Board of Deputies of British Jews President Marie van der Zyl said: “It is right for the Conservative Party to discipline MP Daniel Kawczynski after his attendance at this conference alongside a number of people with reprehensible views.
"After his initially unrepentant stance, we wait to see his apology, which has not yet been communicated with us.”
In response, JLM said it had "yet to hear what his apology consists of" and claimed Mr Kawczynski was "warned" about attending the conference in advance.
Mr Kawczynski was condemned within his own party for attending the conference in Rome this week, with former party chair Lord Pickles saying the MP had "let his fellow Conservatives down".
Among the anti-immigration figures who also spoke at the conference were the Hungarian prime minister Viktor Orbán and a niece of French far-right leader Marine Le Pen.
They also included Ryszard Legutko, the Polish Law and Justice MEP, who has said homophobia was a “totally fictitious problem”.
JLM had said earlier that Mr Kawczynski should be suspended by the Tories.
Its parliamentary chair Dame Margaret Hodge said: "No member of Parliament should be attending a conference packed full of racists, homophobes and Islamophobes.
“There can be no place for these hateful views in our Parliament.”
Earlier, Mr Kawczynski called his critics "hysterical" and said he was attending to "share an Anglo-Polish perspective on Brexit and what it signifies for the future of Europe".