Jewish Labour MP Luciana Berger tweeted: “An individual who peddles antisemitic conspiracy theories has no place advising government about anything."
She urged the prime minister to intervene and for the Government to "urgently reconsider his appointment”.
Labour MP Wes Streeting said Communities Secretary James Brokenshire should "remove [Sir Roger] immediately".
A spokesman for the Ministry of Housing, Communities and Local Government said: “Professor Sir Roger Scruton, as a long-standing public intellectual, has strong views on a number of issues.
“He received a knighthood in 2016 and advised the Coalition government on design.
“His commitment to driving quality in the built environment is well known and he has published extensively on architecture and place, which makes him an excellent candidate for the unpaid chairmanship of the Building Better, Building Beautiful commission.”
