Last week, Mr Kerry said Israel risked becoming an “apartheid state” if a Middle East peace agreement was not reached.
British Colonel Richard Kemp, an outspoken supporter of Israel, condemned the comment on Twitter. Col Kemp accused Mr Kerry of “disgracing America - John Kerry falsely accuses Israel of racism”.
Abraham Foxman, national director of the Anti-Defamation League, said: “It is startling and deeply disappointing that a diplomat so knowledgeable and experience about democratic Israel chose to use such an inaccurate and incendiary term.”
The American Israel Public Affairs Committee said: “Any suggestion that Israel is, or is at risk of becoming, an apartheid state is offensive and inappropriate.”
Mr Kerry's remark came following last week's breakdown of the peace talks between Israel and the Palestinian Authority.
The US-imposed deadline for a deal has now expired.