Rabbi Halpern’s solicitor said that he “categorically denies any allegation of wrongdoing”.
One of the men, Gary Ost, has temporarily stepped down from his role as chief executive of community security group Shomrim while the investigations continue.
Mr Ost said he “vehemently denied” the allegations against him and had fully co-operated with police.
“While these allegations are being investigated and until my name is completely cleared, I reluctantly feel it would be inappropriate for me to remain in my role at this time,” he said.
Meanwhile, a Union of Orthodox Hebrew Congregations source said that a special Beth Din, set up to investigate complaints about Rabbi Halpern’s marriage counselling sessions for women, would now be “delayed” following the arrests.
Its three rabbinic judges from abroad had been due to return to the UK next week to resume their hearing.