The pair allegedly tried to continue their assault on Goldfeiz, at which point he pulled a handgun from his coat, prompting them to flee the scene.
The firearm was legal and Goldfeiz holds a permit to carry it, according to local police.
While glad to have saved his car, the rabbi is understood to still be recuperating from the attack.
Fellow local rabbi VelVel Belinsky told News 11: “Unfortunately, he’s hurt.
"He was punched very, very hard, and I’m wishing him a speedy recovery.
"When we hear about events like this, it’s definitely very disturbing because safety is a very big concern for us.”
Councilman Isaac Schleifer, who represents the district in which Goldfeiz lives, added: “Just the brazenness of the incident, where they have no problem going and attacking, you know, an older person, somebody clearly who’s a person of faith.
"He was still dressed in all of his attire coming from synagogue and so it’s really very upsetting.
"What we see is that people feel emboldened to be committing these kind of violent acts and attacks against Jewish people, and that needs to stop.”