The Select Committee is investigating hate crime in the wake of the murder of Labour MP Jo Cox last year.
Giving evidence Mr Hoyle confirmed female Jewish and Muslim MPs received more threats than men – particularly from far-left and far-right sympathisers.
As chair of Parliament’s consultative panel on security he said the situation “undermines democracy” because MPs had to be concerned about carrying on meeting members of the public.
"General banter is fine. But it's about the level. Robust debate is good, but when that says, 'I'm going to come round and kill you,' that is more serious," said the Deputy Speaker.
Jewish Labour MPs Luciana Berger and Ruth Smeeth are among those to be targeted by online threats and abuse in recent years. Muslim MP Tulip Siddiq also revealed she had received death threats.
