Note it's only when it affects the jews is when it's a problem. If he said something like "If you make jokes about any group of people when they're being attacked in the street, you're a piece of shit" it might have been seen as some moral principle. He'd have been a hypocrite either way, as he's made plenty of jokes wishing harm on others. But it's the 'antisemitism' that he takes exception to.