They are the ones getting pleasure and degenerate satisfaction from preventing others from achieving hedonism. Dominance and sadistic bullying aren't uncommon fetishes.

In fact, they are using hedonism as the carrot on the stick to join them, even if they don't intend to ever actually let you.