It's not unreasonable at all. I can easily imagine one of the justices thinking "if the American people don't like it they can vote accordingly" and smiling to himself as he wrote his opinion. Not a stretch to also assume that justice hangs out with the uniparty power circles in DC.