First off, I don’t think being racist is necessarily bad. It depends on a lot of contextual stuff like who’s being racist, as well as where, how, and what the consequences are.

With that out of the way, I definitely wouldn’t consider either one racist. If someone said “both are racist,” I would think that stupid but it’s still a universal standard. The issue is that a large group of people with cultural and institutional power would consider only one of those things racist, and think that that’s an offense that merits punishment.