You can be "toxic" about a lot of things. I won't say it doesn't exist, but it's a vacuous term that depends on the listener and the context of the discussion.

You can be masculine or even "hyper-masculine". That's not necessarily a bad thing for a male. It can be a good thing. Every man a king.

There's no reason to connect the two ideas. That the phrase became popularized is evidence that we live under a toxic feminist cultural order.