I think you're falling into the cage with no bars he alludes to in his rap.

He isn't punching both directions. There's four directions on a standard political compass. He's punching "up", not in the Gender Studies sense, but in that political compass sense. The entire song is anti-authoritarian in all its forms, governmental and societal. Your perception of punching both directions is him punching upwards with both arms.