A lot of the Japanese in the Yazuka are Burakumin who were outcasts in ancient Japan and also 30% of Yakuza are Korean.

And they are involved in criminal activity as well , aka not the kind of people who would care about societal wellbeing .Not sure why people would expect them to be super nationalistic about Japan