The film doesn't answer this because Dirty Harry is literally a response to the fact that the left-wing government has allowed crime to run absolutely rampant, including serial killing pedophiles. Callahan is more concerned with stopping evil than he is with virtue signaling to San Francisco's ideals.

THIS IS BECAUSE SAN FRANCISCO IS MORE CONCERNED WITH VIRTUE SIGNALING THAN STOPPING SERIAL KILLING PEDOPHILES

The film isn't asking who should be in charge of making determinations about intolerance. It's saying YOU are already in charge of that tolerance, and you are tolerating serial killing child rapists, while being intolerant to his gruff language. Harry isn't the mayor, he's a hero trying to save people within a broken system. Your broken system.

What's great is that the sequel to this movie actually addresses this concern. Harry ends of having to kill a conspiracy of corrupt cops that are assassinating judges, prosecutors, witnesses, and criminals because they are actual vigilantes and tyrants who made the decision of tolerance on their own.