they'll immediately follow you around and hit you with spam downvotes and are clearly all coming from the same place.

No, you get downvoted when you post stupid shit. You also get upvoted when you post good shit, but no one is accusing you of running a self-promotion botnet for those. This is that same issue of you being unable to conceptualize that maybe, just maybe, real people have real reasons for not liking all your opinions.