Your last sentence is true if you happen to speak uncomfortable truths that people don't like. People naturally downvote things that they find uncomfortable and do not want to hear or accept. In Internet parlance, it's known as being blue pilled.

For example, in a major news publication, I warned of ID cards and the consequences they will bring on the back of voter ID and am now been downvoted massively by authoritarians. I can't let the massive negative number bother me because if I did, I would either have to keep quiet or lie, both bad outcomes ultimately.