No, it's absolutely not inconceivable. There are many men who act like this.

But have you noticed that people who (correctly!) say that generalizing on groups is fine because it's "just pattern matching", always have to make excuses for some other group which is also over-represented?

Everybody just wants to pretend the root of all evil is some other group. One which is as dissimilar to their own identity group as possible. Reality is a lot more complex and a lot less comfortable.