Speaking as someone who isn't attractive, I dunno if judging by looks is a great strategy

It's a strategy that every organism in the world uses.

I'm no looker myself, but Tony is right in this case. You can tell a lot about a person by how they dress, how they groom themselves, how they walk, etc. That's not even getting into whether or not they're hot. Physiognomy is a real thing.