'Little people' sounds way worse to me than 'midget' ever could.

Normally when you say 'little people', you're talking about the common man as compared to the wealthy elite, or to corporate business. They're 'little' in the sense that they have little power, little resources, little ability to compete or defend themselves.

Applying this language to people with dwarfism seems terrible to me. They have all of the same legal rights as anyone else, and in modern society where most jobs involve sitting at a desk rather than shovelling tons of dirt all day, their employment options are still good. In a society where you're allowed to carry a gun, they're even more equal, since they're not at the mercy of people twice their size.

That's not to say dwarfism isn't a disadvantage in life - it absolutely is, but it's not that bad. Like, I'd abort an infant with down syndrome every single time, but I wouldn't abort a dwarf. That's a real person, not a 'little person'.