I think you hit the nail on the head: when we were children playing these systems the controllers were fine, because they were primarily designed for children. And by the time we got old enough that they might've felt a bit small we'd gotten used to them.

So from that standpoint I'd say the engineers understood ergonomics very well.