Both very large people and very small ones have all kinds of problems that Medieval medicine just wasn't prepared to cope with. So, even if they were accepted, and actually I think they would have been more than you suspect, they probably didn't survive very long.