Can't this exact same argument be made by the Native Americans?

^This was me.

Because that meant they weren't immediately wiped out with their children taken as slaves and had their women taken as prizes as was the norm throughout human history.

^This was you.

So either it's natural selection that one group fails in its hegemonic ruling (If you can call it that) or a middle ground with a collective agreement is met by those with claims to be present on the land today.