That's because most of the explorers and conquering people from England were pretty rare compared to the common man. By the time England had conquered half their badasses had died or moved out. Captain Cook was the first guy to deal with the long school tradition of Kill a Haole day, and all the famines and hardship had people moving to the states as fast as they could.

Keep in mind France was a country of badasses for centuries, and then slowly lost all of it for the same reason.