I mean, that is not too far off from history. the Americas were settled by the rejects of Europe for the most part. I'm talking people whose family could not feed them, criminals who chose exile as opposed to slavery or the rope, religious exiles, you name it.

the difference now is that, instead of settling a fertile land with sink or swim opportunities, it's basically completely filled in with a ruling government with tons of power.