If we didn't have to compete with mass immigration for all houses and jobs (and the lowered pay of them because of their willingness to work for slave wages), most people would be financially secure enough to have more kids and likely put us much closer to the replacement rate.

You are repeating their narrative of selling the solution to a problem that is partially created by that solution in the first place.