The "cost" of less refugees is specifically using them as slave labour. Their "cost" is that goods and services cannot be done at wages that the local population don't want to do for those prices.

It's almost like leftists love the idea of a slave class without calling it as such. But then again, they've always loves slavery.