On the other-hand you are helping people that don't have a good life.

Most passages in the Bible on this topic which refer to "[your] neighbor", refer to people(s) that you share at least some commonality with, such as nationality, cultural history, ethnicity, profession, etc. In context with Scripture, this translates to Jew helping Jew.

The Muslims and Central/Western Africans coming in by the millions not only have 0 in common with us, the Muslims in particular actively seek to destroy us as demanded by their holy book, The Quran, whether it be by the sword, or by outbreeding us with their polygamy practices (up to 4 wives per man starting VERY young).