The reason why foreigners (from certain countries) are not to be trusted is because they come from low trust societies.

No, the reason foreigners from any country must generally be kept out, is because diversity of any kind destroys high trust societies and social capital. Japan would not be Japan if you had 20% even from a country that you think is a high-trust society - you'd have ethnic tension for example.