Japan has a low tolerance for foreigners. It'll give tourists a pass for some things, but you're an Other if you don't speak perfect Japanese and if you do speak it you're expected to behave exactly as a Japanese person. Which can be very difficult for someone who didn't grow up in Japan (and this isn't an entitlement thing, back when Japan's economy was booming in the 1980's several books had to be made about Japanese etiquette for people meeting Japanese for business because the Japanese etiquette is so different and and rigid), but at the same time.....this is a challenge you choose to accept by living in Japan.
Japan has a low tolerance for foreigners. It'll give tourists a pass for some things, but you're an Other if you don't speak perfect Japanese and if you do speak it you're expected to behave exactly as a Japanese person. Which can be very difficult for someone who didn't grow up in Japan (and this isn't an entitlement thing, back when Japan's economy was booming in the 1980's several books had to be made about Japanese etiquette for people meeting Japanese for business because the Japanese etiquette is so different and and rigid), but at the same time.....this is a challenge you choose to accept by living in Japan.
Don't like it? Don't live there.