Because they aren't Asian Asian. They are brownish, not as squinty, and have very different cultures. So they need a separate label or people will get confused.

Just like everyone outside of Britain when you call Indians and Arabs "Asian." It just don't seem right.