You are correct that semitic has come to be mainly used to refer to Hebrews and in turn Jews over time even though it means a broader group.

I honestly don't know how that happened but I have a hard time blaming anyone for it. Considering how often they are changing definitions nowadays I see this as a lesser issue but to each his own.