Right back at ya.
The meaning of "Anti-Semitic" is hatred of Jews. Not hatred of the Semitic peoples. This is grade school shit.
I will give you that if you take the prefix and the word and try to literally re-construct the meaning from that, ignoring its use in actual language, you would get "against the Semitic people". But the dictionary definition, the one meaning that is solely used in everyday speech, is "against the Jewish people", and you will simply confuse people by trying to change that meaning to the literal meaning.