Full disclosure, I am Jewish myself, and sorry for the book... try not to knee-jerk react to it.
I hate to partake in this genetic essentialism garbage, but Ashkenazis by and large share their paternal heritage with Sephardic Jews and other Semites, although that Semitic heritage has become somewhat diluted over time by converts in the maternal line and their descendants. My point in saying that is not to say that Zionists have any legitimate claim to Palestine - they absolutely don't. It's just "Ashkenazi Jews aren't Semites" is a highly debatable and fraught claim that has the potential to lead one down a rabbit hole into actual racism, and incidentally has absolutely nothing to do with the crimes of Zionism. When I hear that implication, my mind is drawn to the adoption by antisemites (most recently Black Hebrew Israelites) of the now disproven myth that the original Semitic Jews died out and were replaced by Khazars.
I'm stopping short of calling what you said, specifically, antisemitism, but in another context a similar statement might be called a dog whistle. People can say these things unintentionally when they just don't understand the implications. This kind of reckless use of language and ideas is at least part of why we have Jewish students on college campuses claiming they don't feel safe. We Jews have grown up being implicitly taught to keep our ear to the ground when it comes to rising intolerance, and yes in a lot of cases that has resulted in a massive blind spot for our own intolerance, but it doesn't mean we should ignore warning signs. Of course, as a Jew, and like you, I often scoff when I hear claims of antisemitism, and in fact I get angry about them when they conflate Jewishness with Israel & Zionism, which ironically IS antisemitism.
Now I mentioned the Khazar myth and Jewish students who don't feel safe. The issue here is that they lack the self awareness to say, "maybe my hangups about certain things people say are a product of my own upbringing and sensitivities, rather than any intentional antisemitism on their part." On the other hand, when people talk about Jews or Jew-adjacent issues like the Israeli-Palestinian conflict, they should also have the self awareness to ask themselves "am I contributing to a climate that lets actual antisemitism fly under the radar and should I be more careful about the things I say?"
In any case, flinging accusations back and forth is unproductive. If my fellow Jews feel threatened by protestors and their words, I would recommend they approach those protestors with humility, and listen to their grievances before making assumptions about their intentions. Which is funny, because here I am Jew-splaining in response to a flippant remark in an internet comment section, but the reason is I just desperately want people to understand each other (and themselves) better.