You tend to get two groups who dislike it. Ignorant folks who think something like no animal stuff means no protein means you shrivel up and die, and the ones who've encountered a few too many militants in their time and ain't interested or are downright sick of their schtick. Vaguely similar to atheism, except replace the animal product stuff with something religion related, ofc.