the difference is that the patriarchy exists and favors men. there is no systematic structure that puts Muslims above others, at the expense of others, in a way that is parallel to what the patriarchy does.
i get what you are saying, and maybe not too long ago i was professing quite similar feelings, but i encourage you to self interrogate how big of a difference that is. truly hope this is helpful.