A protest isn't just a speech - it's an act. It's an act of blocking a street, occupying a square, crowding or obstructing a neighborhood etc.
In democratic countries, a permit isn't an ask for permission, but more like a notification. Like you say youself: all permits are approved. But you are warning the city that a protest is going to happen here and there.