Language is defined by how it's used, if it's common for people to say "less" then that is correct. Trying to define the only "correct" usage counter to how people actually use the language is prescriptivism, which rarely changes how people actually speak. The only real use of prescriptivism is elitism.
You clearly understood what was said, you just wanted to announce you're "better" at English.