I can say "I don't speak [language], sorry." in about 10 languages, just so if someone tries to speak to me I can say that to them.
So far only one person has said any follow up things in that language. I like to think it was "but you're speaking it now!" but probably just about work stuff.
Is it weird that I get a very tiny kick out of the slight confusion I can see on some people's faces?