What kinds of olives have you had? Have they been those cheap canned olives that sit on shelves for years? Then yeah, they're not great, more and at giving an olive flavor to dishes. If you've had fresh olives, those can be amazing. That said, black and green olives taste different and you may have a preference between the two (like some people prefer red or green apples), and there are a bunch of different varieties as well.
My brother-in-law always "hated olives", and then he came over for a party where we had set up an olive bar, which he vehemently and repeatedly declined. But we were hanging around afterward and, as you do when you're not really thinking and there's food hanging around, he absently ate one. He then made his way down the entire bar - I think we had like 20 different types (some were stuffed). Now he gets pouty if we have a party and there aren't any olives, lol!