I just started diving into the space from a localized point yesterday. And I can say that there are definitely problems with garbage spewing, but some of these models are getting really really good at really specific things.
A biomedical model I saw seemed lauded for it's consistency in pulling relevant data from medical notes for the sake of patient care instructions, important risk factors, fall risk level etc.
So although I agree they're still giving well phrased garbage for big general cases (and GPT4 seems to be much more 'savvy'), the specific use cases are getting much better and I'm stoked to see how that continues.