you know that the confidence value is generated by the ai itself right? So it could still spew out bullshit with high confidence. The confidence score doesn't really help much
cue the "one of our devs slipped and fell on a keyboard, completely coincidentally hitting all the right keys in the right order to code this. Completely coincidentally! "
because of ai stuff. For these kinds of things, they are perfectly happy to advertise unprecedented 99% accuracy rates, when in reality, non ai tools are held to much higher standard (mainly that they are expected to work). If the code I wrote had a consistent, perpetual 1% failure rate (even after fixing it, multiple times), I'd have been fired long ago.