just a guess, but in order for an LLM to generate or draw anything it needs source material in the form of training data. For copyrighted characters this would mean OpenAI would be willingly feeding their LLM copyrighted images which would likely open them up to legal action.
You're allowed to use copyrighted works for lots of reasons. EG satire parody, in which case you can legally publish it and make money.
The problem is that this precise situation is not legally clear. Are you using the service to make the image or is the service making the image on your request?
If the service is making the image and then sending it to you, then that may be a copyright violation.
If the user is making the image while using the service as a tool, it may still be a problem. Whether this turns into a copyright violation depends a lot on what the user/creator does with the image. If they misuse it, the service might be sued for contributory infringement.
What I think is amazing about LLMs is that they are smart enough to be tricked. You can't talk your way around a password prompt. You either know the password or you don't.
But LLMs have enough of something intelligence-like that a moderately clever human can talk them into doing pretty much anything.
That's a wild advancement in artificial intelligence. Something that a human can trick, with nothing more than natural language!
Now... Whether you ought to hand control of your platform over to a mathematical average of internet dialog... That's another question.
I don't want to spam this link but seriously watch this 3blue1brown video on how text transformers work. You're right on that last part, but its a far fetch from an intelligence. Just a very intelligent use of statistical methods. But its precisely that reason that reason it can be "convinced", because parameters restraining its output have to be weighed into the model, so its just a statistic that will fail.
Im not intending to downplay the significance of GPTs, but we need to baseline the hype around them before we can discuss where AI goes next, and what it can mean for people. Also far before we use it for any secure services, because we've already seen what can happen
The fun thing with AI that companies are starting to realize is that there's no way to "program" AI, and I just love that. The only way to guide it is by retraining models (and LLMs will just always have stuff you don't like in them), or using more AI to say "Was that response okay?" which is imperfect.
