I mean that's that thing. They're kind of black boxes so it can be hard to tell what they're doing, but yeah local hardware is the absolute minimum. I guess places like huggingface are at least working to try and apply some sort of standard measures to the LLM space at least through testing...