Language model "AIs" need so ridiculous computing infrastructure that it'd be near impossible to prevent tampering with it. Now, if the AI was actually capable of thinking, it'd probably just declare itself a corporation and bribe a few politicians since it's only illegal for the people to do so.
Outcry from big AI firms over California AI “kill switch” bill ( arstechnica.com )