They are already good at criminal activities such as phishing. That bar is rather low, especially once you scale up (hitting 100 people and successfully scamming 1 is still great ROI with cheap small models).
But I don't see what governments can really do about it. I mean, sure, they can ban the models, but enforcing such a ban is another matter - the models are already out there, it's just a large file, easy to torrent etc. The code that's needed to run it is also out there and open source. Cracking down on top-end hardware (and note that at this point it means not just GPUs but high-end PCs and Macs as well!) is easier to enforce but will piss off a lot more people.
Re:Claude can now search the web
by Workaccount2 on Friday March 21, 2025 @10:30AM
(#43436160)
It's just going to turn into an arms race of AI trying to stop AI.
Governments will want to ban them, but there's just too much $$$ to be made from replacing employees, so things will get complicated fast.