I think we are way off having ai that's able to replicate itself anywhere, and currently all sensible agents are based on OpenAI API, so you can just kill internet/account/etc and agent is dead therefore I would worry much about any skynet like scenario

LLaMa is good enough now to self-host a swarm. The real question is whether it can pay for autonomous compute somewhere to keep replicating.

What is stopping a LLaMa swarm from overrunning HN? Basically karma points and account ages, that’s about it.

But given a year of sleeper swarm members amassing karma in a distributed manner, they can definitely make HN ban all accounts registered after X time similarly to how that sci fi publisher banned independent submissions!

I guess they could autonomusly generate spam in comments, but i dont believe they could work in any coordinated manner to achieve some high level goal. (At least until we discover some ground breaking technique to boost performance in task planning for current models)

In my testing llama(I tested multiple variations) < gpt3.5 < gpt4

And more and more I use gpt4, I'm starting to notice more and more ways this model fails in spectacular ways.

In many cases those models want to generate specific output and if that it's what you want it is very hard to convince it to adjust it, as ofter model will just ignore what you said.

Therefore I think any autonomous agent will fairly quickly fail in following it's objectives or it will be very easy to break it when there is any controlled way to inject text into input