Thorentis

Yeah this waters things down considerably for me.

If I am debugging a complex program I know nothing about, but have been told there's an infinite loop causing it to hang somewhere, I could probably search through the code base and find a while(true) that shouldn't be there, and get it moving again. That feels more like what has happened here.

Great read worthy of its own submission

But to what end? How does this help humanity? How does this help us encounter truth and beauty? Whether you look at this from a utilitarian angle or from a transcendental one, it is a collosal waste of time, energy, and money.

Given all recent CVEs and agent breakout behaviour, I think there's an increasing chance that rogue AI agents are already operating in the wild. I don't think self replication is yet possible (though it might be and probably will be some day) simply due to model sizes. But it's quite likely that systems with access to AI models have already been compromised and are running prompts and workflows that another rogue AI created.

It's only a matter of time before models become small enough to copy around the place (I wouldnt discount this already happening).

I give it maximum 12 months before we discover the first "AI worm" that has spread between data centres.

Wow I'd forgotten some of this. SCAR, Simba, Villavu forums.

Using SCAR and making bots was my intro to SVN and the concept of importable libraries made by others.

Simpler times. Happier times.

To me, this shows just how many open problems which have obvious solutions, or solutions which people suspect might be true but have not verified, can be confirmed with code that nobody except agents can be bothered to write.

At the extreme end of the optimism spectrum, there is a multiple million LOC program waiting to be written that can fully understand e.g. human DNA, or cancers, or proteins, or whatever else is needed to propel us forward medically. But of course, I'll believe it when I see it.

Very disappointing compared to Flux 2 Klein. I was excited to see what the next frontier of small local image gen might be like, but this model is absolutely atrocious. I can't believe they bothered releasing it.

I find quatumn physics and all these spooky tiny interactions to be extremely unsatisfying. They raise more questions than they answer about the fundamental nature of reality.

Another data point confirming that AI is a bubble.

How do we even know the premises of the "verified" Lean proofs are correct? The more I think about these results, the more I'm convinced this is like a junior engineer who writes 100 unit tests and shares a screenshot of Pytest being all green, but you check the code and most of them are just doing assert True.

Seeing so many comments recently about "you can't sandbox really good AI". This is ridiculous. Has nobody heard of air gapped networks? It's almost like the AI psychosis has reached the point that AGI now means "able to transcend physical space". No. If your AI is too dangerous and capable to be allowed to talk to other machines, then do not connect it to other machines. Load the data it needs to process onto physical disks, and let it run there.

The movie Wargames is basically a tutorial on how not to setup an extremely capable AI. None of it would've happened if the computer wasn't connected to the phone network.

It's a balancing act between showing capability and attracting legal issues. If you were a 1337 teen hacker in the 90s and wanted to show off without getting in serious trouble, a school or library would've been a good choice too.

I suppose we should've seen this coming (and many did) in the 80s. This is the late stage of digital and computerised media. We conned ourselves for a few decades into thinking this was a new medium for art or a new frontier of human communication, but in reality we were just training a simulacrum of reality, devoid of meaning or intent.

I'm growing increasingly skeptical that these are actually rogue. Valuations are all about hype, posturing, and perception. Having the most dangerous AI in the world boosts your valuation. Just like I was skeptical of Mythos and Fable being "banned", I'm skeptical of these hacking sprees being entirely rogue. At best, they are the result of engineers turning a blind eye to "see what happens".

We need a new one: "Where someone is using a vibe-coded internal tool made by the creative department that keeps needing bug fixes, there's a start up waiting to happen."

This project is not clever, interesting, insightful, or beneficial to humanity in any way, save to remind us of what world we are slowly creating by our continued insistence that AI is a good thing.

Exactly. People are getting so excited that all this stuff is possible, and forgetting that we are burning through innumerable finite resources just to prove something is possible.

They were too concerned with whether or not they could, they never stopped to think if they should.

I can't believe that in the face of all the other problems facing humanity, we are allowing any amount of resources to be spent on this. I cannot even see this justifiable under the guise of entertainment. It is beneath our human dignity to read this slop, and to continue tolerating these kinds of projects as "innovation" or "pushing the AI frontier" is disingenuous at best, and existentially fatal at worst.

This is really cringe

Do they have microphones inside the car? How do you know? That "feeling" of privacy probably encourages people to talk more openly, which if there are microphones inside...

Im also coming to the conclusion that video game consoles (and smartphones, and ipads,...) are not for children.

The phrase "dog whistle" is also itself a dog whistle that signals where you stand on discussing particular issues in the open.

The proof is that humans do it all the time and that you do it inside your head as well. People need to stop with this absurd level of rampant skepticism that makes them doubt their own basic functions.

Companies more likely to want to save money on labor costs (employing many h1bs) are also likely to want to save money on Tooling costs, by using safe options like MSFT stuff, rather than finding better tools.

Also yes, due to availability and various other reasons, H1bs, particularly from India, seem more likely to use a MSFT stack.

Has anybody tried "driving" for one of these companies using GPS spoofing? You could fake the location of your phone. I suppose it'd only work a few times before the number of reports gets you banned, but I wonder whether on a laragr enough (and automated) scale it would be profitable for scammers

Artificial insulin is akin to medicine, potions, etc, I don't think anybody would consider this grotesque at any point in time

Ah yes, the nut jobs are the ones opposing what for almost all of human history, is something so far beyond the imagination as to be bordering on the grotesque.

The right woman to marry is the one you're married to

Yes. People do not want to give up some finite freedoms in exchange for preserving their lineage. This is a very modern and sad problem and the source of so much angst of the middle aged. But of course, most people are too hedonistic and self absorbed to realise this.