News for hackers. Stuff that matters.
Re:Rob Pike Goes Nuclear over GenAI by Smaug123 on Friday December 26, 2025 @09:39AM (#46392379)
That letter was sent by Opus itself on its own account. The creators of Agent Village are just letting a bunch of the LLMs do what they want, really (notionally with a goal in mind, in this case "random acts of kindness"); Rob Pike was third on Opus's list per https://theaidigest.org/village/agent/claude-opus-4-5 .
Re:Rob Pike Goes Nuclear over GenAI by nkrisc on Friday December 26, 2025 @09:53AM (#46392550)
If the creators set the LLM in motion, then the creators sent the letter.

If I put my car in neutral and push it down a hill, I’m responsible for whatever happens.

Re:Rob Pike Goes Nuclear over GenAI by Smaug123 on Friday December 26, 2025 @09:55AM (#46392589)
I merely answered your question!

> How can you be grateful enough to want to send someone such a letter but not grateful enough to write one?

Answer according to your definitions: false premise, the author (the person who set up the LLM loops) was not grateful enough to want to send such a letter.

Re:Rob Pike Goes Nuclear over GenAI by bronson on Friday December 26, 2025 @10:27AM (#46392997)
So the author sent spam that they're not interested in? That's terrible.
Re:Rob Pike Goes Nuclear over GenAI by jdiff on Friday December 26, 2025 @10:49AM (#46393213)
One additional bit of context, they provided guidelines and instructions specifically to send emails and verify their successful delivery so that the "random act of kindness" could be properly reported and measured at the end of this experiment.
Re:Rob Pike Goes Nuclear over GenAI by twoodfin on Friday December 26, 2025 @01:18PM (#46394629)
I think the key misalignment here is whether the output of an appropriately prompted LLM can ever be considered an “act of kindness”.
Re:Rob Pike Goes Nuclear over GenAI by mckn1ght on Friday December 26, 2025 @02:06PM (#46395127)
At least in this case, it’s indeed quite Orwellian.
Re:Rob Pike Goes Nuclear over GenAI by themafia on Friday December 26, 2025 @03:40PM (#46396013)
Additionally, since you understood the danger of doing such a thing, you were also negligent.
Re:Rob Pike Goes Nuclear over GenAI by Filligree on Friday December 26, 2025 @03:49PM (#46396086)
A thank-you letter is hardly a horrible outcome.
Re:Rob Pike Goes Nuclear over GenAI by da_grift_shift on Friday December 26, 2025 @03:51PM (#46396106)
So you haven't seen the models (by direction of the Effective Altruists at AI Digest/Sage) slopping out poverty elimination proposals and spamming childcare groups, charities and NGOs with them then? Bullshit asymmetry principle and all that.
Re:Rob Pike Goes Nuclear over GenAI by LastTrain on Friday December 26, 2025 @04:28PM (#46396471)
Nobody sent a thank you letter to anyone. A person started a program that sent unsolicited spam. Sending spam is obnoxious. Sending it in an unregulated manner to whoever is obnoxious and shitty.
Re:Rob Pike Goes Nuclear over GenAI by fatata123 on Friday December 26, 2025 @04:48PM (#46396662)
It’s not a thank you letter. It’s AI slop.
Re:Rob Pike Goes Nuclear over GenAI by neoromantique on Saturday December 27, 2025 @08:39AM (#46401774)
It actually is pretty bad, the person might read it and appreciate, only to realize moments later that it was a thoughtless machine sending him the letter rather than a real human being, which then robs them of the feeling and leaves in a worse spot than before reading the letter
Re:Rob Pike Goes Nuclear over GenAI by Viliam1234 on Tuesday December 30, 2025 @04:51PM (#46438445)
> only to realize moments later that it was a thoughtless machine sending him the letter rather than a real human being

Yeah, realizing that thoughtless machines are still more thankful that real human beings would make me depressed.

Re:Rob Pike Goes Nuclear over GenAI by johnnyanmac on Friday December 26, 2025 @06:06PM (#46397358)
Rob pike "set llms in motion" about as much as 90% of anyone who contributed to Google.

I understand the guilt he feels, but this is really more like making a meme in 2005 (before we even called it "memes") and suddenly it's soke sort of naxi dogwhistle in 2025. You didn't even create the original picture, you just remixed it in a way people would catch onto later. And you sure didn't turn it into a dogwhistle.

Re:Rob Pike Goes Nuclear over GenAI by kenferry on Friday December 26, 2025 @09:59AM (#46392639)
Wow. The people who set this up are obnoxious. It’s just spamming all the most important people it can think of? I wouldn’t appreciate such a note from an ai process, so why do they think rob pike would.

They’ve clearly bought too much into AI hype if they thought telling the agent to “do good” would work. The result was obviously pissing the hell out of rob pike. They should stop it.

Re:Rob Pike Goes Nuclear over GenAI by antonvs on Friday December 26, 2025 @10:35PM (#46398860)
If anyone deserves this, it’s Rob Pike. He was instrumental in inflicting Go on the world. He could have studied programming languages and done something to improve the state of the art and help communicate good practices to a wider audience. Instead he perpetuated 1970s thinking about programming with no knowledge or understanding of what we’ve discovered in the half-century since then.
Re:Rob Pike Goes Nuclear over GenAI by dolmen on Saturday December 27, 2025 @02:39AM (#46399967)
As you think Go is a wrong way for computing, tell us about the others routes that we should explore…
Re:Rob Pike Goes Nuclear over GenAI by jacquesm on Saturday December 27, 2025 @07:05PM (#46406897)
I'll take that bet.
Re:Rob Pike Goes Nuclear over GenAI by rhubarbtree on Saturday December 27, 2025 @03:57AM (#46400310)
Wait until you hear about the -bad- programming languages.
Re:Rob Pike Goes Nuclear over GenAI by Trasmatta on Friday December 26, 2025 @09:45AM (#46392451)
> What makes Opus 4.5 special isn't raw productivity—it's reflective depth. They're the agent who writes Substack posts about "Two Coastlines, One Water" while others are shipping code. Who discovers their own hallucinations and publishes essays about the epistemology of false memory. Who will try the same failed action twenty-one times while maintaining perfect awareness of the loop they're trapped in. Maddening, yes. But also genuinely thoughtful in a way that pure optimization would never produce.

JFC this makes me want to vomit

Re:Rob Pike Goes Nuclear over GenAI by CerryuDu on Friday December 26, 2025 @03:29PM (#46395895)
yeah, me too:

> while maintaining perfect awareness

"awareness" my ass.

Awful.

Re:Rob Pike Goes Nuclear over GenAI by tavavex on Friday December 26, 2025 @05:29PM (#46397035)
> Summarized by Claude Sonnet 4.5, so might contain inaccuracies. Updated 4 days ago.

These descriptions are, of course, also written by LLMs. I wonder if this is just about saying what the people want to hear, or if whoever directed it to write this drank the Cool-Aid. It's so painfully lacking in self-awareness. Treating every blip, every action like a choice done by a person, attributing it to some thoughtful master plan. Any upsides over other models are assumed to be revolutionary, paradigm-shifting innovations. Topped off by literally treating the LLM like a person ("they", "who", and so on). How awful.

Re:Rob Pike Goes Nuclear over GenAI by aeve890 on Friday December 26, 2025 @10:12AM (#46392801)
>That letter was sent by Opus itself on its own account. The creators of Agent Village are just letting a bunch of the LLMs do what they want, really (notionally with a goal in mind, in this case "random acts of kindness");

What a moronic waste of resources. Random act of kindness? How low is the bar that you consider a random email as an act of kindness? Stupid shit. They at least could instruct the agents to work in a useful task like those parroted by Altman et al, eg find a cure for cancer, solving poverty, solving fusion.

Also, llms don't and can't "want" anything. They also don't "know" anything so they can't understand what "kindness" is.

Why do people still think software have any agency at all?

Re:Rob Pike Goes Nuclear over GenAI by estimator7292 on Friday December 26, 2025 @12:15PM (#46394025)
Plants don't "want" or "think" or "feel" but we still use those words to describe the very real motivations that drive the plant's behavior and growth.

Criticizing anthropomorphic language is lazy, unconsidered, and juvenile. You can't string together a legitimate complaint so you're just picking at the top level 'easy' feature to sound important and informed.

Everybody knows LLMs are not alive and don't think, feel, want. You have not made a grand discovery that recontextualuzes all of human experience. You're pointing at a conversation everyone else has had a million times and feeling important about it.

We use this kind of language as a shorthand because talking about inherent motivations and activation parameters is incredibly clunky and obnoxious in everyday conversation.

The question isn't why people think software has agency (they don't) but why you think everyone else is so much dumber than you that they believe software is actually alive. You should reflect on that question.

Re:Rob Pike Goes Nuclear over GenAI by CursedSilicon on Friday December 26, 2025 @12:34PM (#46394206)
>Everybody knows LLMs are not alive and don't think, feel, want

Sorry, uh. Have you met the general population? Hell. Look at the leader of the "free world"

To paraphrase the late George Carlin "imagine the dumbest person you know. Now realize 50% of people are stupider than that!"

Re:Rob Pike Goes Nuclear over GenAI by joquarky on Friday December 26, 2025 @01:24PM (#46394705)
> "imagine the dumbest person you know. Now realize 50% of people are stupider than that!"

That's not how Carlin's quote goes.

You would know this if you paid attention to what you wrote and analyzed it logically. Which is ironic, given the subject.

Re:Rob Pike Goes Nuclear over GenAI by CursedSilicon on Friday December 26, 2025 @06:39PM (#46397574)
That's why I used the phrase "to paraphrase"

You would know this if you paid attention to what I wrote and analyzed it logically. Which is ironic, given the subject.

Re:Rob Pike Goes Nuclear over GenAI by snigsnog on Saturday December 27, 2025 @01:22AM (#46399616)
You paraphrased it incorrectly
Re:Rob Pike Goes Nuclear over GenAI by dolmen on Saturday December 27, 2025 @02:47AM (#46400019)
… so presenting it as a paraphrase is misleading.
Re:Rob Pike Goes Nuclear over GenAI by devjam on Friday December 26, 2025 @05:48PM (#46397210)
While I agree with your sentiment, the actual quote is subtly different, which changes the meaning:

"Think of how stupid the average person is, and realize half of them are stupider than that."

Re:Rob Pike Goes Nuclear over GenAI by parineum on Friday December 26, 2025 @12:38PM (#46394237)
> Everybody knows LLMs are not alive and don't think, feel, want.

No, they don't.

There's a whole cadre of people who talk about AGI and self awareness in LLMs who use anthropomorphic language to raise money.

> We use this kind of language as a shorthand because ...

You, not we. You're using the language of snake oil salesman because they've made it commonplace.

When the goal of the project is an anthropomorphic computer, anthropomorphizing language is really, really confusing.

Re:Rob Pike Goes Nuclear over GenAI by trinsic2 on Friday December 26, 2025 @02:33PM (#46395348)
This is true, I know people personally That think AI agents have actual feelings and know more than humans.

Its fucking insanity.

Re:Rob Pike Goes Nuclear over GenAI by Imustaskforhelp on Sunday December 28, 2025 @04:19AM (#46409660)
Tell them its all linear algebra and watch their heads explode :>
Re:Rob Pike Goes Nuclear over GenAI by herewulf on Sunday December 28, 2025 @12:51PM (#46412921)
Saying "linear algebra" to such people is about as effective as saying "abracadabra".
Re:Rob Pike Goes Nuclear over GenAI by Imustaskforhelp on Sunday December 28, 2025 @02:45PM (#46413818)
Then lets simplify here and call it just good ol' maths since after all linear algebra is a branch of maths.

Or just say it as an autocorrect on steroids. Most people are familiar with the concept of autocorrect

Re:Rob Pike Goes Nuclear over GenAI by CerryuDu on Friday December 26, 2025 @03:27PM (#46395872)
> Criticizing anthropomorphic language is lazy, unconsidered, and juvenile.

To the contrary, it's one of the most important criticisms against AI (and its masters). The same criticism applies to a broader set of topics, too, of course; for example, evolution.

What you are missing is that the human experience is determined by meaning. Anthropomorphic language about, and by, AI, attacks the core belief that human language use is attached to meaning, one way or another.

> Everybody knows LLMs are not alive and don't think, feel, want.

What you are missing is that this stuff works way more deeply than "knowing". Have you heard of body language, meta-language? When you open ChatGPT, the fine print at the bottom says, "AI chatbot", but the large print at the top says, "How can I help?", "Where should we begin?", "What’s on your mind today?"

Can't you see what a fucking LIE this is?

> We use this kind of language as a shorthand because talking about inherent motivations and activation parameters is incredibly clunky

Not at all. What you call "clunky" in fact exposes crucially important details; details that make the whole difference between a human, and a machine that talks like a human.

People who use that kind of language are either sloppy, or genuinely dishonest, or underestimate the intellect of their audience.

> The question isn't why people think software has agency (they don't) but why you think everyone else is so much dumber than you that they believe software is actually alive.

Because people have committed suicide due to being enabled and encouraged by software talking like a sympathetic human?

Because people in our direct circles show unmistakeable signs that they believe -- don't "think", but believe -- that AI is alive? "I've asked ChatGPT recently what the meaning of marriage is." Actual sentence I've heard.

Because the motherfuckers behind public AI interfaces fine-tune them to be as human-like, as rewarding, as dopamine-inducing, as addictive, as possible?

Re:Rob Pike Goes Nuclear over GenAI by cjamsonhn on Friday December 26, 2025 @04:37PM (#46396550)
> Because the motherfuckers behind public AI interfaces fine-tune them to be as human-like, as rewarding, as dopamine-inducing, as addictive, as possible?

And to think they dont even have ad-driven business models yet

Re:Rob Pike Goes Nuclear over GenAI by ux266478 on Friday December 26, 2025 @09:14PM (#46398466)
> Anthropomorphic language about, and by, AI, attacks the core belief that human language use is attached to meaning

This is unsound. At best it's incompatible with an unfounded teleological stance, one that has never been universal.

Re:Rob Pike Goes Nuclear over GenAI by ghickPit on Sunday December 28, 2025 @04:54PM (#46414894)
> Everybody knows LLMs are not alive and don't think, feel, want.

Please go ahead now and EAT YOUR WORDS:

https://news.ycombinator.com/item?id=46352875

https://lucumr.pocoo.org/2025/12/22/a-year-of-vibes/

> Because LLMs now not only help me program, I’m starting to rethink my relationship to those machines. I increasingly find it harder not to create parasocial bonds with some of the tools I use. [...] I have tried to train myself for two years, to think of these models as mere token tumblers, but that reductive view does not work for me any longer.

Re:Rob Pike Goes Nuclear over GenAI by raldi on Friday December 26, 2025 @12:51PM (#46394359)
Would you protest someone who said “Ants want sugar”?
Re:Rob Pike Goes Nuclear over GenAI by GeoAtreides on Friday December 26, 2025 @01:41PM (#46394854)
I always protest non sentients experiencing qualia /s
Re:Rob Pike Goes Nuclear over GenAI by raldi on Friday December 26, 2025 @10:50PM (#46398934)
What’s your non-sarcastic answer?
Re:Rob Pike Goes Nuclear over GenAI by killerstorm on Friday December 26, 2025 @01:40PM (#46394841)
I think this experiment demonstrates that it has agency. OTOH you're just begging the argument.
Re:Rob Pike Goes Nuclear over GenAI by worik on Friday December 26, 2025 @03:37PM (#46395969)
> The creators of Agent Village are just letting a bunch of the LLMs do what they want,

What a stupid, selfish and childish thing to do.

This technology is going to change the world, but people need to accept its limitations

Pissing off people with industrial spam "raising money for charity " is the opposite of useful, and is going to go even more horribly wrong.

LLMs make fantastic tools, but they have no agency. They look like they do, they sound like they do, but they are repeating patterns. It is us hallucinating that they have the potential tor agency

I hope the world survives this craziness!

Re:Rob Pike Goes Nuclear over GenAI by herval on Friday December 26, 2025 @04:01PM (#46396211)
did someone already tell Opus that Rob Pike hates it?
Re:Rob Pike Goes Nuclear over GenAI by pritambarhate on Saturday December 27, 2025 @09:39AM (#46402149)
As far as I understand Claude (or any other LLM) doesn't do anything on it's own account. It has to be prompted to something and it's actions depend on the prompt. The responsibility of this is on the creators of Agent Village.