News for hackers. Stuff that matters.
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by WarmWash on Sunday April 19, 2026 @09:54AM (#47824327)
When you are worth hundreds of billions, people start falling over themselves running to file lawsuits against you. We're already seeing this happen.

So spending $50M to fund a team to weed out "food for crazies" becomes a no-brainer.

Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by echelon on Sunday April 19, 2026 @04:41PM (#47827470)
It's so shameful.

We let people buy kitchen knives. But because the kitchen knife companies don't have billions of dollars, we don't go after them.

We go after the LLM that might have given someone bad diet advice or made them feel sad.

Nevermind the huge marketing budget spent on making people feel inadequate, ugly, old, etc. That does way more harm than tricking an LLM into telling you you can cook with glue.

Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by gmac on Sunday April 19, 2026 @04:49PM (#47827509)
I don’t feel like that’s a reasonable analogy. Kitchen knives don’t purport to give advice. But if a kitchen knife came with a label that said ‘ideal for murdering people’, I expect people would go after the manufacturer.
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by mattjoyce on Sunday April 19, 2026 @05:11PM (#47827686)
Ad companies prompt injecting consumers. LLM companies countering with guardrails.
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by goosejuice on Sunday April 19, 2026 @05:18PM (#47827726)
It is a no brainer. If a company of any size is putting out a product that caused cancer we wouldn't think twice about suing them. Why should mental health disorders be any different?
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by bojan on Sunday April 19, 2026 @05:49PM (#47827927)
There are many, many companies out there putting out products that cause cancer. Think about alcohol, tobacco, internal combustion engines, just to name a few most obvious examples.
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by fineIllregister on Sunday April 19, 2026 @07:05PM (#47828509)
> alcohol, tobacco, internal combustion engine

Yes, the companies providing these products are sued a lot and are heavily regulated, too.

Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by ChadNauseam on Sunday April 19, 2026 @08:10PM (#47828907)
If you get cancer from drinking alcohol, smoking cigarettes or breathing particles emitted by ICE engines in their standard course of operation, you generally can't sue the manufacturer.
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by nozzlegear on Sunday April 19, 2026 @10:57PM (#47829907)
Notably, that's because they include warning labels telling you not to do those things because they're known to cause cancer.
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by ChadNauseam on Sunday April 19, 2026 @11:48PM (#47830216)
That's just not true. Makes me wondered if you've ever bought a bottle of alcohol before lol. There's no label that says it causes cancer. (Maybe in california because of prop 65?) And I expect cars also have no such labelling, not that it would matter, considering they cause cancer in random passers by who have no opportunity to consent to breathing in auto exhaust or read any labels
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by nozzlegear on Monday April 20, 2026 @12:25AM (#47830393)
> Makes me wondered if you've ever bought a bottle of alcohol before lol.

I'm a teetotaler so no, I literally have not. I was mostly thinking about cigarette and tobacco products which are the most glaring, obvious counterpoints. But you'll be happy to learn that virtually all vehicles in the US also come with operating manuals that profusely warn people not to breathe in the exhaust from the vehicle.

Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by salad-tycoon on Monday April 20, 2026 @08:37AM (#47833407)
Don’t worry, every bottle in the US has the surgeon general’s warning on it and it doesn’t call out cancer, yet. Adding cancer to the ills of booze was proposed in 2025 so your intuition was correct, directionally.

On every bottle:

Alcoholic Beverage Labeling Act of 1988

“ GOVERNMENT WARNING: (1) According to the Surgeon General, women should not drink alcoholic beverages during pregnancy because of the risk of birth defects. (2) Consumption of alcoholic beverages impairs your ability to drive a car or operate machinery, and may cause health problems"

Cancer proposal: https://www.mdanderson.org/cancerwise/not-just-a-hangover--t...

https://www.ttb.gov/regulated-commodities/beverage-alcohol/d...

(As if adding this text will do anything other than reduce the companies liability, rofl)

Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by goosejuice on Monday April 20, 2026 @02:02PM (#47838187)
Labeling is only one part of a larger strategy for population health initiatives. Warning the consumer is the absolute minimum responsible thing to do when the harmful effects are known.
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by goosejuice on Monday April 20, 2026 @02:16PM (#47838394)
You could when the effects were knowingly withheld by said manufacturer. We've seen it with tobacco, lead paint/diesel, pfas, thalidomide, asbestos, opioids, glyphosate, dioxin, and others.

It's much more difficult to isolate alcohol and exhaust as the primary driver of an individuals disease than the above and that's the primary reason it's not regulated more than it is today. I expect that to change as research evolves.

Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by goosejuice on Monday April 20, 2026 @11:36AM (#47835862)
Yes, and they face lawsuits. Tobacco in particular is a canonical example of knowing about the harm and not taking action to warn their consumers, leading to severe legal consequences. Tobacco and alcohol are age restricted. There's anti idling laws.
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by arcanemachiner on Sunday April 19, 2026 @06:31PM (#47828238)
Why stop there? We could jam up the system prompt with all kinds of irrelevant guardrails to prevent harm to groups X, Y, and Z!
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by nozzlegear on Sunday April 19, 2026 @10:58PM (#47829914)
This but unironically. Preventing harm is good, actually.
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by salad-tycoon on Monday April 20, 2026 @08:45AM (#47833486)
Because it dumbs everything down, makes the output quality worse and more expensive, and removes personal agency and is dehumanizing. Plus, does it actually prevent harm, do we have evidence?

Finally, what is often missed is what if an actual good is decided harmful or something that is harmful is decided by AI company board XYZ to be “good”?

I think censorship is bad because of that danger. Quis custodiet ipsos custodes (who will watch the watchers).

Instead of throwing ourselves into that minefield of moral hazard, we should be lifting each other up to the tops of our ability and not infantilizing / secretly propagandizing each other.

Well, ideally at least.

Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by goosejuice on Monday April 20, 2026 @11:52AM (#47836086)
There's enough evidence that Anthropic would be liable if they didn't make a reasonable effort to do something about it.

Look, I get where you're coming from, partially. I generally believe we should make an effort to maximize individual liberty. But in this case, were talking about severe bodily harm and the death of young adults. We've spent the last decade dealing with the chaos and general unwellness has brought to our societies. This isn't much different.

What are you giving up here where such sacrifices are worth it? Can you measure it? What's the utility?

There's room for models trained for non consumer purposes, further age restriction etc but shit is moving so fast. If there are actual needs for a less censored model these can be addressed.

> Finally, what is often missed is what if an actual good is decided harmful or something that is harmful is decided by AI company board XYZ to be “good”?

This is just standard product liability and consumer protection. Companies who do nothing to protect their consumers from known harms are liable. Are you saying you think that's somehow bad for society?

Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by WarmWash on Sunday April 19, 2026 @09:45PM (#47829449)
I think a more apt analogy would be suing a vaccine manufacturer after it gave you adverse effects, when you also knew you were high risk before that.