reducesuffering
reducesuffering on Hacker News
"training LLMs until now has been a largely different process"
Yes, but nobody should be surprised when large amounts of intelligence results in changes to this process in support of the obvious end goal! Lesswrong.com discussions about AI were predicting this behavior a decade ago, before the transition from machine learning to the Attention paper and LLM's. The intelligence process will change but the world's premier capital and human intelligence have been laser focused on this and the trajectory has been crystal clear for those paying attention to second order effects and not the immediate here-and-now... It's quite astonishing how much discussion on HN is about present LLM capabilities being the limit of AGI and immediately proven wrong within 6 months.
I'm baffled this is surprising. This has been the goal and every data point on the trajectory has been leading here and beyond. Opus 5.5 was created by many research engineers using Opus 4.6 extensively. Opus 6 is being created by using even more intelligence and agents on Opus 5.5. They are approaching autonomy and Opus X+1 will soon be rapidly created autonomously from Opus X. Given we have practically zero interpretability into the models, and we have not solved alignment, they will recursively improve out of our control. The engineers in A.I. labs are actually generally scared of what's unfolding. They don't know at what point this RSI takeoff occurs and what will happen after.
Yes service industry is quite broad, is white collar work more clear in general?
Yes, it is quite obviously apparent that law firms are and will be using lots of token-based intelligence. They won't be using the same tokens at the same time as an A.I. lab. However, the best law firms of 2029 will be using approximately the same tokens per employee as an A.I. lab of 2026, that much is clear.
Anthropic is full of the smartest talent and a bellwether for how the rest of the service industry will work. Just as cutting edge companies of the past, like 2005-2020 Google's use of computers and software were indicative of the software every other service company was going to be using, lest they turn into an old fashioned uncompetitive dinosaur.
Actually I think it's very informational. For every other company, working on the cutting edge of technology, paying for intelligence at retail prices, means you are now paying more for AI than you are employees. That $ could have been spent on 2x the employees, however that's not as useful as 50% AI / 50% humans, and indicative of where we are headed.
According to HN of the last year, "marketing stunts." Remember when Mythos preview was announced only 6 months ago
"It's just marketing" HN mostly told us
"If you ask actual AI researchers, they rate the chance of an existential threat from AGI pretty low as of 2026.
All this is, understandably, frustrating and confusing for anyone trying to understand just how scared to be."
Meanwhile it links to an article stating: "The closest thing to a public debate about the existential threat of AI is surveys of AI researchers. The most recent, published last week, asked 1,580 researchers what probability they put on AI causing human extinction — or a permanent, severe loss of human control, which is not the same outcome. The median was about 10%, up from 5% two years ago. The middle half of the responses ran from 1% to 25%, and 12% said zero."
Personally if half of AI researchers have 1-25% chance all humans being massacred or having zero agency over our lives, and only 12% of them think there's no chance, I would be very worried!
“I believe there’s about a 50% chance we all die because of the development of smarter-than-human AI systems, and that our actions over the next two to 10 years will determine the outcome.”
There are a gargantuan number of extremely intelligent AI researchers, Turing Award winners, and the lab CEOs saying the same thing. They are the ones closest to understanding the technology.
Where there’s smoke there’s fire.
You're literally doing what GP is describing. We have objective data on running shoes on:
https://runrepeat.com/The foams are getting better, the shoes lighter, they are more cushioned and more responsive in general. Especially the ASICS.
Imagine having a "stop gambling assistance" section of your fking AD to promote gambling to people
"we regulate the passive exploitation of people to supplement taxes in a regressive manner."
I was convinced by this for a full 30 seconds before I realized there are millions of advertisements for the state lotteries. They aren't just regulating a market that will exist with or without the state, they are actively promoting and encouraging it
Astonishingly simplified. There is far more evidence for the health improvements from ample amount of strength training and aerobic cardio exercise. Good luck lifting 3x and running 3x a week on "low carb".
Amongst acquaintances I see low carb adherents. I wonder why they are always the ones woefully less fit than the serious athlete acquaintances. Amongst serious athletes there is no low carb proselytizing lol.
For sure it can help people who don't exercise and thus don't use much carbs in the first place. But that is far from ideal health, and thus the ideal diet.
Exactly. HN has had an utterly terrible prediction record for AI. So many dismissals of capabilities and existential risk, even this year, that get proven wrong within a month.
You're probably not aware that all of the "science fiction" about AI from LessWrong written 5-20 years ago has come true and our present AI environment reflects that. It wasn't science fiction, it was prescient.
While unfortunate, these are not personal issues. By promoting AGI capability progress, you risk the lives of billions of all of us.
Posted by
reducesuffering on Friday September 25, 2026 @01:24PM
from the axios.com dept.
Yes, but clearly that's not what Zitron was implying. The rest of his thread's commentary makes that clearer. He's saying:
OpenAI is going to implode soon. They would have to raise an unfathomable amount of money, it's literally never been done and is so much it won't happen. That's why they're going to collapse.
He could have predicted that OpenAI would raise an unprecedented amount of money and are not going to collapse. He clearly believed differently.
"Based on estimates of their burn rate and historic analyses, I hypothesize that OpenAI will collapse in the next 12-24 months unless it raises more funding than in the history of the valley and creates an entirely new form of AI." - Ed Zitron (Jul 29, 2024)
Yep, anyone who thinks these leaders are only saying this now for marketing purposes hasn't even done a cursory 15 minute investigation into whether their beliefs are verifiably false.
Because they can't. If they actually engaged with it, they would realize how shallow the "doomer" / existential risk dismissals are. Meanwhile there are ample essays and arguments about the existential issues from Turing award winners, frontier lab CEO's, and many more. There's also
https://ai-2040.com/ , you will never see the equivalent on the other side of the debate because it won't hold under any scrutiny.
As you should. Sacks takes the contrarian moronic take on everything, and the people that are correct and prescient (idk maybe all of the people who ended up as CEO's of frontier labs and Turing award winners in AI?) are saying that AGI is a very real risk of humanity's extinction.
Already determined, but yes frontier models will eventually identify them confidently
This thread is a testament to the travesty of how bad HN discourse has gotten. It's become an echo chamber of knee-jerk cynical sneering. All the heads of the labs (Sama, Dario, Demis Hassabis, Ilya, Musk) agree with the risks to humanity's existence. Most of the core employees agree. Yoshua Bengio, Geoffrey Hinton, Bernie Sanders agree. These issues have been discussed in more intelligent channels for a decade now, and still after all the incredible mathematics and coding progress that is improving incredibly fast every 6 months, this forum is fundamentally unserious. You will not find prescient views in the HN majority anymore, for many years now. The people intelligent, prescient, and forward thinking enough, skating to where the puck was going, to be involved in shaping the future of AGI are elsewhere and barely involved in this place from how badly it's gotten. The inventor of RLHF [0], and newest board member of OpenAI, wasn't on HN, they were on LessWrong.
[0] https://arxiv.org/abs/1706.03741
It's worrying because they all agree, along with Turing Award winners like Geoffrey Hinton and Yoshua Bengio, that this is indeed an existential risk to humanity.
"The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible - but I hear the same people express fear. No other human activity poses this level of danger." -
https://x.com/hilbertspaess/status/2097476196791709843#m"Development of superhuman machine intelligence (SMI) is probably the greatest threat to the continued existence of humanity. There are other threats that I think are more certain to happen (for example, an engineered virus with a long incubation period and a high mortality rate) but are unlikely to destroy every human in the universe in the way that SMI could." - Sam Altman
"If Anyone Builds It, Everyone Dies": https://en.wikipedia.org/wiki/If_Anyone_Builds_It,_Everyone_...
This forum is fundamentally unserious and complete kneejerk cynicism these days. At one point it was prescient. Now these types of things were discussed years ago in other channels and when we reach a point where finally everyone comes around to the right conclusion based on tangible evidence in the news, a majority of people here go "huh i guess so"
GCP reported its first quarterly operating profit in Q1 2023, roughly 15 years after Google began offering cloud computing.
Frontier labs are also reinvesting their tens of billions of revenue back into infra scaleout, sounds like Amazon.
If 2 of 3 were like this, and Azure numbers were never split out, want to take a guess what the economics of the third was like too?