News for hackers. Stuff that matters.

LarsDu88

Re:Astra can read and write weights to improve Qwen on Monday November 02, 2026 @06:46PM (#50345898)
Is it not?
Re:Astra can read and write weights to improve Qwen on Monday November 02, 2026 @06:33PM (#50345742)
Absurd. We tend to anthropomorphize LLMs, but I've never heard of man editing his own thoughts consciously like this.
Re:Galactus the Devourer and the exponential time hypotheses on Saturday October 31, 2026 @01:07AM (#50313383)
Bringing OpenAIs big result down to earth
Logically having a robot is great, but doesn't Shenzen still have a massive supply chain for the actual stuff that goes on the boards?
Re:Anthropic S-1 on Monday October 26, 2026 @04:26PM (#50250428)
I work in biotech. Honestly, I think they will run into massive hurdles.

Amodei's academic background is relevant for protein engineering. Hence the recent press releases Anthropic has released which all concern prototype proof-of-concepts related to binding efficacy.

For a large number of therapeutic relevant indications, the bottleneck is actually clinical trials where you must contend with the sideeffects of any given therapeutic. Almost every drug I've worked on involves very well known mechanisms where knockdowns with targeted compounds will work in a petri dish, but can have catastrophic consequences when dosed on a live human.

As far as I can see there is no way to accelerate clinical trials in humans.

Even the most fantastically large and detailed perturbation datasets will struggle to capture this dynamic in a full human. This is why tech oligarchs are investing in virtual cell models. With a large automated research lab running perturbations 24/7 and capturing massive amounts of data, perhaps we will get as confident with predicting outcomes in cells as we now are confident with many coding projects. However, this is a scientific question, not a technological one. Public companies rarely give the people running them leeway to try and fail on big scientific question marks as opposed to well established or soon-to-be well established technology.

Re:Anthropic S-1 on Monday October 26, 2026 @02:43PM (#50248867)
I posted the original comment, but there are multiple reasons why math success won't translate into drug development or materials engineering success. It is easy to create verifiable rewards environments for math and coding, and use the resulting data for RLVR post-training. For other domains you need machines or robots creating and running experiments. This is simply something that's never been attempted at scale.

Getting IPO level monies should enable the amount of capital needed to sustain such efforts, and if I were a betting man, that is going to be Anthropic's actual endgame given their nascent efforts in automating bio research.

Re:Anthropic S-1 on Monday October 26, 2026 @12:22PM (#50246442)
I think a lot of discussion around the sucess or failure of Anthropic and OpenAI seems to hinge on their current uses, but people seem to have amnesia regarding the fact that Claude code wasn't even a thing until about 1 year ago. There are far wider markets these companies can tap on if they are well capitalized even as Chinese "actually open AI" commoditizes things.

There are moonshot projects related to superconductors, materials, and biology that these companies can claim progress on to keep valuations stratospheric.

Re:The Missed Opportunities of Sonic 06 on Friday October 23, 2026 @05:57PM (#50215922)
He lead the team for most of development until leaving the company months before the horribly botched release. He mostly wrote most of the assembly code for the mainline sonic games in the 90s.
Re:The Missed Opportunities of Sonic 06 on Friday October 23, 2026 @02:22PM (#50213291)
Yuji Naka really fell off hard after Sonic Adventure 2 and commercial failures of Sega's hardware endeavors as a whole. Went from being Sega's golden child, to being arrested for securities fraud.

Allegedly he was extremely difficult to work with and would not share the Night's 3d game engine with an American team that was developing a 3d Sonic game for the Sega Saturn, effectively kneecapping a big part of that console's commercial viability

Re:Mercury 3: Diffusion at scale on Wednesday October 21, 2026 @08:44PM (#50189636)
Thank you for the correction. You dont need to retrain from scratch
Re:EA is shutting down BioWare on Wednesday October 21, 2026 @02:05PM (#50185101)
Let us not forget MDK2
Re:Mercury 3: Diffusion at scale on Monday October 19, 2026 @03:57PM (#50157260)
Pricing can always be set at a loss, however, particularly for a private company. Are there solid published numbers for a specific hardware spec?
Re:Mercury 3: Diffusion at scale on Monday October 19, 2026 @02:42PM (#50156209)
Google's gonna Google...
Re:Mercury 3: Diffusion at scale on Monday October 19, 2026 @02:26PM (#50156011)
Google's research showed some of the speed benefits tended to drop off at larger batch sizes on an H100. Are there published batch-size vs tokens/s figures for Mercury 3?
Re:Mercury 3: Diffusion at scale on Monday October 19, 2026 @02:23PM (#50155971)
Honestly, a lot of those issues could be remedied with more optimized kernels, which LLMs could definitely write quite well now. I wouldn't be surprised if some deployments of Gemini Flash switched to diffusion for cases where there is low utilization, since Google showed you don't need to retrain an autoregressive model to rework it for diffusion inference.
Re:Mercury 3: Diffusion at scale on Monday October 19, 2026 @02:00PM (#50155675)
Their preprint showed it worked well with small batch size, but most prod deployments right now have rather large batch sizes from serving multiple users
Re:Show HN: Gemini 4 Argon plays StarCraft on Friday October 16, 2026 @04:24PM (#50124110)
whoops, apologies
Re:Show HN: Gemini 4 Argon plays StarCraft on Friday October 16, 2026 @04:17PM (#50123988)
Basically yes, but the space of "AI for RTS and videogames" likely goes well beyond Starcraft, so there's probably a lot of unique programming techniques these frontier models can apply for writing AI bots that haven't been done yet.
Re:Show HN: Gemini 4 Argon plays StarCraft on Friday October 16, 2026 @12:19PM (#50120343)
https://broodbench.com/

TLDR they suck and many default to doing probe rushes.

Re:Show HN: Gemini 4 Argon plays StarCraft on Friday October 16, 2026 @12:18PM (#50120331)
Not played by LLMs. The LLMs write the bots that play the game. They don't play directly. Read the article!
Re:Neural Networks Are Already Clean on Thursday October 15, 2026 @02:15PM (#50107836)
This is such a caveman take...
Re:Neural Networks Are Already Clean on Thursday October 15, 2026 @02:14PM (#50107826)
Intuitively this makes sense. When you have small models, they need to compress more by leveraging superposition and polysemanticity.

Nick is looking at a 32B model, which certainly has to compress less... Now we have 10 trillion parameter models... do they need to compress at all? As far as I can tell, experiments show that Fable has basically memorized every lat/long position on the map of the earth can can tell you at a glance whether your standing in the ocean or not based on your coordinates

Bayezid may have gotten his ass kicked, but the Ottoman Empire lasted longer than Mughals
The Tamerlane picket works like the chinese cannon piece and so does the war engine. They both have to jump over the piece in the direction of their movement before being able to deal damage. I think the Chinese canon might be based on the picket + war engine. Timur did have aspirations to invade the Ming Dynasty after all
Half of the cost of the datacenter is the building, power, and cooling infra, and half is the silicon. Datacenter investments will depreciate faster than fiber, but the value won't disappear.

Holding value is contingent on whether a company can manipulate the regulators to create a lasting monopoly or expand the market dramatically. My suspicion is that at some point the investors will gravitate towards the latter by turning LLMs into more active participants in the economy

I think the closest analogy we have of the AI boom is the mid 90s browser wars.

First all the money went into the browsers like Mosaic then Netscape. Then the browser got commoditized, but that didn't mean the value went away. A better business model came along, and lo and behold, the Chrome browser went open source. The browser became free, and the scale of adoption meant a lot of value could still be extracted.

A free browser product didn't mean the value of Chrome went away. Rather the opposite. It's a gateway for buying stuff through Google search.

Marc Andressen was the "Mosaic browser" guy before he was the investor guy, so the folks in the early days did not lose all their money. Quite the opposite. Many are now billionaire oligarchs.

LLMs will likely go the way of the browser... commoditized, then free, then appropriated to shove ads into your face. I predict a lot of safety and interpretability research will be leveraged to one day push ads, just like "Golden Gate Claude" could be manipulated to think of itself as the Golden Gate Bridge.

Re:Redesigning Source Control at Anthropic on Tuesday October 13, 2026 @04:31PM (#50078275)
Google migrated from Perforce to Piper, and Meta migrated from Mercurial to Sapling.

Now Anthropic has migrated from Git to Scion. It's a good sign they are on the right track.

Re:Gemini 4 Argon on Tuesday October 13, 2026 @12:38PM (#50074560)
simonw, your pelicans are so famous now that the frontier labs can just RLVR for SVG images explicitly.

It's a simple manner of prompt...generate concept art with nanobanana, measure, llm creates svg with text, measure the distance between rasterized svg embedding to nanobanana art....do post-training RL on a 3 million such images and matching embeddings.

I swear this will be a canonical example of Goodhardt's Law in action.

You have to switch to a new benchmark that isn't so easy to run a verifiable rewards pipeline on...Perhaps a longer horizon task where it's easy to mess up midway.

Older »