News for hackers. Stuff that matters.

rybthrow2

Show HN: Teaching a 4M-param model to read like a child, with RL and no labels

https://rjb7731.github.io/blog/2026/learning-from-scratch/

I have been really interested in reinforcement learning and had a go at trying to teach a model through simulation to read and speak through experience.It’s two small networks (~4M parameters total) trained on a MacBook. It passed generated versions of England’s Year 1 Phonics Screening Check (36.6/40, pass mark 32), and the bit I like most is that it taught itself irregular words like “glove”...

( Read More... | no comments | on HN )
Re:On the Navier–Stokes Millennium Prize Problem on Tuesday September 08, 2026 @04:23PM (#49616495)
I suppose this is how Lee Sedol felt when AlphaGo beat him. But in the same vein, didn't it ultimately advance human understanding of the game?
Re:On the Navier–Stokes Millennium Prize Problem on Tuesday September 08, 2026 @04:21PM (#49616461)
"Argh, they have rushed in too quickly to solve a Millennium Problem!"

How far we have come :.)

Re:Kimi K3 is now live on Thursday July 16, 2026 @11:26AM (#48935872)
Or the American one :)
Re:OpenAI Audio Models on Thursday March 20, 2025 @03:54PM (#43428096)
This is hilarious, extra points if you get it to say:

"Get to the chopper now and PUT THAT COOKIE DOWN NOWWWW"

Re:Gemma 3 Technical Report [pdf] on Wednesday March 12, 2025 @03:32AM (#43340699)
Google DeepMind are the best :)
Re:Mathematical Foundations of Reinforcement Learning on Monday March 10, 2025 @03:32PM (#43324923)
Also one by David Silver of Deepmind, AlphaGo fame are good too: https://www.youtube.com/watch?v=2pWv7GOvuf0
The snythesizable materials is another paper by deepmind not relying on LLMs and unrelated to this one. The article's author briefly mentions one of the other two findings without providing any sources to support the claim that they aren’t novel/useful?

If it helps scientists find answers faster, I don’t see the problem—especially when the alternative is sifting through Google or endless research papers.

What about the other two use cases it came up repurposing existing drugs and identifying novel treatment targets for liver fibrosis as per the paper?

https://research.google/blog/accelerating-scientific-breakth...

Such a bad take. Consider examples like AlphaFold, which has revolutionized protein folding and is already having a profound impact on scientific research and healthcare. AI’s potential extends far beyond being compared to a 90s MS Office suite it has profound, wide-ranging implications for society.
You are using the old 1.3B model no wonder..