News for hackers. Stuff that matters.

natolambert

Re:The current balance of power in open models on Wednesday September 23, 2026 @11:11AM (#49817380)
I did leave ai2, but I'm still in the open-source, non profit sector :)
Re:The Atom Project on Monday August 04, 2025 @10:59AM (#44786746)
ATOM: American Truly Open Models
Re:RLHF Book on Saturday February 01, 2025 @10:20PM (#42905447)
Author here! Just wanted to say that this is indeed in a good place to share, some very useful stuff, but is also very work in progress. I'm may 60% or so to my first draft. Said progress is coming every day and I happily welcome fixes or suggestions on GitHub.
Re:RLHF Book on Saturday February 01, 2025 @10:19PM (#42905436)
As the other commenter said, R1 required very standard RLHF techniques too. But a fun way to think about it is that reasoning models are going to be bigger and uplift the RLHF boat.

But we need a few years to establish basics before I can write a cumulative RL for LLMs book ;)

thx, you're right. I've fixed it!
Re:The AI research job market shit show (and my experience) on Thursday October 12, 2023 @02:33PM (#37861069)
Author here, you can find more on my website: https://natolambert.com/cv Have been building RLHF systems at HuggingFace since ChatGPT, with some other experience before.

Older »