News for hackers. Stuff that matters.
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by woah on Wednesday November 18, 2026 @04:12PM (#50552188)
The heavy reliance on eval datasets showcased here and also evidenced by the frontier lab's high payments for such data cast doubt on the claims that AI will become self-improving soon
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by charcircuit on Wednesday November 18, 2026 @05:25PM (#50553172)
>doubt on the claims that AI will become self-improving soon

It already happened. https://github.com/karpathy/autoresearch

Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by its_down_again on Wednesday November 18, 2026 @05:53PM (#50553515)
Curious, where did you see the numbers on how much frontier labs are paying for eval data?
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by dimes on Wednesday November 18, 2026 @06:15PM (#50553724)
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by trescenzi on Wednesday November 18, 2026 @08:16PM (#50554790)
I’ve gotten recruiting emails to be a human grader of Claude coded projects. 6 month contract at $150/hour 40hrs/week. Not insanely expansive but also not cheap.
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by anon373839 on Wednesday November 18, 2026 @06:27PM (#50553820)
The frontier labs want you to believe that their models are magically gaining intelligence that generalizes to new areas with each new release. But it’s an illusion: the models are post-trained on a HUGE array of hand-curated datasets for specific tasks, with good enough coverage that it feels general.
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by harry8 on Wednesday November 18, 2026 @06:53PM (#50554042)
The frontier labs are using all their customers' logs to train. It's the best training set there is.
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by boardendgrain on Wednesday November 18, 2026 @07:56PM (#50554635)
Time to do all business in cockney ryming slang!
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by XenophileJKO on Wednesday November 18, 2026 @09:52PM (#50555462)
I don't think your data is as valuable as you think it is.

I would not want a model trained on user conversations.

Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by Bnjoroge on Wednesday November 18, 2026 @11:37PM (#50556138)
it's pretty valuable, and there's a huge demand for it from data labs depending on the kind of data. Agent traces are also pretty valuable
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by visarga on Wednesday November 18, 2026 @11:48PM (#50556183)
It is longitudinal data with LLM responses to human tasks and outcomes showing up later in the stream, you can use hindsight to see how a LLM response fared, humans come back and bring those outcomes to continue iterating.
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by jhancock on Wednesday November 18, 2026 @11:57PM (#50556230)
Both OpenAI and Anthropic have setting that allow (at least paid customers) to ensure their data is not used for training. Do you have reason to believe this setting is not what most user believe it is?
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by harry8 on Thursday November 19, 2026 @12:22AM (#50556365)
Seriously who the f@&k actually believes that? The mind boggles that people actually say “there’s a setting.” Is it next to the one that says they won’t break the law and infringe copyright to train their models?

Sam Altman, would you actually believe anything he said if he had an incentive to lie to you?

Rieman hypothesis story was not secret. How do you even entertain this stuff for a second? Even if it were in your financial interest to not understand it’s just so very stark.

The AI companies will tell whatever lie helps them and won’t blink when caught and there will be no consequences because we’ve seen it. Repeatedly. There isn’t a grey area…

Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by SubiculumCode on Thursday November 19, 2026 @12:37AM (#50556435)
Dude.
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by outside1234 on Thursday November 19, 2026 @01:03AM (#50556569)
He’s also not necessarily wrong. The guy is a rat and everyone here knows it.
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by ipaddr on Thursday November 19, 2026 @12:43AM (#50556463)
Both tell you not to include password/tokens in chat. Why would it matter if they weren't training
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by anon373839 on Thursday November 19, 2026 @01:02AM (#50556560)
I think if you read the legal agreements adversarially, there are a lot of cracks in them the labs can exploit. For example, what about derivative data such as LLM-generated summaries of your sessions? Do the training settings preclude use of that?
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by endgame on Thursday November 19, 2026 @01:07AM (#50556596)
Anthropic used to charge you API rates if it saw a HERMES.md in the repo you were working on, even if you had a subscription: https://github.com/anthropics/claude-code/issues/53262

Another commenter here: https://news.ycombinator.com/item?id=49502774

> I made it to a third round interview at anthropic in 2024 and they had me build a web crawler as their programming test. Part way through I started on making it respect robots.txt and I could immediately tell they were no longer interested in me.

Everything but the core models seems to be some mixture of slapdash, petty, and reckless. I would absolutely believe they'd train on customer conversations. Where else would those customers go?

Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by jpardoe on Thursday November 19, 2026 @12:10AM (#50556291)
That depends on the customer. How can you detect the ones that are making smart decisions and guiding the agent correctly towards better outcomes? If you could know that then the problem would already be solved.
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by 0xWTF on Wednesday November 18, 2026 @06:53PM (#50554044)
How is that different from you?
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by StilesCrisis on Wednesday November 18, 2026 @07:16PM (#50554255)
Humans generalize much more quickly than models? We don't require millions of curated examples to learn a concept?
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by p-e-w on Wednesday November 18, 2026 @08:26PM (#50554907)
Because there is four billion years of evolutionary pre-training.
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by bavell on Wednesday November 18, 2026 @08:43PM (#50555030)
Instead of pre-training, I'd say it's more like a better architecture, training regime, higher fidelity data, and perhaps better initial "weights".
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by LoganDark on Wednesday November 18, 2026 @08:49PM (#50555082)
All of that stuff was still trained by evolution, though.
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by gegtik on Wednesday November 18, 2026 @09:59PM (#50555513)
Hmm perhaps I learned to drive in the womb from my moms epigenetic driving genes
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by staplers on Wednesday November 18, 2026 @11:27PM (#50556081)
Monkeys couldnt be taught how to do it. Thus the analogy stands. Our brain architecture allows for more precise instructional retention
Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by octoberfranklin on Wednesday November 18, 2026 @10:14PM (#50555600)
In ~8G weights of DNA?

Lol.

Re:DaisyRose-27B: 1,200-task RL took Qwen3.8 from 5.6% to 12... by jodrellblank on Wednesday November 18, 2026 @10:26PM (#50555697)
Maybe not just DNA. "Something needs to speed evolution up" - Denis Noble, Professor of Biology argues against the idea that DNA is instructions and everything else in the body passively takes orders and has no input and no feedback - https://www.youtube.com/watch?v=NAPhBt8VJCM