News for hackers. Stuff that matters.
Re:Claude Fable 5.2 solves two open problems in the physics ... by keeda on Thursday November 19, 2026 @02:04PM (#50564642)
In my (limited) experience it does not struggle with empirical research — At least in the procedural aspects thereof — as long as it has access to the right data.

It is very good at understanding research goals, identifying appropriate datasets to work with, doing data wrangling and data science, determining appropriate metrics, running simulations, analyzing results, writing up reports with charts and tables, and proposing follow ups or “high potential next steps” which show a surprising amount of judgment, and if instructed to, executing on those too.

I use Astra and Fable (who delegate to cheaper models for coding) and have them review each others work, and only spot check things when they are done calling each other out. I rarely find issues, and when I do, it’s usually a misunderstanding of intentions.

I’ve only explored a few areas though, including computer vision, vector search, and wireless signal processing in applications, as far as I can tell, are genuinely novel (though of varying levels of novelty and economic value, as the models are fond of pointing out to me!)

I prefer being in the loop and setting the direction — because I do not have unlimited tokens, hah! —- and I regularly identify new directions they had not considered or had prematurely dismissed… so I am a bit more useful than just a financier of tokens! But I can totally see how they could grinding ahead by themselves and brute force useful results, especially if given very concrete goals like a theorem to prove.

I don’t think we’re at Recursive Self Improvement yet, but I don’t doubt for a minute that this is behind the insane pace of development at Anthropic and OpenAI.

Re:Claude Fable 5.2 solves two open problems in the physics ... by glitchc on Thursday November 19, 2026 @02:50PM (#50565310)
In empirical research, getting the right data represents the bulk of the intellectual effort. Designing the right experiment and collecting good data is painstaking, backbreaking work.
Re:Claude Fable 5.2 solves two open problems in the physics ... by keeda on Thursday November 19, 2026 @03:22PM (#50565814)
I agree, and this may be nitpicking, but would it not be more accurate to say “bulk of the effort” rather than “intellectual effort”?

My perception is that most data collection, once designed (which does take considerable thought, as you point out), is a slog of executing rather mechanical processes over a long time. (Which is what RA’s and lab assistants are for!) For sure, regular analysis is needed to ensure the right data is being collected and no confounding factors are sneaking in, but seems to me the majority of time goes into the relatively rote work of setting up equipment, running experiments and recording the results.

I do think that with access to MCP-enabled equipment, AI would be ideal for this too, given its infinite patience. The problem, as with all other fields, is this would rob novices the opportunity of building the necessary intuition that comes from spending time in the weeds.

Re:Claude Fable 5.2 solves two open problems in the physics ... by glitchc on Thursday November 19, 2026 @05:22PM (#50567307)
> bulk of the effort” rather than “intellectual effort”?

No, it is intellectual. Designing and implementing an experiment that eliminates confounding variables requires a great deal of creativity and ingenuity. Reality is messy and complicated.

Some notable examples include: Michelson-Morley, Millikan, Wrights, Cas-9 for CRISPR, CERN (one giant experiment).

Re:Claude Fable 5.2 solves two open problems in the physics ... by keeda on Thursday November 19, 2026 @11:16PM (#50570092)
I guess in my mind I'm separating out the cycle into experiment design -> experimental setup + data collection -> data analysis phases and feeling like the middle phase appears to be the longest, most painstaking and most mechanical. But as I mentioned in a sibling comment, my perceptions are based on limited second-hand experience, so yeah I can believe they're off-base.
Re:Claude Fable 5.2 solves two open problems in the physics ... by thaumasiotes on Thursday November 19, 2026 @05:56PM (#50567734)
The majority of time goes into collecting nonsense data in the service of doing computations that aren't useful, because the data was nonsense.

https://desystemize.substack.com/p/desystemize-1

Re:Claude Fable 5.2 solves two open problems in the physics ... by keeda on Friday November 20, 2026 @01:04AM (#50570753)
Fascinating read, thanks for sharing!
Re:Claude Fable 5.2 solves two open problems in the physics ... by epihelix on Thursday November 19, 2026 @09:58PM (#50569611)
> but seems to me the majority of time goes into the relatively rote work of setting up equipment, running experiments and recording the results.

Sadly, no. There are surely exceptions, but most data collection for experimental research is highly skilled and intellectually demanding.

The good RAs are the ones that could have aced a PhD if they'd wanted to (there's one in my lab, and they're worth their weight in gold) -- but they are rare. There's a reason that the majority of research effort in the sciences comes from PhD students and postdocs, not from RAs. This stuff is not simple, and definitely not rote.

Re:Claude Fable 5.2 solves two open problems in the physics ... by keeda on Thursday November 19, 2026 @10:49PM (#50569909)
Fair enough. My earliest exposure to scientific experimental work was working (on an unrelated engineering project) alongside some scientists and PhD students in an NMR lab. I got the impression that they spent the bulk of their time tinkering with the mechanical aspects of the NMR machines to set up experiments, then waiting hours while the experiments ran, and then staring at the results to figure out what to do next.

Then I had friends studying biotech who seemed to spend hours in labs slicing up flies or preparing cultures for experimental assays.

They were all definitely very smart and hard-working, and the science was extremely deep, but setting up and carrying out the experiments seemed to be the most time-consuming aspect, which may have skewed my perceptions.

Re:Claude Fable 5.2 solves two open problems in the physics ... by epihelix on Friday November 20, 2026 @09:41AM (#50575291)
Experiments are definitely repetitive and time consuming, sure. But they are also highly skilled, and need intelligent operators. Both things can be true.

To take one of your examples -- dissecting Drosophila is an expert task and requires extremely fine motor skills (you are pulling apart soft tissues 100-200 microns in diameter), and also requires the ability to recognise and isolate different tissues visually. You're not going to ever get a robot to do this any time soon.

And that's just a tiny part of the experiment -- before that, there was thinking through the crosses; the fly husbandry; the sorting ... and after dissection, there's the fixation and antibody labelling; mounting and imaging (an art in itself).

We don't really give these skills enough credit, I agree. But the only reason why a high-performing biomed lab can do what it does, is because it's filled with extremely smart and capable individuals.

(Yes, not everything is as highly skilled as tissue dissection, and some repetitive molecular biology can now be handled with robotics and microfluidics quite well. But there's a lot that still can't be automated. I also wouldn't dream of letting an LLM near any of this -- a hallucination that causes a bug in code is one thing; a hallucination in a biomed lab facility could kill people.)

Re:Claude Fable 5.2 solves two open problems in the physics ... by tomrod on Thursday November 19, 2026 @03:09PM (#50565614)
I'd argue that "the right data" should really be called "the right information in context."

Context is king.