News for hackers. Stuff that matters.
Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by badrunaway on Monday June 17, 2024 @09:02PM (#40713006)
When we talk about system 2; is it possible that [generating large number of programs; evaluating them of the task; choosing top K outcomes; feeding it back to Neural net] can act as system 2 for a AGI? Isn't that how we think intelligently as well- by making lot of hypothesis internally and evaluating them - and updating our model?
Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by awwaiid on Monday June 17, 2024 @09:23PM (#40713140)
I think it's more like humans are a chaotic choir of subsystems all doing their thing and tossing up their directives until some sort of "win" happens or the volume is loud enough in some direction that it then gets reverse engineered into a "thought". But yes.
Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by badrunaway on Tuesday June 18, 2024 @07:39AM (#40716559)
like darwin selection between the subsystem approaches? Put in a lot of different kind of LLMs and let them play the same game inside with each other.. whosoever wins the simulation is allowed to externally present the approach... something like that?
Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by spencerchubb on Monday June 17, 2024 @09:26PM (#40713161)
Possibly

I think we need those pieces, and also a piece for determining hypotheses in an efficient manner. Monte Carlo Tree Search could be that piece. Probabilistically choose a node to search, and then backpropagate the probabilities back to the root node.

Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by badrunaway on Tuesday June 18, 2024 @07:44AM (#40716612)
Intuitively I feel efficiency is the outcome of existing world model.. approach can look like yours - I don't see why there has not been efforts on scaling monte carlo tree search for extending the existing world model via tree search. My guess is that it would diverge to hallucinations too fast because it doesn't have a strong logical building block already
Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by bshanks on Tuesday June 18, 2024 @03:19PM (#40721168)
Yes, I think it's very possible that human brains unconsciously generate-and-test surprisingly large numbers of small candidate programs when solving a problem.

This approach is https://en.wikipedia.org/wiki/Embarrassingly_parallel, which is a good fit for biological neural architectures, which have very many computing nodes but each node is very slow (compared to electronic computer CPUs/GPUs).