News for hackers. Stuff that matters.
Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by infgeoax on Monday June 17, 2024 @11:05PM (#40713702)
Plus it's unclear if the amount of data used to "train" a human brain is really less than what GPT4 used. Imagine all the inputs from all the senses of a human over a lifetime: the sound, light, touches, interactions with peers, etc.
Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by Jensson on Tuesday June 18, 2024 @12:40AM (#40714140)
But that is of little help when you want to train an LLM to do the job at your company. A human requires just a little bit of tutorials and help, an LLM still require an unknown amount of data to get up to speed since we haven't reached that level yet.
Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by infgeoax on Tuesday June 18, 2024 @01:34AM (#40714356)
Yeah humans can generalize much faster than LLM with far fewer "examples" running on sandwiches and coffee.
Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by logicchains on Tuesday June 18, 2024 @02:23AM (#40714614)
>Yeah humans can generalize much faster than LLM with far fewer "examples" running on sandwiches and coffee.

This isn't really true. If you give an LLM a large prompt detailing a new spoken language, programming language or logical framework with a couple examples, and ask it to do something with it, it'll probably do a lot better at it than if you just let an average human read the same prompt and do the same task.

Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by infgeoax on Tuesday June 18, 2024 @08:03PM (#40723361)
Hmm, but is it really "generalizing" or just pulling information from the training data? I think that's what this benchmark is really about: to adapt to something it has never seen before quickly.
Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by alchemist1e9 on Tuesday June 18, 2024 @03:23AM (#40714993)
Don’t forget all the lifetimes of all ancestors as well. A lot of our intelligence is something we are born with and a result of many millions of years of evolution.