Re:Gemini 3
by stephc_int13 on Tuesday November 18, 2025 @03:20PM
(#45971510)
The real strength of current neural nets/transformers relies on huge datasets.
ARC do not provide this kind of dataset, only a small public one and a private one where they do the benchmarks.
Building your own large private ARC set does not seem too difficult if you have enough resources.
However, many people have worked hard to optimize tools specifically for ARC over many years, and it's proven to be a particularly hard test to optimize for. This is why I find it so interesting that LLMs can do it well at all, regardless of whether tests like it are included in training.