News for hackers. Stuff that matters.

ld4nt3

Re:I resigned from Anthropic today on Wednesday September 09, 2026 @03:38AM (#49622718)
Yeah but trends seems to point strongly that upcoming models in the next few years will make it orders of magnitude easier to develop one with no real expertise.
Re:Claude Opus 5 on Friday July 24, 2026 @09:53PM (#49043780)
This happened before for arc agi 1 and 2 great gains but high costs then slowly but surely the price dropped for less than a dollar per task and got saturated.
Re:GPT-5.6 on Friday July 10, 2026 @05:01AM (#48857514)
Yes an no current models can read and output much more faster with differing quality tho.
Re:Gemini 3 on Wednesday November 19, 2025 @05:50PM (#45986395)
Yes everyone is doing that on benchmarks but they are still somewhat useful and the likes arc agi even more, though we are not be able to quantize exactly how much better they are getting they are still necessary. For arc agi these are some big gains by which ever way the went about it, since everyone also has been trying to max it for the last 3 years but we do need to come up with better benchmarks/evals like arc tried.
Re:Gemini 3 on Wednesday November 19, 2025 @01:00AM (#45976331)
Its almost certain that it was, but the purpose of this puzzle benchmark is that it shouldn't really be possible just to be memorized by the amount of variations that can be created and other criteria detailed in it.
Re:Gemini 3 on Wednesday November 19, 2025 @12:57AM (#45976317)
Yes you can build your dataset of n puzzles but it was still really hard for any system to achieve any scores, it even beats specialized one for this just one task and this puzzles shouldn't really be possible just to be memorized by the amount of variations that can be created.