Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ...
by bwfan123 on Wednesday January 01, 2025 @01:48PM
(#42568124)
Reminds me of software i have built which had some basic foundational problems.
Each bug was fixed with a data-patch that fixed the symptom but not the cause.
hence we continually played whack-a-mole with bugs. we would squash one bug, and another one would appear.
same with llms, squash one problem with a data-fix, and another one pops-up.
hence we continually played whack-a-mole with bugs. we would squash one bug, and another one would appear.
same with llms, squash one problem with a data-fix, and another one pops-up.