Re:Do Large Language Models learn world models or just surfa...
by thaumasiotes on Monday January 23, 2023 @05:49AM
(#34487372)
Point 1 isn't wrong; it's correct. There's a reason the name for this problem is "overfitting".
[ Parent
| on HN ]
Re:Do Large Language Models learn world models or just surfa...
by klodolph on Monday January 23, 2023 @01:02PM
(#34492486)
Yeah, it sounds like you’re assuming two things things here which are often (or usually) wrong:
1. No cross-validation, and
2. You have the ability to solve for additional parameters without losing accuracy.
Statistics is not intuitive.