An image of an archeologist adventurer who wears a hat and uses a bullwhip

Re:An image of an archeologist adventurer who wears a hat an... by 9dev on Friday April 04, 2025 @02:11AM (#43578848)

And… that is called overfitting. If you show the model values for y, but they are 2 in 99% of all cases, it’s likely going to yield 2 when asked about the value of y, even if the prompt didn’t specify or forbid 2 specifically.

[ Parent | on HN ]

Re:An image of an archeologist adventurer who wears a hat an... by FeepingCreature on Friday April 04, 2025 @03:02AM (#43579142)

I would argue this is just fitting.

[ Parent | on HN ]

Re:An image of an archeologist adventurer who wears a hat an... by fluidcruft on Friday April 04, 2025 @12:01PM (#43584348)

If you take the perspective of all the possible responses to the request, then it is overfit because it only returns a non-generalized response.

But if you look at it from the perspective that there is only one example to learn, from it is maybe not over it.

[ Parent | on HN ]

Re:An image of an archeologist adventurer who wears a hat an... by IanCal on Friday April 04, 2025 @06:17AM (#43580237)

> If you show the model values for y, but they are 2 in 99% of all cases, it’s likely going to yield 2 when asked about the value of y

That's not overfitting. That's either just correct or underfitting (if we say it's never returning anything but 2)!

Overfitting is where the model matches the training data too closely and has inferred a complex relationship using too many variables where there is really just noise.

[ Parent | on HN ]