News for hackers. Stuff that matters.
Re:The bigger-is-better approach to AI is running out of road by MrScruff on Sunday June 25, 2023 @08:38AM (#36467581)
I agree that is a fundamental difference. That’s what I meant about reinforcement learning. Our ‘model weights’ are being updated with new data all the time.

I was just referring to what happens at a specific instance in time when someone asks me for example ‘What’s the capital of Norway?’

Re:The bigger-is-better approach to AI is running out of road by chongli on Sunday June 25, 2023 @09:54AM (#36468206)
That one’s not a great example. Either you know the capital or you don’t. There’s no process (other than research) by which you can learn the name while attempting to answer.

A question I get much more often is “how do I solve this math problem?” Many times, the problem is one I’ve never seen before. So in the process of answering the question, I also learn how to solve the problem too.

Re:The bigger-is-better approach to AI is running out of road by ItsMonkk on Sunday June 25, 2023 @10:54AM (#36468793)
While you can apply zero shot learning and get the answer to a new math problem, you are only apply the learning to significant depth after a fine-tuning session - sleep.