News for hackers. Stuff that matters.
Re:Forget ChatGPT: why researchers now run small AIs on thei... by gugagore on Saturday September 21, 2024 @10:20AM (#41610161)
Generally (not just for LLMs) this is called student-teacher training and/or knowledge distillation.
Re:Forget ChatGPT: why researchers now run small AIs on thei... by calf on Saturday September 21, 2024 @11:47AM (#41610703)
It reminds me of when I take notes from a textbook then intensively review my own notes
Re:Forget ChatGPT: why researchers now run small AIs on thei... by solardev on Saturday September 21, 2024 @12:00PM (#41610779)
And then when it comes time for the test, I end up hallucinating answers too.