News for hackers. Stuff that matters.
Re:Can LLM be trained like training Go AI? Such as alphago by verdverm on Wednesday November 08, 2023 @04:06PM (#38197024)
LLM and AlphaGo (DRNN) are different architectures, training regimes, and optimizers. They are not designed for the same inputs & outputs
Re:Can LLM be trained like training Go AI? Such as alphago by Jax_Hax on Wednesday November 08, 2023 @04:36PM (#38197444)
There are models trained via RNN, but LLMs usually use Transformer architecture with a bit of human feedback on top which sort of uses reinforcement learning like AlphaGo
Re:Can LLM be trained like training Go AI? Such as alphago by mindwok on Thursday November 09, 2023 @02:36AM (#38202172)
AlphaGo is also “already knowing” the same way LLMs are. At the end of the day they are just neural nets trained for different tasks. The training process is the “figuring out” part in both cases.