Re:How LLMs Work, Explained Without Math – Miguel Grinberg
by photon_lines on Monday May 06, 2024 @06:21AM
(#40273021)
Yeah - most of the online descriptions aren't even remotely accurate nor close to explaining how LLMs like ChatGPT actually work. They are not simple 'next-word predictors' and most of the online tutorials / info don't go into fine-tuning nor the intricate details of chain of thought reasoning (which I personally believe plays a huge role in ChatGPT's amazing performance). If you want my own detailed description you can find it here: https://photonlines.substack.com/p/intuitive-and-visual-guid...
[ Parent
| on HN ]
Re:How LLMs Work, Explained Without Math – Miguel Grinberg
by sk11001 on Monday May 06, 2024 @06:28AM
(#40273052)
I think too many people confuse the base model (which can be called a next token predictor) with the fine-tuned chat model which is specifically modified to carry a conversation, be helpful and be as factually correct as possible.