Re:Running large language models like ChatGPT on a single GPU
by baobabKoodaa on Thursday February 23, 2023 @08:23AM
(#34910207)
> > The code has to be updated
> I'm pretty sure this is not how an LLM works.
You can say that about any software. "You can use this software perfectly well without ever updating it." Sure, you can do that, but typically people have lots of reasons to update software. LLM isn't magic in this sense. An LLM does not mysteriously update its own code if you just wish hard enough. If you want to continue the development of the LLM then you need to make changes to the code, just like with any other software.
I'm pretty sure this is not how an LLM works.
>It isn't a "do it once and forget about it" task that it is being touted as in this thread.
That's neither here, nor there. Training the LLM itself is not a "do it multiple times per day if you want to compete with Google" thing as it has been stated in this subthread.