Re:Better and Faster Large Language Models via Multi-Token P...
by jstummbillig on Wednesday May 01, 2024 @05:09PM
(#40229455)
> Can I assume AI are continuing their training as they interact with people when deployed?
Yes, you can. Some of the big providers are fairly clear on where in their products this happens, and all offer a way out (mostly when paying for api access)
> One wonders, if that's the case, how quickly an AI might improve if it has something close to Google's search site throughput
Indeed. Another possibility is that user input will turn out to be increasingly less important for upcoming state of the art models.
Re:Better and Faster Large Language Models via Multi-Token P...
by astrange on Wednesday May 01, 2024 @06:29PM
(#40230407)
They don't train as they go. Training is incredibly expensive.
They do take your feedback and presumably do something with it. Your actual queries are only indirectly useful since they might have private info in them.
One wonders, if that's the case, how quickly an AI might improve if it has something close to Google's search site throughput. I mean fielding several billion queries a day, for a year — that would be some pretty stellar training right there I would think.