Re:Eliezer Yudkowsky on large language model economics
by boole1854 on Tuesday March 14, 2023 @10:48AM
(#35152369)
It may not be exactly as good, but it's also a 7B parameter model vs 175B parameters for GPT-3.5 (i.e., text-davinci-003). People are running the new model on their phones, laptops, and Raspberry PIs.
People's mouths were watering over the commercial implications of the recent 90% drop in cost for the new ChatGPT model. Now imagine if you can get similar performance on a model that requires <5% of the parameters.
Re:Eliezer Yudkowsky on large language model economics
by sharemywin on Tuesday March 14, 2023 @11:56AM
(#35153578)
not to mention I think you want your knowledge in some kind of database and just let the AI just do the conversational part of it.
which would be a much easier and more reliable(explainable) way to do it. just find and parrot the facts.
Right now we're in this weird phase where we have no accurate metrics for how good an LM is, so people just try them with a handful of queries and are subjectively impressed or not. Maybe clones can pass that test, but as the market gets more sophisticated, people will prefer superior models.