Re:Using ChatGPT Plugins with LLaMA
by londons_explore on Sunday March 26, 2023 @01:26PM
(#35317009)
The running costs will drop precipitously with time. Especially in Googles position - they can afford to design custom silicon for their search engine, and potentially save money compared to having hundreds of copies of every page on the whole internet sitting in RAM, just waiting for some user query to maybe need to see it, which they currently do.
Language models are only a few terabytes of RAM, which is small chips in comparison.
Language models are only a few terabytes of RAM, which is small chips in comparison.