Re:Llama 2 is about as factually accurate as GPT-4 for summa...
by ldjkfkdsjnv on Tuesday August 29, 2023 @12:45PM
(#37310512)
The cost will drop like a rock in the coming years. Its always the same pattern with technology. Theres probably 5-20 Billion in capital working on solving this problem right now.
Re:Llama 2 is about as factually accurate as GPT-4 for summa...
by losteric on Tuesday August 29, 2023 @12:56PM
(#37310679)
Wouldn't cost savings also translate to simpler models? I anticipate the process of distilling knowledge to simpler models will also become much cheaper and non-technical
Re:Llama 2 is about as factually accurate as GPT-4 for summa...
by two_in_one on Tuesday August 29, 2023 @06:44PM
(#37315123)
To be fair you need to add the cost of new development and estimate when it pays bask. Without that it's not obvious that custom solution is better. For small tasks it's likely not.
imo the industry will consolidate around LLMs for early prototypes and as part of the workflow for building a corpus to train domain-specific models.
Source: team went through this process. LLM cost ~1% unskilled human labelers, then we finetuned BERT to bring the cost down to < 0.001% (savings $120k/y compared to just using the LLM)