Re:Cutting LLM Costs by 83% with LangSmith
by sp332 on Friday October 27, 2023 @12:16PM
(#38040477)
Well, I heard of one case where a bug was causing queries of 100,000 tokens at a time. https://medium.com/dataherald/cutting-llm-costs-by-83-with-l...
[ Parent
| on HN ]
Re:Cutting LLM Costs by 83% with LangSmith
by nick_rocks on Friday October 27, 2023 @12:53PM
(#38040906)
Fair enough! But have you heard of 2 cases?