Re:Cutting LLM Costs by 83% with LangSmith
by nick_rocks on Friday October 27, 2023 @11:52AM
(#38040144)
83% cost reduction seems impressive, but is this really an issue for anyone?
[ Parent
| on HN ]
Well, I heard of one case where a bug was causing queries of 100,000 tokens at a time. https://medium.com/dataherald/cutting-llm-costs-by-83-with-l...
Re:Cutting LLM Costs by 83% with LangSmith
by nick_rocks on Friday October 27, 2023 @12:53PM
(#38040906)
Fair enough! But have you heard of 2 cases?