News for hackers. Stuff that matters.
Re:Cutting LLM Costs by 83% with LangSmith by sp332 on Friday October 27, 2023 @12:16PM (#38040477)
Well, I heard of one case where a bug was causing queries of 100,000 tokens at a time. https://medium.com/dataherald/cutting-llm-costs-by-83-with-l...
Re:Cutting LLM Costs by 83% with LangSmith by nick_rocks on Friday October 27, 2023 @12:53PM (#38040906)
Fair enough! But have you heard of 2 cases?