News for hackers. Stuff that matters.
Re:Cutting LLM Costs by 83% with LangSmith by nick_rocks on Friday October 27, 2023 @11:52AM (#38040144)
83% cost reduction seems impressive, but is this really an issue for anyone?
Re:Cutting LLM Costs by 83% with LangSmith by sp332 on Friday October 27, 2023 @12:16PM (#38040477)
Well, I heard of one case where a bug was causing queries of 100,000 tokens at a time. https://medium.com/dataherald/cutting-llm-costs-by-83-with-l...
Re:Cutting LLM Costs by 83% with LangSmith by nick_rocks on Friday October 27, 2023 @12:53PM (#38040906)
Fair enough! But have you heard of 2 cases?
Re:Cutting LLM Costs by 83% with LangSmith by aazo11 on Friday October 27, 2023 @01:53PM (#38041669)
Is langsmith still useful if your app is not built with Langchain? Given how early these technologies wouldn't it be better to use a framework agnostic tool to not be tied in to a single framework?