News for hackers. Stuff that matters.
Re:Show HN: Fructose, LLM calls as strongly typed functions by ilaksh on Wednesday March 06, 2024 @04:18PM (#39621612)
I find it grating that all of these types of things say "LLMs" when in fact they literally only work with OpenAI. There are hundreds of variations of LLM models. When it works with only gpt-4-turbo or gpt-3.5-turbo, it's inaccurate to say it's a tool for LLMs in general.
Re:Show HN: Fructose, LLM calls as strongly typed functions by vineetch on Wednesday March 06, 2024 @04:24PM (#39621686)
So you're saying they should ensure compatibility with all LLMs on Day 0 so you can avoid a personal "grating" feeling. It's called an MVP.
Re:Show HN: Fructose, LLM calls as strongly typed functions by ilaksh on Wednesday March 06, 2024 @08:10PM (#39623895)
They should just say it works with OpenAI or ChatGPT. It's called being honest.
Re:Show HN: Fructose, LLM calls as strongly typed functions by edunteman on Wednesday March 06, 2024 @09:33PM (#39624473)
feel free to PR the readme if you feel it was misleading
Re:Show HN: Fructose, LLM calls as strongly typed functions by iAkashPaul on Wednesday March 06, 2024 @11:00PM (#39624917)
True, Grammar has been around with Llama.cpp since the early days IIRC. Microsoft had Guidance as well & now TGI supports it as well. End game for Langchain/Llamaindex if just guarantee or structure adherence was the only reason to use & beg the LLM for usable output.