News for hackers. Stuff that matters.
Re:Intent-tuned LLM router that selects the best LLM for a u... by rfc on Tuesday May 07, 2024 @06:57PM (#40292497)
Very cool... nice work.
Re:Intent-tuned LLM router that selects the best LLM for a u... by robertclaus on Tuesday May 07, 2024 @09:48PM (#40293574)
An example with different fine-tuned models (especially smaller/cheaper ones) would probably be more interesting than running against a bunch of similar foundation models. For example throwing in some code-generation models and demonstrating that it picks those for coding problems.
Re:Intent-tuned LLM router that selects the best LLM for a u... by fbnbr on Wednesday May 08, 2024 @12:26AM (#40294324)
That’s an interesting use case, we thought of a composition of expert router with specialized models like code-generation models to handle coding tasks. Currently we encourage Users to experiment with their own data, and we're happy to help. If you're interested in applying this to smaller LLMs and specialized adapters, let's connect!
Re:Intent-tuned LLM router that selects the best LLM for a u... by PeterStuer on Wednesday May 08, 2024 @11:05AM (#40298910)
I was shocked how much better CodeQwen1.5 was at Python compared to ChatGPT 4.