News for hackers. Stuff that matters.

Show HN: Mockingbird is an LLM that outperforms GPT4 on RAG

https://vectara.com/blog/mockingbird-is-a-rag-specific-llm-that-beats-gpt-4-gemini-1-5-pro-in-rag-output-quality/

Hi HN!

I lead product at Vectara and we've just released a new LLM in our platform that outperforms GPT4 and Gemini 1.5 Pro on RAG tasks.

Vectara is a Retrieval Augmented Generation (RAG) platform primarily deployed as a SaaS service which includes a generous free tier so you can try it for free.

The way we've been able to offer a "better but cheaper" is that we focus a lot of our attention on taking smaller models (which can be hosted in a cost efficient way) and fine tuning them to specific tasks: in this case RAG. This ends up with a model that is less capable of arbitrary tasks like crafting creative stories, but for many enterprises we've learned they don't see the "creativity" of LLMs as a positive, as they also result in hallucinations.

Would love feedback!

( 1 comment | 2 points | on HN )
Re:Show HN: Mockingbird is an LLM that outperforms GPT4 on RAG by llm-apprentice on Friday July 19, 2024 @02:27PM (#41009518)
I think we all recognize that specialized models are the future. Great to see Vectara already on that path for RAG (enterprises)!