News for hackers. Stuff that matters.

TastyLamps

Re:Mockingbird: A RAG-Focused LLM on Tuesday July 16, 2024 @02:48PM (#40979155)
I'm happy to share that today we are releasing the Mockingbird LLM.

At <10B parameters it's an LLM trained to provide optimal results for RAG and structured outputs. Although significantly smaller (and thus faster) than GPT-4 or Gemini-1.5 Pro, it performs at a comparable level for generation, citations, and structured outputs.

Re:Chatbots May 'Hallucinate' More Often Than Many Realize on Monday November 06, 2023 @10:41AM (#38164032)
I think in addition to all the benchmarks used right now for LLM evaluation (HumanEval and the like). It would be interesting to have a 'hallucination benchmark' with a summarization based hallucination dataset.

Show HN: Talk to YouTube – RAG for YouTube Videos

https://github.com/SulemanKazi/TtYT

Hi HN,I built this little application for setting up RAG on Youtube video transcripts. I haven't seen a lot of RAG for multimodal use-cases so I thought this was interesting. It uses YoutubeDL to get transcripts and Vectara to set up the RAG system. It's multilingual so other languages besides english work as well.The answer produced by the LLM has references with timestamps to where its...

( Read More... | 1 comment | 4 points | on HN )
Re:DNS record "hn.algolia.com" is gone on Monday October 09, 2023 @12:36PM (#37822177)
We built a Hacker News search demo at Vectara. Maybe it'll be useful while the site search is down.

https://asknews.demo.vectara.com/

It defaults to a summarization-first view. To get a more search-like experience go to options > UX Mode > select Search (instead of summary).

Google did something similar in 2017 (although it's overlaying your WHOLE FACE) on the headset and only when viewed through a camera: https://blog.google/products/google-ar-vr/google-research-an...