News for hackers. Stuff that matters.

paras_athina

Re:Embeddings Drive the Quality of RAG (2023) on Tuesday December 03, 2024 @07:40AM (#42305512)
I agree and I have practical proof to say that. In an experiment we did at Athina, we made a cookbook for every RAG Technique out there and then evaluated it. We used different vector Db's, different embeddings and we saw different results. You should check out the Github Repo: https://github.com/athina-ai/rag-cookbooks
RAG is amazing. For all the RAG techniques that are being used by enterprises today, here is an amazing repo that provides Google Collab Links for each technique implementation along with an evaluation framework fully implemented. Check out: https://github.com/athina-ai/rag-cookbooks
Re:What Is Retrieval-Augmented Generation (RAG)? on Tuesday December 03, 2024 @06:55AM (#42305218)
Large Language Models are trained on a fixed dataset, which limits their ability to handle private or recent information. They can sometimes "hallucinate", providing incorrect yet believable answers. The Retrieval-Augmented Generation (RAG) framework addresses this issue by using external documents to improve the LLM's responses through in-context learning. RAG ensures that the information provided by the LLM is not only contextually relevant but also accurate and up-to-date. If you want to learn more about it along with a code implementation of every technique, you should check this repo out: https://github.com/athina-ai/rag-cookbooks
Re:The Grammar of Thought: Does Fine-Tuning Make a Difference? on Thursday November 28, 2024 @02:48PM (#42268086)
Yes sometimes it does. Found this blog on how to finetune LLM the easy way with QLora, should be helpful to answer your question: https://dub.sh/fintune-with-qlora
Re:Evaluating the Effects of Fine Tuning on Creative Writing on Thursday November 28, 2024 @02:47PM (#42268077)
I found this blog on how to finetune LLM the easy way with QLora and shows the effects, should be very helpful: https://dub.sh/fintune-with-qlora
I found this blog on how to finetune LLM the easy way with QLora, should be very helpful: https://dub.sh/fintune-with-qlora
Re:How to reduce the risk and impact of LLM hallucinations on Tuesday November 26, 2024 @12:42PM (#42247884)
Honestly, right now there are not a lot of ways in which you can stop that but yes enterprises have found out their own techniques that help them mitigate this risk. For example Doordash built their own 2 layer guardrail system to deal with Hallucinations. Found this blog which shows real hands on the system: https://dub.sh/how-doordash-mitigates-hallucinations
Agreed on this but now companies have figured out their own way to deal with this. For example Doordash built their own 2 layer guardrail system to deal with Hallucinations. Found this blog which shows real hands on the system: https://dub.sh/how-doordash-mitigates-hallucinations
Enterprises these days have built their own 2 layer guardrail system to work around with Hallucinations and its really effective. I found this blog with proper experimentation on real life use case of Doordash: https://dub.sh/how-doordash-mitigates-hallucinations