News for hackers. Stuff that matters.
Re:Show HN: Nomadic – Minimize RAG Hallucinations with 1 Hyp... by rnvarma on Thursday September 05, 2024 @02:38PM (#41459326)
For my company, we don't have complex chains, but generally are giving a large context and looking to get structured outputs. Curious how this could help with that? We don't currently use any eval frameworks.
Re:Show HN: Nomadic – Minimize RAG Hallucinations with 1 Hyp... by varunkrishnan17 on Thursday September 05, 2024 @02:52PM (#41459448)
That's a great use case of Nomadic! We support many Eval frameworks in the optimization, but one is a LLM-as-a-Judge model, where you can input custom weights based on your metrics of interest! Adhering to a proper structure could be one of them :-)