News for hackers. Stuff that matters.
Re:How do domain-specific chatbots work? A retrieval augment... by goldemerald on Friday August 25, 2023 @02:33PM (#37265466)
ACL had a recent tutorial about state of the art for this topic. https://acl2023-retrieval-lm.github.io/

My favorite takeaway was that purely fine tuning your model on your documents (without extra document context during inference) consistently performs worse than using a context added from a datastore.

Re:How do domain-specific chatbots work? A retrieval augment... by atmb4u on Friday August 25, 2023 @09:42PM (#37269152)
ACL tutorial is a treasure trove. Thank you so much for sharing.

Do you have any thoughts on how to handle real-time streaming data refreshes in such a system?

Re:How do domain-specific chatbots work? A retrieval augment... by goldemerald on Friday August 25, 2023 @10:56PM (#37269554)
Hire a grad student for a year to write a research paper on it, haha. I've just gotten into the LLM space for work, so I wouldn't know