Re:How do domain-specific chatbots work? A retrieval augment...
by atmb4u on Friday August 25, 2023 @09:42PM
(#37269152)
ACL tutorial is a treasure trove. Thank you so much for sharing.
Do you have any thoughts on how to handle real-time streaming data refreshes in such a system?
Re:How do domain-specific chatbots work? A retrieval augment...
by goldemerald on Friday August 25, 2023 @10:56PM
(#37269554)
Hire a grad student for a year to write a research paper on it, haha. I've just gotten into the LLM space for work, so I wouldn't know
My favorite takeaway was that purely fine tuning your model on your documents (without extra document context during inference) consistently performs worse than using a context added from a datastore.