Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data...
by Datagenerator on Thursday March 28, 2024 @01:14AM
(#39848003)
Interesting I have the same task, can you share your tools? My goal is to detect if documents contain GDPR sensitive parts or are copies of official documents like ID's and driving licenses etc - would be great to reuse your work!
Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data...
by bevekspldnw on Thursday March 28, 2024 @04:12PM
(#39856732)
Working in the same sector, we’ll license it out soon.
I have multiple millions of documents so GPT is cost prohibitive, and too slow. My tools of choice tend to be a first pass with Mistral to check task performance and if lacking using Mixtral.
Often I find with a good prompt Mistral will work as well as Mixtral and is about 10x faster.
I’m on my “home” network, but it’s a “home office” for my startup.