News for hackers. Stuff that matters.
Re:Mistral Small 3 by Beretta_Vexee on Thursday January 30, 2025 @11:05AM (#42879025)
RAG mainly, Feature extraction, tagging, Document and e-mail classification. You don't need a 24B parameter to know whether the e-mail should go to accounting or customer support.
Re:Mistral Small 3 by pheeney on Thursday January 30, 2025 @12:55PM (#42880208)
What models would you recommend for basic classification if you don't need a 24B parameter one?
Re:Mistral Small 3 by josh-sematic on Thursday January 30, 2025 @01:51PM (#42880833)
You might find this comparison chart helpful: https://www.airtrain.ai/blog/how-15-top-llms-perform-on-clas...

Note: from October; also I work at Airtrain

Re:Mistral Small 3 by Beretta_Vexee on Friday January 31, 2025 @04:06AM (#42885931)
There's no alternative to testing with your own data. The majority of our data is in French, and our benchmarks differ greatly from public benchmarks generally based on English documents.
Re:Mistral Small 3 by elorant on Friday January 31, 2025 @08:32AM (#42887450)
I’m using Llama-3 8B to classify html files. It’s surprisingly good, and I run it on an RTX 4060 Ti at 8-bit quantization. No complains so far.
Re:Mistral Small 3 by Panoramix on Thursday January 30, 2025 @01:44PM (#42880766)
Would this work for non-text data? Like finding outliers in a time series or classifying trends, that kind of thing
Re:Mistral Small 3 by Beretta_Vexee on Friday January 31, 2025 @04:01AM (#42885906)
Don't use LLM to do something that some python + panda lines could do better. Buy a data scientist a coffee and have a chat.