News for hackers. Stuff that matters.
Re:Mistral looks set to challenge AI frontrunners Google and... by bcye on Friday January 19, 2024 @02:18PM (#39059766)
Do you run the model locally on your computer or how do you use it as an alternative to ChatGPT?
Re:Mistral looks set to challenge AI frontrunners Google and... by dontupvoteme on Friday January 19, 2024 @03:22PM (#39060578)
I have a linux box which i run it locally for batch processing, otherwise i just run it through poe (serves as a good comparative website endpoint for differently models i find.)
Re:Mistral looks set to challenge AI frontrunners Google and... by bcye on Saturday January 20, 2024 @12:08PM (#39069774)
Can you elaborate what poe is?
Re:Mistral looks set to challenge AI frontrunners Google and... by lsb on Friday January 19, 2024 @02:33PM (#39059970)
I can run Mistral 7B, in 3-bit quantization, on my phone, and I get helpful answers for (just today) seeing environment variables in Python.
Re:Mistral looks set to challenge AI frontrunners Google and... by AlexAndScripts on Friday January 19, 2024 @02:42PM (#39060088)
What do you use to run it on your phone?
Re:Mistral looks set to challenge AI frontrunners Google and... by lsb on Friday January 19, 2024 @05:52PM (#39062456)
The iOS app “MLCChat”
Re:Mistral looks set to challenge AI frontrunners Google and... by thorum on Friday January 19, 2024 @03:36PM (#39060775)
Re:Mistral looks set to challenge AI frontrunners Google and... by Tommstein on Friday January 19, 2024 @06:35PM (#39062901)
chat.lmsys.org has a zillion models you can use.
Re:Mistral looks set to challenge AI frontrunners Google and... by SamPatt on Saturday January 20, 2024 @12:36AM (#39065009)
Check out LMStudio if you want to try. Open source and quite easy to use, doesn't need a beefy machine.
Re:Mistral looks set to challenge AI frontrunners Google and... by bcye on Saturday January 20, 2024 @12:09PM (#39069787)
Thank you, it looks really good