News for hackers. Stuff that matters.

A comment on French AI startup Mistral releases ‘unmoderated’ chatbot via torrent. Parent comment

Re:French AI startup Mistral releases ‘unmoderated’ chatbot ... by 7moritz7 on Saturday September 30, 2023 @09:43AM (#37715365)
This can run on 1x 2060S 8 GB
[ Parent | on HN ]
Re:French AI startup Mistral releases ‘unmoderated’ chatbot ... by ComputerGuru on Saturday September 30, 2023 @06:02PM (#37720348)
With what degree of quantization?
[ Parent | on HN ]
Re:French AI startup Mistral releases ‘unmoderated’ chatbot ... by 7moritz7 on Saturday October 14, 2023 @08:46AM (#37880055)
None, just the default weights using ollama. It's fast too. 13b is where things get slow
[ Parent | on HN ]