News for hackers. Stuff that matters.

A comment on Mistral ships le chat – enterprise AI assistant that can run on prem. Parent comment

Re:Mistral ships le chat – enterprise AI assistant that can ... by abujazar on Wednesday May 07, 2025 @08:08PM (#43921748)
Actually you shouldn't be running LLMs in Docker on Mac because it doesn't have GPU support. So the larger models will be extremely slow if they'll even produce a single token.
[ Parent | on HN ]

There are no comments on this comment yet.