News for hackers. Stuff that matters.

A comment on Smollm3: Smol, multilingual, long-context reasoner LLM. Parent comment

Re:Smollm3: Smol, multilingual, long-context reasoner LLM by tripplyons on Tuesday July 08, 2025 @09:57PM (#44505665)
Have you tried setting device="mps" to use Metal? It should be faster than PyTorch's "cpu" device on Mac.
[ Parent | on HN ]

There are no comments on this comment yet.