Re:Show HN: Open-Source Alternative to OpenAI Platform, for ...
by dadmobile on Wednesday January 29, 2025 @10:19AM
(#42865920)
Yes! The easiest way to run this locally is to use one of the distilled models (you download one from the Model Zoo or enter any huggingface ID at the bottom of the page). If you are on a mac, the MLX versions work great, and of course GGUF if you want a quantized model or don't have a GPU.
[ Parent
| on HN ]
There are no comments on this comment yet.