Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Serving 70B-Scale LLMs Efficiently on Low-Resource Edge Devices [pdf]. Parent comment
https://huggingface.co/bartowski/Qwen2.5-72B-Instruct-GGUF
Man I need to test the q8 version with llamafiles optimizations, it would be so nice to host it locally with the new ryzens, it could maybe fit my 96GB of ram
There are no comments on this comment yet.
https://huggingface.co/bartowski/Qwen2.5-72B-Instruct-GGUF
Man I need to test the q8 version with llamafiles optimizations, it would be so nice to host it locally with the new ryzens, it could maybe fit my 96GB of ram