Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Show HN: Run 500B+ Parameter LLMs Locally on a Mac Mini. Parent comment
~19 tok/s for Apple M1 Max (64 GB) with TinyLlama-1.1B-Chat-v1.0
There are no comments on this comment yet.
~19 tok/s for Apple M1 Max (64 GB) with TinyLlama-1.1B-Chat-v1.0