Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Google “We Have No Moat, and Neither Does OpenAI”. Parent comment
https://github.com/ggerganov/llama.cpp/issues/34
An M1 Max does 100ms per token. A 64 core threadripper about 33ms per token.
There are no comments on this comment yet.
https://github.com/ggerganov/llama.cpp/issues/34
An M1 Max does 100ms per token. A 64 core threadripper about 33ms per token.