Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Inkling 2 Mini. Parent comment
Well it would be theoretical, alas — the M1 Max can't actually saturate the bus with the GPU.
I have seen varying suggestions that it might in practice between 320GB/s and 390GB/s; for the CPU it is much much lower (only 243 GB/s).
I am seeing 16-20 tokens per second generation in Unsloth Desktop.
There are no comments on this comment yet.
Well it would be theoretical, alas — the M1 Max can't actually saturate the bus with the GPU.
I have seen varying suggestions that it might in practice between 320GB/s and 390GB/s; for the CPU it is much much lower (only 243 GB/s).
I am seeing 16-20 tokens per second generation in Unsloth Desktop.