Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G...
by IsTom on Sunday February 22, 2026 @04:24AM
(#47109617)
OP probably means watt-hours.
[ Parent
| on HN ]
Re:Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-G...
by dotancohen on Sunday February 22, 2026 @09:45AM
(#47111411)
And 0.5 tokens/s should work out to 1800 tokens at the end of the hour. Not 3600 as stated.