News for hackers. Stuff that matters.

A comment on Ask HN: Cheapest hardware to run Llama 2 70B. Parent comment

Re:Ask HN: Cheapest hardware to run Llama 2 70B by Tepix on Thursday August 10, 2023 @11:57AM (#37077846)
Tiny box is for running it at fp16, most other comments here talk about running it with 4bit quantization
[ Parent | on HN ]

There are no comments on this comment yet.