News for hackers. Stuff that matters.

A comment on Ask HN: Cheapest hardware to run Llama 2 70B. Parent comment

Re:Ask HN: Cheapest hardware to run Llama 2 70B by ipsum2 on Thursday August 17, 2023 @10:20PM (#37170768)
This is wrong, NVLink is crucial for tensor parallelism in models for training and in large (>40B param) models for inference.
[ Parent | on HN ]

There are no comments on this comment yet.