News for hackers. Stuff that matters.

A comment on Scaling LLama2-70B with Multi Nvidia/AMD GPU.

Re:Scaling LLama2-70B with Multi Nvidia/AMD GPU by zhye on Thursday October 19, 2023 @11:11PM (#37951974)
Serving LLM with AMD GPUs to serve LLM looks impressive, MLC is evolving fast! Any results on NVLink/xGMI instead of PCIe?
[ Parent | on HN ]

There are no comments on this comment yet.