News for hackers. Stuff that matters.

A comment on AMD Inference. Parent comment

Re:AMD Inference by steeve on Thursday October 03, 2024 @02:24PM (#41733399)
We do use ROCm and CUDA. Only we sandbox it with the model and download only the needed parts which are about 1/10th of the size.
[ Parent | on HN ]

There are no comments on this comment yet.