Re:LLM Training and Inference with Intel Gaudi 2 AI Accelera...
by ilaksh on Saturday January 06, 2024 @02:02PM
(#38894211)
I looked in their Intel Developer Cloud and saw the $10.42/hr 8x but there is no individual 1x Gaudi 2 there that I could see. The $1.30/hr could be okay for some inference use case though if it were available. Although for what I was thinking, llama.cpp is not going to work anyway.
[ Parent
| on HN ]
There are no comments on this comment yet.