News for hackers. Stuff that matters.
Re:LLM Training and Inference with Intel Gaudi 2 AI Accelera... by ilaksh on Saturday January 06, 2024 @02:02PM (#38894211)
I looked in their Intel Developer Cloud and saw the $10.42/hr 8x but there is no individual 1x Gaudi 2 there that I could see. The $1.30/hr could be okay for some inference use case though if it were available. Although for what I was thinking, llama.cpp is not going to work anyway.

There are no comments on this comment yet.