dexterac
Re:AMD's MI300X Outperforms Nvidia's H100 for LLM Inference
on Monday June 17, 2024 @01:27AM (#40702566)
How many customers/consumers will care about services are be built with CUDA?
If they need a ChatBot that uses a model with same accuracy and performance as on non-CUDA hardware, would they still want CUDA based hardware?
Re:AMD's MI300X Outperforms Nvidia's H100 for LLM Inference
on Sunday June 16, 2024 @09:48PM (#40701630)
"Everyone" at top is also developing their own chips for inference and providing APIs for customers to not worry about using CUDA.
It looks like the price to performance of inference tasks gives providers a big incentive to move away from Nvidia.
Re:ECS LIVA Mini Box QC710 Desktop – Snapdragon Developer Kit for Wind...
on Sunday November 14, 2021 @04:16PM (#29220787)
Hope they make it easy to wipe and install Linux.
Re:At what time will be the YC S16 invites/rejection emails sent?
on Monday April 11, 2016 @12:41PM (#11472872)
Thank you!