News for hackers. Stuff that matters.

A comment on Energy-Efficient Llama 2 Inference on FPGAs via High Level Synthesis.

Re:Energy-Efficient Llama 2 Inference on FPGAs via High Leve... by hongspike on Friday May 10, 2024 @04:27AM (#40316593)
Trying to understand what cases we would want to use FPGAs rather than GPUs.

Memory bandwidth for FPGAs seems worse, so for serving models don't GPUs still win out?

[ Parent | on HN ]

There are no comments on this comment yet.