News for hackers. Stuff that matters.

A comment on Energy-Efficient Llama 2 Inference on FPGAs via High Level Synthesis. Parent comment

Re:Energy-Efficient Llama 2 Inference on FPGAs via High Leve... by almostgotcaught on Friday May 10, 2024 @02:56AM (#40316106)
ebay has a bunch of Alveo U30 cards for ~500. 500k luts, 3000 dsp slices, ~1M registers, even some DDR.

fair warning: one does not "play around" with an FPGA. they are the antithesis of user friendly.

[ Parent | on HN ]

There are no comments on this comment yet.