Re:Energy-Efficient Llama 2 Inference on FPGAs via High Leve...
by BonusPlay on Friday May 10, 2024 @03:00AM
(#40316118)
Note, that paper provides environment for AWS FPGAs, which you can rent on per-hour basis.
As for cheaper FPGAs, the paper notes that the bottleneck is the size of on-chip memory. So I doubt it will be easy to find cheaper model to reduce costs.
Another hidden fee would be Vivado and Vitis (tooling) licenses, which you need for most upper-end FPGAs.
As for cheaper FPGAs, the paper notes that the bottleneck is the size of on-chip memory. So I doubt it will be easy to find cheaper model to reduce costs.
Another hidden fee would be Vivado and Vitis (tooling) licenses, which you need for most upper-end FPGAs.