News for hackers. Stuff that matters.
Re:LlamaF: An Efficient Llama2 Architecture Accelerator on E... by jsheard on Friday September 27, 2024 @11:32AM (#41671742)
That's the thing though, we're already there. Every new consumer ARM and x86 ASIC is shipping with some kind of NPU, the time for tentatively testing the waters with FPGAs was a few years ago before this stuff came to market.
Re:LlamaF: An Efficient Llama2 Architecture Accelerator on E... by PaulHoule on Friday September 27, 2024 @11:35AM (#41671787)
But the NPU might be poorly designed for your model or workload or just poorly designed.