[dead]
Re:GTK: Introducing Graphics Offload
by ElectricalUnion on Saturday November 18, 2023 @06:41PM
(#38326188)
Hardware acceleration in this case is to draw less power doing day-to-day operations and not melt the user's hand.
In the general case most effective hardware acceleration uses are supposed to increase latency.
Let's take another example for the analogy: you can run your LLM straight in the CPU and it will have awesome latency and very poor throughput; or you can take your sweet time to load the weights into your GPU/NPU/TPU/memory-in-compute device and run it hardware accelerated at lower energy cost and higher throughput.