News for hackers. Stuff that matters.

A comment on Show HN: Speed up model inference on CPU with hand crafted layer implementations. Parent comment

Re:Show HN: Speed up model inference on CPU with hand crafte... by wanderinglight on Saturday November 16, 2024 @09:25PM (#42161490)
We let the generator code hardcore the weight into the generated source.

GPU performance significantly affects performance by as much as 20X. This project is only intended for cases where GPU is not available / desired due to cost or other constraints,

[ Parent | on HN ]

There are no comments on this comment yet.