News for hackers. Stuff that matters.
Re:Render a neural network into CUDA/HIP code by philipturner on Sunday June 04, 2023 @08:32AM (#36185113)
To give more credit, I know your company was working on your own optimizations, which are prior art. It's possible that you made a 180 GB/s shader on your own (quite slow compared to my 319 GB/s). Or that the 319 GB/s was used, but the self-attention bottleneck was non-negligible.

However, for whatever reason, when Greg Gerganov started work on the Metal backend, you made a product announcement almost a day later. That seems like a non-coincidence and there must be some logical explanation.

There are no comments on this comment yet.