Re:Intel CEO: 'The entire industry is motivated to eliminate...
by jart on Friday December 15, 2023 @02:49AM
(#38651966)
I honestly don't see why it's so hard. On my project we wrote our own gemm kernels from scratch so llama.cpp didn't need to depend on cublas anymore. Only took a few days and a few hundred lines of code. We had to trade away 5% performance.
[ Parent
| on HN ]
Re:Intel CEO: 'The entire industry is motivated to eliminate...
by soulbadguy on Friday December 15, 2023 @04:00AM
(#38652362)
For a given set kernels, and a limited set of architectures, the problem is relatively easy.
But covering all the important kernels acros all the crazy architecture out there and with relatively good performance and numerical accuracy ... Much harder