Re:Launch HN: Deepsilicon (YC S24) – Software and hardware f...
by areddyyt on Monday September 09, 2024 @01:33PM
(#41491077)
The non-linear layers, particularly the softmax(QK^T), will be crucial to getting ultra-low latency and high throughput. We're considering some custom silicon just for that portion of every transformer block
[ Parent
| on HN ]
There are no comments on this comment yet.