News for hackers. Stuff that matters.
Re:Launch HN: Deepsilicon (YC S24) – Software and hardware f... by areddyyt on Monday September 09, 2024 @01:33PM (#41491077)
The non-linear layers, particularly the softmax(QK^T), will be crucial to getting ultra-low latency and high throughput. We're considering some custom silicon just for that portion of every transformer block

There are no comments on this comment yet.