Sohu: The First Transformer ASIC

Re:Sohu: The First Transformer ASIC by Zaheer on Tuesday June 25, 2024 @06:47PM (#40794572)

The results sort of speak for themselves - custom ASIC's are the way of the future. How hard is it though for Nvidia to design a custom ASIC like this?

[ Parent | on HN ]

Re:Sohu: The First Transformer ASIC by ifuknowuknow on Tuesday June 25, 2024 @06:51PM (#40794606)

what results

[ Parent | on HN ]

Re:Sohu: The First Transformer ASIC by jasonni on Wednesday June 26, 2024 @04:19AM (#40797578)

No one is sure that Transformer model is the final best structure. However, you can still use RTX3090 or RTX2090 to run AI models today, no matter the neural network structure is LTSM/RNN/Transformer. Programmablity and compatibility have more value in some aspect of economic considaration.

I hope in the future, when Chip manufacture cost is no longer the bottleneck of AI, we can have more options.

[ Parent | on HN ]