News for hackers. Stuff that matters.
Re:Transformers on Chips by quickthrower2 on Saturday December 16, 2023 @08:05PM (#38669418)
It’s a bet. Probably a good one to make. The upside of being the ones who have an AI chip (not a graphics chip larping as an AI chip) is huge. It will run faster and more cheaply. You get to step all over OpenAI, or get a multi billion dollar deal to supply Microsoft data centres. Or these ship on every new laptop etc. You get to be the next unicorn ($1tn company). So that is a decent bet for investors assuming the team can deliver. Yes the danger is there is a new architecture that runs on a CPU that for practical purposes whoop’s Attention’s ass. In which case investors can throw some money at ASICifying that.
Re:Transformers on Chips by dontwearitout on Saturday December 16, 2023 @09:07PM (#38669740)
Yep, transformers showed up in 2017, nearly 7 years ago, and they still wear the crown. Maybe some new architecture will come to dominate eventually, but I would love a low cost PCIe board that could run 80B transformer models today.
Re:Transformers on Chips by imtringued on Sunday December 17, 2023 @06:25AM (#38672119)
If the fairy tale numbers are correct, they could price it at a million dollars and it would still be cheap.