Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on NanoGPT. Parent comment
The system are moving in the opposite direction (look at Dojo architecture or TensTorrent)
The silver lining is that the cost of training will fall substantially with those architecture that are not based in reusing gpu.
There are no comments on this comment yet.
The system are moving in the opposite direction (look at Dojo architecture or TensTorrent)
The silver lining is that the cost of training will fall substantially with those architecture that are not based in reusing gpu.