News for hackers. Stuff that matters.
Re:How Meta trains large language models at scale by rldjbpin on Thursday June 13, 2024 @09:51PM (#40676783)
being first/early doesn't always mean long-term dominance, see tensorflow.

at consumer level, npu are becoming a useful accelerator, and here google can choose to become the platform of choice.

but nobody comes close for training workflow but nvidia as it stands. imho it is currently possible thanks to community efforts afforded by cuda being the only realistic option.

politics and leadership aside, it would be nice to sustian a market for highly efficient matrix multipliers. also a s/w ecosystem that finally makes multiprocessing workloads easy to integrate for dummies like me.

There are no comments on this comment yet.