News for hackers. Stuff that matters.
Re:Building the Future of TensorFlow by p1esk on Friday October 21, 2022 @10:25AM (#33288306)
Their development on ShardedTensor seems to have slowed or stopped recently

What makes you say that?

Re:Building the Future of TensorFlow by atty on Friday October 21, 2022 @11:11AM (#33288822)
Just looking at commit frequency in the main branch, and activity on the relevant RFCs in GitHub issues. I have no visibility into what’s going on at Meta of course so it could just be there’s a lot of currently internal development, maybe there’s a lot of work going into a different branch at the moment, or maybe they’re waiting for things to happen in torch’s RPC support, I’m not sure. Or it could be they’re just waiting to release what they have as a beta in the 1.13 or 1.14 release?

I’ll note that checking right now there was a commit 15 hours ago, but the last commit before that seems to be 28 days. So some work is still going on at least, thankfully :)

Re:Building the Future of TensorFlow by smhx on Friday October 21, 2022 @01:35PM (#33290763)
ShardedTensor was merged / subsumed into DTensor: https://dev-discuss.pytorch.org/t/rfc-pytorch-distributedten...

Lots of development and traffic happening here: https://github.com/pytorch/tau/

Re:Building the Future of TensorFlow by baggiponte on Friday October 21, 2022 @01:46PM (#33290878)
So is DTensor a Google thing like XLA or more of an open standard?
Re:Building the Future of TensorFlow by learndeeply on Friday October 21, 2022 @02:12PM (#33291198)
Looks like its just a name collision. It's a tensor used in distributed models, thus Distributed Tensor, or DTensor for short.
Re:Building the Future of TensorFlow by atty on Friday October 21, 2022 @04:33PM (#33292729)
Awesome thanks for pointing this out!