News for hackers. Stuff that matters.
Re:Sam Altman Seeks Trillions of Dollars to Reshape Business... by jszymborski on Thursday February 08, 2024 @11:32PM (#39311420)
While I doubt OpenAI will be a good fit for semiconductors, my understanding is PyTorch and TensorFlow have been really good at embracing new accelerators, largely due to XLA.

PyTorch, TF, and JAX work great on TPUs. Adoption is low bc they are not really available outside the Google cloud.

Re:Sam Altman Seeks Trillions of Dollars to Reshape Business... by Cacti on Friday February 09, 2024 @09:00AM (#39314894)
I mean, it took almost a decade to get there.
Re:Sam Altman Seeks Trillions of Dollars to Reshape Business... by jszymborski on Friday February 09, 2024 @09:07AM (#39314970)
Right, but that was for XLA no? I think (not an expert) that it compiles code from franeworks into a lower-level IR.

That's gotta be way easier, no?

Re:Sam Altman Seeks Trillions of Dollars to Reshape Business... by coredog64 on Friday February 09, 2024 @06:48PM (#39321929)
AWS uses tricks to accelerate PyTorch with Inferentia/Trainium. Haven’t used it, but I have tried the equivalent for Apple silicon and rage quit after wasting half a day.