News for hackers. Stuff that matters.
Re:Google Cloud TPU Multislice Training by leumassuehtam on Friday November 10, 2023 @02:44PM (#38223570)
Did they use this to train Gemini? Which raises the question, where is Gemini?
Re:Google Cloud TPU Multislice Training by lern_too_spel on Friday November 10, 2023 @04:01PM (#38224480)
Unlikely. One reason Google Cloud is so terrible is that nobody in Google actually uses Google Cloud. It used to be that every time I mentioned this, somebody would jump in and say, "Well actually, Google Domains runs on Google Cloud," and we'd discuss whether Google Domains was a business critical part of Google. https://support.google.com/domains/answer/13689670?hl=en
Re:Google Cloud TPU Multislice Training by amf12 on Friday November 10, 2023 @04:59PM (#38225091)
> Unlikely. One reason Google Cloud is so terrible is that nobody in Google actually uses Google Cloud.

Well, actually, Google Cloud is just an abstraction on top of internal Google infra, so this isn't the right question. So, it depends on what you want to infer/compare.

Re:Google Cloud TPU Multislice Training by lern_too_spel on Friday November 10, 2023 @10:58PM (#38227497)
> Well, actually, Google Cloud is just an abstraction on top of internal Google infra

I didn't say otherwise. Of course Google Cloud runs on internal Google infrastructure. They wouldn't have an entirely different stack to build Google Cloud on. The problem is that Googlers don't use Google Cloud.

Amazonians use AWS. https://courses.cs.washington.edu/courses/cse452/23wi/papers...

Microsofties use Azure. https://www.zdnet.com/article/microsoft-moves-closer-to-runn...

Re:Google Cloud TPU Multislice Training by danielmarkbruce on Friday November 10, 2023 @11:30PM (#38227638)
It is the right question. It's the right question because Google doesn't dogfood Google Cloud like they should/could. Dogfooding a bunch of stuff at a lower level of abstraction isn't the same thing.
Re:Google Cloud TPU Multislice Training by tdullien on Saturday November 11, 2023 @01:16AM (#38228021)
Xoogler here. GCP was not an abstraction on Borg when I was there. GKE isn't either.

So up until late 2018 when I left, very little of Cloud ran on "proper" Google3 infra. This may have shifted slightly (cloud has been fishing for good Google infra to externalize a lot), but in general cloud!=google3 infra.

Re:Google Cloud TPU Multislice Training by milesward on Friday November 10, 2023 @06:00PM (#38225732)
Lots of stuff inside Alphabet runs on GCP. And yes, Google Domains pisses me off.
Re:Google Cloud TPU Multislice Training by lern_too_spel on Friday November 10, 2023 @11:00PM (#38227500)
If anything important ran on Google Cloud, you can bet we'd see a blog post from Google Cloud marketing about that. Yes, many of the money losing side bets from the non-Google companies under the Alphabet umbrella use Google Cloud. That's only because they want the optionality to spin them off if by some miracle any of them are ever worth anything. If they were part of Google, they would use internal infrastructure. If they weren't under Alphabet, they would use AWS or Azure like everyone else.
Re:Google Cloud TPU Multislice Training by antifa on Friday November 10, 2023 @10:47PM (#38227460)
They also announced Claude 2 back in August, but AFAICT there's currently no way to get API access to Claude 2.