Re:8 Google Employees Invented Modern AI. Here's the Inside ...
by Jensson on Wednesday March 20, 2024 @03:37PM
(#39771092)
> I cannot even understand what I do stands for in the context of your question
That he had a higher budget than he knew what to do with. When I worked at Google I could bring up thousands of workers doing big tasks for hours without issue whenever I wanted, for me that was the same as being infinite since I never needed more, and that team didn't even have a particularly large budget. I can see a top ML team having enough compute budget to run a task on the entire Google scrape index dataset every day to test things, you don't need that much to do that, I wasn't that far from that.
At that point the issue is no longer budget but time for these projects to run and return a result. Of course that was before LLMs, the models before then weren't that expensive.
Re:8 Google Employees Invented Modern AI. Here's the Inside ...
by bigcat12345678 on Wednesday March 20, 2024 @04:05PM
(#39771385)
Sure, your explanation just matches what I was imaging.
Neither the question nor the answer made any sense.
Re:8 Google Employees Invented Modern AI. Here's the Inside ...
by smolder on Wednesday March 20, 2024 @05:39PM
(#39772311)
I know a Google operations guy who has occasionally complained that the developers act like computing/network resources are infinite, so this made me chuckle.
Re:8 Google Employees Invented Modern AI. Here's the Inside ...
by ShamelessC on Wednesday March 20, 2024 @04:17PM
(#39771523)
Lighten up.
I worked at Borg
The quota system can kick in at whatever time the limits are reached.
And GPUs are scattered across borg cells, limiting the ceiling. That's why XBorg was created so that a global search among all Borg cells for researchers.
And data center Capex is around 5 billion each year.
Google makes hundres of billions of revenue each year.
You are asking what people would do in impossible situation. Like "what you do after you are dead", literally I could do nothing after I am dead.
I cannot even understand what I do stands for in the context of your question. The above is my direct reaction in the line that he assumes he had unlimited budget.