News for hackers. Stuff that matters.

A comment on Jeff Dean’s ML System Architecture Blueprint. Parent comment

Re:Jeff Dean’s ML System Architecture Blueprint by seanmcdirmid on Friday July 27, 2018 @02:23AM (#17623882)
I heard that Google was actually late to the game on this, not realizing the value of GPUs over (just) distributed computing when the DNN trend started. Now they even have custom silicon...
[ Parent | on HN ]
Re:Jeff Dean’s ML System Architecture Blueprint by daviddumenil on Friday July 27, 2018 @10:26PM (#17631156)
I think it was more a case that Google had a large existing investment in CPU-based compute.

A lot of Dean's initial work was getting models effectively training on that kind of hardware using distributed SGD.

[ Parent | on HN ]