Jeff Dean’s Lecture for YC AI [video]

Re:Jeff Dean’s Lecture for YC AI [video] by deepnotderp on Monday August 07, 2017 @08:22PM (#14952408)

It's cute, but isn't going to completely obsolete ML/DL expertise. (And believe me, as a prospective supplier of DL compute, I would love for the answer to be "more compute").

To give you an idea of how much compute it took, they spent two million dollars for one run on a relatively toy dataset, CIFAR-10. Imagine how much it would take on an imagenet sized dataset! Can your company afford ~$20 million+ per dataset?

I do think that hyperparameter twiddling aspect might get automated, but believe me, that is much welcomed by the DL research community! I would much rather spend my time on new ideas rather than trying ten different initializations :)

[ Parent | on HN ]

Re:Jeff Dean’s Lecture for YC AI [video] by blueyes on Monday August 07, 2017 @08:34PM (#14952482)

Sure, but that's $2m of today's compute on today's chips. The constraints on chips and cost are moving, and Google is pushing them.

[ Parent | on HN ]

Re:Jeff Dean’s Lecture for YC AI [video] by deepnotderp on Monday August 07, 2017 @11:12PM (#14953721)

Sure, so it becomes ~$2 million for an imagenet scale dataset with TPUs and ~$200K with our chips. Still pretty expensive :)

[ Parent | on HN ]