Smart Algorithms beat Hardware Acceleration for Large-Scale Deep Learning

Re:Smart Algorithms beat Hardware Acceleration for Large-Sca... by tkyjonathan on Friday March 06, 2020 @08:07AM (#22503236)

This is obvious to me. Since Hadoop came out, (a lot of) people have been giving up on even forming algorithms and just dumping data into machine learning and hoping for the best. I recall someone high up at Google complaining about it.

We need to get back to forming algorithms as well as concepts and first principles. We cannot and should not expect ML to brute force finding patterns and just sit back and relax.

Here is another prediction for you: we will not solve ray-tracing in games and movie CGI with more hardware. We will need some algorithm that gets us 80-90% of the way there in a smart way.

[ Parent | on HN ]

Re:Smart Algorithms beat Hardware Acceleration for Large-Sca... by taneq on Friday March 06, 2020 @08:36AM (#22503398)

This was my first thought. Well, to be more complete - smart algorithms beat dumb algorithms even if the dumb algorithms use hardware acceleration (unless the problem is trivial anyway.) Smart algorithms plus hardware acceleration beats smart algorithms on general purpose hardware. Smart algorithms are just better.

[ Parent | on HN ]