News for hackers. Stuff that matters.

A comment on Deep Neural Networks for YouTube Recommendations.

Re:Deep Neural Networks for YouTube Recommendations by Eliezer on Sunday September 04, 2016 @04:53PM (#12426662)
I noticed that YouTube's recommendations had suddenly gotten better! I wondered if they were using a new statistical approach, or had just started really optimizing at all because the old recommendations were extremely naive. I'm actually a little disappointed to find out that it might just be another deep learning thing. (Yes, it works, but I feel like you learn a little less about problem structure when what you read is mostly "we threw a generic function approximator and 30,000 hours of GPU time at it".)
[ Parent | on HN ]
Re:Deep Neural Networks for YouTube Recommendations by Rotonde on Sunday September 04, 2016 @05:15PM (#12426747)
That's curious, because in my opinion YouTube recommendations haven't been any good since 2009. Instead of getting interesting, strange and niche content, I'm bombarded with videos that have >100k views, feature clickbait titles and thumbnails and are generally incredibly low effort content.

Methods that work better for a population as a whole might not work better for a large subset of that population, and might even cause users to stop using features entirely. The lack of transparency in recommendation algorithms combined with the homogenizing effect of distributing low-quality content this way is something I find somewhat depressing.

[ Parent | on HN ]
Re:Deep Neural Networks for YouTube Recommendations by robinduckett on Sunday September 04, 2016 @05:31PM (#12426809)
Maybe those are just the videos that you're statistically more likely to watch through to the end based on your viewing history...
[ Parent | on HN ]
Re:Deep Neural Networks for YouTube Recommendations by alphydan on Sunday September 04, 2016 @06:14PM (#12426982)
Precisely. But that might be a local minimum. "Show him boobs and action trailers" is guaranteed to make him stay another 40min.

But perhaps there is a more risky strategy that takes longer to craft and actually delivers hours and hours of content to the user (but needs to fail longer before getting there).

[ Parent | on HN ]
Re:Deep Neural Networks for YouTube Recommendations by 5olidor on Sunday September 04, 2016 @06:59PM (#12427143)
It seems like reinforcement learning would be useful, i.e. at a high level, forming a policy for recommendations would require balancing exploration (experimenting with more risky recommendations) vs. exploitation (showing you recommendations that it knows will likely lead to clicks) and using the click-throughs, time spent watching the video, etc. as reward signals.

Does anyone know whether RL is used for recommendation in practical settings, and if so what is the current state of the art?

[ Parent | on HN ]
Re:Deep Neural Networks for YouTube Recommendations by pcovington on Sunday September 04, 2016 @08:15PM (#12427376)
This is a very natural avenue and an active area of research at Google/Deep Mind. Stay tuned...
[ Parent | on HN ]
Re:Deep Neural Networks for YouTube Recommendations by pcovington on Sunday September 04, 2016 @07:01PM (#12427151)
YouTube has used machine learning in recommendations for many years.

We have struggled with interpretability, both while debugging mistakes made by the system and exposing plausible "reasons" to users.

There was a fascinating discussion [1] about interpretability during a deep learning panel at KDD this year.

[1] https://www.youtube.com/watch?v=furfdqtdAvc#t=54m25s

[ Parent | on HN ]
Re:Deep Neural Networks for YouTube Recommendations by thomasahle on Sunday September 04, 2016 @05:10PM (#12426724)
Mine seem like they have gotten a lot more click-baity. I wonder if that's an artifact of their optimization goal.
[ Parent | on HN ]
Re:Deep Neural Networks for YouTube Recommendations by artifaxx on Sunday September 04, 2016 @05:20PM (#12426768)
If people fall for the click bait(they do), then they get more views from optimizing for it. It would be more surprising if an optimization algorithm for views didn't favor this.
[ Parent | on HN ]
Re:Deep Neural Networks for YouTube Recommendations by brokenmachine on Sunday September 04, 2016 @06:58PM (#12427138)
Probably some part of it is that there's more clickbait videos being created now, which is making them get more views.

It's a vicious clickbaity cycle.

[ Parent | on HN ]
Re:Deep Neural Networks for YouTube Recommendations by AndrewKemendo on Sunday September 04, 2016 @06:02PM (#12426935)
Throwing passive aggressive shade at what is current state of the art in machine learning is unwarranted.
[ Parent | on HN ]
Re:Deep Neural Networks for YouTube Recommendations by blahi on Monday September 05, 2016 @01:55AM (#12428405)
Please. Deep learning is cool and all and has its applications but state if the art inplies that it,s the best for everything when in reality is that they are just very good for a very little subset of problems.
[ Parent | on HN ]