News for hackers. Stuff that matters.
Re:The Facebook Algorithm Mom Problem by ryanbrunner on Wednesday July 12, 2017 @01:37PM (#14754602)
I find a lot of sites feel like they're overtuning their recommendation engines, to the detriment of using the site. YouTube is particularly bad for this - given the years of history and somewhat regular viewing of the site, I feel like it should have a relatively good idea of what I'm interested in. Instead, the YouTube homepage seems myopically focused on the last 5-10 videos I watched.
Re:The Facebook Algorithm Mom Problem by cameldrv on Wednesday July 12, 2017 @08:02PM (#14757722)
The problem is the economics of the Internet today. Most sites are ad-funded. They need to maximize pageviews and time on site. The recommender is a huge part of accomplishing that, and it simply won't be tuned to any metric other than maximizing revenue. The solution would be to reskin popular sites with recommenders that had other objectives, such as retrospective satisfaction with time spent. Unfortunately sites know that if they give up control of the UI through an API that is open, they will lose money when people do things like this.

I really think we're entering a crisis here where sites and apps that are engineered to maximize corporate metrics are leading people down horrible paths of addiction, and psychic stress as they spend their mental energy resisting temptations constantly thrown at them.

Re:The Facebook Algorithm Mom Problem by phs318u on Thursday July 13, 2017 @04:48AM (#14759746)
Thought just occurred: would I be willing to pay a subscription to have the recommender tuned to remove revenue maximisation and site-addiction maximisation? Would anyone?

I've made plenty of "remove ads" in-app purchases on my phone. This isn't too different. And it might actually result in a truly useful experience.

Re:The Facebook Algorithm Mom Problem by dandare on Thursday July 13, 2017 @07:06AM (#14760287)
There may be public relations problem - users these days understand that ads pay the bills and don't see them as a moral compromise but try to explain to your users that they can pay premium to get relevant recommendations instead of "spam".
Re:The Facebook Algorithm Mom Problem by coolsdude2282 on Thursday July 13, 2017 @10:29PM (#14766981)
I've said the same thing many many times, I can't remember the numbers but the monetization of facebook data per person (If I remember correctly from something I read a year back, I'll try to look and add it to this comment) is less than 20$!

I would be very very willing to pay for Facebook to simply not be tracked, especially at such a reasonable price. I know that won't happen, but I'd really love such a thing.

Re:The Facebook Algorithm Mom Problem by eru on Sunday July 16, 2017 @01:39PM (#14783146)
It's only so low, because those are averages. The people willing to pay the twenty bucks might be exactly the ones that drive up the average, so they don't want to lose them.
Re:The Facebook Algorithm Mom Problem by jrimbault on Thursday July 13, 2017 @08:33AM (#14760711)
In the case of Youtube, it could be part of the Youtube Red package.
Re:The Facebook Algorithm Mom Problem by travmatt on Thursday July 13, 2017 @11:55AM (#14762349)
What you're saying reminds me of http://www.timewellspent.io/
Re:The Facebook Algorithm Mom Problem by wruza on Thursday July 13, 2017 @02:58AM (#14759283)
They can at least do right recommendations if adblock detected.
Re:The Facebook Algorithm Mom Problem by eat_veggies on Thursday July 13, 2017 @07:49AM (#14760504)
That incentivizes using adblockers though, and given that ads are pretty much YouTube's entire business model, that would be nice for you but terrible for the business.

However, they do charge money per month for YouTube Red which removes ads, and a better recommendation system for Red subscribers might encourage people to buy it.

Re:The Facebook Algorithm Mom Problem by Semaphor on Wednesday July 12, 2017 @01:47PM (#14754719)
I'm not sure if it is because of weird tastes or something else. But for sites like Steam, YT, Netflix I always wish for more tuning parameters because their recommendations are all horrible.

On Netflix, for example, I get recommended stuff that's similar to other things I didn't like.

Amazon is often the best of them for books because their engine seems to only really value the last few things I looked at / bought and so just recommends really similar stuff. Of course, that fails hard whenever I look at something I'm not interested in for whatever reason.

On Steam I wish they had some elaborate filtering system, there are so many games, I need something like NOT(Adventure+Puzzle) BOOST(RPG), I need to combine tags, not just filter them out by themselves.

Re:The Facebook Algorithm Mom Problem by unoti on Wednesday July 12, 2017 @05:51PM (#14757014)
> for sites like Steam, YT, Netflix I always wish for more tuning parameters because their recommendations are all horrible.

The problem with those recommendation engines is that they're not optimized to serve your needs. They're optimized to serve the goals of their respective companies. And the problem comes when your needs are a little incompatible with the needs of the company.

Consider Netflix for example. Their recommendations don't seem to care much about what you actually enjoy the most. They pay different amounts of money to let you watch different content. So your goal of watching the thing you would enjoy the most is different from whatever the hell their goals are-- probably to get you to watch just enough Netflix to make you not want to cancel your subscription, but not run up their bills on bandwidth and licensing fees.

I'm absolutely confident Netflix could make amazing recommendations-- and probably already has them internally. But it's not in their best interest to give recommendations that are in your best interest.

To the extent that I'm right about this it could be a market opportunity to make an honest and useful recommendation service.

Re:The Facebook Algorithm Mom Problem by sgustard on Wednesday July 12, 2017 @06:58PM (#14757400)
Netflix has a tiny catalog, so investing in making recommendations from that tiny catalog is mostly wasted. Half of Netflix's business now is House of Cards, so their entire algorithm consists of recommending House of Cards to people who haven't watched it yet, and random content to the others.
Re:The Facebook Algorithm Mom Problem by theseatoms on Wednesday July 12, 2017 @06:35PM (#14757256)
> They're optimized to serve the goals of their respective companies. And the problem comes when your needs are a little incompatible with the needs of the company.

Ultimate they are compatible though. And yes I mean in the econ 101 way. This tension should be at least partially resolved via pricing scheme innovation.

Re:The Facebook Algorithm Mom Problem by eru on Sunday July 16, 2017 @01:41PM (#14783166)
Pricing scheme innovation, and just plain iterated interaction and long term reputation.
Re:The Facebook Algorithm Mom Problem by watwut on Thursday July 13, 2017 @07:48AM (#14760501)
Steam would earn more from me if I did not closed it frustrated every time I wanted to buy game. I literally did not bought game because there was no way to filter out stuff I don't like (well defined category in this case).
Re:The Facebook Algorithm Mom Problem by chiefalchemist on Wednesday July 12, 2017 @09:00PM (#14758022)
It's worth noting that satisfaction is also a function of perception. Did you enjoy the movie? Yeah, probably. But then you think about all the possibilities, a small number of which would naturally be better, and an acceptable film fades towards unacceptable.

Regardless of how good the recommendation engine might be, it's still always subject to human perception. That can be unpredictable and fickle, on a good day :)

Re:The Facebook Algorithm Mom Problem by kerbalspacepro on Wednesday July 12, 2017 @03:00PM (#14755498)
Regarding Amazon:

"Oh, you bought a wallet? Here are twenty wallets of the exact same type but with slightly different colors that you might want to buy, too"

Re:The Facebook Algorithm Mom Problem by lostphilosopher on Wednesday July 12, 2017 @04:22PM (#14756289)
"Amazon seems to think my recent purchase of an air conditioner was just the gateway to an air conditioner collecting hobby."

That's probably not exact and I don't remember where in my social feeds it came from, but I loved this.

Re:The Facebook Algorithm Mom Problem by badwolf on Wednesday July 12, 2017 @03:58PM (#14756072)
Buy a Dyson vacuum cleaner on Amazon... For the next several weeks Amazon thinks I've taken up the popular hobby of collecting vacuum cleaners
Re:The Facebook Algorithm Mom Problem by vacri on Wednesday July 12, 2017 @08:37PM (#14757913)
I once clicked on a 'russian bride' google ad for a laugh, quite a while back. Google still puts lots of russian and filipino bride ads into my 'bubble' to this day...
Re:The Facebook Algorithm Mom Problem by marcuslager on Wednesday July 12, 2017 @11:10PM (#14758454)
You can remove "mistakes" like that from your Google history pretty easily.
Re:The Facebook Algorithm Mom Problem by inopinatus on Wednesday July 12, 2017 @05:47PM (#14756990)
To give some justice to the algorithm, after purchasing my first Dyson I wanted to replace all my vacuum cleaners with Dysen.
Re:The Facebook Algorithm Mom Problem by tgb on Wednesday July 12, 2017 @05:56PM (#14757034)
How many vacuum cleaners do you have?
Re:The Facebook Algorithm Mom Problem by barking on Wednesday July 12, 2017 @07:56PM (#14757695)
One per house, like everyone else!
Re:The Facebook Algorithm Mom Problem by TheRealDunkirk on Thursday July 13, 2017 @11:53AM (#14762326)
Plebeian.

One per floor per house, of course. You don't want to have to carry them up and down stairs.

Re:The Facebook Algorithm Mom Problem by cestith on Thursday July 13, 2017 @07:40PM (#14766236)
Nouveau riche.

All houses should have one floor. Why use stairs or elevators when you can just buy more land?

Re:The Facebook Algorithm Mom Problem by inopinatus on Thursday July 13, 2017 @10:46PM (#14767045)
The staff are downstairs, and they have their own cleaning equipment.
Re:The Facebook Algorithm Mom Problem by freehunter on Wednesday July 12, 2017 @07:55PM (#14757691)
Not the same person, but I have three. I have a roomba for everyday sweeping, a Bissell for actually cleaning the carpets not just sweeping them, and a Black and Decker handheld for the stairs, the car, and other places it's hard to take a full vacuum or a robot.
Re:The Facebook Algorithm Mom Problem by nkrisc on Wednesday July 12, 2017 @04:14PM (#14756220)
My Amazon homepage is full of stuff I already own. Even worse is their internet-wide remarketing makes it so I see stuff I own on many of the sites I visit.

There was however one moment where Amazon got it right: they recommended to me a book that only a week earlier I had purchased on a whim from an independent bookstore with cash. Creepy good.

Re:The Facebook Algorithm Mom Problem by wfunction on Wednesday July 12, 2017 @06:32PM (#14757240)
> There was however one moment where Amazon got it right: they recommended to me a book that only a week earlier I had purchased on a whim from an independent bookstore with cash. Creepy good.

That is creepy. Any way it might've been more than just a coincidence?

Re:The Facebook Algorithm Mom Problem by nkrisc on Thursday July 13, 2017 @09:46AM (#14761131)
It's possible, but it was a book in a relatively unusual niche that I have a hobbyist interest in. It was a book about the archaeological and linguistic study of proto-Indo-European people (PIE) and their origins and spread by means of horses and the, at the time novel, wheels. I had previously purchased a book or two on linguistics from Amazon so perhaps there is only a small set of popular books in that category for their recommendation algorithm to pick from.
Re:The Facebook Algorithm Mom Problem by wfunction on Thursday July 13, 2017 @04:01PM (#14764666)
Ah, yeah, that would explain it. Thanks!
Re:The Facebook Algorithm Mom Problem by hohenheim on Thursday July 13, 2017 @09:22AM (#14760976)
Well there was this sometime ago: https://news.ycombinator.com/item?id=14406583

Though that was Google.

Re:The Facebook Algorithm Mom Problem by wlesieutre on Wednesday July 12, 2017 @03:05PM (#14755563)
I told this story in the recent Amazon recommendations discussion, but I bought a pair of speaker stands from them and before it was even delivered they sent me an email saying "HEY BASED ON YOUR BROWSING HISTORY MAYBE YOU'D LIKE THESE OTHER 10 SPEAKER STANDS!"
Re:The Facebook Algorithm Mom Problem by jon_richards on Wednesday July 12, 2017 @03:19PM (#14755692)
I've heard the argument that this prevents buyer's remorse. Not sure if it has any merit.
Re:The Facebook Algorithm Mom Problem by CodeCube on Wednesday July 12, 2017 @04:18PM (#14756259)
wait, wouldn't this cause buyer's remorse? like, if I just finally decided to buy some product ... being bombarded with all the other options suddenly makes me rethink my purchase decision, "oh but what if this other one is more gooder!?!?!"
Re:The Facebook Algorithm Mom Problem by jon_richards on Wednesday July 12, 2017 @05:01PM (#14756644)
I think the argument is cognitive dissonance and confirmation bias generally function to make you more happy with the one you bought already when presented with other alternatives.
Re:The Facebook Algorithm Mom Problem by chongli on Thursday July 13, 2017 @01:33AM (#14758952)
I thought that cognitive dissonance was the buyer's remorse. I've experienced that a few times in my life. Now I've got no qualms about immediately taking stuff back.
Re:The Facebook Algorithm Mom Problem by sogen on Wednesday July 12, 2017 @04:50PM (#14756543)
Exactly my thoughts, you might see there something with better/more reviews.
Re:The Facebook Algorithm Mom Problem by differonzi on Wednesday July 12, 2017 @03:46PM (#14755944)
What are the (general) financial consequences of buyer's remorse?
Re:The Facebook Algorithm Mom Problem by njarboe on Wednesday July 12, 2017 @04:03PM (#14756119)
For Amazon with a generous return policy, when a person has buyer's remorse, they can return the item. Lost sale.
Re:The Facebook Algorithm Mom Problem by maxxxxx on Wednesday July 12, 2017 @04:33PM (#14756392)
Funny story:

A while ago I took an Ayurveda class (Indian medicine) and part of it was doing an oil enema. There are devices for this that are also used by a certain population for sexual pleasures. Bought one on Amazon and for months I couldn't show my Amazon page to other people because it was filled with sex toys....

Re:The Facebook Algorithm Mom Problem by birdman3131 on Wednesday July 12, 2017 @05:30PM (#14756875)
It is possible to delete things from your amazon history. https://www.amazon.com/gp/history
Re:The Facebook Algorithm Mom Problem by type0 on Wednesday July 12, 2017 @05:57PM (#14757041)
And the lesson here would be not to get involved with Ayrveda.
Re:The Facebook Algorithm Mom Problem by freehunter on Wednesday July 12, 2017 @07:57PM (#14757704)
Or more specifically, not pour random fluids into your butt for some mystical health benefit. Only for pleasure.
Re:The Facebook Algorithm Mom Problem by maxxxxx on Wednesday July 12, 2017 @09:39PM (#14758168)
Actually I would recommend it. It's quite nice :-)
Re:The Facebook Algorithm Mom Problem by Semaphor on Thursday July 13, 2017 @07:03AM (#14760268)
My favorite sleeping mask is made by Joy Division, a blindfold sold as a sex toy. When I replace it every 1-2 years (or earlier in case I was on a flight…) my Amazon page is full of sex toys ;)
Re:The Facebook Algorithm Mom Problem by lostlogin on Thursday July 13, 2017 @02:09PM (#14763677)
How do they get away with that brand name?
Re:The Facebook Algorithm Mom Problem by drizzzler on Wednesday July 12, 2017 @08:31PM (#14757875)
lol
Re:The Facebook Algorithm Mom Problem by afarrell on Wednesday July 12, 2017 @05:34PM (#14756909)
The fact that Amazon doesn't have a way to recommend complimentary products ("oh, you just bought a tent? You probably want some bug spray") boggles.
Re:The Facebook Algorithm Mom Problem by fletchowns on Wednesday July 12, 2017 @05:46PM (#14756980)
Isn't that what the "frequently bought together" suggestions are?
Re:The Facebook Algorithm Mom Problem by freehunter on Wednesday July 12, 2017 @07:58PM (#14757708)
Yeah but they should show that in the recommendations, not just when I'm at the product page.
Re:The Facebook Algorithm Mom Problem by Semaphor on Wednesday July 12, 2017 @03:25PM (#14755758)
For books this works pretty well for me as I tend to read genres in bursts. If I just read a scifi books, I'll read a bunch more before going back to fantasy ;)
Re:The Facebook Algorithm Mom Problem by ballenf on Wednesday July 12, 2017 @05:29PM (#14756863)
The equivalent for books would be "you might like this paperback copy or a large print version of the book you just purchased along with 3 other editions!"
Re:The Facebook Algorithm Mom Problem by patmcguire on Wednesday July 12, 2017 @04:24PM (#14756309)
It's probably correct by expected value. You're just not the multiple wallet type. I'm sure there are people who'd want five wallets, eight different shoe styles, multiple cuts of pants...

Your indifference is subsumed in the sheer size of others' consumption.

Re:The Facebook Algorithm Mom Problem by kerbalspacepro on Thursday July 13, 2017 @10:50AM (#14761704)
You're right that there are categories of products that this absolutely works. When I buy clothes, books, media... even tech, then I probably will buy something related. But there are some "one-off" purchases that Amazon doesn't need to hound be about.
Re:The Facebook Algorithm Mom Problem by phkahler on Wednesday July 12, 2017 @05:07PM (#14756695)
Dude it's a wallet not a coach purse.
Re:The Facebook Algorithm Mom Problem by freehunter on Wednesday July 12, 2017 @08:02PM (#14757724)
I have multiple wallets. I have one I take on business trips that contains my work ID, American Express, business cards, etc. All stuff I normally don't carry with me. I have an everyday wallet with cash and my bank card and stuff I need everyday. And if I'm dressing up, I don't want to ruin the lines of my suit so I have a far slimmer wallet that just has my ID and space for one credit card.

I mean I'm not accessorizing with the latest seasonal fashions, but there are utility reasons to change the kind of wallet you're carrying for different purposes.

Re:The Facebook Algorithm Mom Problem by crowbahr on Wednesday July 12, 2017 @02:31PM (#14755189)
Netflix, I think, has killed their own recommendation algorithm when they removed stars and made it boolean. I don't know if those buttons even do anything anymore because I think they're just matching based off demographic and who they're trying to market to now. It's recommending shows that I never would watch in a million years and giving them high matches despite me disliking most similar shows just because I'm a 20-something male.
Re:The Facebook Algorithm Mom Problem by fritzw on Wednesday July 12, 2017 @04:31PM (#14756371)
I think Netflix probably did it because people are inherently bad at being objective. For the average person, 2 stars for a movie and 4 for another isn't based on anything measurable, even they couldn't explain. I'm shocked at some of the amazon product reviews, most of which are 5 star reviews even if the product is absolutely terrible. Movies are different than products, but it's the same people doing the reviewing. Remember, the average user is not a thinking analytical HN user. Average people are much better at bool choices.

Whether the buttons do anything, I have no idea

Re:The Facebook Algorithm Mom Problem by ballenf on Wednesday July 12, 2017 @05:33PM (#14756898)
I know I'm in the minority here, but I am a big fan of the new system. I would torture myself trying to decide between, e.g., 3 or 4 stars for movie. And then go back and re-rate other movies that I realized I liked more but rated lower than the just-rated movie.

Their % match numbers are fairly accurate, but I have had to go into the watch history and delete the occasional movie watched and finished that we actually hated. No number of 1-stars (or thumbs downs) would eradicate its effects on the recommendations.

Re:The Facebook Algorithm Mom Problem by jimbobimbo on Wednesday July 12, 2017 @07:36PM (#14757596)
My system was (and is, in DVDs):

  5 - Absolutely loved it, will buy a disc
  4 - Good, but won't buy a disc
  3 - Movie was okay
  2 - Not a good movie
  1 - Stopped watching 20 minutes into it
My problem with binary choice is that 1 == 2 and 3 == 4 == 5, whilst 1 and 5 were very special for me. :(
Re:The Facebook Algorithm Mom Problem by nol13 on Wednesday July 12, 2017 @07:35PM (#14757593)
Plus the scale bias differing vastly between people and cultures makes the data a mess. Like say or me a 5 means 100% perfect, Why discreet choice stuff is all the rage in the market research world. (unless that's changed in last few years)

Asking people "which of these 3 things you like best" vs. "rate these 3 things 1-5" will usually give you much more useful data, plus be easier for respondents.

Re:The Facebook Algorithm Mom Problem by JacobiX on Wednesday July 12, 2017 @06:47PM (#14757341)
Popular recommendation algorithm like collaborative filtering by matrix factorization takes into account the accounts for user and item biases (the simplest method is to normalize the ratings of a particular user by the average of ratings of that user).
Re:The Facebook Algorithm Mom Problem by tomc1985 on Thursday July 13, 2017 @09:14PM (#14766717)
Couldn't you control for that by weighting people's ratings by the range in which they provide them? Like weighting a 5-star review a bit more from someone who averages 3's than someone whose ratings average 4's? Far from perfect sure but I bet it could save a lot of results from needing to be thrown out.
Re:The Facebook Algorithm Mom Problem by thinkingemote on Wednesday July 12, 2017 @05:59PM (#14757050)
With stars you can cross compare with others to see if they have the same score. With simple thumbs up recommendations you cannot compare the ratings as the score is whether it appears to you or not.
Re:The Facebook Algorithm Mom Problem by eru on Sunday July 16, 2017 @05:14PM (#14784141)
If what you say is true, that's an argument in favor of eg aggregating via median instead of average.
Re:The Facebook Algorithm Mom Problem by fitzroy on Wednesday July 12, 2017 @03:41PM (#14755902)
I have to wonder if Netflix did this because a lot of their original or exclusive content seems to debut to mediocre star ratings. When the new system says "x% match" I assume that value is derived more from genre match or search relevance than whether I'll actually like it or not.
Re:The Facebook Algorithm Mom Problem by swenn on Wednesday July 12, 2017 @03:18PM (#14755687)
Interesting experience, I recently read an article that gave me the impression that they rather improved the system.

Excerpt from https://www.appcues.com/blog/rating-system-ux-star-thumbs/

"In addition to the new rating system, Netflix has new match percentages (up to 100%) to more accurately predict how much users will like something.

...

The new rating system received 200% more ratings in A/B tests, according to Netflix VP of Product Todd Yellin.

When it comes to rating movies and shows, stars reflect the preferences that people want to have, rather than how people actually behave. Todd gave the example of users giving 5 stars to a documentary but just 3 stars to an Adam Sandler movie that they watched over and over again. “What you do versus what you say you like are different things,” said Todd."

Re:The Facebook Algorithm Mom Problem by dkarl on Wednesday July 12, 2017 @04:29PM (#14756357)
If Netflix was trying to ensure that what I was mostly likely to watch next had the highest star rating, no wonder they gave up on it. Our opinion of the quality of something is not a good predictor of our likelihood of watching it.

Their users are surely not confused about that. So why does Netflix want to present a prediction as a rating? Is it to flatter their users by telling them that the thing that feels instantly gratifying right now is actually an amazing movie? "Hey, great choice. Billy Madison is a five-star movie. What? Why would you feel bad about not watching Raging Bull instead? It's a two-and-a-half star movie at best."

In other words, Netflix, like Facebook, like Doritos, is engineering itself for maximum addictiveness without regard for honesty. It will shelter you from even what you know and reassure you that whatever triggers a pleasure response in your brain is the best. Relax and enjoy it.

The truth is that we consume easy things a lot more often than we challenging things. It would be exhausting otherwise. But the best things are often the most challenging. We know that, we know that easy movies are just a way to kill time, but Netflix wants to do us the service of helping us forget it, because then we might be 1% more at ease when we watch Netflix and 1% less likely to switch to another service.

Re:The Facebook Algorithm Mom Problem by scythe on Wednesday July 12, 2017 @03:29PM (#14755787)
>When it comes to rating movies and shows, stars reflect the preferences that people want to have, rather than how people actually behave. Todd gave the example of users giving 5 stars to a documentary but just 3 stars to an Adam Sandler movie that they watched over and over again. “What you do versus what you say you like are different things,” said Todd."

There's a reasonable objection to this behavioral definition of "like", which is that it doesn't actually make people's lives better, it just fills them with more compulsive behavior. It's not necessarily "irrational" to wish you were more patient, or to want to ask Netflix to show you useful things rather than useless fluff. That you occasionally betray your stated goals does not mean you should be denied the right of self-definition.

In other words, what people say they like is more important, to me at least. See eg "Thinking Fast and Slow" by Kahneman.

Re:The Facebook Algorithm Mom Problem by ryanmaclean on Wednesday July 12, 2017 @03:13PM (#14755641)
I can't agree more - I'm a huge proponent for star rating systems. I get that they are perhaps more complicated than a Boolean value, but they help me out personally.

I miss the days of "tap tap scroll four clicks" on the iPod to help me rate new music, specifically.

Re:The Facebook Algorithm Mom Problem by freehunter on Wednesday July 12, 2017 @08:06PM (#14757742)
Thumbs up/down might not be the best for training a recommendation engine, but as someone who just switched his product's rating system from 1-5 to simple up/down, let me tell you: people have no idea how to use a star rating system. I would get people raving but leave a 1 star review, some people would leave a 5 star review and say bad things, some would leave a 1 star review but seem pretty neutral in their review.

A person is smart. People in general are dumb.

Re:The Facebook Algorithm Mom Problem by jandrese on Wednesday July 12, 2017 @03:00PM (#14755497)
Netflix's recommendation system is only good at recommending Netflix shows now.
Re:The Facebook Algorithm Mom Problem by alistairSH on Wednesday July 12, 2017 @03:12PM (#14755634)
Or movies I watched last week. Sigh.
Re:The Facebook Algorithm Mom Problem by chiefalchemist on Wednesday July 12, 2017 @08:56PM (#14758006)
All the technology hype aside, it often feels as if these feed prediction algorithms are akin to weather forecasting. That is, there not forecasting per se, but taking educated guesses based on some set of knowns. The problem is correlation is not cause.
Re:The Facebook Algorithm Mom Problem by softawre on Wednesday July 12, 2017 @05:35PM (#14756921)
Steam itself doesn't have filtering like that but third-party sites do. Try: https://steamdb.info/
Re:The Facebook Algorithm Mom Problem by Semaphor on Thursday July 13, 2017 @07:09AM (#14760301)
Yeah, I know steamdb. Didn't know they had such a search though and looking there I can't find it, got a direct link?
Re:The Facebook Algorithm Mom Problem by c3534l on Wednesday July 12, 2017 @06:20PM (#14757181)
Part of that trend is because recommendation algorithms aren't all that interested in making recommendations anymore. They're interested in getting sales or views. To do this, they use dumber algorithms that are easier to understand ("people who bought this also bought...") and over-value recency. They're not helping you find new content, they're trying to prolong the time you're on youtube.
Re:The Facebook Algorithm Mom Problem by revmoo on Wednesday July 12, 2017 @07:04PM (#14757439)
I have been paid to write an algorithm like this. It matched you to relevant content, but then a manually configured weighting table would skew results to more popular sources. It went as far as taking into account the number of leads we had sent each partner that month as a percentage of their quota
Re:The Facebook Algorithm Mom Problem by ThrustVectoring on Wednesday July 12, 2017 @01:51PM (#14754767)
Youtube is definitely over-weighing the last few videos. Then again, it's likely optimized for a different market segment. Especially with how many children are given tablets. Like, brief intense fascination with many subjects in general is genuinely hard to optimize for, especially when a huge portion of your market has long-lasting intense fascination with a few subjects.
Re:The Facebook Algorithm Mom Problem by samatman on Wednesday July 12, 2017 @07:34PM (#14757590)
This is often the behavior I want. I frequently queue up a song on YouTube and then let it keep auto-playing, if I hit one I don't care for I usually select off the sidebar of recommendations.

This only works because YouTube stays focused on what you're doing without trying to build a bigger picture of who you are. It would be nice if it could somehow do both, but I don't have a clear picture of how that UI would function.

Re:The Facebook Algorithm Mom Problem by thinkingemote on Wednesday July 12, 2017 @06:04PM (#14757084)
YouTube's home page system is quite hackable in a way, but you need to use the search or other recommended videos to change your viewing pattern.

In other words it doesn't consider you as someone with a long history. You can change your profile from a conservative to a liberal in a few hours watching videos. Whether it's possible to have a balanced amount of crazy ( not the same as a centrist) is something I'm currently working on, it requires effort!

Re:The Facebook Algorithm Mom Problem by rhizome on Wednesday July 12, 2017 @01:55PM (#14754813)
YouTube would rather you fall into a trance of continuing your recent viewing habits rather than providing a personalized library. It just makes better business sense.
Re:The Facebook Algorithm Mom Problem by icebraining on Wednesday July 12, 2017 @03:22PM (#14755718)
Why does it make better business sense?
Re:The Facebook Algorithm Mom Problem by quadrangle on Wednesday July 12, 2017 @03:58PM (#14756073)
Because they aren't trying to help you enjoy videos over the long-term, they're trying to keep you from going over to Facebook where their addictive algorithm will take over and reduce your likelihood of returning to YouTube!

It's a classic race-to-the-bottom. If YouTube lets Facebook keep you addicted, you won't get to the long-term.

http://timewellspent.io/ is good for perspective

Re:The Facebook Algorithm Mom Problem by icebraining on Wednesday July 12, 2017 @05:53PM (#14757026)
Yes, but that has an unspoken assumption that recent habits are more additive than longer term ones. I find that suspect; after all, you've already shown that you'll go back again and again to these kinds of videos, whereas you might spend a couple of hours watching a bunch of videos of a kind that you'll never be interested in again.

Personally, I find YouTube terrible at keeping me engaged. Even when I want to keep watching videos, their sidebar fails to show me anything I want to click on at least 1/3 of the times.

Re:The Facebook Algorithm Mom Problem by rhizome on Wednesday July 12, 2017 @07:02PM (#14757427)
Yes, but that has an unspoken assumption that recent habits are more additive than longer term ones

This is too fine a point. A user will "select" a default choice by doing nothing, and it's in YT's interests to provide default choices that reward the company. This has been researched for decades and is supported by, among other things: https://en.wikipedia.org/wiki/Status_quo_bias

Re:The Facebook Algorithm Mom Problem by quadrangle on Thursday July 13, 2017 @09:19PM (#14766734)
You could be exceptional or the algorithms might just be shitty at their intended purpose. Lots of possibilities.
Re:The Facebook Algorithm Mom Problem by marksc on Wednesday July 12, 2017 @04:06PM (#14756155)
It probably massively increases average time on site and average videos viewed, and thus ad revenue.
Re:The Facebook Algorithm Mom Problem by rhizome on Wednesday July 12, 2017 @05:05PM (#14756671)
Because if e.g. you watch a Tool video, the ad rates for you watching a Korn video after that are higher than if you watch a Zeni Geva one. Alternatively, Kesha > Lady Gaga vs. Kesha > Joni James. Unscientific, but it comports with conventional wisdom with regard to fiduciary duties to stockholders.
Re:The Facebook Algorithm Mom Problem by icebraining on Wednesday July 12, 2017 @05:57PM (#14757042)
Because if e.g. you watch a Tool video, the ad rates for you watching a Korn video after that are higher than if you watch a Zeni Geva one

But why? If I've watched hundreds of Zeni Geva videos over the years, but it's my fifth Tool video, why would I be more likely to click on a ad on a Korn video?

Re:The Facebook Algorithm Mom Problem by rhizome on Wednesday July 12, 2017 @06:54PM (#14757381)
It's not that they think you'll be more likely, it's that they rather you did, so the suggestion emerges. Recommendation engines are a funnel for revenue.
Re:The Facebook Algorithm Mom Problem by hyperdunc on Wednesday July 12, 2017 @11:12PM (#14758457)
What doesn't make good business sense is filling my feed with videos I've already seen!
Re:The Facebook Algorithm Mom Problem by russdill on Wednesday July 12, 2017 @02:38PM (#14755255)
If I watch a video I ended up not being interested in, I delete it from my watch history to avoid YouTube spamming me.
Re:The Facebook Algorithm Mom Problem by Consultant32452 on Wednesday July 12, 2017 @05:14PM (#14756750)
Hulu is the worst for this. Fall asleep watching a show I like, wake up with random shit in my queue that I can't convince Hulu I don't want to watch.
Re:The Facebook Algorithm Mom Problem by hk__2 on Wednesday July 12, 2017 @03:03PM (#14755527)
Can’t you "dislike" it instead?
Re:The Facebook Algorithm Mom Problem by CaptSpify on Wednesday July 12, 2017 @03:09PM (#14755610)
I constantly get recommended more videos for something I dislike
Re:The Facebook Algorithm Mom Problem by patmcguire on Wednesday July 12, 2017 @04:29PM (#14756350)
If you're hate-watching, you're still watching.
Re:The Facebook Algorithm Mom Problem by cestith on Thursday July 13, 2017 @07:50PM (#14766306)
As largely a geeky population, perhaps we do need to accept that our interests are more varied and often actually more intense than those of the average person. Being mildly amused by every fart joke movie available for some people is more rewarding than watching an emotionally challenging drama, a thoughtful comedy, and eight documentaries about four topics.
Re:The Facebook Algorithm Mom Problem by watwut on Thursday July 13, 2017 @11:05AM (#14761867)
It is not all that bad. If I listened to three metal songs last few videos, I am likely to want some more metal in the next one. I am unlikely to want jazz or comedy sketch or kiddy cartoon (despite these being seen from my account last few days).
Re:The Facebook Algorithm Mom Problem by vidarh on Wednesday July 12, 2017 @02:03PM (#14754906)
But there ought to be no reason for them to be unable to at least roughly cluster users into segments based on viewing habits as well as topics.

Of course it's possible they have, and realised they still make more money by focusing on the more recent videos.

Re:The Facebook Algorithm Mom Problem by gthtjtkt on Wednesday July 12, 2017 @02:44PM (#14755316)
> Instead, the YouTube homepage seems myopically focused on the last 5-10 videos I watched.

Noticed the same thing happening for the past year or two.

I used to be able to go on YouTube and find a variety of interesting videos I'd never seen before. It seemed like there was a good balance of categories in the recommendations.

Now, I watch one boating video and suddenly my recommendations are 100% boat related with some random clickbait/viral garbage sprinkled in for good measure.

Re:The Facebook Algorithm Mom Problem by anigbrowl on Wednesday July 12, 2017 @01:59PM (#14754861)
YouTube is weird. I made the mistake of watching a flat earth video last year in order to get a handle on that growing weirdo fad. Well it turns out that flat earthers are really avid content consumers (presumably because of the enormous cognitive reinforcement requirements to maintain such a belief) and YouTube really wanted to help me with that. It took a couple of months for it to stop offering me a portal to a better, flatter world every time I refreshed a page.
Re:The Facebook Algorithm Mom Problem by duskwuff on Wednesday July 12, 2017 @02:35PM (#14755234)
For future reference, you can remove videos from your YouTube history if you're logged in:

https://www.youtube.com/feed/history

Once a video is removed from your history, you'll no longer get recommendations based on it.

If you aren't logged in, you can't view or edit your viewing history, but you can at least clear it. (Which will return you to YouTube's terrible default viewer profile... sigh)

Re:The Facebook Algorithm Mom Problem by anigbrowl on Wednesday July 12, 2017 @02:39PM (#14755263)
Forgot about that! Thanks for the tip.
Re:The Facebook Algorithm Mom Problem by Fomite on Wednesday July 12, 2017 @03:42PM (#14755909)
I similarly had that happen with some GamerGate stuff. Watched a video just to see if I could wrap my head around it, went "Nope!" and went on with my life, and the next thing I knew YouTube was desperately trying to send me down the alt-right rabbit hole.
Re:The Facebook Algorithm Mom Problem by Florin_Andrei on Wednesday July 12, 2017 @02:24PM (#14755127)
It's a hard problem. If they kept recommending old topics, you'd be like "hey, I quit watching pink zebra videos 5 years ago, stop recommending that stuff to me".
Re:The Facebook Algorithm Mom Problem by gervase on Wednesday July 12, 2017 @01:57PM (#14754833)
My supposition is that this is a response to changing tastes over time. However, I think 10 videos or less it probably an overreaction to this problem.

For example, let's say they have a user who watches 100 videos a week, for ease of math. 50 of those videos are in "core" areas of interest - these do not change over time. An additional 35 are in areas of secondary interest: topics which have piqued the viewer's curiosity, but not deeply interested them. We can expect these topics to change every [1,4] weeks. The remaining 15 are referrals or clickbait from other websites.

How can YouTube differentiate between these three classes of videos? The first class will be heavily represented in their subscriptions. Presumably, the viewer will prefer their recommendations to ignore the third class (clickbait). The second class is the hardest, as the user may want these videos surfaced, but then want them to decay over time as their interests change.

I think this is the problem that they are attempting to solve, with varying degrees of success.

Re:The Facebook Algorithm Mom Problem by chiefalchemist on Wednesday July 12, 2017 @09:05PM (#14758049)
It's not just over tuning, but finding me things I might have missed. Not necessarily popular things, but thinks that appeal to me.

For example, I get emails from Pocket "You saved a popular article..." And I think "Who cares?" Don't tell me what I know, tell me what I missed. YT is similar. It recommends things I've watched. I'm looking for new and interesting and I'm getting yesterday's news? That doesn't excite me.

Re:The Facebook Algorithm Mom Problem by tbcktu on Wednesday July 12, 2017 @01:55PM (#14754817)
I hate this. Several years of nothing but a single genre of music in my history but watch one video about something different and get nothing but recommendations based on that. I have to clean up my watch history daily.
Re:The Facebook Algorithm Mom Problem by freeflight on Wednesday July 12, 2017 @09:59PM (#14758228)
I've moved pretty much all my music listening to YouTube due to simple convenience of easily being able to generate whole genre playlists based on one song.

But because the playlists are dynamic, YouTube keeps on shoving songs from other playlists (and genres) into each other, trying to generate a "perfect playlist" and in the process making all the playlists sound very similar with no more genre distinctions except for the first couple of songs.

Re:The Facebook Algorithm Mom Problem by elif on Wednesday July 12, 2017 @05:18PM (#14756779)
yeah, but i get the impression history is retained and utilized. If i watch 2-3 how-to videos i start getting how-to videos that are similar to my history, not just random how-to. then if i switch to skateboarding, i get skateboarding videos similar to my history.

This seems like a good algorithm to me, as when i'm watching skateboard videos with my friends, I don't want "how to caulk tile joints" to show up

Re:The Facebook Algorithm Mom Problem by Siecje on Wednesday July 12, 2017 @04:00PM (#14756096)
Why are so many videos I have already seen? I guess people re-watch them, or show other people "Hey have you seen this".

But for me it is just silly.

Re:The Facebook Algorithm Mom Problem by tragic on Thursday July 13, 2017 @07:54AM (#14760527)
Well, it sometimes makes sense. I, and many others, use YouTube as a music streaming service. Most people listen to most songs they like more than once. I dare say yt has gotten a good amount of ad revenue out of me listening to Darren Emerson's dub extravaganza mix of black sky by Shakespeare's sister, which is always in the recommendation panel for some reason...
Re:The Facebook Algorithm Mom Problem by jitix on Wednesday July 12, 2017 @04:28PM (#14756344)
I concur that.. these days I have to clear my youtube history every few weeks to prevent it from spamming my page (and my fucking TV!) with suggestions related to random videos I watched over a short period of time. The videos I liked over the last 7-8 years seem to carry less weight. I wish there was a way to tune these behavior.
Re:The Facebook Algorithm Mom Problem by chongli on Wednesday July 12, 2017 @01:55PM (#14754823)
If I had to guess, I would say YouTube is attempting to get you to watch new types of videos you've never watched before. By focusing on recent videos you've watched, they can try to convert you from a 1-off to a regular viewer of a particular genre.
Re:The Facebook Algorithm Mom Problem by gabrielgoh on Wednesday July 12, 2017 @02:56PM (#14755447)
i think this is the right approach, you're not after all, the person you were 5 years ago, or even a week. most interests change with time, I lose interest in a topic very fast, and gain interest in another topic just as quickly. No good recommender system should be based off a reading of my "personality", whatever that may be - the most stable aspects of my personality, even if they can be divined from my viewing history, say little as to what I would be interested in watching next.
Re:The Facebook Algorithm Mom Problem by ryanbrunner on Wednesday July 12, 2017 @08:19PM (#14757816)
I think that's a fair point, and I wouldn't expect a video I watched 10 years ago to factor in very heavily on what I'm seeing today. But at least in my experience, it doesn't appear that the engine takes anything that happened more than a few days ago into account.

As an example: I watched a few episodes of Penn and Teller: Fool Us yesterday. I hadn't really watched it before, and while I like Penn and Teller in general, I don't remember watching them all that much on YouTube prior to yesterday (I'm sure at some point I had watched a video or two, but not more so than anything else I stumbled on.)

Today, 12 of the top 30 videos on my YouTube home page are specifically Penn and Teller: Fool Us. Not magic in general, not Penn and Teller in general, but specifically that show. That seems like the very recent past is way overrepresented.

Re:The Facebook Algorithm Mom Problem by escribmac on Thursday July 13, 2017 @11:10AM (#14761922)
I agree. I've been reluctant to click amazon links because I know ads will follow me around for weeks if I look at a single product.
Re:The Facebook Algorithm Mom Problem by Dylan16807 on Wednesday July 12, 2017 @02:21PM (#14755094)
Trying youtube music recently made that abundantly clear, with an awful awful playlist extrapolated from something like 4 recent songs.
Re:The Facebook Algorithm Mom Problem by asah on Wednesday July 12, 2017 @03:40PM (#14755897)
Sounds like an opportunity: deeper recommendations
Re:The Facebook Algorithm Mom Problem by avar on Wednesday July 12, 2017 @02:23PM (#14755113)
This is because they're not trying to give you stuff you'd generally like given your entire history. The recommendation feature powers the part of YouTube that auto-plays the upcoming video.

So e.g. if I go and view Russian dashcam videos they're going to automatically play more of them, even though I've shown no prior interest in that topic.

Having two systems for recommendations would introduce a lot of UI complexity, so I can see why they didn't go for that, and why the recommendations are consequently tuned for people who are actively watching videos on some topic right now.

Re:The Facebook Algorithm Mom Problem by icebraining on Wednesday July 12, 2017 @03:24PM (#14755747)
Having two systems for recommendations would introduce a lot of UI complexity,

Do you mean, in terms of implementation or for the user? Because as the later, I think the two are already conceptually different (homepage vs next video), so I don't see how just feeding it different videos would make it more complex.

Re:The Facebook Algorithm Mom Problem by avar on Wednesday July 12, 2017 @05:10PM (#14756707)
For the user. What you're describing is still going to cause complex UX.

So let's say I'm interested in exactly two things. Russian dash cam videos and videos of trains without narration.

I go to the homepage and click on one type of video, what should the next video be? A random video from the two categories? One or the other? Should it show me a banner at the top indicating what recommendation mode I'm in (historical preference or "similar to current video").

Now I go and do the same on my Android YouTube app which has no real UI equivalent of a homepage, what happens then?

This is a lot of UX complexity for a feature few probably care about.

Re:The Facebook Algorithm Mom Problem by icebraining on Wednesday July 12, 2017 @05:42PM (#14756961)
Like I said, I think the homepage is already quite different from the next video in the user's perspective, so there's no need to show banners or anything like that. Homepage = full profile analysis, next video = similar to current.

By the way, the Android app does absolutely have an UI equivalent of a homepage, it's even called "Home".

Re:The Facebook Algorithm Mom Problem by avar on Wednesday July 12, 2017 @06:45PM (#14757331)
I mean once the user selects a video you need to continue showing them context, because at this point they may not remember what mode they're in to begin with.

Making your app behave differently because you navigated to the current state via different menus is very bad UX design. That's all I'm saying. Your suggestion would entail either UX complexity or such implicitly different behavior for YouTube.

Yes Android has a "Home" button. But what I meant by no real UX equivalent is that when you open youtube on the web you'll open a new tab and go to youtube.com.

When you do so an Android you've likely just dismissed the app in the past, and opening it again will bring you back to the last video you were viewing. You don't go through the homepage by default.

Thus it's more of just another menu item on Android, not something that's equivalent to / on a website.

Re:The Facebook Algorithm Mom Problem by idyllei on Wednesday July 12, 2017 @02:31PM (#14755188)
I imagine it would be possible (though difficult) to autoplay videos which are related to each other and gradually converge to something that would interest the viewer.

For example, Russian dash cams to Russia at night to the Russian sleep experiment creepypasta, to horror games to video games in general, if that is what the user tends to watch.

I know this has graph theory written all over it and the shortest-distance problem has wreaked havoc for centuries, but I think with enough resources Google/YouTube could find a good compromise in this situation.