News for hackers. Stuff that matters.
Re:Facebook relies on editors' judgment for trending news fe... by salimmadjd on Thursday May 12, 2016 @04:15PM (#11686401)
Given the history of propaganda and how we got into the Iraq war, this is an area of real major concern for me.

On two different occasions I've noticed a similar behavior on a "trending" news topic that was not trending anywhere.

Both cases (surprisingly) that caught my eyes, had to do with vilification of Iran. The first time, I assumed a certain organized PR effort or perhaps it was naturally trending.

However, the second time (May 9th) [0] it coincided with the Gizmodo's article coming out. That prompted me to search all major news sites (with the logic that if it was on some major news sites it will then circulate within FB and will explain why it was trend).

So I decided to document this, I checked CNN, HuffingtonPost, NYTimes, WashingtonPost...no mention of an "Iranian missile test" but there was a small blurb at the bottom of the FoxNew site [1]. Not enough exposure for it to get the kind of volume to be the top-3 trending story.

[0] http://imgur.com/UNRBrRu

[1] http://imgur.com/1f13R80

Re:Facebook relies on editors' judgment for trending news fe... by scholia on Thursday May 12, 2016 @04:45PM (#11686639)
Facebook says: "The list of Trending Topics is then personalized for each user via an algorithm that relies on a number of factors, including the importance of the topic, Pages a person has liked, location (e.g.. home state sports news), feedback provided by the user about previous Trending Topics and what’s trending across Facebook overall. Not everyone sees the same topics at the same time." (My italics.)

If you're interested in Iran, you will probably see stuff about Iran that hardly anyone else sees.

I have zero interest in Iran and have never seen anything about it.

Re:Facebook relies on editors' judgment for trending news fe... by salimmadjd on Thursday May 12, 2016 @05:06PM (#11686790)
If you look at the image I posted [0] there is trending topic of Justin Bieber. I have zero interest in him, in fact I've never or rarely can I recall have mentioned anything about the pop culture, music or anything else (I like classical music and some classical rock). Given all the different topic I post on FB and Justin Bieber popping up, I can image this is not all personalized news.

I also follow many people who posts news and information on Iran, and it's surprising none of them showed up on trending, except an article with intent of vilification. Seems unlikely.

Even if FB news is personalized, FB guideline indicates they can inject any news they want into this.

I noticed the same thing with the Yahoo News showing up on Yahoo email years ago and last time I checked continuing today. That source also rapidly became hawkish on foreign policy issues.

Re:Facebook relies on editors' judgment for trending news fe... by dimino on Thursday May 12, 2016 @05:19PM (#11686857)
What you're trying to do is draw conclusions based on very small sets of data. Sure, the article submitted agrees with your conclusion, but there's simply no way to tell if the conclusion you're drawing (and what's stated in the article) is related to your observations.

Your very small anecdotal evidence does not provide additional confirmation of the reported behavior.

Re:Facebook relies on editors' judgment for trending news fe... by nimblegorilla on Friday May 13, 2016 @10:21AM (#11690557)
Not everything has to be proven beyond reasonable doubt before people provide anecdotes.
Re:Facebook relies on editors' judgment for trending news fe... by TrevorJ on Thursday May 12, 2016 @06:07PM (#11687185)
The problem is what facebook says is at odds with what the leaked documents purport to show. Trending items, and hand-curated items are not the same thing, and apparently they have been passing one off as the other which is problematic.
Re:Facebook relies on editors' judgment for trending news fe... by jonathankoren on Thursday May 12, 2016 @06:14PM (#11687233)
No. It's exactly what the documents say. You see an algorithmic ranking of a set of curated topics.

I know. I worked on the ranking.

Re:Facebook relies on editors' judgment for trending news fe... by TrevorJ on Thursday May 12, 2016 @08:41PM (#11687850)
So was there a level of human curation or not?
Re:Facebook relies on editors' judgment for trending news fe... by jonathankoren on Thursday May 12, 2016 @11:12PM (#11688398)
It works exactly as FB has publicly stated. As set of topics are algorithmically detected from a variety of sources. Let's say this set has "many many" things in it. Many of which are of low quality. The best comparison I can give you is Twitter trends. Humans approve some of these detected topics to appear in the trending module. Let's just say there are now "many" topics. Yes, curators have the ability to insert a topic in to the trending list, and yes they have ability to make something appear in everyone's trending module, but it's not really used. It's mostly there so that you don't have to wait minutes for trending to detect that aliens have landed on the Washington Mall, or that nuclear war has broken out. In fact, the "everyone must see this now!" has never been used. This candidate set of approved topics is then algorithmically ranked for each person. Using criteria that they said.

If you really care, it uses a GBDT and the newly released Facebook Flow.

Re:Facebook relies on editors' judgment for trending news fe... by jmiserez on Friday May 13, 2016 @04:00AM (#11689214)
Wow, that is horrible. And equally horrible is the fact that you don't seem to find this problematic at all. If the features were/are regularly used is not really relevant: "algorithmically selected" implies a certain non-bias in the process, but if this is not how it really works then one should be much much more skeptical about the validity of any "trending" topics.
Re:Facebook relies on editors' judgment for trending news fe... by emn13 on Friday May 13, 2016 @06:09AM (#11689527)
It's a common misconception that "algorithmically selected" implies a certain non-bias. Perhaps this myth stems from examples used to explain simple algorithms (e.g. drawing straws, or pulling names from a hat).

Complex algorithms certainly do exhibit bias, and not only that - it's intentional. The whole point of a "trending" topic is to discriminate (i.e. inject bias) trendy topics from less trendy topics.

So you're talking about only adding the bias you want it to add - but I hope you can imagine that's an impossible cause to get 100% correct. There's no rigorous definition of trending; nor is there a rigorous definition of the topics to be selected from, nor are lots of other matters here rigorously defined. There's no way you're going to do better than some fuzzy algorithms trained on real data. Critically, that tends to mean real data generated by... biased humans.

Re:Facebook relies on editors' judgment for trending news fe... by _Understated_ on Friday May 13, 2016 @07:37AM (#11689794)
I would have thought that the algorithm would be entirely agnostic and based on incoming data only without humans to distort it, e.g. I share details with a dozen friends about aliens landing in Central Park, they then share it on and on. Facebooks algorithm will spot this and also others who did the same and then say "Hey, looks like there is a trend growing about aliens in Central Park" and from there would act upon it based on that data only, e.g. this topic was talked about 5 million times in the last minute and therefore bump it up the list to its corresponding position based on other "trending" topics.

Having humans involved will distort that process, thus meaning true trending does not exist. Well, on Facebook at least.

Re:Facebook relies on editors' judgment for trending news fe... by jler on Friday May 13, 2016 @03:36AM (#11689139)
Right. Like the time it was used when it was decided everyone in India got the post about supporting Facebook's Internet.org to save humanity or whatever.

Facebook's employees repulse me.

Re:Facebook relies on editors' judgment for trending news fe... by fapjacks on Friday May 13, 2016 @03:54AM (#11689197)
I have a question, mostly unrelated, so I apologize ahead of time. Do actual humans review pictures that are reported? I've been reporting a picture for a few months and get repeatedly "This picture does not violate our community guidelines". It's a picture of the bloody, naked, mutilated corpse of a murder victim with a crucifix shoved down her throat. I have reported it fifteen or twenty times over the last six months with the same answer, that the picture doesn't violate Facebook's community guidelines. What's that about?
Re:Facebook relies on editors' judgment for trending news fe... by scholia on Friday May 13, 2016 @06:47AM (#11689617)
That sounds like the sort of question you should ask Buzzfeed, HuffPo or a similar website. Like Google and other companies, Facebook is normally very quick to respond to bad publicity.
Re:Facebook relies on editors' judgment for trending news fe... by Angostura on Friday May 13, 2016 @08:24AM (#11689963)
I really don;t see anything horrible about a mixture of human curation and algorithmic work at all. It's the way that Digg works, for example.

What make it 'horrible' in your view? An implicit suggestion that 'trending' is mathematically deduced a la Reddit's 'Hot'?

Re:Facebook relies on editors' judgment for trending news fe... by TrevorJ on Friday May 13, 2016 @01:42PM (#11691894)
There's nothing wrong with it, the problem is calling it 'trending'. Trending implies that these are the things that the users on facebook are talking about. If the list is, in fact curated by facebook employees then that's fine but it shouldn't be passed off as trending.
Re:Facebook relies on editors' judgment for trending news fe... by iamdave on Thursday May 12, 2016 @06:42PM (#11687378)
I know. I worked on the ranking.

Is there any method of validating this claim?

Re:Facebook relies on editors' judgment for trending news fe... by stoic on Thursday May 12, 2016 @07:22PM (#11687528)
Cursory googling would suggest it is valid.

I don't think Zuckerberg is gonna call you and verify his employment.

Re:Facebook relies on editors' judgment for trending news fe... by colordrops on Thursday May 12, 2016 @08:34PM (#11687821)
I think the question is whether there is any way to validate that the code works as he said, not whether he works at facebook or not.
Re:Facebook relies on editors' judgment for trending news fe... by narrowrail on Thursday May 12, 2016 @09:16PM (#11687987)
You don't have to bet your first-born on it or anything, but on HN there is an implicit assumption of good faith.
Re:Facebook relies on editors' judgment for trending news fe... by colordrops on Thursday May 12, 2016 @09:32PM (#11688054)
According to who? There is no prescribed and assumed reality for this forum. I do not change my judgement because you say so.
Re:Facebook relies on editors' judgment for trending news fe... by narrowrail on Thursday May 12, 2016 @09:47PM (#11688108)
You are correct, I should have prefaced my statement with, "I think" or "I like to believe." I happen to believe cynicism is a seductive methodology, while sometimes useful. I don't care for FB's hegemony either, FWIW.
Re:Facebook relies on editors' judgment for trending news fe... by SapphireSun on Friday May 13, 2016 @12:41AM (#11688671)
I'm inclined to agree with you and the implicit assumption of good faith. However, FB's trend information is an instance of real power and susceptible to the sort of hiding of capabilities and intentions that implies. It's fair for people to ask for verification though of course no one is required to provide it.
Re:Facebook relies on editors' judgment for trending news fe... by jonathankoren on Friday May 13, 2016 @01:07AM (#11688751)
There is nothing that anyone can say that would "prove" that any system works as described. Once you start down Conspiracy Road, you never get off it.

All I can say, is why would I possibly lie to defend some minor product at a billion dollar corporation that I don't even work for anymore?

Re:Facebook relies on editors' judgment for trending news fe... by colordrops on Sunday May 22, 2016 @12:05AM (#11747338)
Re:Facebook relies on editors' judgment for trending news fe... by Sacho on Friday May 13, 2016 @02:35AM (#11688970)
It's pretty easy to justify why you would lie, if I think you are an ideologue who truly believes that Facebook trending topics must be curated with a certain slant for the greater good.

When you believe in a conspiracy theory, hearing "why would I lie" doesn't change your mind, quite the opposite. It's also not true that there's "nothing that anyone can say that would prove that any system works as described". There's no general statement that will convince everyone, because everyone has personalized doubt about it.

It's certainly possible to assuage the fears of a conspiracy theorist - take their examples, give a credible, particularized explanation(not a vague "it's algorithmic", but describe the steps in detail), and show some goodwill to address their underlying fears. What you perhaps wanted to say was that you don't really care about convincing conspiracy theorists, which is fine, but very different.

edit: wording

Re:Facebook relies on editors' judgment for trending news fe... by SapphireSun on Friday May 13, 2016 @03:09AM (#11689078)
I believe you, I just think that the thing you made is not really minor.

It has incredible reach and is quite effective in claiming attention. I actually had to use uBlock's element hiding function to keep myself from reflexively looking at it and reading a bunch of news stories. I would be surprised if that wasn't true for many people, as that's what it was designed to do.

I guess asking for proof is an unreasonable thing in this case as I can't think of what would actually constitute proof. I do think that additional questions are reasonable in this case as the editorial control of the ranking is currently a topic of national interest. I'm not really sure what that means exactly in this conversation, but I have a vague feeling that things that are big should be examined more closely. That's not super fair to facebook compared with a traditional media company, but this thing is new and isn't really like our models of how media companies like newspapers and magazines work.

It's a little scary because of the power a couple headlines sprinkled here and there have when they're seen be a lot of people. Something that was nothing becomes a scandal, lies become truths in the public consciousness and can't be fixed (look at the antivax movement). Of course, they also have the power to do great justice as well.

I guess, my point after all this text is still that what you've built isn't minor, there will be and probably have been real world impacts from it. Those impacts stem from public trust in FB's editorial position. If the public doesn't trust FB to show unbiased stories, they interpret the state of the world vastly differently than if they trust FB. This is why I think it's reasonable to have questions, even if they may be somewhat pointed at times.

That said, I really appreciate the fact that you took the time to respond to this thread. Talking to the people directly involved is a great way to disabuse one of falsehoods. :)

EDIT:

For an example of a reason why people are interested in this capability, imagine a rouge FB employee were to push the following headline to everyone: "US Nuclear Arsenal Almost Fired at Russian City" The world would see this post made by one person, and the fact that it was pulled nearly immediately would be seen as evidence by some of a cover up and could add tension and possibly instigate an international incident. Until this generation died, you would have people all over the world that would believe that the US nearly nuked a Russian city without provocation.

Re:Facebook relies on editors' judgment for trending news fe... by throwawaykeno on Thursday May 12, 2016 @06:10PM (#11687209)
"Fair and balanced" isn't either.

We can argue about whether there's an ethical problem, but the assertion that there's any sort of legal problem seems completely arbitrary and partisan IMO.

Re:Facebook relies on editors' judgment for trending news fe... by pessimizer on Thursday May 12, 2016 @06:25PM (#11687284)
> "Fair and balanced" isn't either.

"Fair and balanced" doesn't mean anything. Editorial control and algorithmic control are two different things.

> the assertion that there's any sort of legal problem seems completely arbitrary and partisan IMO.

I don't see any assertion that there's a legal problem in the parent.

Re:Facebook relies on editors' judgment for trending news fe... by throwawaykeno on Thursday May 12, 2016 @06:46PM (#11687394)
> Editorial control and algorithmic control are two different things.

It's also a meaningless distinction.

The point of contention is the bias, not whether the bias is imposed by an algorithm or by a human. People would still be complaining if Facebook had tweaked its algorithm to achieve identical outputs instead of employing humans to do it manually.

The truth seems to be somewhere in-between -- it was algorithmically generated and then the output was human-modified.

In general, I think the response to this post demonstrates the prevalence of magical thinking about computers, even by people who ought to know better. Bias is bias regardless of whether it's explicitly programmed behavior, emergent behavior from a carefully trained neural net, or enforced in human processes post-hoc. Distinguishing between these on the basis of where the behavior came from -- rather than whether or not there's a bias -- misses the point.

> I don't see any assertion that there's a legal problem in the parent.

The point of my post wasn't to contradict the parent post. There certainly are people who do claim it's a legal problem.

Re:Facebook relies on editors' judgment for trending news fe... by TrevorJ on Thursday May 12, 2016 @08:43PM (#11687857)
It isn't meaningless in this case at all. "Trending" suggests that it reflects, so some level, popular opinion about what people are discussing. If the items aren't trending, but are hand curated, then you've essentially lied.
Re:Facebook relies on editors' judgment for trending news fe... by golemotron on Thursday May 12, 2016 @10:55PM (#11688341)
>Facebook says: "The list of Trending Topics is then personalized for each user via an algorithm that relies on a number of factors

In other words, they are lying. 'Trending' should be calculated directly as topics of highest interest over all users. If it's not it's a manipulated figure.

Re:Facebook relies on editors' judgment for trending news fe... by onewaystreet on Thursday May 12, 2016 @05:50PM (#11687038)
Whether a story trends isn't contingent on it being placed on the front page of major news sites. Most people don't get their news that way. A story is more likely to trend because someone notable talked about it or linked to it.
Re:Facebook relies on editors' judgment for trending news fe... by exclusiv on Thursday May 12, 2016 @05:12PM (#11686828)
Are you saying news about Iran's military actions is not important to the US and its allies?

Perhaps users on FB find it more interesting and they surface it. Why does news on FB have to mimic the mainstream media?

Many times we have to read the stories about the US as reported from other countries because the MSM misses them or decides they aren't important enough.

Re:Facebook relies on editors' judgment for trending news fe... by ProAm on Thursday May 12, 2016 @04:32PM (#11686547)
> Given the history of propaganda and how we got into the Iraq war, this is an area of real major concern for me.

This is how the news media has operated in the US for almost all of its existence. I wouldnt be too concerned about it, just take news you read with a grain of salt.

Re:Facebook relies on editors' judgment for trending news fe... by spenvo on Thursday May 12, 2016 @06:35PM (#11687349)
Facebook's opaque blend of personalized algos and editorial decision-making means it can never be truly pinned down on what it shows you
Re:Facebook relies on editors' judgment for trending news fe... by arcticfox on Thursday May 12, 2016 @07:05PM (#11687478)
How are you so sure [1] is promoted? That would be a HUGE scandal if it was. IMO, bigger than this trending topics issue.
Re:Facebook relies on editors' judgment for trending news fe... by spenvo on Thursday May 12, 2016 @07:37PM (#11687582)
Hey, there isn't any way for me to be sure -- after some digging -- looks like a "sponsored" label is necessary [0] -- i've amended my comment.

[0] - https://www.facebook.com/business/help/community/question/?i...

Re:Facebook relies on editors' judgment for trending news fe... by spinlock on Thursday May 12, 2016 @08:31PM (#11687812)
Are you claiming that Facebook was responsible for the "free speech zones" that silenced our protest against the march to war in Iraq?
Re:Facebook relies on editors' judgment for trending news fe... by guelo on Thursday May 12, 2016 @05:58PM (#11687109)
Facebook didn't exist in 2002 and we still went to war in Iraq.