News for hackers. Stuff that matters.
Re:A friend of mine died and I didn't know because of algori... by wpietri on Monday December 18, 2017 @08:57PM (#15957158)
Having interviewed people who worked at Facebook, I'm convinced that nobody there really understands how it works. (Or, at best, a very few people do.) There are just too many people running around trying relentlessly to improve micro-metrics by fractions of a percent for the system to have much in the way of intellectual coherence.
Re:A friend of mine died and I didn't know because of algori... by greggman on Monday December 18, 2017 @09:20PM (#15957248)
you may have seen it but there is a really scary Ted talk suggesting that it's possible Facebook is using deep learning techniques to optimize for engagement and they have no idea why it picks what it picks but it's possible making people choose sides and argue happens to be the best way to meet its goals

https://m.youtube.com/watch?v=iFTWM7HV2UI

Re:A friend of mine died and I didn't know because of algori... by nautilus12 on Monday December 18, 2017 @10:21PM (#15957472)
Wait, so theoretically, suppose that a deep learning algorithm figures out that if they bombard someone with tons of images of other people happy during an acutely sad event of their life that they can drive them to suicide, and that this causes a massive peak of engagement from all the people expressing sympathy on their wall, would it do so? Given the fact that facebook is engineered to be addictive and holds the dopamine button on so many people's brains, wouldn't this practically be manslaughter?
Re:A friend of mine died and I didn't know because of algori... by civilitty on Monday December 18, 2017 @10:44PM (#15957568)
IANAL but based on my understanding, manslaughter generally includes some form of negligence (instead of premeditation like homicide) so until our laws and culture catch up to the power these developers/decision makers actually hold, it's unlikely that a jury would blame the developers (or that a judge would even be sympathetic to the argument). Our society has agreed long ago that drinking and driving is irresponsible so thats why drunk driving fatalities are often prosecuted as manslaughter but the same is not true of software engineers and their creations. We need a sweeping cultural change outside of software engineering just like we had with civil engineers in the 20th century.

Nowadays, a professional engineer (a phrase with a precise legal meaning) can be held criminally and civilly liable for negligence even when they are "just following irders." Unfortunately, we're at the very early wild wild west stages of the industry, before some big exposé or calamity completely shakes up the industry (i.e. Sinclair's The Jungle did for food, Carson's Silent Spring for pesticide use, or the 1906 SF earthquake for building codes).

Re:A friend of mine died and I didn't know because of algori... by nautilus12 on Monday December 18, 2017 @10:55PM (#15957616)
If you build a machine that builds random types of robots but are negligent to make sure it doesn't create robots that kill people, isn't that still criminal negligence?

I think of these algorithms as being algorithms created and vetted out by algorithms, therefore, its negligent to not understand what they are doing. Since its difficult to know what they are doing, then the risk to use them in this way should be viewed as too great

Re:A friend of mine died and I didn't know because of algori... by dorgo on Tuesday December 19, 2017 @04:14AM (#15958854)
It's the point of machine learning that no human needs (or often even can) understand how the machine is doing something as long as the target metric is optimized. We are building black boxes which translate input into desired output. And tomorrow we will have black boxes building other black boxes.

The only way to ensure nobody is killed is to add "0 people killed" to the target function of the black box.

Re:A friend of mine died and I didn't know because of algori... by doomjunky on Thursday December 21, 2017 @02:37PM (#15982072)
Every heuristic algorithm needs a tollerance

    peopleKilled() < ε
Re:A friend of mine died and I didn't know because of algori... by mygo on Tuesday December 19, 2017 @01:55PM (#15962916)
“World without end” amen
Re:A friend of mine died and I didn't know because of algori... by WillReplyfFood on Tuesday December 19, 2017 @02:36AM (#15958435)
This does not always follow the rational way. If you hack society, and society rejects the hack- you can end up in a concentration camp.
Re:A friend of mine died and I didn't know because of algori... by keithnz on Monday December 18, 2017 @10:42PM (#15957558)
Sounds plausable. I certainly like it as a plot line to a story instead of a sentient AI trying to take over the world that unaware deep learning AI takes over and kills us as it adapts to our preferences of sensationalisim and find those destructive social cycles
Re:A friend of mine died and I didn't know because of algori... by nautilus12 on Monday December 18, 2017 @10:52PM (#15957601)
Basically at that point AI becomes an echo chamber for our own evil tendencies...until the point it totally drowns us out.

It would make a good novel, but it would be too confusing and depressing, like the Infernal Desire Machines of Dr. Hoffman, but more frustrating and confusing.

Re:A friend of mine died and I didn't know because of algori... by flycaliguy on Monday December 18, 2017 @11:56PM (#15957867)
Sounds like a great Black Mirror episode. Just imagine if that algorithm was paid for by the cosmetics industry to sell make up and face cream.
Re:A friend of mine died and I didn't know because of algori... by amigoingtodie on Tuesday December 19, 2017 @01:42AM (#15958257)
The virus kills the host?
Re:A friend of mine died and I didn't know because of algori... by nautilus12 on Monday December 18, 2017 @10:00PM (#15957391)
If this is true then it explains so much.

Facebook is trying to get people to be miserable because then they are using facebook more, and its engineered in such a way that it makes us addicted to facebook and want to use it more anyway.

Is this enough reason for our society to revolt against facebook? How do we actually make it go away when everyone is addicted to it. Does anyone have any practical tactical strategies to get rid of it?

Re:A friend of mine died and I didn't know because of algori... by rdtsc on Monday December 18, 2017 @10:29PM (#15957502)
There was another article recently about using deep learning to see if people are too depressed and are at suicide risk. It's a nice idea on the surface but it a bit dark thinking that maybe there counterpart to it, that is another AI algorithm which makes the person addicted and depressed to start with.

It's a bit like a parasite - it needs to control and extract usefulness from the host but not let the host die quickly because well it won't get the resources anymore and it would die with it.

Re:A friend of mine died and I didn't know because of algori... by nautilus12 on Monday December 18, 2017 @10:31PM (#15957510)
But see my post above, suppose that it decides that it can get a strong burst of engagement from all the sympathy posts, would it chose to kill off some of its hosts that have outlived their usefulness (from an engagement perspective). Does facebook have enough power that it can chose to kill off certain people? Are there examples of people committing suicide solely because of their facebook feeds (I guess how would we know)
Re:A friend of mine died and I didn't know because of algori... by rdtsc on Monday December 18, 2017 @11:09PM (#15957662)
Just read it. It's a scary potential. It might start doing it automatically one day. If anyone discovers the bug it will be just "oh sorry, just an algorithm bug, we'll tweak it, we promise".

> Does facebook have enough power that it can chose to kill off certain people? A

I never signed up for Facebook to start with, but I got a glimpse of this power with Netflix. The movie recommendations were so good that I end up liking them if took its advice. Where normally I wouldn't have watched them based on rating, synopsis, or title. I had realized some algorithm at Netflix seems to know me better than I knew myself. Then thought what if it suddenly decided to use that against me, because it somehow would be more profitable for it.

Re:A friend of mine died and I didn't know because of algori... by trophycase on Monday December 18, 2017 @10:04PM (#15957408)
Just delete it, it's not that difficult.
Re:A friend of mine died and I didn't know because of algori... by megy on Monday December 18, 2017 @10:52PM (#15957603)
Sure, and then I miss the fact that a friend from overseas is visiting, because he would rather write on facebook then post to everyone/keep their details updated.
Re:A friend of mine died and I didn't know because of algori... by tinymollusk on Tuesday December 19, 2017 @12:03AM (#15957893)
So what? While I value each individual friendship I have, I have also found better life satisfaction with fewer, deeper, friendships. Is everyone else convinced that holding distant relationships, punctuated by infrequent in person, makes them happier/more fulfilled?
Re:A friend of mine died and I didn't know because of algori... by Scea91 on Tuesday December 19, 2017 @05:30AM (#15959206)
Actually yes. I definitely enjoy keeping in touch with people I am not able to see on regular basis for various reasons.
Re:A friend of mine died and I didn't know because of algori... by tinymollusk on Tuesday December 19, 2017 @12:21PM (#15961812)
Is that healthy? Before I reduced social usage, I found myself spending time I 'enjoyed'. Now, I look back, and that time was unhealthy. (I believe seeing only other people's highlights helped trigger a depressive episode.)

It's like time spent watching TV. I enjoy it; sometimes it provides value; it's tendency is to take over and create an unhealthy life for me.

Re:A friend of mine died and I didn't know because of algori... by genofon on Tuesday December 19, 2017 @07:08PM (#15965775)
why do you argue on this? it's totally a personal preference and totally OT, if he/she wants to use FB that way let it be
Re:A friend of mine died and I didn't know because of algori... by tinymollusk on Wednesday December 20, 2017 @06:00PM (#15974669)
Because I am curious about the perspective and experience of another person.
Re:A friend of mine died and I didn't know because of algori... by bigbugbag on Tuesday December 19, 2017 @04:16AM (#15958862)
FOMO and network effect. Just keep in touch with your friends as we did before facebook took over your social interactions and you'll know what they're up to.

Anyways even if this friend posts about visiting on facebook, this is not guaranteed you will be shown this post, as demonstrated by the actual HN submission you're commenting about.

Re:A friend of mine died and I didn't know because of algori... by lossolo on Monday December 18, 2017 @11:37PM (#15957796)
If he really wants to meet with you then he will find a way, even if you are not on facebook. You know there was no facebook 15 years ago, right? and my friends were always finding a way to contact me if they wanted to meet.
Re:A friend of mine died and I didn't know because of algori... by megy on Monday December 18, 2017 @11:39PM (#15957802)
Such a strange comment. He didn't expect to not find me on facebook, so had no idea I never saw his message. I still have an account, just do not check it.

And yes, there was no facebook 15 years ago. That is great, 15 years ago everyone new to SMS or email you. Now, everyone expects you to be on facebook. See the difference?

Re:A friend of mine died and I didn't know because of algori... by jacquesm on Tuesday December 19, 2017 @12:27AM (#15957997)
So you use Facebook, once to let everybody know you are no longer on Facebook.

I'm lucky in the sense that I made a FB account, tried it out for two weeks, realized it wasn't for me and then cancelled so I never got hooked. But I can see that once you are in it takes a bit more effort to get out. But being 'on Facebook' should not be a prerequisite for normal social interaction.

Re:A friend of mine died and I didn't know because of algori... by eropple on Tuesday December 19, 2017 @02:53AM (#15958507)
> But being 'on Facebook' should not be a prerequisite for normal social interaction.

Why not? Collectively it's proven to be the easiest way for groups of loosely and moderately connected people to communicate and coordinate socially, so it's what virtually everyone I know uses. We all use Facebook for events and for Facebook Messenger. The set of friends who live within train/car distance who I communicate with via something other than Facebook Messenger numbers around...four? Out of dozens? And it's not because We Don't Use Facebook, it's because we share a Slack and had an IRC channel before that.

By not using it, somebody my age and in my neck of the woods relies on making people who they ostensibly call friends treat them as a special case just to organize beers on a Friday. And it does make that person a special case: why would people use group-SMS anymore when Facebook chats are right there and you don't need to track down phone numbers to include everyone (and deal with sharded SMS threads if people are added, etc.)? The expectation that people special-case your edge-case life decisions has to be balanced against not being a pain in the ass for people you claim are your friends.

So, yes, in many quarters Facebook is a prerequisite for normal social interaction (unless you're That Guy, and it's good life advice to never be That Guy). And, TBH? It works fine. It's nothing special. It works fine. I very rarely see a news feed (I use Social Fixer) so I have no real opinion on the way it does likes/shares/etc.; I did tag some people as "close friends" so when they post it does reliably surface, but I don't remember the last time I even scrolled down the news feed and its existence has no impact on the other features of the platform.

It is just not that big a deal. It's certainly not worth the airs put on--not from you, but the I-don't-even-own-a-TV levels of smarm from people who don't use Facebook makes my eyes roll out of my head and bounce down the stairs--by people who don't use it.

Re:A friend of mine died and I didn't know because of algori... by bigbugbag on Tuesday December 19, 2017 @04:29AM (#15958929)
>> But being 'on Facebook' should not be a prerequisite for normal social interaction.

>Why not? Collectively it's proven to be the easiest way for groups of loosely and moderately connected people to communicate and coordinate socially

I'd be happy to have a source for this outlandish claim.

As to answer your question, there are many many reason not to let a private transnational company take control of your social interactions. Easy one: what happens to your social interactions when facebook disappears as every other so called social network before it did (remember friendsted, myspace, etc.) Another easy one: what happens when your account gets locked and you get banned from facebook ?

Harder ones are not so obvious for people who do not stay informed such as the deep impact on shaping people opinions and thoughts, the disappearance of empathy, intelligence dropping, destruction of internet, support of foreign dictatorship, massive tax fraud and tax evasion, emotional manipulation, organized abuse, sextorsion, and a lot more.

Re:A friend of mine died and I didn't know because of algori... by eropple on Tuesday December 19, 2017 @10:37AM (#15960887)
> I'd be happy to have a source for this outlandish claim.

My entire friend group and extended friend group in the Boston area. Somewhere between ten and twenty thousand people within two hops of me and in the local area, geometric expansion's weird like that. If I want to talk to any of them, we will end up using Facebook. If a friend intros two people face-to-face and they want to talk later, we use Facebook. If I meet a girl at a bar, or if I meet somebody who might be cool to work with on a project, and we want to hang out later, we use Facebook. Suggesting SMS is usually tolerated but makes you a little weird and makes you harder to get ahold of and you're likely to be ignored and left out later; suggesting email (outside of an explicitly business context) makes you a dinosaur and makes it very likely that you are ignored.

I cannot remember one time in the last five years that somebody suggested SMS as a contact method to me. I have phone numbers for folks I knew before Facebook was a thing, sure. And phone numbers are a good-enough "front door" for stuff like online dates. But actual interaction? Overwhelmingly, overwhelmingly via Facebook Messenger.

Nobody's saying you have to use it. But, in my experience, making it harder for people to contact you means people don't. The fumfuh about "well my real friends" ignores that there are both social and transactional benefits to not being sand in the gears, not being a pain in the ass, for people who are not your real friends. Being sorta friends is still both fun and useful.

> As to answer your question, there are many many reason not to let a private transnational company take control of your social interactions.

The assertion I am making alongside that rhetorical statement--which, TBH, I'm not quite sure why you thought was not rhetorical enough to need a soapbox stand--which is missed in the less friended corners of HN, is that all of this matters a lot less than keeping in touch with people.

Datamining--whatever. Oh, no, Facebook knows I go out for a drink on Fridays. Oh, no, the like button on pages (which don't actually phone home, because I have a hosts-based ad-blocker on my phone and my browser) shows that I read the Times. The tradeoff of that whatevermining versus not having a functioning social life in the year 2017 is immense and the types who don't-own-a-TV about Facebook display a distinct lack of understanding that maybe that trade-off is okay for some people and that it does not necessarily come from ignorance but is weighed and calculated--because having a social life is really nice and not having a social life really sucks.

Facebook is often annoying and is kind of shitty, sure. It is also the only game in town. In plenty of social circles, you play or you don't participate. The lack of understanding and empathy out of the "oh, just don't use it" camp is not shocking--tech people choosing not to understand things they might not agree with and choosing not to employ human empathy is not and never will be shocking--but it remains profoundly annoying.

Re:A friend of mine died and I didn't know because of algori... by guelo on Tuesday December 19, 2017 @03:21AM (#15958617)
I think your disagreement is somewhat off because when people rail against Facebook what they're talking about is the original product, the profiles, the friends, the feeds, the posts, etc. Messenger and to a lesser extent Events are separate products that happen to leverage the friends network. Kind of like how "Googling" is searching, not Gmail or maps or the rest.
Re:A friend of mine died and I didn't know because of algori... by eropple on Tuesday December 19, 2017 @03:30AM (#15958651)
I understand what people object to. But it's not a product. It's a platform, and getting all I-don't-even-own-a-TV about the news feed makes you social sandpaper in my neck of the woods because of everything else that Facebook provides.

It is really, really good at that stuff, and you can--you really can!--pick and choose what you want to use and what you care about.

Re:A friend of mine died and I didn't know because of algori... by bigbugbag on Tuesday December 19, 2017 @04:22AM (#15958895)
So you are on facebook and he's used to you regularly logging in to facebook but you stopped doing that. This is something totally different to what your previous comment said.

It's akin to "I've used this email address for years and decided to stop checking it and use another one but did not tell anyone about it. Now I'm missing messages people send me to my old address I do not check anymore".

Re:A friend of mine died and I didn't know because of algori... by lerpa on Tuesday December 19, 2017 @07:07AM (#15959562)
If less people use it then less people expect others to also use it.
Re:A friend of mine died and I didn't know because of algori... by nautilus12 on Monday December 18, 2017 @10:23PM (#15957476)
I can delete it for myself, but what about all the people that are addicted and don't know any better?
Re:A friend of mine died and I didn't know because of algori... by maskedSlacker on Monday December 18, 2017 @10:16PM (#15957453)
It's incredibly liberating in fact. My life is so much better without it. And I'm not missing anything of value. The people who matter can get a hold of me if they want.
Re:A friend of mine died and I didn't know because of algori... by chowchowchow on Tuesday December 19, 2017 @01:39AM (#15958248)
Agreed. Deleted last year and, despite all the incredibly disheartening news and current events, my well being has improved so much over the past 14 months.
Re:A friend of mine died and I didn't know because of algori... by njarboe on Monday December 18, 2017 @10:05PM (#15957412)
CGP Grey has an interesting 7 min video on how this might work [1]. Not so easy to summarize but the main part is that opposite sides of an issue are really part of the same meme that need each other to grow. The more polarization the better.

[1] https://www.youtube.com/watch?v=rE3j_RHkqJc

Re:A friend of mine died and I didn't know because of algori... by tomrod on Monday December 18, 2017 @10:05PM (#15957410)
Machine Learning, meet economic theory, where people have time-inconsistent decisions and where macro observations of micro-decisions can really throw off your model (big K/little k problem[0]).

[0] A decent review with code, a Noble laureate, and a top notch Computational Economist: https://lectures.quantecon.org/jl/rational_expectations.html

Re:A friend of mine died and I didn't know because of algori... by hinkley on Tuesday December 19, 2017 @02:19AM (#15958384)
See, this is the same thing that has turned me off since the very first time I heard of neural nets.

I have no interest at all in a solution that can’t be explained. That’s not a solution, that’s a remedy.

I don’t have a lot of time for humans that know things but can’t articulate them. Why would I make time for a computer that does the same? It doesn’t even earn the courtesy of give a human.

I was drawn into this field by the idea of understanding things and solving problems with them. If AI can’t “show it’s work” homework style, then it might find me a shorter route to the mall but it hasn’t solved anything.

Re:A friend of mine died and I didn't know because of algori... by standyro on Tuesday December 19, 2017 @02:59AM (#15958531)
Explain in detail all of the minute muscle movements that you make to throw a ball.

Not all things that humans learn are easily articulated or explained, not because those humans aren't articulate, but because they learned actions that are more easily intuited.

Also, on this topic, explainability of machine learning models is a hot field: https://www.youtube.com/watch?v=KP7-JtFMLo4 https://arxiv.org/abs/1602.04938 https://github.com/marcotcr/lime

Re:A friend of mine died and I didn't know because of algori... by trophycase on Monday December 18, 2017 @10:04PM (#15957404)
Don't mean to be rude but isn't it fairly well known that facebook is using deep learning to optimize the feed for engagement? I mean do you really think they are hand tuning these algorithms?
Re:A friend of mine died and I didn't know because of algori... by gaius on Tuesday December 19, 2017 @05:40AM (#15959256)
The issue isn't the use of DL per se, it's that the resulting NN has independently discovered it can achieve its goal of increasing "engagement" by fuelling negative feedback loops in its test subjects (us). There's blind faith in its effectiveness on the part of its owner, and no oversight.
Re:A friend of mine died and I didn't know because of algori... by jdale27 on Monday December 18, 2017 @10:00PM (#15957392)
Having interviewed people who worked at Facebook, I'm convinced that nobody there really understands how it works.

I agree, but far from being an unique or surprising property of Facebook and the way it (as a company) works, I'd say it's almost in the nature of any system built by a large enough group of people that "nobody there really understands how it works".

Re:A friend of mine died and I didn't know because of algori... by wpietri on Tuesday December 19, 2017 @04:14PM (#15964347)
I agree, but I still think Facebook is unusually bad in this respect, and perhaps uniquely so.

Physical products have reasonably comprehensible user experiences. That's even true for much software. Microsoft Word is a beast, but the user experience is tethered by the external reality of what people do with it. Memo writers and novel writers and PhD dissertation writers all have different needs, but it's reasonably clear what their goals are and what successful outcomes look like. There are approximately equivalent tools that can be swapped in.

Facebook, on the other hand, is creating an ongoing experience. My needs are jumbled together with that of my friends, their friends, strangers, news organizations, advertisers, companies, non-profits, celebrities, would-be celebrities, and Facebook itself. And each experience is deeply individualized, adding yet more complexity.

It still probably had some intellectual coherence at a much smaller size. But they have so many people working, and so many of them beavering away at optimizing semi-conflicting metrics based on so much data that I don't believe it makes sense to anybody there. Much less sense than Word makes to its creators, for sure.

Re:A friend of mine died and I didn't know because of algori... by spion on Monday December 18, 2017 @11:13PM (#15957676)
This is not about the size of the system. You really cannot predict how the system will work, since its observing input from the outside and constructing its actions based on it.

Sure, there are ways to ask some ML systems why they made a decision after the fact, and they can elaborate which variables had the most effect. But before the algorithm gets the training data, you don't know what it will decide - nobody does!

It picks actions that maximise a value it was told to maximise. It does this based on "well, when I encountered a situation like this other times, I did these 5 things, and this one thing maximised that value I'm told to maximise in most of those cases, so I'll do that.

At the beginning it will try random things. After several iterations, it will find things that "stick" i.e. maximise the value. There are sophisticated techniques to get unstuck from local maximums and minimums, too, in order to find even bigger maximums.

When you have enough data, enough users, enough actions in a system, you can very quickly try a lot of things and learn a lot of stuff. But what those stuff would be, no human can predict.

The main problem is that its unethical to train a machine learning system with a value function that doesn't take into account basic ethical behaviour. There are 3 challenges here

The first challenge is technical, and its the easiest one - how to come up with a value function that encodes additional measures of human ethics. Its easy as in, you take a bunch of ethicists, give them various situations and ask them to rate actions as ethical/unethical. Then once you have that, you try to put it into the value function, so that the system can learn some decency. All done. (If only it were that easy!)

The second challenge is a business one, which is, how far are you willing to reduce your value maximisation to be ethical, and what to do if your competitor doesn't do that. One way to solve that is to have regulations for ethical behaviour of machine learning systems. The system could be held responsible for unethical actions. If such actions are reported by people, investigated by experts and found true in court, the company is held liable. Public pressure and exposure seems to help too. Perhaps we could make machine learning systems that detect unethical behaviour and call it the ML police. Citizens could agree to install the ML police add-on to help monitor and aggregate behaviour of online ML systems. (If these suggestions look silly, its because they are)

The third challenge is philosophical. Until now, philosophers were content with "there is no right answer, but there have been many thoughts on what exactly is ethical". They better get their act together, because we'll need them to come up with a definite, quantifiable answer real soon. On the more optimistic side, lets hope that any generally agreed upon ethical system is better than no system at all.

Re:A friend of mine died and I didn't know because of algori... by chii on Tuesday December 19, 2017 @12:53AM (#15958087)
> philosophers were content with "there is no right answer, but there have been many thoughts on what exactly is ethical".

i propose that all legal actions are ethical, and all illegal actions unethical. There shouldn't be actions that are considered unethical, but legal (and, for completeness's sake, no ethical action is illegal either).

Then, society will need to continue to codify their ethical framework as law.

Re:A friend of mine died and I didn't know because of algori... by chaosite on Tuesday December 19, 2017 @03:32AM (#15958661)
Absolutely not.

Laws are based on ethics, but not everything that is unethical is also unlawful.

It's usually legal to lie, break promises, exaggerate, and other things that I would consider unethical. I also submit that the should remain legal and unethical. Lying to my parents about some detail of my personal life I don't wish to share is unethical, but shouldn't be illegal.

Re:A friend of mine died and I didn't know because of algori... by pvdebbe on Tuesday December 19, 2017 @05:53AM (#15959287)
And also ethics is subjective, a matter of one's taste. It wouldn't make sense to equate law and ethics just like that.
Re:A friend of mine died and I didn't know because of algori... by underwater on Monday December 18, 2017 @10:03PM (#15957398)
Very few Facebook engineers work on the feed ranking team. I am ex-Facebook, and have a decent mental model but never dove into the code myself.