News for hackers. Stuff that matters.
Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by microcolonel on Saturday June 01, 2019 @11:27AM (#20069635)
Now imagine for a moment that you're not better than everyone else at thinking for them.

Agency is the only option. It's not like the concept of agency was thought up in a society with no dumb people.

If you want to live in a society where the state doesn't believe in agency, and where your difficult decisions will be made by people who are (on average) more intelligent than you, go ahead and move to the PRC, they're right up your alley!

People are actively opting out of advertising, which is why major advertising businesses are pulling out all the stops (see Google's recent announcement that they will restrict advertisement and tracking blockers); these businesses will suffer with the new generation of "consumers".

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by api on Saturday June 01, 2019 @12:02PM (#20069814)
This is exactly the problem: the fallacy of self exclusion on the part of those who would rule or otherwise think for us.

If humans are all vulnerable to all these manipulative tactics, where are we supposed to get humans who are not?

There is another alternative: reclassify exploitation of cognitive failure modes as a type of initiation of force. We already do this with deception in certain areas like con artistry, giving false testimony, bad faith in business, etc. Maybe we need to vastly expand our notion of tortious or civilly actionable deception to include clear use of dark patterns.

The idea that we are perfectly rational and can deal with any form of deception is perhaps the intangible analog of saying we are impervious to bullets. If that's not true, then it is the responsibility of law enforcement to protect us.

This is kind of radical of course. It would lead to regulations on speech that classify certain kinds of speech as assault.

The more I see of this emerging mass mind control dystopia the harder it is for me to think of non-radical solutions.

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by microcolonel on Saturday June 01, 2019 @12:21PM (#20069897)
> ...reclassify exploitation of cognitive failure modes as a type of initiation of force.

Yeah, I think there's some room for that, and the law (as you point out) is already somewhat headed that way. I think we need to be careful also not to write laws we can't afford to enforce fairly, or read too much into people's private interactions.

I remember having to help my employer prove that they were not the reason I wasn't in school when I was 17; and I think even with that they were still at my mercy. As a result of this, and a pretty large number of other experiences, I'm very very sensitive to the unintended outcomes of the law, and the limits of legislators' ability to understand what precisely they are doing.

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by CyanBird on Saturday June 01, 2019 @01:00PM (#20070112)
>The more I see of this emerging mass mind control dystopia the harder it is for me to think of non-radical solutions.

You should 100% see the adamn Curtis documentary I mentioned above and read up on manufacture of consent

https://m.youtube.com/watch?v=tTBWfkE7BXU

What you mention is already the case, it is fully within the interest of the decentralized power holders and policy makers for them to control the population via the information that's fed to them, that's why the Iraq invasion happened in the first place, that's why the US continues to try spread fear about Iran or China.

There is no way to destroy that machinery, only repurpose it for different means

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by bittercynic on Saturday June 01, 2019 @11:49AM (#20069745)
>Now imagine for a moment that you're not better than everyone else at thinking for them.

I didn't read that in GP. Currently we seem to be very reluctant to admit that we're all vulnerable to being manipulated, and it might actually increase the total amount of agency available to individuals if we could restrict the ways we're allowed to manipulate each other.

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by microcolonel on Saturday June 01, 2019 @11:59AM (#20069795)
The problem is the line between preventing manipulation, and imposing on people's private thoughts.

Poorly-conducted industry-funded research? That's pretty straightforward; and in some sense it is not that different from other forms of fraud. I'm okay with punishing people for acting with intent to knowingly mislead.

On the other hand, you look at lending, and it becomes a little bit difficult. There are illegal interest rates in many places, and for setting an upper bound, that works fine; but people throw around a lot of dubious allegations about lenders.

At some point, if you deny the existence of agency, you end up telling people things you can't know, because you don't have the imagination to consider that they might know what they're doing.

That is tyrannical.

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by bittercynic on Saturday June 01, 2019 @02:41PM (#20070734)
I didn't intend to deny the existence of agency, only to point out that it's often unclear exactly how much agency we have in different situations, and it could be useful to acknowledge that this is a thorny subject.
Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by CyanBird on Saturday June 01, 2019 @01:13PM (#20070198)
>Agency is the only option.

This is the problem, agency is dead, or at least in the grand scales, manufacture of consent has been a thing for a long, long, long time now and it won't go away simply because some people are afraid of looking into the reality of things

https://m.youtube.com/watch?v=tTBWfkE7BXU

Also, not sure if you saw the provided podcast, but most of the things you mention are addressed there

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by GavinMcG on Saturday June 01, 2019 @12:37PM (#20069989)
But we frequently are better off having others think for us. There are a broad spectrum of examples, from research that we don't have the time or resources to accomplish, to, say, getting advice from a friend, while in a crisis, that we fail to follow even though we would give that same advice.
Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by danShumway on Saturday June 01, 2019 @01:05PM (#20070141)
Voluntary delegation is different than involuntary delegation.

This is a hard thing for people to get over, and I don't really understand why. As an analogy, think about Right to Repair: I can simultaneously say that I want consumers to have the ability to control their devices, install custom firmware, and crack them open to repair them if they break, without making an assertion that every single consumer is qualified to do so.

With Right to Repair, I don't lose the ability to let someone qualified make decisions about my device, or to set device policies. It doesn't require a massive amount of faith in ordinary people, just an acknowledgement that a single company making those decisions for everyone is overall bad for the market.

And the fact that some individuals will make bad decisions and hand their iPad to Uncle Joe to fix with his power tools is an acceptable tradeoff, given that it means we're not forced to solve the much harder problem of deciding for everyone which modifications and usage is "correct" for every device.

The reason people go in so hard on individual freedom isn't because individuals are amazing -- individuals are flawed as heck. It's that it is extremely difficult to figure out when someone is fit to take over someone else's decision power, and that getting it wrong comes with massive risks. Given that we don't have an easy formula to tell when delegation is the right choice, or even to define what happiness is, or even to define whether or not happiness should be a universal goal, we (when possible) leave it up to individuals to make their own decisions or voluntarily delegate their decisions to another person.

Individual freedoms allow us to practice Defense in Depth on a societal level, at the cost of making us more vulnerable to some manipulations and allowing individuals to make some bad decisions about who they delegate their thinking to.

It's not perfect, but it is terribly practical, and nobody that I know of has come up with a better scheme yet.

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by CyanBird on Saturday June 01, 2019 @01:31PM (#20070300)
>Voluntary delegation is different than involuntary delegation

I mean, this is 100% correct, yet that's not quite the problem, and stating it that way leads to overall confusion, the issue is that policy makers, companies and other profit motivated groups found ways to get inside the root unconscious mental proceses which lead to concious decision making, this just means that said groups can hijack the agency of thousands of people at the same time with the same set of tools. That is what's happening right now, it had been the case that groups were using mass media to manufacture consent, but this new machinery is far more efficient and less expensive than previous systems

The defense in depth analogy is indeed very good, yet the agency of a critical amount of people has been compromised by this new machinery, and this machinery preys on people's unconscious instincts, fears and epigenetic predispositions. Those are things which simply can't really be postdoc taught to hundreds of millions of people at a whim

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by danShumway on Saturday June 01, 2019 @01:38PM (#20070355)
> this just means that said groups can hijack the agency of thousands of people at the same time with the same set of tools.

Yeah, very good point.

What we're trying to get at is this idea that some of the voluntary decisions people make aren't really voluntary.

What's (sometimes) proposed though is that this somehow invalidates the idea that people should be able to make their own decisions at all -- that they're incapable of it.

To go back to the idea of people controlling their devices, a hacker might trick me into giving device permissions for something I don't want -- because I misunderstand the permissions, or because they have some kind of leverage over me, or because they convince me that the permissions are no big deal.

I'm all for efforts to address 'Limbic Capitalism' that involve educating consumers and trying to plug those kinds of holes and giving people ways to interact with brands where brands can't sidestep informed decision-making processes. I disagree with someone who looks at those holes and says, "well clearly freedom isn't working", for the same reasons I disagree with someone who looks at Android's horrible permissions system and says, "well, clearly users shouldn't be able to decide whether or not an app gets location privileges, clearly only the smart people at Google should."

On the software side of things, we've learned that things like upfront permission prompts on app installation circumvent user agency, and we've started to move more towards forcing apps to only ask for permissions at the moment they need them. We've also given users tools like the ability to grant a permission temporarily rather than permanently.

Those kinds of solutions help defend against exploitative behavior without robbing users of agency.

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by CyanBird on Saturday June 01, 2019 @02:13PM (#20070559)
One of the guys below posted a beautiful analogy comparing us people to cracked poorlywwritten legacy software/hardware

https://news.ycombinator.com/item?id=20069693

I think that the only hope remains in the newer generations, and try to taught them as good as possible of the dangers this newly opened Pandora box released...

I studied international relations and this kind of thing keeps me up at night, I know that the Cia and other intelligence agencies are and have been exploiting this for a long, long, long time, and that there is no true defense against this problem other than "making it illegal" because sure as heck that didn't stop them from doing anything ever..

Anyhow, thank you for being around and help bounce ideas around!

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by crdoconnor on Saturday June 01, 2019 @01:13PM (#20070196)
>It's that it is extremely difficult to figure out when someone is fit to take over someone else's decision power

"It's difficult" doesn't mean it's a task that should be completely abandoned because of some ideological notion.

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by danShumway on Saturday June 01, 2019 @01:29PM (#20070293)
But it's not just a hard problem we can solve once, it's a wildly difficult problem that we haven't been able to solve for thousands of years.

I brought up the Defense in Depth angle because I think it's kind of the same category of problem. Why do we need multiple layers of security on our devices -- why shouldn't Apple just validate the code on everything that gets submitted to the store? Why shouldn't developers just write code that's bug free?

Because they just can't.

It's not that everyone has stopped trying to answer questions like "what is the purpose of society?". Nobody's talking about abandoning anything. If you think the problem is solveable, you're welcome to jump into philosophical circles right now and solve it. And once you've solved it, I promise I will happily move over to a totalitarian system where a perfectly informed formula decides what my life should be.

In the meantime, we need a pragmatic solution, and individual freedom is the best one I've seen proposed.

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by crdoconnor on Saturday June 01, 2019 @04:12PM (#20071373)
It's really not wildly difficult to discourage smoking by, e.g. putting a tax on it.
Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by danShumway on Saturday June 01, 2019 @07:27PM (#20072438)
Okay, sure. But what does the difficulty of taxing something have to do with the difficulty of building a single central authority that makes good decisions for a population without their consent?

Passing laws is not the difficult part, any government can do that :)

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by crdoconnor on Sunday June 02, 2019 @09:49AM (#20075417)
...and that's a good example of a good decision made on behalf of the population that lots of countries (maybe most?) have made.

The difficult part was browbeating the cigarette companies.

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by danShumway on Sunday June 02, 2019 @02:44PM (#20077197)
> made on behalf of the population

Right -- in most cases through a voluntarily elected representative democracy, or something similar. In the US, a decent portion of these taxes are even imposed by individual state laws, not just through the federal government. This is, maybe not the complete opposite of totalitarianism, but it's pretty close to the opposite.

But you might be missing the point of what I'm saying. If you want to move to a totalitarian system where we centralize all decision-making power, it's not enough to find a couple of things we all agree on. You have to be right nearly all of the time.

Go back to the Right to Repair analogy I made earlier. There are generally accepted best practices for most devices (for example, I don't want to be able to overcharge the battery until it explodes). But just because we can think of a couple of examples of this, it doesn't necessarily follow that a single company should control everything I can do with my device. Why? Because my concern isn't that Apple or Google will never get anything right, it's that their priorities won't in general align with mine, and that if something goes wrong, I won't have a recourse to correct the problem (The Defense in Depth analogy).

The same concerns are present with any system of government. If you want to remove user/citizen agency, you need a consistent framework or set of tests that can be applied to every decision you make. You need a way to make a decision and, without getting the consent or input of the general populous, figure out whether it's in their best interests. That's the difficult, impossible task.

Not passing the law; not quieting the companies that opposed it. That stuff might not be trivial, but we know how to do it. We do it all the time. We don't have any idea of how to objectively determine whether or not a random policy is in the public's (or an individual's) best interest without their input.

And it's worth noting that even in drug policy, even representative democracies struggle with this. In the US, we had prohibition, which was an attempt to say, "come on, alcohol is obviously bad for society". That failed pretty spectacularly. Now we do cigarette taxes, but we haven't gone so far as to actually ban cigarettes, even though we're all pretty much agreed it would be better if they stopped existing. And more recently, we're starting to see states decriminalize marijuana, which is a clear example of citizens/states rejecting a centralized "common-sense" decision about what was good for them.

Corrections like this are examples of the system working as intended.

You're looking at this through a government vs. corporation regulatory lens that I'm not really following. I'm arguing that voluntary delegation of a decision making process is different than involuntary delegation, and that preserving individual freedom doesn't mean you can't ever delegate a decision to someone else. I don't understand how cigarette taxes relate to that idea.

[dead]
Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by dang on Saturday June 01, 2019 @07:07PM (#20072331)
Please don't take HN threads into generic ideological flamewar. Those are always the same: boring and leading to worse.

https://news.ycombinator.com/newsguidelines.html

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by CyanBird on Saturday June 01, 2019 @01:09PM (#20070168)
I think that what you are missing is that this is not an option, this is a reality, Cambridge analytica already happened and since then they have moved into manufacturing consent in many other countries elections

For a long time, marketing and political propaganda have gone hand in hand

Manufacture of consent is something that has been happening for a long time now

https://m.youtube.com/watch?v=tTBWfkE7BXU

The difference now is that it can be done far cheaper, and on a bigger scale and more effectively than ever before, I would indeed recommend you to check out the planet money podcast at the least

Lastly, just because you see the value of mental agency and thought liberty, it doesn't mean that other people will value it the same way you do, or as much as you do. Psychographics is also a thing, and used to great effect when it come to manipulating people this way

Re:‘Limbic Capitalism’ Preys on Our Addicted Brains by jaggednad on Saturday June 01, 2019 @02:13PM (#20070554)
You’re presenting a false choice here. Either we live with free market limbic capitalism, or we live with a totalitarian PRC like state. There are other options that mitigate some of the issues with limbic capitalism without being totalitarian