News for hackers. Stuff that matters.
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by jerf on Tuesday September 01, 2015 @12:59PM (#10153878)
'“It’s always going to follow the rules, I mean, almost to a point where human drivers who get in the car and are like ‘Why is the car doing that?’” said Tom Supple, a Google safety driver during a recent test drive on the streets near Google’s Silicon Valley headquarters.'

This is a drum that, like privacy and encryption, we techies need to start banging hard before it's too late. The fact that laws are fundamentally limited by our abilities to enforce them, and that laws are fundamentally written to be enforced by humans with some discretion, is such a deep assumption for us that we don't see it. We irrationally tend to conceive of a law that says "It is a felony to wear your hair in a ponytail on a Tuesday" as an absolute, even though what it really means is "If a police officer spots you with your hair in a ponytail on a Tuesday, and by their discretion arrests you, and at the discretion of a prosecutor charges you, who at the discretion of a judge and jury convicts you, you will be guilty of a felony." All laws actually say that, but that's not how we humans speak or conceptualize them. Also note the importance of a human even spotting the violation in the first place.

So, naturally, when we get technology that can rigidly enforce law, we don't program them with the "real" law, we program them with the text of the law. But the truth is, the text was never passed as a law. When the law was deliberated, everybody was really deliberating the version that involves all the human discretion, and prior to the introduction of computers, the law that was really enforced was the one with all the human discretion. A rigidly-enforced-by-computer law is a fundamentally different law, in the most concrete way possible; actions that you would never have been penalized by the human law result in immediate penalty in the computer world. There's no more concrete way to prove the point that it is a fundamentally different law.

We CAN NOT simply translate the text of the law into computer programs. If we are going to do computer enforcement of laws (and I'm going to drop the question of whether that's a good idea, feel free to debate in replies), we must write new law. By that, I do not merely mean that society has an obligation to write new laws, but that the very act of programming a law is writing a new law into existence, one never deliberated by the processes of democracy. We literally can not simply translate laws into programs. It is impossible. The result is not the same law.

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by olalonde on Tuesday September 01, 2015 @01:20PM (#10154087)
I'm playing the devil's advocate here but another alternative would be to write laws that are meant to be literal and enforced 100% of the time.
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by geofft on Tuesday September 01, 2015 @01:24PM (#10154128)
That doesn't serve justice, unless you have an actual way to enforce those laws 100% of the time. Theft is illegal, but there are ways for a rich banker to steal money that are undetectable, whereas a man who steals a loaf of bread to feed his family is much more obvious.
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by krapp on Tuesday September 01, 2015 @01:43PM (#10154289)
That's basically a form of authoritarianism.

Also, this is essentially the underlying premise behind no-tolerance policies and three-strike drug laws with mandatory sentences, which view interpreting the law based on context as an impediment to enforcement, the solution for which is removing the ability of judges to do so. You can't have a just legal framework in which the only role of humans is to be punished or to exact punishment.

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by Retra on Tuesday September 01, 2015 @01:50PM (#10154344)
Your conclusions don't necessarily follow. Your interpretation of that post is exactly the kind of problem being addressed here; your idea of how laws currently work is preventing you from seeing how to change them.

Basically, what you have to do is codify human discretion. If a judge wants to say "no, this really isn't a problem," he should be able to directly add that exception to the written law, and then enforce it as written. It's basically a kind of open source law. The question becomes of how to distribute authority.

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by krapp on Tuesday September 01, 2015 @01:58PM (#10154409)
> he should be able to directly add that exception to the written law, and then enforce it as written. It's basically a kind of open source law. The question becomes of how to distribute authority.

So basically, more or less what happens now, only with more bureaucracy and complexity? I'm sorry, but I don't see the benefit in that case.

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by Retra on Tuesday September 01, 2015 @02:00PM (#10154427)
The benefit is that you can better automate it.

But if that line of reasoning were good enough, then the US made a mistake by rejecting the rule of a monarch. Democracy is rife with managerial issues.

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by krapp on Tuesday September 01, 2015 @03:26PM (#10155041)
The typical premise behind automation is to remove the (ethical and financial) burden of a human workforce while keeping the benefits provided by human labor. For most business processes this is acceptable (inevitable loss of jobs notwithstanding.)

But when your 'product' is violence on behalf of the state (in the anarcho-libertarian sense of 'violence' being any non-voluntary interaction with a person or power structure, sometimes involving actual violence) then the ability of humans to mediate, alter and affect that system becomes a feature as well as a bug. This necessarily limits the speed of the law and the degree to which it can be optimized, and remain humane, because removing humans from that system tends to merely concentrate power in the hands of the few humans necessary for it to function.

And then the questions become if humans can write the laws, and humans can update the laws, and humans are enforcing the laws, and have discretion in doing so, then what really is being automated, or optimized, other than recordkeeping? And for that matter, what does law as a programming language actually improve?

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by Retra on Tuesday September 01, 2015 @05:19PM (#10155828)
>then what really is being automated, or optimized, other than recordkeeping?

Other than record keeping? Why does it need to go beyond that? You don't want transparency in your laws? You don't want the ability to format and translate them as needed? You don't want the ability to do queries and comparisons? You don't want machines to be able to update their own behavior when the law changes?

I'm not talking about automating anything other than record keeping.

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by vezzy-fnord on Tuesday September 01, 2015 @01:29PM (#10154166)
This is already the case for the ones where such a quality is relevant. Enforcement is a separate duty from penning legislation, and so will come with its own discretions that may lead to situations where certain laws are enforced with a lower priority because of a lack of practicality.
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by ihsw on Tuesday September 01, 2015 @01:37PM (#10154234)
Human discretion is the bedrock of modern legal systems across the world -- at the risk of inappropriately quoting an aphorism on HN, there are exceptions to every rule.

Such exceptions are sometimes codified in law, but the idea is that our legal system is based on trust rather than technical correctness. Not only do we defer judgement to a jury of our peers rather than rigid and uncompromising interpretation of the law, but we trust that all levels of government (judicial, executive, legislative) will act in our best interest rather than the letter of the law.

What you're proposing would require broad-sweeping revisions to all manner of law.

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by logfromblammo on Tuesday September 01, 2015 @02:12PM (#10154502)
I am simply ebullient with anticipation over the thought of the first copbot arresting its own human supervisor.
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by lumberjack on Tuesday September 01, 2015 @02:26PM (#10154607)
Or maybe there could be a second traffic code for autonomous driving cars that is basically the same code but with lots of exceptions such as "you can never cross a solid double line except when...".
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by tclark225 on Tuesday September 01, 2015 @01:21PM (#10154094)
I definitely agree with this, but how could you specifically change the laws in this case such that they are still, by some measure, "fair" and "just"? Most people would probably agree that there is no reason to adhere to the letter of driving laws all the time. Speeding on an empty highway to get somewhere more quickly is mostly harmless. Running a red light in a dangerous neighborhood might be safer than waiting. To the point of the "real" laws, such violations are probably most often prosecuted when they result in danger to the driver or others. You could certainly generalize these examples from driving to a variety of other laws.

I guess the question is, you can beat the drum about this, but to what tune? What's the answer? How could a self-driving car decide when it is okay to break traffic rules without a certain level of human discretion? How could the laws be re-written such that the effect is the same?

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by danharaj on Tuesday September 01, 2015 @01:34PM (#10154207)
What if we step outside of the law in organizing our societies? Law being an abstraction, any usefulness it has must be realized in its substrate: human relationships. When law fails, it is because the abstraction has leaked. We can find remedy by working with the fundamental thing and restoring the abstraction.

In NYC, there is an unspoken more that people who wish to stand on subway escalators should stay on the right so that people who wish to walk up escalators can use the left side. This is not a law; it is not derived from authority; it is not enforced with coercion. The worst you'll get, probably, is a snide 'excuse me'.

Authority is a degenerate form of respect. Law is a degenerate form of consensus. Arbitration is a degenerate form of mediation. Holding ideas accountable to human beings is superior to holding human beings accountable to ideas. At the end of the day, we are only accountable to each other, not the law.

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by jerf on Tuesday September 01, 2015 @02:33PM (#10154657)
"definitely agree with this, but how could you specifically change the laws in this case such that they are still, by some measure, "fair" and "just"?"

This is a really deep question, which is part of why I dropped the entire discussion on the topic in my initial post so I wouldn't get too sidetracked.

One problem we have is that if we can encode laws into computer programs, which is to say, basically math, we also become subject to the problems that creates. For instance, raise your hand if you enjoy min-maxing in an RPG or MMO or something. Now, keep your hands raised and add a big evil grin for me if you'd love the opportunity to minmax real laws with such impunity.

In theory, even human enforcement is a computational system which could in theory be attacked the same way, but in its own weird way, its own enormous complexity and frankly at times random enforcement prevents the really terrible gaming of the law by preventing an attacking entity from fully accurately simulating the system for the purposes of attacking it.

(I said something that may trigger some knee-jerk reactions in some people about "gaming" the system. But however bad you think it is in the real world... and I would agree that it is bad in many places... it has nothing on the gaming you can do on something specified with programmatic precision and with no human in the loop to prevent truly stupid states from emerging. This isn't making your way to the top over the years by bribery and flattery, this is waking up one day and discovering that one person has literally all the money now.)

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by Retra on Tuesday September 01, 2015 @01:29PM (#10154169)
You'll want to encode enforcement rules in the laws themselves. Fundamentally, our laws really aren't constraints on what you can do, but guidelines for what you can enforce. You need to take it a step further and write down what you will enforce.
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by vezzy-fnord on Tuesday September 01, 2015 @01:46PM (#10154323)
But execution and legislation are two separate branches, why are you creating a tightly coupled relationship between them? Writing down explicit paths of enforcement sounds almost guaranteed to be incomplete, and would result in having a high degree of agency being removed from enforcement, because they would now have to follow literal conditions no matter what. Conditions which will almost certainly account for an insufficient number of variables than the ones that will be encountered in reality.
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by Retra on Tuesday September 01, 2015 @01:58PM (#10154407)
>But execution and legislation are two separate branches,

And cars don't drive themselves. So I guess that solves our problem.

You can read my post below (https://news.ycombinator.com/item?id=10154344) to see how I'd start addressing your other concerns. Basically, if an enforcement officer recognizes some new variables, they can write them down in the law and then enforce it.

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by danharaj on Tuesday September 01, 2015 @01:34PM (#10154211)
How do you guarantee the enforcement of the rules of enforcement? The fundamental problem is a vicious circle. The abstraction of law leaks.
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by Retra on Tuesday September 01, 2015 @01:40PM (#10154261)
Every abstraction leaks. That's why they are abstractions and not 'actuals.'

What you do is try it, and when it fails, you manage the failure and modify your system.

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by danharaj on Tuesday September 01, 2015 @03:24PM (#10155022)
Different people have different idea what the actuality of law is. Most people (as Baudrillard would argue) don't ever work with the actuality. Others, mainly the powerful, are quite happy enough to fix failures of the law with copious amounts of force. The abstraction tends to leak bullets. It is very important to emphasize that the law is less than sacred, even an annoyance, to undermine those who will enforce it with the wrong actuality.
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by Retra on Tuesday September 01, 2015 @05:31PM (#10155896)
I fail to see your point.
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by danharaj on Tuesday September 01, 2015 @07:02PM (#10156391)
Attempting to maintain the abstraction of law by fixing it when it leaks has the hazard of bad actors sneaking undesirable elements into our social structures, like violently maintained hierarchy. Adopting a mindset that law is fundamentally flawed and its language is essentially incoherent helps mitigate this possibility.

An example of such incidence is when people trust the police to the point that they prejudge conflicts involving the police on the basis that they represent the law, and the law is good, therefore the police are good. This is still happening.

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by ewzimm on Tuesday September 01, 2015 @01:35PM (#10154224)
Computer programs are just human-dictated logic, so we can program the same decision-making processes into computers. A logical way to do this would be to train mapping computers the same way we do now, by allowing them to learn from human drivers. Just like how Google hires drivers with cameras to take pictures of streets, we can start with semi-autonomous cars which compare their programmed decisions with the decisions of the drivers and analyze differences. Afterward, they could ask the driver questions about why their behavior was different from what was expected in a programmatic way. Trends could be analyzed, and suggestions for altering the driving logic could be incorporated by programmers.
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by rasur on Tuesday September 01, 2015 @01:16PM (#10154054)
This. A Million times this.

However I fear the subtlety will be lost on the majority, as we continue to construct our own cages around ourselves.

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by danharaj on Tuesday September 01, 2015 @01:24PM (#10154119)
Most people are given a very, very stupid idea of what the law is from the very same institutions whose authority is derived from the law being treated as a real object external from human subjectivity that has real power over humans. An education that provides a realistic comprehension of laws and how they really work is dangerous; demystifying legal power and demystifying politics makes for a conscious, more autonomous body politic. Let's not blame people for their cages: The cages were put up while they were least able to contest them.
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by qntty on Tuesday September 01, 2015 @01:06PM (#10153957)
I think you're onto something that a lot of people don't understand or don't buy into
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by wereHamster on Tuesday September 01, 2015 @01:18PM (#10154069)
OTOH, if you start applying the law to the letter as it is written in the books, you'll quickly see how stupid certain laws are. And here stupid could be anything from not enforcable without arresting everybody, inconsistent, contradictory, etc. Think of it as formal verification of the law. The result, in turn, you can show to politicians or the people and convince them to change it.
Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by CWuestefeld on Tuesday September 01, 2015 @01:40PM (#10154263)
I think there's a lot of truth to what you're saying, but it's more complex than that.

When considering legislation and regulation, we willingly juggle a lot of cognitive dissonance. We seem to divide plan into (at least) its implementation and its intended effect, and consider each of those separately.

So I'm endlessly having conversations with friends of a different political stripe (which is easy, since everyone is of a different political stripe than me) that go something like: (note I'm not trying to trigger the implied political debate, this is for illustration only)

Friend: Financial system bailouts and systemic risks of "too big to fail" are terrible, and so we can't touch the Dodd-Frank legislation.

Me: I know that supporters of Dodd-Frank promised that it would put an end to TBTF. But the bill doesn't actually contain anything that does that. And in fact, since the industry has further consolidated since the bill was passed, it shows that whatever the intent, it isn't able to do its job successfully. If it can't do what you want it to do, why should we keep it?

Friend: But the banks are out of control, and we need to do something to prevent another collapse. We can't remove any regulation on them!

Maybe this is just the normal voter ignorance effect, but it seems that we assume people are making decisions based on actual understanding, but they're really just using oversimplified proxies instead, even when the inaccuracy of their proxy is pointed out to them. So a law that purports to fix X (whether X is healthcare or immigration or whatever) is a necessity, regardless of what the actual evidence, whether empirical or from reading the bill, tells us.

TL;DR: passing a law is intended to make us feel like we're doing the right thing, not necessarily to actually do it.

Re:Google Says It’s Not the Driverless Car’s Fault. It’s Oth... by chrismcb on Thursday September 03, 2015 @03:08AM (#10163675)
It seems to me that this is less about "following" the law, and more about being safe. The car that was rear ended might have stopped for any number of reasons, the tailgater is going to hit the stopping car. And the google car actually didn't follow the letter of the law at the 4 way stop. It also has been programmed to wait for others, in case they are breaking the law. If everyone followed the law 100% everyone would be safer. I'm not saying the laws are perfect, but the issue discussed here is more about what the self driving car is doing that isn't covered by law