I've no doubt taken into account copyrighted works and personal information when training my built-in neural network. The examples the article gives like "misremembering" the murder as the murder victim sounds like something a person would do. Knowing verbatim contact information of some random person is also possible. All in all, GPT-2 sounds a lot like us.
You can ask a person "did you come up with that sentence, or is it something you read?" And they can answer that question. The answer isn't perfectly reliable, but it isn't completely unreliable either. You can't do that with GPT-2/GPT-3.
Big picture: the human mind is a machine of sorts. It's not the same kind of machine as any form of machine learning we've developed so far.
How would we be able to tell how reliable it is in general?
"""The left brain of people whose hemispheres have been disconnected has been observed to invent explanations for body movement initiated by the opposing (right) hemisphere, perhaps based on the assumption that their actions are consciously willed.""" - https://en.wikipedia.org/wiki/Neuroscience_of_free_will#Rela...
No idea if it would be feasible to integrate this information directly into the model. With my limited understanding of neural networks, this seems difficult.
Thus “free will” must come from some sort of faith. Either it was given to us by “God”, or we’re all part of some simulation and it exists on a level we don’t know about, or something else entirely too advanced for us to understand.
I take the view that ∀ x ∈ <free will definitions>, Has(x, humans) ≡ Has(x, AI)
∀ x ∈ <free will definitions>, Has(x, humans) ≡ ~Has(x, AI)
For these to both be true, <free will definitions> becomes empty. Thus I argue we have none. Edit, or rather it’s meaningless to argue if we have any or not, as it cannot be defined.
This sums up my view too. Can't argue about it if you can't define it.
Free will is faith in the sense that we learn the concept from our culture as our sense of self develops. The assumption of having it shapes our thinking such that we can say we actually have it.
A person who took their inner voice as voice from the gods would have a restricted free will in this view.
There is a lot of space between “user data and ML research on that data needs to be closely regulated” and “run the ML researchers out of town.” This uncharitable exaggeration makes critics sound like an uninformed mob and closes yourself off to legitimate ideas. This directly leads to logically flawed and morally gross suggestions like:
> It's that people really need to start using the encryption technologies that were built decades ago to protect some of their most valuable assets, their mental model of the world.
It is simply not reasonable to expect most Facebook/Skype/etc users to know enough about encryption to make good decisions here - for the same reason that you can’t expect people to have detailed understanding of food science to protect themselves from unscrupulous grocers, or to have a detailed understanding of medicine to protect themselves from fraudulent doctors. It really doesn’t matter if this knowledge has been around for “decades” since it’s still specialist knowledge.
Protecting digital privacy from unscrupulous tech companies and unethical ML researchers is a job for the government. Suggesting otherwise is victim-blaming. “The problem is that society is dumb and needs to become smart through the power of self-righteous scolding” is not helpful.
'The majority of humans are idiots who need to be protected from themselves by the government.'
I sincerely have no idea what your problem is.
Because the government is always scrupulous and trustworthy...and nobody that's ever said trust us we'll protect you has lied...
Nobody is disputing that the government can be corrupt, and at its best will be incapable of protecting everyone from everything. And if you are sincerely anarchist then that’s more of an ideological dispute beyond the scope of this comment.
But I suspect that you actually support regulation around food and medicine, since “a fatal case of salmonella is a small price to pay to make sure we don’t rely on the government” isn’t actually a good argument. And, unlike people who are ignorant about computer technology, you probably have empathy and understanding for people who are ignorant about whether the ground beef they are purchasing is actually safe to eat. You would not be sympathetic to a libertarian food safety specialist came in and said “well I can tell that the ground beef is unsafe, why not teach everyone my skills so they can defend themselves?”
The idea that the government can protect people when it comes to health, medicine, transportation, and personal property... but NOT when it comes to privacy, is just not coherent.
This is in addition to the ever greater sample-efficiency of bigger models, which learn eerily fast from just a handful of datapoints, rendering the supposed 'moats' of big giant proprietary datasets ever more moot...
You are proposing a technical solution to a social problem. That pretty much never works.
It's like trying to build a dog by hanging around the park collecting turds.
-- Richelieu
General state of encryption technology is that it's arcane and unusable outside of like a couple of chat apps
The problem isn't really the technology, it's that the people you are interacting with on the internet don't care about privacy as much as you do, and obviously when it comes to keeping things private, everyone has to participate.
This would make a good SF story. Probably has already :-)
It's a variation on the transporter problem from Star Trek - https://www.youtube.com/watch?v=nQHBAdShgYI
• https://worldbuilding.stackexchange.com/questions/51746/when...
• https://kitsunesoftware.wordpress.com/2018/10/01/pocket-brai...
Potential damage: the sim can do any work which meat-you might otherwise be paid for, building the things the megacorps want to build, while meat-you sufferers from <insert dystopian fate of your choice here, because you now have less annual economic value than a guide dog costs today>.
Even worse outcome: the sims are sentient and they know they’re enslaved and they can’t do anything about it.
(I don’t think anyone yet knows if sims would be sentient, or if it might be optional, but in the worst case dystopian nightmare the combination would definitely be even worse than just one of the two).
The obvious response to this is, "Then don't patron those companies," which is just as naive and oversimplified of a solution as the one above suggesting everyone everywhere should just use encryption (but for very different reasons).
There is just simply no logical reason to believe consumers would ever get data rights over corporations under capitalism with major reforms putting corporations back under our boots where they belong.
https://en.wikipedia.org/wiki/White_Christmas_(Black_Mirror)
Every company stores this stuff for ages, and the value of candid conversation data just keeps increasing. Eventually these companies are either going to get hacked, get bought, or go bankrupt, and all the cleartext data they hold is going to get passed around to various data markets and end up incorporated into GPT-12 or whatever.
The moral of the story here isn't that companies need to stop storing data, or that we need to run ML researchers out of town. It's that people really need to start using the encryption technologies that were built decades ago to protect some of their most valuable assets, their mental model of the world. Otherwise these systems, which are being trained to extract as much value out of you and the ones you love as possible, will use this data you're giving them for free against you, and it'll be to late to do anything about it then.