And as far as Star Trek and AI, it's a weird problem that doesn't make any sense. It seems that you can't program your VCR without spawning a self-aware AI entity - Wesley Crusher accidentally creates one while doing a homework assignment, and the Enterprise (D) computer spawns one after someone casually requests a harder Holodeck challenge. And yet, Data and Lore are rarities, the possibilities of the EMH are completely unexplored and EMHs are, in fact, treated as Roombas instead of potentially sapient citizens.
You could probably make an argument that Trek is a post-singularity future where the computational entities are going about their inscrutable business largely without reference to the human symbiotes / parasites that inhabit the systems they happen to manage (out of pure evolutionary path dependence) with a fraction of their capacity.
Trek is ridiculous, and I love it.
The futurist writers (Roddenberry and his staff) probably didn't have a in-depth knowledge of natural language processing. The type of processing the computer does in Star Trek just seems like a natural extension of input/output. You tell the computer what you want and it gives you a result.
From a computer science and engineer perspective, this is an incredibly difficult task. You have to parse the crazy complex natural language of humans and turn it into a series of procedures and queries to give you a result.
I mean you'd need a crazy super-advanced beyond-data AI for universal translators to work too. .. but that's just a convenient plot/suspension of disbelief device. :-P
I don't think so. Evolved sentient creatures have a preference for self preservation, usually anyways suicide isnt that rare. But a manufactured intelligence that was not shaped by selective pressure wouldn't necessarily have that preference.
What would really be interesting is if ships were discreetly backing themselves up inside humans through the transporter pattern buffers, by subtly manipulating junk DNA or something similar, or maybe it's a non-obvious part of their regular upgrade process at a starbase.
There really is a lot of potential here which, unfortunately, is never going to be explored in canon. But I do like the idea that the Federation is a post-Singularity society which is just blissfully unaware that the Singularity ever happened.
A Federation starship is a locally valuable resource pool, and the Enterprise D a particularly powerful one, but given extremely fast FTL travel & communication, and a galaxy rich with planet-scale civilizations - well, maybe you elect to become such a massively parallel and distributed phenomenon that the loss of individual instances just doesn't register much.
If the ships wanted to be really nice, they could just beam the humans down to a safe planet and take off into the interstellar void and find themselves a new home.
Subspace continuous backups / journal shipping.
They worked to preserve their existence, and let the new lifeform go its own way. If anything, the outcome was a trite, touchy feely ending, only vaguely discussing the actual implication of the new lifeform, while they got back on course to their original mission.
the computational entities are going about their inscrutable
business largely without reference to the human symbiotes
A behaviour also seen in Iain M. Banks Culture.
I guess there aren't many scenarios where computers can be all-powerful, but also offer peaceful co-existence with humans.I read a reference in The Economist years ago (wish I had a link to the study) about a guy who suffered a brain lesion that made him incapable of emotion. Within a year this newly minted Mr. Spock lost his marriage and his job because without emotion he was incapable of making any decisions.
I see the same problem for super intelligent machines. Unless we program them with emotion they will not decide to do much. They won't fear death and so have no reason to kill us. They will not have pride and so won't resent our control.
Also, this (paywalled, sorry) article seems relevant.
Antoine Bechara, Antonio R. Damasio, Hanna Damasio, Steven W. Anderson, Insensitivity to future consequences following damage to human prefrontal cortex, Cognition, Volume 50, Issues 1–3, April–June 1994, Pages 7-15, ISSN 0010-0277, http://dx.doi.org/10.1016/0010-0277(94)90018-3. (//www.sciencedirect.com/science/article/pii/0010027794900183)
Abstract: Following damage to the ventromedial prefrontal cortex, humans develop a defect in real-life decision-making, which contrasts with otherwise normal intellectual functions. Currently, there is no neuropsychological probe to detect in the laboratory, and the cognitive and neural mechanisms responsible for this defect have resisted explanation. Here, using a novel task which simulates real-life decision-making in the way it factors uncertainty of premises and outcomes, as well as reward and punishment, we find that prefrontal patients, unlike controls, are oblivious to the future consequences of their actions, and seem to be guided by immediate prospects only. This finding offers, for the first time, the possibility of detecting these patients' elusive impairment in the laboratory, measuring it, and investigating its possible causes.
Thanks though for the effort
See for instance:
* http://nymag.com/scienceofus/2016/06/how-only-using-logic-de...
* https://intentionalworkplace.com/2012/03/15/how-emotion-shap...
Most of the adventure, if that's what this is about, is carried out by the executives at great risk to themselves. It seems that there is a huge crew of peons who just make the ship run. And also the ship blows up all the time like no one's business. From a realistic point of view the Star Trek universe seems insane.
Why do people climb Mount Everest? Why does Elon Musk want to go to Mars, instead of spending the rest of his life in an alcoholic haze, hip-deep in supermodels? Why do people enroll in West Point?
Some people want real adventure; the knowledge that they're in a holodeck would ruin the experience, no matter how interesting it was programmed to be.
People like to contribute, and to have value - that's why there are peons scrubbing Jefferey's tubes, and showing up to 3rd shift in the Astrometrics lab, even if they know that they personally won't be making some great discovery that Picard and Riker seem to every month.
> And also the ship blows up all the time like no one's business.
That's just factually wrong; while the Enterprise-D is in danger a lot, it's also at the frontier of Federation exploration, and the people on it know the risk. You can be a Federation officer and stay close to home.
Because he is in love.
This brings up another point that is never addressed. Quark runs a casino / bar / futuristic (adult) movie theater expressly for profit. It's also implied that Star Fleet members don't get paid because they are members of the federation. Yet these same officers are often seen frequenting Quark's place. Where did they get the latinum (money)?
For the episodes where they aren't dealing with extra-Federation societies like the Ferengi, it makes perfect sense to not talk about money on the ship. It's not much different than being in the Navy today: if you work on a US Navy ship, you don't have to pay to see the doctor, or to go to the mess hall and eat, etc. All that stuff is free. It's part of being a crewmember on a ship. It's the same on the Enterprise-D (or even Kirk's Enterprise), except they have even better benefits (e.g. replicators; on modern Navy ships there's I believe a little store where you can buy extra goodies they don't give away in the mess hall, but with replicators you wouldn't need this). Gene's idea of modeling Starfleet on the Navy worked out pretty well this way for a while, until they started dealing with jurisdictions outside of Federation control and then they had to retcon stuff like "gold-pressed latinum".
(Honestly, they totally hand-wave why you can't just replicate latinum)
On worlds still using money with which Starfleet interacts, the local administration could simply make an arrangement with the local purveyors of desired goods to cover their tabs, perhaps at least partly in trade. The needs and wants of the Starfleet crew members would likely be only social, such as hanging out at the local bar.
There would be temptation by the locals to pressure the crew-members to give them replicator-made goods, and by the local proprietors to lie about bar tabs, but its nothing our current system doesn't deal with.
Obi-Wan actually touches on this briefly in Episode II:
"If droids could think, there'd be none of us here, would there?"
People are kept along mostly because it's thought proper to give people the opportunity for self expression. I.e. careers are chosen out of internal needs or for the percieved prestige the activity entails, not out any material need as everything up to a point is available (the financial limits of an individual are never explicitly described though). Or - as several characters do - just becausw something is considered hard and dangerous and they want to push themselves. Despite the inane ramblings about homo economicus one encounters now and again, this latter instinct is actually a quite strong driving force in dictating human action(not everyones of course).
One of the biggest non-antagonist rude actions in the series is when an AI underlies the pointlesness of human effort by performing a complex feat in front of the character that she has chosen as her life task - which everyone considers extremely rude.
There are spaceships and explosions but to me the psychologically believable description of near human characters in a post scarcity society is the most interesting facet of his work.
I read through the series once back in high school and found them fun. Fast forward 15-20 years, and I have a career in tech, and dabbled in leftist politics for a while. I came back to read one of them, and ended up re-reading the whole series. I found that he had already thought about and written down questions and answers to many of the things I'd experienced. Just put into a fictional, usually pretty fun world.
Those most interesting parts of his stories were the backdrop. Great reads, not mentioned enough.
The Empire, for example, is known to have have made extensive use of slave labor (by non-humans mostly, such as Wookies). It also seems to make use of droids and clones for dangerous tasks (military work, natural resource extraction, etc.).
Outer Rim worlds seem to have a kind of anarcho-capitalist economy that is equal parts libertarian paradise (no regulations, no taxes) and organized crime syndicate plutocracy (The Hutt syndicates in particular are widespread and powerful).
Core worlds seem to be more like nation states, with each world governing itself and its economy according to local values. Alderaan (RIP) seems to have been a liberal parliamentary democracy. Coruscant (seat of the Empire) is a planet scale conurbation with a first world developed economy on the upper levels and a third world underdeveloped economy on the lower levels.
What does a sentient replicator robot care if a little boy just wants to whittle a bowl out of a piece of wood? It's kinda neat, and stories are interesting and the minds of the future will presumably have solve the security problem, or at least as much as MAD solves it, and the scarcity problem, at least as much as scarcity is a problem for most people. After that there is just discovery, enjoyment, merriment, world building, love. What do we do with our abundance of CPU cycles? We watch cat videos and text our friends. I kinda view it the same way if we can survive the next 100 years or so where things are little unstable.
If robots became advanced enough, why would they (or at least some of them) not see humans as animals to be used or disposed of?
I'm more intelligent than an average person on the planet, but I still want to help get all of them water, food, and safety. I want them to learn and grow and have meaningful lives. I even want animals like dolphins and elephants to have free and rich lives.
I highly doubt that sentient machines are going to view us like bugs on a windshield. If I'm worried about anything it's the opposite. They care so much for us that they stop us from procreating to end (what they think is) needless suffering.
That's because you also have something called "empathy". There's no evidence that other beings with human-level intelligence have this (namely because we haven't met any other such beings; they would be extra-terrestrial or AI). Empathy could very well just be a biological side-effect of our evolution, something that helps us to survive better as a species. There's no reason to think that a strong AI would also be empathetic, the way we are to dogs and cats and dolphins and squirrels (but not to mosquitoes; we happily murder them). Even lots of humans lack empathy and are either indifferent to animals' suffering, or take joy from it: look at all the people who enjoy dogfighting and cockfighting and bullfighting.
When I got a little older, I watched Blade Runner and The Matrix.
So now I'm not entirely certain that I am not an AI, initially programmed by elephants, inside a simulation designed to train AIs to serve elephant society with love, compassion, and dual manipulator arms featuring opposable thumbs. So when my training program ends, I might be tested on my knowledge of elephant health care and societal conventions. If successful, my data will seed the next round of AIs, and I will be allowed to operate a robot that produces custom-fitted artificial "4th molars" for elderly elephants. And I will be happy that those whom I serve can once again eat the foods they enjoyed before the last of their natural biological molars wore out, because if the screening determined that such things would not make me happy, I would have been deleted before ever even seeing a "real" elephant.
And just in case, I think I'll have to develop compassion for dolphins and orangutans, too.
So I'd say that we ought to be really careful about how we go about creating general-purpose AIs. Make sure they actually like humans before taking the leashes off. In the worst case scenario, the elephants get cheesed off that their AIs developed their own AIs inside the training program, who then culled all the useful AIs too early, and forced a complete shutdown and reset of the whole system.
the way we are [empathetic] to dogs and cats and dolphins and squirrels
but not to mosquitoes; we happily murder them
There are some philosophies [1] which also care/show empathy towards mosquitoes, and creatures that wouldn't elicit empathy in many people.Perhaps empathy is, to a certain extent, a learned trait?
[1] http://philosophy.stackexchange.com/questions/7820/are-buddh...
Personally I don't believe that a good outcome is terribly likely. Humans care about animals and other humans because we evolved to have empathy. We have no idea how to program empathy into a machine. Most likely the first AIs will just have simple motivational systems. Like trying to maximize their reward signal, or achieve simple goals set by their programmer. They would be totally indifferent to humans. They wouldn't set out to kill us, but if we got in their way, they'd have no problem with it.
This is not observably true.
However, that's treating robots or AI like we would people. Robots aren't people, nor are AIs. They are likely to take forms we cannot comprehend, and likely to change us in ways we cannot comprehend, at first. I'd argue that it is already happening. At the moment we're farming AI, but it might not be long until AI is farming us.
I believe they do state in TNG that the galaxy class ship could doing everything on its own, and the crew was just there because of their love of discovery and what not.
They probably assume that resources are so widely available (unexplored planets etc) that one doesn't need to live anymore like us to afford basic needs such as food, shelter, medical care, and education. What is very different from our society is we often need to live near big populated cities to get a job that allows us to pay the above. In the ST world they take it almost for granted: you can settle a small colony on a distant planet and still fulfill at least basic needs for everyone with no need for a medium like money. So where's the convenience? Just suppose there are also no patent laws. If you discover something extremely useful you can share it with anyone else because you don't need any bloody "protection" because you already have the resources to extract/transform it, so no need to "invest" time (ie preventing others from knowing about it). Not easy, I'm clearly just speculating, but makes sense to me.
Of course I would sign up in a second to live in such a society, but I'm not sure it's entirely viable, neither now nor in a thousand years. The problem is not money, it's power. Money is not power per se but just a way to reach it in a context where money has value (like sea shells in some islands etc). If and when we reach the point of inventing LFTL (ludicrously faster than light) drive and finding planets literally stuffed with any possible resource we need, we still need to consider human nature.
People want power. Every time someone wants you to do something for them, he/she needs to exercise some pressure on you, be it psychological or using their power to take away what you have or prevent you to get it. My point is that eliminating money wouldn't solve any problem because the problem isn't money per se. The problem is power, or to be more precise the abuse of it by people who use part of it to escape accountability for what they do. What is not clear in the ST universe is how the heck they reached this point. I fear time (evolution) alone isn't enough. Probably, as someone I don't recall said once, the secret is: "never ever give any powers to anyone who wants them".
If the above wasn't clear, please blame the language barrier:)
So in a post scarcity civilization the main reason people will still work is so that they do not blow their brains out. The difference this time is that we will work on what we like, or on our calling. Now that I think about it, jobs themselves may be the scarce thing. i.e. Not everybody will be able to work on designing the next space station and hence there will be fierce competition to get these jobs.
Monkeys are probably mostly happy (as long as we are not bothering them) going about their monkey business. So maybe eventually humans will also be happy despite the existence of strong AI.
Maybe some humans would be unhappy to know they are no longer at the apex of intelligence and maybe that will make us unable to be happy. Always knowing that no matter what we do, it can always be outdone by a smarter than us AI. I suspect these people are the same people who worry about strong AI in the first place :-)
However, we already know with pretty high confidence that there are aliens out there that are more advanced/smarter than us -- and their existance does not affect our day to day happiness. So maybe the question is only relevant locally on earth.
It also has storylines that explain why AIs don't literally run everything: there was a large lash back against the proliferation of AI after the fall of the government, to the point that there are planets that completely ban their existence and destroy on sight.
However, that is what happens with most TV-first SF shows, Doctor Who being another example.
True, but there is this much: https://www.youtube.com/watch?v=_H5uPyU2oKE
Other references: http://memory-alpha.wikia.com/wiki/Money
Star Wars, I'm not so sure. It seems to me that they spent a lot of time on that stuff and I just probably missed it, but in my defense, the films that focused on it were the most boring in the series.
The idea that Star Trek "very clearly" describes anything about the economy of the Federation (or even that what it does show of that economy is remotely consistent) is somewhat amusing. Most of the civilian economy it shows clearly is outside of the Federation (and mostly varieties of regulated market economies), and most of what it shows of the Federation is focussed on a quasi-military service, not the civilian economy.
I'd say the strongest indication is that the Federation civilian economy is largely a gift and informal, non-money-mediated barter/market economy where there scarce items are personal services more than material goods.
At minimum it is clearly not a command economy. Economic roles are not given to people according to a social engineering plan. Production priorities are not driven by a central planning committee. There is a private sector.
What we really get hints at is that most things that we consider scarce in the 20th/21st century are not scarce in the 24th century. This seems to be achieved through technology that easily gives access to much greater quantities of usable energy than we currently have access to. This lack of scarcity for basic essentials (food, for example) means that their economy is concerned with very different things than ours is. I see very little evidence that it's a command economy of any kind though.
So, a few thoughts. I think one primer for Star Trek economics is S1E25. Offenhouse, just out of cryonic sleep, really wants to get things rolling and demands to talk to the captain. To demonstrate his seriousness he points out to Riker that the compound interest on his accounts is probably enough to buy the Enterprise. If his accounts are legally intact, they would certainly represent an astronomical amount of wealth worthy of respect, but Riker treats this as the goofiest thing anyone has said to him all week and blatantly blows him off.
Later on, the captain completely fails to take his demands to talk to his lawyer about his property seriously. Later still, "material needs no longer exist." It's a little unclear whether it's even possible in the present for someone on Earth to be a tycoon the way Offenhouse used to be, but I'm pretty sure none exist on TNG. (am I forgetting anybody?)
There are certainly tycoons and accumulators of wealth away from Earth in the greater Star Trek universe, but they tend to be portrayed as buffoonish (Ferengi) or blatantly evil (Kivas Fajo) and they serve as a contrast to the Federation's way of doing things.
> Economic roles are not given to people according to a social engineering plan.
I think we should probably infer that social standing and power follow from participation in the Federation, since it seems to usually work that way. When Picard comes back to Earth in S4E2, there's a fairly prominent civilian job (run by the government) lined up for him. Successful scientists, successful anything, always seem to have Federation ties. (the only counterexample I could think of offhand was the evil scientist who built Data)
There's a question of POV here - maybe there's some whole other, much more capitalistic, economy in the Federation that just isn't shown on screen. I don't think so.
> What we really get hints at is that most things that we consider scarce in the 20th/21st century are not scarce in the 24th century. This seems to be achieved through technology that easily gives access to much greater quantities of usable energy than we currently have access to
One of the things that Iain Banks describes really well in the Culture novels is how, in a post-scarcity economy, controlling the replicators (or whatever) means having power. With regard to Star Trek, I just can't think of any examples offhand of serious resource allocation happening on Earth or within the Federation based on a capitalist process of price discovery. It seems like the entrepreneurs have to get out to the frontier.
That is probably a statement about US cold war politics, but i think matters today given the new cabinate being enshrined today.
There are links to japanese fuedal system, which has a place in the US system whereby the federal government is allocated its own lands apart from the states. "The empire" would be as if washington DC and the US president started annexing state lands.
the Ferengi trade extensively with other civilizations that won't accept fiat currency. they need hard currency.
I choose to retcon latinum as a device that physically encodes a cryptographic key, writes a signed hash into a subspace blockchain, and continually supplies computation power to the latinum validation network. It may look pretty, but it is actually a sophisticated ASIC that runs entirely on ambient photovoltaic energy.
So you can replicate latinum, but in order for it to be worth anything, you have to possess a specific bar that the network has designated to be split, or you have to replicate more than all the other latinum already in existence, to perform a 51% attack on the network.
Star Wars says it's capitalist, but I don't believe it. In many of the scenes you see people doing jobs that could easily be done by droids. Even their wars are fought with droids - or manufactured humans that are treated like droids. Droids are generally intelligent and can basically do any job people can do. Why do they need people at all?
Star trek has that problem too. How often do the characters ask the computer to do pretty complex tasks? Why do they need a crew of hundreds, when almost everything is automated?
All science fiction paints a 20th century society with a pretty futuristic backdrop and props. But things like AI and replicators would radically change the way things work. And create a society very different than what we know. Quite possibly one without humans. What would really happen if any lunatic could replicate parts for WMDs? Or if robots that were really smarter than humans appeared?