News for hackers. Stuff that matters.
Re:Not OK, Google by TulliusCicero on Wednesday October 05, 2016 @11:34AM (#12644712)
What I think is interesting is that many of us nerds have probably innocuously fantasized about having a Star Trek-like AI assistant with us, but now that they're taking the first steps towards that, we're starting to realize that in order for it to do everything for us, it has to know everything about us, too.
Re:Not OK, Google by pimlottc on Wednesday October 05, 2016 @12:19PM (#12645217)
Nobody was thinking about "the cloud" back in those days. Back then, your data, you programs all lived and ran on your own computer in your home. Most people didn't go online, and if you did, it was mostly to read and download data to use locally on your own computer. Connections were intermittent and slow. The idea that your own data would be stored online was almost unimaginable; even using network-depending applications like usenet or email involved downloading everything first before using it. Online applications were hardly even dreamed of.

Our expectations of how "Star Trek AI" would actually be implemented were completely different than how highly connected cloud-based services like Google Assistant work today.

Anyway, the point being, if the assistant lived entirely in your own computer, it would entirely different. Most people are not concerned about what their "computer" knows about them, they're concerned about what companies and their employees do.

Re:Not OK, Google by sangnoir on Wednesday October 05, 2016 @12:43PM (#12645471)
> Our expectations of how "Star Trek AI" would actually be implemented were completely different than how highly connected cloud-based services like Google Assistant work today.

The trope-namer (Star Trek AI) was a ship-wide AI - when considering the ship sizes, it definitely is closer to the "cloud" model and not limited to a private instances on officers' bunker/bridge terminals/tricorders. Perhaps a hardcore Trekkie could answer this question: is there any canon that defines the AIs scope? Is restricted to just one ship, or could it possible be a Federation-wide presence with a presence/instances on ships?

Re:Not OK, Google by falcolas on Wednesday October 05, 2016 @04:43PM (#12647664)
The AI for the Enterprise D was run from three computer cores on the ship (two in the saucer, one in the engineering section), made up of Isolinear Chips subjected to a small warp field (iow, it makes computes using light faster than the speed of light). Subspace communication bandwidth is too limited (and potentially affected by latency, since it had to travel through repeaters throughout the galaxy) to provide realtime cloud computing as we experience it.

There are some cannon exceptions to this (such as in Nemesis where the subspace communication interruption affected the star charts), but even then the functionality of the ship was not impacted.

The Star Trek ships are very analogous to our own ocean-bound ships, where satellite communication is possible almost anywhere, but they don't rely on it.

So, yes, the AI is completely confined to the ship.

Re:Not OK, Google by timv on Wednesday October 05, 2016 @07:18PM (#12648812)
What about when someone was (permanently) transferred between ships?

Was there ever an indication that their AI-level data was transferred along with their personnel file? For example did the replicator know what food to offer them on day one?

If so, then it's seems reasonable to assume that the Enterprise's AI data was backed up at Federation HQ during routine maintenance, and that the "IT department" at Federation knew exactly what you liked to do on the Holodeck.

Re:Not OK, Google by falcolas on Thursday October 06, 2016 @10:12AM (#12652570)
> did the replicator know what food to offer them

Through specific indication from the user. Recall the constant utterance of "tea, earl grey, hot"?

Ultimately, I imagine the user's information (documents, etc) was passed directly between ships, or through (as you say) Federation HQ.

> Enterprise's AI data was backed up

Ultimately, I think this is where AI will differ from ML. An AI won't have data that isn't a part of the AI - i.e. you couldn't separate out information specific to Picard from the rest of the AI code. An AI might be able to "scribble" down some notes about interacting with Picard and pass them off to another ship's AI, but the second AI would never treat Picard quite the same way as the first, even with those notes.

This stems from my belief that how ML interprets data is different from how an AI would. If you were to copy all of the data used to build a ML model and apply it again, you'd end up with the same ML model. An AI, on the other hand, if built twice twice from the same data would end creating two separate AIs.

Re:Not OK, Google by sangnoir on Wednesday October 05, 2016 @07:25PM (#12648847)
Thank you for that very thorough answer!
Re:Not OK, Google by unprepare on Wednesday October 05, 2016 @01:21PM (#12645807)
I never got the feeling that there was a lot of mistrust of other federation people.

for example, the Star Trek universe didnt seem like a universe where you had to shop around for a trustworthy mechanic, who wouldnt overcharge or over diagnose. (e.g. headlight fluid)

Maybe the implicit trust of other people was integral to the AI being successful in that universe.

Re:Not OK, Google by pixelbath on Wednesday October 05, 2016 @03:20PM (#12646898)
It's definitely a per-ship thing, because there are several episodes where they have to down/upload updated data to/from the Federation (at least in TNG canon).

I also think the comparison isn't perfect, because Federation vessels (in my mind) are similar to today's Navy vessels. All onboard systems are connected to other onboard, but opsec demands the ship systems not be influenced by external actors.

Re:Not OK, Google by ocdtrekkie on Wednesday October 05, 2016 @06:35PM (#12648557)
And a big point is that on a Navy-analogous vessel, it's reasonable to assume most activity on the ship is being monitored, for the safety of the ship and crew. The fact that the ship knows where everyone aboard is or that they can pull up the full Starfleet record for anyone who's ever been in Starfleet is not surprising, this is the military* and records and accountability are a big deal. But there's nothing to indicate that Federation civilians are monitored to that extent, and I'd argue enough episodes are strong on fundamental individual rights, that it's hard to imagine Federation life for civilians being a surveillance state.

* Don't start that argument. Seriously.

Re:Not OK, Google by dragonwriter on Wednesday October 05, 2016 @06:47PM (#12648628)
> But there's nothing to indicate that Federation civilians are monitored to that extent

The clearest example of extensive off-starship monitoring (within the Federation) that I can think of in TNG is a civilian (though, to be fair, a civilian in a role analogous to a "defense contractor"), Dr. Leah Brahms.

> I'd argue enough episodes are strong on fundamental individual rights, that it's hard to imagine Federation life for civilians being a surveillance state.

Actually, I'd say that its quite plausible that the Federation is a "benevolent surveillance state", that is, one with pervasive monitoring but a very low incidence of "serious" abuse (that is, the kind that substantially limits practical liberty -- casual intrusions on privacy may be more common.)

While the Federation seems keen on "fundamental individual rights", it doesn't seem to exactly mirror, say, some modern views on what those rights are -- and not just in terms of privacy.

Re:Not OK, Google by ocdtrekkie on Wednesday October 05, 2016 @08:36PM (#12649199)
I saw you give the Brahms example in another comment before I posted, so I am not surprised to see you bring it up. But I think you answered your own point. She worked heavily on the Galaxy-class starship's warp drive, which would be a relatively classified project that they would be very unhappy if the Romulans or any other hostile parties were intercepting data on.

And arguably, if she was working at Utopia Planitia Fleet Yards on the Galaxy class project, she presumably worked on a Starfleet orbital facility (technically, a number of facilities) over a span of years, where certainly enough data would be collected to make a poor replica of her personality, as in the show. I don't see anything suggesting specifically outside of basic biographical data, that she was being monitored in her civilian life.

La Forge, having interacted with that hologram extensively, and having surely read Starfleet's records... apparently didn't know she was married.

Re:Not OK, Google by CaptSpify on Wednesday October 05, 2016 @01:34PM (#12645916)
Even then, IIRC, it was limited to the ship(s). If you didn't want the ship to follow you, you could simply avoid entering the ship.

We're starting to lose that ability now.

Re:Not OK, Google by bhauer on Wednesday October 05, 2016 @12:58PM (#12645608)
I feel your message is the most important in this thread because it's the crux of the whole concern about privacy and the cloud.

Where technology has failed us most is in the utterly stagnant evolution and maturation of secure private networks. The following is a utopian notion, but had private networks seen as much R&D as the public clouds, they would be significantly less cumbersome than today's clunky VPNs. Imagine all of your devices collaborate directly with one another and with you on your own secure private network—no central cloud servers needed. Your personal assistant is software running on a computer you own rather than a third-party's centralized server.

I still feel this ideal will eventually be realized, but for the time being, no large technology company is willing to take the necessary risks to buck the trend of centralization.

The biggest fiction propped by up centralization and cloud proponents is that it would be impossible to provide the kind of utility seen in Cortana, Siri, Google Assistant, Alexa, et al without a big public cloud. A modern desktop computer has ample computational capability to convert voice to text, parse various phrases, manage a calendar, and look up restaurants on Yelp. Absolutely nothing the public clouds provide strikes me as something my own computer would struggle to do (to be clear, I would expect a local agent would be able to reach out to third-party sites such as Yelp or Amazon at your command in order to execute your desires, but they would do so directly, not via an intermediary).

A few years back, when Microsoft was at the beginning of its Nadella renaissance, I had hoped it would be the first technology titan to disintermediate the cloud and make approachable and easily-managed personal private networks a thing. Microsoft's legacy of focusing on desktop computers would have made it well-situated to reaffirm your home computer as an important fixture in your multi-device life. They could have co-opted Sun's old bad tagline: "Your network is your computer." But they elected to just follow the now-conventional public cloud model, reducing everyone's quite-powerful home computer to yet another terminal of centralized cloud services. Disappointing, but I think it is ultimately their loss. I suspect a lot of money is on the table for someone to realize a coherent easy-to-use multi-device private network model that respects consumer privacy by executing its principal computation within the network.

Re:Not OK, Google by eli_gottlieb on Wednesday October 05, 2016 @01:39PM (#12645964)
>Where technology has failed us most is in the utterly stagnant evolution and maturation of secure private networks.

Not just secure private networks, but secure and programmable personal computing in general. The amount that I can actually do with my workstation PCs, let alone laptops or mobile phones, is now thoroughly restricted compared to problems that require a full-scale datacenter.

I originally enjoyed computing because, so to speak, it was an opportunity to own and craft my own tools, rather than being forced into the role of consuming someone else's pre-prepared product. Now we're being boxed into the consumer role in computing, too.

Re:Not OK, Google by RodericDay on Wednesday October 05, 2016 @03:04PM (#12646751)
People at work keep asking me why I reinvent a few wheels here and there on my personal projects. "Why are you wasting your time with WebRCT? Why are you not using phaser.io?"

idk man. Computers are powerful. I like seeing what I can do with them.

Re:Not OK, Google by TheRealDunkirk on Wednesday October 05, 2016 @03:16PM (#12646854)
And with UEFI-level code on mainboards and baseband software on phones, the era of "owning" a computer is basically over. All you can do is hope and trust that the manufacturer isn't co-opting your experience or data somehow. As someone who grew up hacking on a C64 in grade school, and never stopped, I find this utterly depressing.
Re:Not OK, Google by Programmatic on Wednesday October 05, 2016 @04:13PM (#12647391)
Let me preface this by first saying that I absolutely can't wait to have my own personal home automation, AI assistant, etc. on prem without the cloud:

I think that as far as the nascence of these features goes, the cloud model will beat the on-prem features any day of the week for several reasons. Lack of configuration to set up, ease of use from anywhere without network configuration, etc. are table stakes. But the biggest at this point is the sheer amount of training and A/B testing data you can ingest to determine what is useful for your end users.

The velocity of cloud-based products is nothing short of amazing and I doubt that on-prem will compete with the feature set and ease of use of always connected solutions until there are feature-complete, mature cloud versions to then bring in.

Re:Not OK, Google by falcolas on Wednesday October 05, 2016 @04:52PM (#12647747)
As we just learned with Yahoo, though, once the ML models have been trained, they can be disseminated and used without the need for "cloud-scale" data or compute resources.

And, for better or worse, Dragon's text-to-speech is pretty damned good after a rather minimal amount of training.

I don't think there's anything stopping voice and intent recognition from coming back to our personal machines other than the ability to keep making money from having it come up to the cloud.

Re:Not OK, Google by Periodic on Wednesday October 05, 2016 @09:28PM (#12649434)
The cloud is all about scale and only having to rent resources when you need them. If you have your home server you have to buy and maintain and pay for those resources at all times. When you make a quick cloud request you only "pay" for the resources you consume.

When I was working on Google Search what really astounded me is how we could leverage hundreds of machines in a single request and still have virtually no cost per search. The reason was that each search used a tiny amount of the total resources of those machines and for a very short time. A total search might have (made up numbers) one minute of computation time, but spread across 200 machines it only takes 300ms from start to finish.

That's the benefit the cloud will provide. You don't want to have a 1000-machine data center available at all times to store billions of possible documents and process your requests with low latency. If we went to a private-network model I fear that the turn-around time would be a lot closer to a human assistant. You'd ask it to do things and then it would get back to you sometime later (seconds? minutes? hours?) when it had finished it's research and come up with an answer.

Re:Not OK, Google by Fang_ on Friday October 07, 2016 @06:27AM (#12659510)
>I still feel this ideal will eventually be realized

Quick shoutout to Urbit here.

Re:Not OK, Google by buckbova on Wednesday October 05, 2016 @12:40PM (#12645437)
> The idea that your own data would be stored online was almost unimaginable

Except that's what I did for many years using a computer only as a terminal for an AIX mainframe. My mail was there, I browsed what was the web, used gopher, wrote programs, all stored there.

Re:Not OK, Google by MildlySerious on Wednesday October 05, 2016 @01:55PM (#12646137)
On top of that, the cloud we have now is commercialized, opaque and constantly under pressure to comply with a government that many distrust, for what I would say very good reasons.

I would like to say that the cloud we have is a privacy concern because we don't know the full scope of data collected, nor what happens to it, nor do we own any of "our" data once it's in the cloud. But not every cloud would have to be that.

There's a perfect world where one wouldn't have to be paranoid about this stuff, but it's not what we have right now.

Re:Not OK, Google by pmyjavec on Wednesday October 05, 2016 @12:45PM (#12645497)
This is a great point, people didn't imagine a world where we became the product.
Re:Not OK, Google by marak830 on Wednesday October 05, 2016 @12:58PM (#12645610)
This right here. When I first heard about android, I imagined an open system I could tinker with like I can on my PC.

Instead I get the current evolution. I want a 3rd party.

The same thing comes to my every day of usage, I'm still on win 7, and short of leaving Linux(yes I should have already), I can't upgrade without becoming a product.

I want what we all imagined and dreamt of, and I pay for it.

What I won't do, is become a product.

Instead I'm stuck with multiple fake accounts on Gmail, using a pseudonym on everything(including programming contract sites such as upwork), just to keep some semi iota of privacy, and to enjoy the benefits of what we all want.

Imho we need a new major party to emerge, that will charge an initial fee(like windows 7), and let us do what we want with those services(with caveats of course).

But I fear we won't get that anymore.

Re:Not OK, Google by marak830 on Wednesday October 05, 2016 @01:21PM (#12645808)
Learning* not leaving Linux. Too late to edit. Damn you fat thumbs.
Re:Not OK, Google by AidanRB on Wednesday October 05, 2016 @02:18PM (#12646353)
That explains my confusion.

It's not that complicated. Use a common distro like Ubuntu and everything's documented online.

Re:Not OK, Google by marak830 on Wednesday October 05, 2016 @04:30PM (#12647537)
I keep meaning to learnt it, and try it.

But my main coding(admittedly amateur and earning very little) uses .net. on top of that most of the games I play to relax are Windows does only(as far as I know for most).

O keep meaning to make time, but it just hasn't happened yet. I don't get paid as a programmer (English teacher), so I need to spend my free time earning money on what I know.

As always, one day when I have money to spare(or time, which is basically the same thing haha).

Re:Not OK, Google by r00fus on Wednesday October 05, 2016 @02:27PM (#12646439)
You can move to Mac, AppleID is not really required.
Re:Not OK, Google by marak830 on Wednesday October 05, 2016 @04:33PM (#12647573)
Without trying to look like an arse, why? I have been on pc since dos, I can hack my way around any pc.

I will fully admit I have not spent enough time in Mac to figure out the file system, but from what (little) I have seen, your not in control.

I like my pc because I can see what sub-processes are running, who is taking up how much memory, install things to where I want and if worse comes to worse, manually change how windows runs. (I apologise if you can do all that in Mac, as I said, I don't have the experience certificate - I bounced off it hard).

Re:Not OK, Google by r00fus on Thursday October 06, 2016 @01:40PM (#12654408)
So go Hackintosh. At least you don't have to distrust your OS vendor.

To answer your questions, you're in complete control with macOS, you can turn off SIP, turn off Gatekeeper and install whatever kernel extensions you want. Apple doesn't snoop on you like with Win10 telemetry.

Re:Not OK, Google by type0 on Wednesday October 05, 2016 @06:04PM (#12648351)
The problem with Mac is that one needs to have Apple hardware, you can't even change your RAM sticks to the ones that Apple didn't approve. There is nothing (apart from maybe some fancy Adobe software) that you can't run on Linux just as well or even better.
Re:Not OK, Google by pmyjavec on Wednesday October 05, 2016 @03:43PM (#12647100)
Totally agree, I remember when that was the promise! I wonder what Ununtu smart phones are like ?
Re:Not OK, Google by winstrhammerman on Wednesday October 05, 2016 @01:18PM (#12645776)
Maybe people could imagine a world where the adage "if you aren't paying for the product, you are the product" would be widely relevant, sure. But not a world where that phrase would be irrelevant, simply because today if you're paying for the product, you're still the product.
Re:Not OK, Google by ska on Wednesday October 05, 2016 @01:30PM (#12645886)
That existed at least as long as cable TV, probably longer.
Re:Not OK, Google by joe563323 on Wednesday October 05, 2016 @12:35PM (#12645390)
Nailed it.
Re:Not OK, Google by someone7x on Wednesday October 05, 2016 @11:38AM (#12644769)
I think there's an additional nuance, that of Google knowing everything about us. If I hacked together my own home automation AI system it would need to know everything about me too and that worries me far less.
Re:Not OK, Google by nine_k on Wednesday October 05, 2016 @11:45AM (#12644832)
...until it's broken into.

I suspect that chances of would-be burglars or identity thieves breaking into Google data are pretty slim, in comparison to a home-installed system.

OTOH both Google and a private person can be strong-armed by a court order, or even a three-letter agency, to open up their AI knowledge vaults.

Re:Not OK, Google by joncrocks on Wednesday October 05, 2016 @11:54AM (#12644942)
The difference is one of targeting.

It's like saying "People would never break into a bank, when they could break into someone's house and steal their stuff"

It may be easier to break into someone's home-brew system, but generally it would be unlikely to happen unless you were being otherwise targetted. Whereas google has a lot of users data, which could make it a more attractive target.

Re:Not OK, Google by tbrownaw on Wednesday October 05, 2016 @12:15PM (#12645180)
It may be easier to break into someone's home-brew system, but generally it would be unlikely to happen unless you were being otherwise targetted.

Just how "home-brew" are we talking here? If there's any web-facing code that you didn't write yourself, whether commercial or open-source or whatever, that's a target for attackers that just scan everything looking for known vulnerable services.

If it is entirely custom, I'm fairly sure there are a few classes of common security errors that can be reasonably well tested for without direct human involvement. Which brings back the threat of attackers just scanning for all available targets.

Re:Not OK, Google by nine_k on Wednesday October 05, 2016 @12:14PM (#12645158)
Very much so!

If you're a "person of interest", you'll be attacked either way.

If you're just a regular person, like me, you won't likely be targeted. But my chances of getting a collateral damage are much higher in a centralized system: when it's broken into, my data have a chance of being siphoned off along with data of someone less ordinary, who was the target of the attack.

Re:Not OK, Google by infogulch on Wednesday October 05, 2016 @01:05PM (#12645666)
It's wider than this. A "person of interest" will be attacked either way. A "normal boring person" won't be targeted directly, but may be swept up in an attack on a "person of interest".

But there's a third case: "normal boring people" become interesting just by being together in a big group, even if no particular "person of interest" is among them.

Re:Not OK, Google by zeveb on Wednesday October 05, 2016 @12:37PM (#12645404)
> I suspect that chances of would-be burglars or identity thieves breaking into Google data are pretty slim, in comparison to a home-installed system.

The odds of someone physically taking my computer and decrypting my data are zero (128-bit encryption for the win!).

The odds of someone electronically breaking into my computer are higher.

The odds of my data being misused or misaccessed at Google are one: it will happen.

Re:Not OK, Google by arca_vorago on Wednesday October 05, 2016 @11:51AM (#12644903)
Im more worried about turn key totalitarian nation states having this info and then being able to walk the cat back.
Re:Not OK, Google by jrowley on Wednesday October 05, 2016 @12:00PM (#12645001)
Exactly. For example, see the news yesterday with Yahoo. Imagine instead of just emails, it was all of the data about all of us.
Re:Not OK, Google by unprepare on Wednesday October 05, 2016 @11:41AM (#12644801)
only if you hacked together your own search, maps, calendar, etc. as well.

Maybe someday that will be a realistic endeavor, but it would take a lot of effort to set up and maintain your own personal versions of all of google's services, and integrate them

Re:Not OK, Google by Malarkey73 on Wednesday October 05, 2016 @11:52AM (#12644917)
I think it's possible to create a hybrid whereby your personal AI - has access to those external systems to check public (maps, search) and cloud data (calendar, mail).

But it stores the private data about your location, your searches, your purchases. this could even be an encrypted private fire-walled bit of cloud rather than a robot in your house.

The point being your AI is serving you. And you can delete/edit this private data (or even the whole AI) if you wish.

Re:Not OK, Google by internaut on Wednesday October 05, 2016 @12:09PM (#12645101)
That is the whole point of Intelligent Agents.

https://en.wikipedia.org/wiki/Intelligent_agent

Perhaps using Urbit as the network architecture since it already has pki. As Yarvin calls it, true 'personal cloud computation'.

Really it's the only sane way to live in the 21st century.

Re:Not OK, Google by ocdtrekkie on Wednesday October 05, 2016 @06:43PM (#12648600)
This is spot on. I'm okay with having my home automation system tap a weather API to collect data. But I don't need an Internet service to know the thermostat settings in my house.

I've designed my home automation system on the concept that the only route to the Internet is my computer (and therefore, my home automation software). My computer is a secure, well-managed intermediary that can store my data, and decide when and how to receive and send data to the Internet.

The idea of dozens of Internet-connected devices in the home is :terrifying: in comparison, especially considering that badly-secured IoT devices are now powering some of the biggest botnets out there.

My light switch, however, cannot talk to the Internet. It has local-only communication protocols that are simple. It knows how to be told to turn the lights on or off or dim or a handful of other settings, but it's literally incapable of doing anything else... and why would I want anything different? Why should my light switch have Bluetooth and Wi-Fi and software updates and a miniature flavor of Linux... It's a switch!

Re:Not OK, Google by nacnud on Wednesday October 05, 2016 @12:04PM (#12645050)
Your description sounds like a very intelligent cache/proxy.

When my AI can talk directly to your AI, we can transfer mail etc without cloud services. If it knows our social network, perhaps it can remotely store encrypted backups of our data, but only with people who we already trust.

Re:Not OK, Google by nine_k on Wednesday October 05, 2016 @11:48AM (#12644868)
Hosting your own mail, calendar, cloud storage, and even a mapping application is quite doable right now. There are open-source projects for that, and you can have your own physically secured machine in a co-location facility for a reasonably small sum.

It's just not easy to do, both in setup and maintenance effort. Most people would not care about their privacy nearly enough to justify that.

Re:Not OK, Google by ocdtrekkie on Wednesday October 05, 2016 @06:38PM (#12648572)
My recommendation for people to look into here is Sandstorm.io. It runs either on-site or in the cloud, and it already can replace a lot of what one uses cloud services for. In time, hopefully open source projects will develop "intelligent" apps that can then tap into that data and do more with it, still within the confines of your secure, private storage.
Re:Not OK, Google by fabrice_d on Wednesday October 05, 2016 @11:52AM (#12644918)
You don't have to develop, setup and maintain all that by yourself. What we need is a user friendly (dead easy install/setup, no administration) way to use alternatives to these services. Some of these services exist, some not, but it's a very achievable goal.
Re:Not OK, Google by johngalt on Wednesday October 05, 2016 @11:40AM (#12644783)
The only thing we got wrong. We expected the machines that knew everything about us to be ours. Not someone elses.
Re:Not OK, Google by csydas on Wednesday October 05, 2016 @11:51AM (#12644908)
Well the missing part is the dedication to ideals and to the greater good of all life that was supposed to be core to the federation. I realize Star Trek is fantasy, but the reason people are more at ease with the omnipresence of technology in Star Trek is because you see people living by these humanitarian and noble ideals. People fight and die to defend thems. The right to self and privacy and protection is held very high in the st universe, even if challenged.

When's the last time Google risked itself or business or any tech ceo risked their livelihood for the sake of the greater good? The problem isn't necessarily the knowing everything part, it's who does what with it that's the problem. I can't really think of any company or person with influence in tech that'd be willing to dive onto that bombshell to protect us all.

Re:Not OK, Google by pjlegato on Wednesday October 05, 2016 @03:41PM (#12647081)
> When's the last time Google risked itself or business or any tech ceo risked their livelihood for the sake of the greater good?

February of 2001.

https://en.wikipedia.org/wiki/Joseph_Nacchio

The former CEO of Qwest, a massive telco, spent years in prison for insider trading. He says this is because he resisted the NSA's demands to tap Qwest's network and hand over customer data.

Re:Not OK, Google by erdevs on Wednesday October 05, 2016 @12:28PM (#12645337)
The big difference is the Star Trek computer wasn't using its data about Kirk to provide him "enhanced advertising experiences", there wasn't a big corporation controlling the computer and no government was accessing the computer's information.

A truly user-aligned AI assistant would be great. Ideally in the future these things will not be tied to indirect business models, but rather will be something you buy and all data/services will be under your control.

Re:Not OK, Google by Artistry121 on Wednesday October 05, 2016 @12:39PM (#12645421)
Capitan Kirk was a government employee. It's implied the government/StarFleet could access the ships logs.

In the Star Trek world they had no advertising because they were a communist society. Everyone dressed the same or slightly differently based on rank. It's interesting how the new movies play over that.

In Star Trek you couldn't choose your AI. In our world you can. At the start of their development most of them are targeted at selling you stuff - but the industry is young and who knows where it will go.

Re:Not OK, Google by snerbles on Wednesday October 05, 2016 @01:05PM (#12645667)
It would be more accurate to say that most of Star Trek depicts life in Starfleet, a pseudo-military institution (Roddenberry insisted that it isn't, while war isn't Starfleet's main purpose it shares enough traits with modern armed services to suffice for this discussion). There is always a lesser expectation of privacy for military personnel, even in the US armed services.

While there are elements of communism depicted in the Federation as a whole, those are facets of a global post-scarcity society that has somehow evolved beyond the less "progressive" bits of human behavior. I'd argue that the biggest fantasy of Star Trek isn't warp drive, but the notion that humans are somehow less violent than Klingons.

Re:Not OK, Google by pjlegato on Wednesday October 05, 2016 @03:44PM (#12647109)
Indeed, their efforts to run the "Klingon culture is bad" thread got comically awkward in TNG, where they also really hammered on the multiculturalist "all cultures are equally valid" theme. All cultures... except for Klingons, whose barbaric and violent customs are just obviously inferior.
Re:Not OK, Google by joe563323 on Wednesday October 05, 2016 @12:38PM (#12645414)
Yes. Also running the AI on local computer made sense because there is no incentive to run it on cloud. Since nothing is gained. Star Trek is set on post scarcity economic society. We will get there once basic income becomes the norm in all countries.
Re:Not OK, Google by darklajid on Wednesday October 05, 2016 @11:59AM (#12644987)
Has Star Trek even a currency? It always feels like a socialist/communist thing to me.

You cannot compare the world's biggest seller of advertisement space with the ST universe. The motivation's aren't aligned: Google/Alphabet want to make sales based on my information.

I agree that I found these oh so clever AI fantasies interesting in my youth, still do to a degree. But I always pictured the data being held inaccessible to humans in general ("Where's my wife right now?") and not in the hands of a golden few with no oversight.

Re:Not OK, Google by eternalban on Wednesday October 05, 2016 @12:12PM (#12645138)
Star Trek's world seems to be a 'utopia' of scientific-military governance. Most of the key players have a military rank, wear color coded uniforms, and appear to be under 24/7 surveillance (which is OK since this is a very nice and progressive scientific-military goverment and you know War On <scary-alien-specie> and all that. :)
Re:Not OK, Google by CaptSpify on Wednesday October 05, 2016 @01:38PM (#12645959)
Was the society under constant surveillance? or just the part of society the show highlighted?
Re:Not OK, Google by pmoriarty on Wednesday October 05, 2016 @06:18PM (#12648456)
I don't remember seeing any Star Trek episodes that showed people under surveillance in their private quarters or in bathrooms.

The public areas which were under surveillance on Star Trek tended to be only on military ships and star bases. I don't remember seeing much surveillance in public areas on planets. There certainly wasn't the sense that everyone was under surveillance on every street and in every shop, unlike most people in major metropolitan areas on Earth today. Nor was there anything on Star Trek like the ever-present spy satellites that can see in great detail anywhere on Earth today.

For the public areas which could be observed through cameras on Star Trek, the surveillance seemed mild compared to today because of Star Trek's lack of massive computers and artificial intelligence analysing what is seen for anomalies, using facial recognition, constantly recording everything and having those recordings instantly available for playback, sophisticated search, and computer analysis.

The reading and viewing habits of Star Trek denizens weren't recorded and analysed, unlike those of many people on Earth. Their positions weren't tracked wherever they went, unlike those of many people on Earth.

The so-called "24/7 surveillance" of Star Trek was very limited and even quaint compared to what we live under on Earth today.

Re:Not OK, Google by r00fus on Wednesday October 05, 2016 @02:30PM (#12646463)
Most of Star Trek is aboard starships and stations - I wouldn't imagine that leaves much for privacy.

Plus, most folks think ST is where hippies took over. Center of Federation is in San Francisco...

Re:Not OK, Google by darklajid on Wednesday October 05, 2016 @12:37PM (#12645405)
Given the "War On $species" thing, "War On Romulan Ale" might work as well?

Remember kids: Don't intoxicate yourself with substances we do not condone. :)

Re:Not OK, Google by tjl on Wednesday October 05, 2016 @12:13PM (#12645152)
In the original show there wasn't a currency but in order to have aliens who exhibit avarice and the worst part of capitalism they had to include a currency (latinum, I think it was called).
Re:Not OK, Google by dragonwriter on Wednesday October 05, 2016 @12:47PM (#12645509)
> In the original show there wasn't a currency

Incorrect, in the original series, there was a currency ("credits") that was explicitly referenced several times; it was also referenced in at least one, and possibly more, early TNG episodes.

Sometime in the TNG era, Roddenberry laid down an edict that money, including the "credits" that had been repeatedly referenced previously, did not exist in the federation, and so they weren't mentioned again.

Re:Not OK, Google by pjlegato on Wednesday October 05, 2016 @03:46PM (#12647124)
Currency was later re-introduced to enable the Ferengi race to be portrayed as greedy merchants.
Re:Not OK, Google by dragonwriter on Wednesday October 05, 2016 @04:23PM (#12647486)
> Currency was later re-introduced to enable the Ferengi race to be portrayed as greedy merchants.

I don't think that's really accurate; the Ferengi were portrated as greedy merchants focused on profit starting fairly early in TNG without direct reference to currency (gold -- not the later "gold-pressed latinum" -- was mentioned, IIRC, as an item of interest, but not in any context which implied it was used as currency); I think gold-pressed latinum as introduced as a currency in DS9 because DS9's role as commerce hub was central to the theme of the series, and having currency just made telling stories about that a lot more convenient.

Re:Not OK, Google by softrock on Wednesday October 05, 2016 @12:52PM (#12645549)
It wasn't a currency in the same way that gold isn't a currency. Latinum is supposed to be a substance which cannot be replicated unlike most things so it's valued by, as you say, the avaricious.
Re:Not OK, Google by dragonwriter on Wednesday October 05, 2016 @12:57PM (#12645595)
> It wasn't a currency in the same way that gold isn't a currency.

Throughout much of history, gold in standardized sizes was a common form of currency. Gold-pressed latinum in standardized "slips", "strips", "bars", and "bricks" is exactly the same thing.

Re:Not OK, Google by DavidHm on Wednesday October 05, 2016 @12:14PM (#12645162)
Nope, it's a post-scarcity economy.
Re:Not OK, Google by pmoriarty on Wednesday October 05, 2016 @12:48PM (#12645515)
Post-scarcity in some ways, perhaps. In many other ways, they're not.

Star Trek still had merchants who sold various wares. That would not be profitable if nothing was scarce.

They still had planets that lacked necessary medicine, requiring The Enterprise or some other ship to go on mercy missions to deliver the meds.

The Star Trek universe had pleasure planets which had highly desirable things that other planets did not.

There was clearly a shortage of starships and crew, as The Enterprise explored alone and not in a fleet, and couldn't just create a hundred others to help it when it was attacked by some alien enemy.

The Enterprise couldn't even use their on-ship replicators to make themselves some dilithium crystals (fuel) when they ran low.

Re:Not OK, Google by joe563323 on Wednesday October 05, 2016 @12:39PM (#12645426)
Many articles say that. Do you have a source .
Re:Not OK, Google by nothis on Wednesday October 05, 2016 @12:59PM (#12645615)
It doesn't though, does it? The only reason this is a problem is that Google's business is still advertising and they act like our problems can be solved by tools made to sell more ads. The moment I could buy an AI service for like $10 a month (it had to be good), I'd trust them with using my data responsibly.

The Star Trek fantasy is, "Computer, what were the principal historical events on the planet Earth in the year 1987?", and it could totally answer that without sending your entire fucking message history to google for deep AI inspection.

Re:Not OK, Google by dragonwriter on Wednesday October 05, 2016 @01:03PM (#12645646)
> The Star Trek fantasy is, "Computer, what were the principal historical events on the planet Earth in the year 1987?", and it could totally answer that without sending your entire fucking message history to google for deep AI inspection.

That's part of the Star Trek fantasy. But so is, "Computer, locate Commander Riker" and "Computer, use personal logs and personality profiles from compiled databases to create a personality simulation of Dr. Leah Brahms."

Re:Not OK, Google by yid on Wednesday October 05, 2016 @11:51AM (#12644896)
I think people also forget that the Star Trek AI was in a semi-militarized scenario where efficiency and information greatly outweighed individual privacy needs.
Re:Not OK, Google by crisnoble on Wednesday October 05, 2016 @11:43AM (#12644815)
I think most fantasies are okay with the anthropomorphic AI assistant knowing everything about us, but don't involve the AI transmitting all of it's data back to "the cloud" where advertisers can mine this data or the NSA could listen in with a secret gag ordered wiretap. Probably wishful thinking, but maybe one day a privacy first company will dip their toes into this arena.
Re:Not OK, Google by option_greek on Wednesday October 05, 2016 @11:37AM (#12644748)
We always assumed they wouldn't spill their beans to third parties. I guess that was assuming too much.
Re:Not OK, Google by JonathonW on Wednesday October 05, 2016 @11:52AM (#12644914)
Google doesn't "spill their beans" to third parties-- what Google actually sells is the opportunity for third parties to be included in the advertisements Google is targeting to their users.

Google has a strong incentive to not allow their aggregated user data to leave Google-- the behavioral data Google collects is the reason why Google is valuable; if they start shipping that data off to third parties, suddenly the third parties don't need Google anymore.

(Same with Facebook-- they're not "selling" your data; they're selling the opportunity to target you based on your data, but the data itself is too valuable to Facebook to sell.)

Re:Not OK, Google by ProAm on Wednesday October 05, 2016 @12:20PM (#12645230)
> Google doesn't "spill their beans" to third parties

Except the government who gets unfettered access. Not into conspiracy theories but Im definitely not a fan of this (and it goes for all social media and technology companies)

Re:Not OK, Google by Oletros on Wednesday October 05, 2016 @12:35PM (#12645387)
> Except the government who gets unfettered access.

Does you have a source for that?

Re:Not OK, Google by pjlegato on Wednesday October 05, 2016 @03:46PM (#12647138)
There was this Snowden guy who leaked some documents about that...
Re:Not OK, Google by Oletros on Wednesday October 05, 2016 @05:06PM (#12647891)
Then it will be easy to provide a link.
Re:Not OK, Google by ProAm on Wednesday October 05, 2016 @12:41PM (#12645439)
>Does you have a source for that?

Yep. They all do it.

[1] http://news.trust.org/item/20161004170601-99f8c

Re:Not OK, Google by Oletros on Wednesday October 05, 2016 @12:45PM (#12645493)
You have put a link about Yahoo! and that link says nothing about Google or others doing the same
Re:Not OK, Google by ProAm on Wednesday October 05, 2016 @12:49PM (#12645529)
No, its safe to say all major tech company's have have NSL's, and are required to allow the government to search and request data, it would be foolish to think otherwise. [1]

[1] http://www.nytimes.com/2016/10/05/technology/subpoenas-and-g...

Re:Not OK, Google by Oletros on Wednesday October 05, 2016 @12:55PM (#12645578)
Are you aware that your new link doesn't talk about unfettered access?
Re:Not OK, Google by ProAm on Wednesday October 05, 2016 @01:08PM (#12645684)
Yes, but this is all we know about now, every day there is a new revelation about what the government has access too that we previously thought they didn't. I think it's naive to assume they don't have access to all of it.
Re:Not OK, Google by Oletros on Wednesday October 05, 2016 @02:25PM (#12646424)
Your claim is that the government have unfettered access to ALL the data.

Can you provide a link to your claim or it is just your opinion because there is no proof of that?

Re:Not OK, Google by ProAm on Wednesday October 05, 2016 @04:02PM (#12647293)
Evidence has been slowly being released for years, what more do you need. Here is my third example for you [1], after this Im done.

[1] http://www.washingtonpost.com/wp-srv/special/politics/prism-...

Re:Not OK, Google by Oletros on Wednesday October 05, 2016 @05:05PM (#12647880)
You still have not provided any evidence for you first claim that the government has total access to those companies. And your last link also doesn't say what you think it says.
Re:Not OK, Google by gue5t on Wednesday October 05, 2016 @12:00PM (#12645002)
Google (or Facebook) is the third party. The first two are you and your computer.
Re:Not OK, Google by mattmanser on Wednesday October 05, 2016 @11:42AM (#12644810)
It really is the big problem at the moment with the cutting edge of AI.

ML relies on large data-sets and if anyone tried to release a personal device it simply wouldn't even work, let alone compete with the mass surveillance google/ms/amazon are bringing to bear.

Unless the state-of-the-art in AI suddenly morphs, we seem to be stuck between giving up our privacy or having vaguely intelligent AI.

I personally fall heavily on the privacy side of stuff, but I can see the intellectual and commercial appeal of pretending it doesn't matter in order to get there.

Re:Not OK, Google by darkpicnic on Wednesday October 05, 2016 @12:12PM (#12645142)
This is simply a matter of AI not being advanced enough at the moment. Take how a human learns: it acquires experiences and information over a long childhood, and from this "data set" is able to do millisecond predictions of future events based off completely new data.

What needs to happen is a company needs to come along and create AI that is trained off of generalized information... some kind of socially accepted public data set... then the trained core is sold as a seed to individuals who then feed it their personal data.

It'll be the equivalent of buying an AI "teenager" and slowly training them to be an "adult".

Re:Not OK, Google by arca_vorago on Wednesday October 05, 2016 @11:54AM (#12644941)
I thing the fallacy here is that a single person can't create a large enough dataset, while I content they can. Combined with tools like pocketsphinx I think its very doable to have a privacy concious AI system.
Re:Not OK, Google by internaut on Wednesday October 05, 2016 @03:29PM (#12646982)
That's the thing.

As sensors become richer and the data becomes more valuable to the ML, consumers are becoming more aware of their privacy.

That means to get to a 'good seam' in the future instead of trawling through trash, you're going to have to convince millions of people their interests won't be affected.

That means in time there is an opportunity for a Google-killer with a different business model not based on using the raw data OR using by the use of intelligent agents. Google goes down because its stakeholders are contingent on getting to the raw data.

Re:Not OK, Google by bbctol on Wednesday October 05, 2016 @11:41AM (#12644789)
I think we just envisioned a highly anthropomorphized AI: essentially, a very smart and entirely obedient person to serve as the perfect aide. The Star Trek dream emerged before computing technology was very far advanced, and well before the idea of constantly mobile wireless communication. We thought our AIs would be small and physical, easy for a single person to entirely own and unable to remember more details than a human; instead we got unfamiliar algorithms run on machines far away.
Re:Not OK, Google by dragonwriter on Wednesday October 05, 2016 @11:48AM (#12644871)
> The Star Trek dream emerged before computing technology was very far advanced, and well before the idea of constantly mobile wireless communication. We thought our AIs would be small and physical, easy for a single person to entirely own and unable to remember more details than a human; instead we got unfamiliar algorithms run on machines far away.

Which is kind of funny, because even if it might be accessed by personal mobile devices, the Star Trek "library computer" AI was never "small and physical, easy for a single person to entirely own and unable to remember more details than a human", it was an aspect of a large server (or networked cluster, the actual architecture is somewhat vague) that was part of a capital ship or base, had access in the server/cluster to a library of very nearly all generally available knowledge and extensive personal information about both its users and about people with little direct connection (and could reach out across a galactic network to access additional remote information sources to handle requests).

"Unfamiliar algorithms run on machines far away" is much more like the source of the "Star Trek dream" than "small and physical, easy for a single person to entirely own and unable to remember more details than a human".

Re:Not OK, Google by Spoom on Wednesday October 05, 2016 @12:24PM (#12645293)
I think Star Trek was very prescient here as well: Security is terrible in the Star Trek universe. Nearly every antagonist is able to break into the computer within about a minute.
Re:Not OK, Google by bbctol on Wednesday October 05, 2016 @11:51AM (#12644901)
True! I suppose I was thinking of earlier space-age fantasy more than TNG. It was rather odd how easily people could look up details on crewmembers aboard the Enterprise, but I suppose the situation's different on an organized ship.
Re:Not OK, Google by dragonwriter on Wednesday October 05, 2016 @12:03PM (#12645040)
> It was rather odd how easily people could look up details on crewmembers aboard the Enterprise, but I suppose the situation's different on an organized ship.

Not just crewmembers: TNG showed some of the broader implications (both useful and creepy) of the convenience-oriented panopticon, e.g., when Geordi used the Enterprise library computer to construct a simulation from data (including personality profiles) of Dr. Leah Brahms, who later meets him (and encounters the simulation.) (S306 "Booby Trap", S416 "Galaxy's Child")

Re:Not OK, Google by VLM on Wednesday October 05, 2016 @03:43PM (#12647105)
That was a substantial plot hole where she had no idea someone was simulating her.

I suspect a huge part of the panopticon culture would be / is being informed that you're being peeped at. 99% of the time someone asking "Computer locate commander Riker" involved commander Riker knowing all about who's looking for him and why and having a substantial conversation with the requester.

I don't recall any plot along the lines of Deanna getting jealous and spamming the computer all night asking where Riker is and he better not be in that cute ensign's bedroom... Because it seems logical the computer would inform him each time and he would eventually tire of the interruption and nature would take its course, WRT his relationship with Deanna.

A better analogy would be technically I could walk up to the company president's office and stalk him, but culturally that is so not going to fly and I would have a lot of explaining to do. Merely using the computer instead of walking there in flesh isn't a major cultural shift.

However, every single "holodeck creeper" plot line involved the simulated attractive real world woman not knowing she's being simulated until the plot reached maximum spaghetti spilling cringe, which is one of the few Trek panopticon situations where people being spied on did NOT know they were being spied on, which seems very un-trek, although it made for some entertaining stories.

An alternative interpretation is I believe over the course of the series every attractive woman on the ship was simulated on the holodeck at least once by at least one lonely guy, and its possible that culturally they just got used to it, although I find that unlikely. People do get conditioned to become used to the weirdest things, so its not out of the realm of possibility. Possibly a culture of what happens in vegas stays in vegas develops and its just the sexism of the TV show that they never showed the women turning the tables on their fellow male crewmen on the holodeck.

Re:Not OK, Google by gvurrdon on Wednesday October 05, 2016 @11:50AM (#12644891)
Isn't it the case that Apple's attempts at similar AI assistance store much of the data on the user's iPhone?
Re:Not OK, Google by johndubchak on Wednesday October 05, 2016 @11:56AM (#12644964)
The fundamental issue comes down to one of trust and the real question is, do we trust Google to do the right ethical and moral things with our data that they are collecting en masse?
Re:Not OK, Google by mc32 on Wednesday October 05, 2016 @11:38AM (#12644762)
I think some people would be okay with that if:

1. That information were secret (you and service/device/implant) but not a whole company and its third party interests.

2. It wasn't making money for a third party after the initial purchase price for the device, service, etc.

Re:Not OK, Google by pat2man on Wednesday October 05, 2016 @11:41AM (#12644790)
So Siri.
Re:Not OK, Google by falcolas on Wednesday October 05, 2016 @12:00PM (#12644999)
Siri recordings are uploaded to the cloud for transcription, and reviewed by third parties to improve transcription and the AI. It also can arbitrarily decide to query search engines to answer questions.

So, better, but nowhere near "on the device only".

Re:Not OK, Google by throwanem on Wednesday October 05, 2016 @12:11PM (#12645123)
> reviewed by third parties to improve transcription and the AI

Cite?

Re:Not OK, Google by falcolas on Wednesday October 05, 2016 @12:46PM (#12645505)
Siri commands stored by Apple: https://www.wired.com/2013/04/siri-two-years/

First party report of reviewing recordings: https://www.reddit.com/r/technology/comments/2wzmmr/everythi...

News article with more investigation and citings: http://sanfrancisco.cbslocal.com/2015/03/12/strangers-apple-...

Siri Privacy Policy excerpts:

When you use Siri the things you say will be recorded and sent to Apple to process your requests. Your device will also send Apple other information, such as your name and nickname; the names, nicknames, and relationships (e.g., “my dad”) found in your contacts, song names in your collection, the names of your photo albums, and the names of apps installed on your device (collectively, your “User Data”)

[...]

By using Siri, you agree and consent to Apple’s and its subsidiaries’ and agents’ transmission, collection, maintenance, processing, and use of this information, including your voice input and User Data

Re:Not OK, Google by corobo on Wednesday October 05, 2016 @11:42AM (#12644808)
Until it started happening I always assumed it'd be powered by a central computer I had in a clean area of the attic or something. Not some DC somewhere.
Re:Not OK, Google by ska on Wednesday October 05, 2016 @11:47AM (#12644856)
"Knowing" in some sense everything about us is not the same as owning that information or trading in it. There are many other possible approaches to applying ML to our personal needs and data, so it is worth being careful about not conflating issues with a particular implementation and issues with the area as a whole.
Re:Not OK, Google by r00fus on Wednesday October 05, 2016 @02:22PM (#12646394)
> in order for it to do everything for us, it has to know everything about us, too

But does it? Does it have to know your birthday? (leave alone the fact that bdays are somehow part of a superkey for your identity).

Why should it know my residence, my spouse, or my CC# (with Apple's TouchID maybe it won't need to)?

Google's concept of AI is too creepy for me. It can be useful without being creepy. They're not even trying to make it less creepy.

Overlay on this the subtext that NSA and other tla's are monitoring all this (leave alone other countries). While I may trust Google, I don't trust them to not be forced to collude with the government.

Re:Not OK, Google by AndrewKemendo on Wednesday October 05, 2016 @12:33PM (#12645375)
Not to sound glib, but the idea of persistent data acquisition and aggregation has been pretty well known to be in the path for anyone seriously researching AGI or other human level AI systems.

How could it be otherwise?

Re:Not OK, Google by Esau on Wednesday October 05, 2016 @03:00PM (#12646722)
I have to admit this is true -- I used to dream of a Star Trek like computer where you can just speak to it but I never imagined that such as system would be strife with privacy and security issues.
Re:Not OK, Google by Someone on Wednesday October 05, 2016 @12:42PM (#12645462)
You could have realized that from watching Star Trek, as the computer in the Enterprise can always tell the captain where every crew member is, whether there are strangers on board, etc.
Re:Not OK, Google by tempodox on Wednesday October 05, 2016 @12:32PM (#12645368)
Yep. I see us somewhat conflicted about this. We would love the (imagined) benefits, but we have no idea yet how to avoid the dangers.
Re:Not OK, Google by shostack on Wednesday October 05, 2016 @05:04PM (#12647862)
Bingo. The movie Her was awesome. But rewatch it. In every scene the AI does something cool, think what permissions it would need and what data it would have to have access to about you to accomplish the task. It gets scary pretty quickly.
Re:Not OK, Google by agumonkey on Wednesday October 05, 2016 @11:57AM (#12644970)
Daydream is way better.