News for hackers. Stuff that matters.
Re:AI will enable mass spying by somenameforme on Tuesday December 05, 2023 @10:45AM (#38532348)
This is a political problem, not a technological one. The USSR (alongside Germany and others) managed effective at scale spying with primitive technology: paperwork for everything and every movement, informants, audio surveillance, and so on. The reason such things did not come to places like the US in the same way is not because we were incapable of such, but because there was no political interest in it.

And when one looks back at the past we've banned things people would never have imagined bannable. Make it a crime to grow a plant in the privacy of your own home and then consume that plant? Sure, why not? Make it a crime for a business to have the wrong opinion when it comes to who they want to serve or hire? Sure, why not?

Going the nuclear route and making the collection of data on individuals, aggregated or otherwise, illegal would hardly be some major leap of reach of jurisprudence. The problem is not that the technology exists, but that there is 0 political interest in curtailing it, and we've a 'democracy' where the will of the people matters very little in terms of what legislation gets passed.

Re:AI will enable mass spying by matthewdgreen on Tuesday December 05, 2023 @11:27AM (#38532999)
It is not a as simple as being a political problem. Many of the policy decisions we think of as being political were actually motivated by the cost/availability of technology. As this cost goes down, new options become practical. We think of the Stasi's capabilities as being remarkable: but in fact, they would probably have been thrilled to trade most of their manual spying tools for something as powerful as a modern geofence warrant, a thing that is routinely used by US law enforcement (with very little policy debate.)
Re:AI will enable mass spying by asdff on Tuesday December 05, 2023 @02:24PM (#38535688)
While this is true, I don't think we are there yet with AI since its usually more expensive to run AI models than it is to perform more traditional statistical modelling.
Re:AI will enable mass spying by matthewdgreen on Tuesday December 05, 2023 @03:00PM (#38536187)
A text recognition and face/object recognition model runs on my iPhone every night. A small LLM is used for autocorrect. Current high-end smartphones have more than enough RAM and compute to run pretty sophiscated 7B-param quantized LLMs. This level of capability will find its way down to even entry-level Walmart phones in about five years. Server side, things are going to be even cheaper.
Re:AI will enable mass spying by xcv123 on Tuesday December 05, 2023 @05:21PM (#38537740)
> usually more expensive to run AI models

Machine learning inferencing on phones is cheap these days

https://apple.fandom.com/wiki/Neural_Engine

Re:AI will enable mass spying by tech_ken on Tuesday December 05, 2023 @12:01PM (#38533544)
> This is a political problem, not a technological one.

Somewhat of a distinction without a difference, IMO. Politics (consensus mechanisms, governance structures, etc) are all themselves technologies for coordinating and shaping social activity. The decision on how to implement new (surveillance) tooling is also a technological question, as I think that the use of the tool in part defines what it is. All this to say that changes in the capabilities of specific tools are not the absolute limits of "technology", decisions around implementation and usage are also within that scope.

> The reason such things did not come to places like the US in the same way is not because we were incapable of such, but because there was no political interest in it.

While perhaps not as all-encompassing as what ended up being built in the USSR, the US absolutely implemented a massive surveillance network pointed at its citizenry [0].

>...managed effective at scale spying with primitive technology

I do think that this is a particularly good point though. This is a not new trend, development in tooling for communications and signal/information processing has led to many developments in state surveillance throughout history. IMO AI should be properly seen as an elaboration or minor paradigm shift in a very long history, rather than wholly new terrain.

> Make it a crime for a business to have the wrong opinion when it comes to who they want to serve or hire?

Assuming you're talking about the Civil Rights Act, the specific crime is not "having the wrong opinion", it's inhibiting inter-state commerce. Bigotry doesn't serve our model of a country where all are free to move about within its borders uninhibited and able to support yourself.

[0] https://www.brennancenter.org/our-work/analysis-opinion/hist...

Re:AI will enable mass spying by w-m on Tuesday December 05, 2023 @11:43AM (#38533268)
Sure, everything is ultimately a political problem, but this one is completely driven by technological change. In the USSR (and GDR), it took them a staff of hundreds of thousands of people to write up their reports.

Now it would take a single skilled person the better part of an afternoon to, for example, download a HN dump, and have an LLM create reports on the users. You could put in things like political affiliation, laws broken, countries travelled recently, net worth range, education and work history, professional contacts, ...

Re:AI will enable mass spying by __jambo on Tuesday December 05, 2023 @02:11PM (#38535522)
Great idea.
Re:AI will enable mass spying by salawat on Tuesday December 05, 2023 @04:11PM (#38536950)
Stop posting things like this, you're just giving them ideas, and you can't take it back once it's out there.

I assure you, you may find the prodpect abhorrent, but there are people around who'd consider it a perfectly cromulent Tuesday.

Re:AI will enable mass spying by w-m on Tuesday December 05, 2023 @04:47PM (#38537374)
I’m not sure who “they” are, but I’m pretty sure they’re already doing that, and don’t need me to get the idea. I think it’s important to talk about what LLMs mean for privacy. Profiling every HN user might be a useful tool to are people more aware of the problems. But I totally get your unease, which is also why I haven’t done that myself.

The cat is out of the bag, can’t get it back in by ignoring the fact.

Re:AI will enable mass spying by aijoe5pack on Wednesday December 06, 2023 @10:13AM (#38544864)
Security by obscurity :). Accept that they will probably do this and work towards a counter-measure. Political solutions might be a counter-measure, as the Op of this thread is probably alluding to.
Re:AI will enable mass spying by JohnFen on Tuesday December 05, 2023 @11:53AM (#38533411)
> This is a political problem, not a technological one.

The political problem is a component of the technological problem. It's a seriously bad thing when technologies are developed without taking into account the potential for abuse.

People developing new technologies can try to wash their hands of the foreseeable social consequences of their work, but that doesn't make their hands clean.

Re:AI will enable mass spying by landemva on Tuesday December 05, 2023 @11:19AM (#38532841)
In a democracy we would have a chance to vote on individual issues such as data privacy, or war against whomever. USA is a federal republic.
Re:AI will enable mass spying by t0bia_s on Wednesday December 06, 2023 @03:31AM (#38541654)
Most people don't bother about it. Consumerism makes people more conform and less conflicting.
Re:AI will enable mass spying by aijoe5pack on Wednesday December 06, 2023 @10:15AM (#38544904)
Correct. So get on the horn with your representative! Handling this through a democracy would be just horrible. Imagine the abuses that could be proffered to minorities with this.
Re:AI will enable mass spying by kubb on Tuesday December 05, 2023 @11:01AM (#38532594)
In the USSR and GDR, not everyone was under constant surveillance. This would require one surveillance worker per person. There was an initial selection process.
Re:AI will enable mass spying by rasz on Tuesday December 05, 2023 @06:01PM (#38538160)
Thats exactly how it worked. In fact there was always more than one pair of eyes on everyone, people were being coerced to snitch on each other. Im old enough to remember a nice man visiting my school asking us to listen carefully what parents talk about around the house and report to teachers any criticism of government or party. That was pre 1989 under Russian occupation of my country.
Re:AI will enable mass spying by nathanfig on Tuesday December 05, 2023 @11:26AM (#38532983)
It's both. Technology really does make a difference. Its existence has effects.
Re:AI will enable mass spying by Pxtl on Tuesday December 05, 2023 @11:25AM (#38532948)
> wrong opinion

That phrase is doing a lot of work.

Re:AI will enable mass spying by tehjoker on Tuesday December 05, 2023 @11:00AM (#38532580)
COINTELPRO
Re:AI will enable mass spying by justin66 on Tuesday December 05, 2023 @01:16PM (#38534789)
> The reason such things did not come to places like the US in the same way is not because we were incapable of such, but because there was no political interest in it.

That might not be quite right. It might be that the reason such things did not come to the US was because the level of effort was out of line with the amount of political interest in doing it (and funding it). In that case, the existence of more advanced, cheaper surveillance technology and the anemic political opposition to mass surveillance are both problems.

Re:AI will enable mass spying by digging on Tuesday December 05, 2023 @01:40PM (#38535122)
> Make it a crime to grow a plant in the privacy of your own home and then consume that plant? Sure, why not? Make it a crime for a business to have the wrong opinion when it comes to who they want to serve or hire? Sure, why not?

Wow, that's a hell of a comparison. The former case being a documented case of basic racism and political repression, assuming you're talking about cannabis. And the latter being designed for almost exactly the opposite.

Restricting, um, "wrong opinions" on who a business wants to serve is there so that people with, um, "wrong identities" are still able to participate in society and not get shut out by businesses exercising their choices. Of course "wrong opinions" is not legal terminology. It's not even illegal to have an opinion that discrimination against certain groups is okay - it's just illegal to act on that. Offering services to the public requires that you offer them to all facets of the public, by our laws. But if you say believing in discrimination is a "wrong opinion"... I won't argue, they're your words :)

Re:AI will enable mass spying by JohnMakin on Tuesday December 05, 2023 @02:09PM (#38535488)
Don't know why you're getting downvoted for this, it's exactly what the parent said, and a completely wild (and off topic) statement.
Re:AI will enable mass spying by janalsncm on Tuesday December 05, 2023 @03:46PM (#38536684)
I think the most charitable interpretation of their point is something along the lines of simply highlighting the far-reaching and ad-hoc nature of lawmaking capabilities. I don’t think antiracism laws were the best example though.
Re:AI will enable mass spying by gosub100 on Tuesday December 05, 2023 @04:56PM (#38537491)
plenty of white people were charged with growing cannabis. I don't know where you are getting that idea from.
Re:AI will enable mass spying by JohnFen on Tuesday December 05, 2023 @05:00PM (#38537539)
In the US, prohibition of marijuana was enacted for overtly racist reasons. Latinos were the concern.
Re:AI will enable mass spying by gosub100 on Tuesday December 05, 2023 @05:01PM (#38537549)
then at some point was expanded to whites.
Re:AI will enable mass spying by JohnFen on Tuesday December 05, 2023 @05:03PM (#38537573)
It always applied to whites and everyone else, of course. But back then, whites were not huge users of it.
Re:AI will enable mass spying by red-iron-pine on Wednesday December 06, 2023 @10:10AM (#38544823)
Hippies. It was explicitly targeted at the anti-war, vaguely USSR-sympathetic left. Can't
Re:AI will enable mass spying by digging on Tuesday December 05, 2023 @06:00PM (#38538148)
I didn't say white people weren't included in political repression. The Nixon administration explicitly targeted cannabis-using white hippies.
Re:AI will enable mass spying by giantg2 on Tuesday December 05, 2023 @02:02PM (#38535407)
No, it's not just a political problem intelligence gathering can happen at scale, including of civilians, by adversarial countries or international corporations.

"Going the nuclear route and making the collection of data on individuals, aggregated or otherwise, illegal would hardly be some major leap of reach of jurisprudence."

It would in fact be a huge leap. Sure, you could make illegal pretty easily, but current paradigms allow individuals to enter into contracts. Nothing stopping a society from signing (or clicking) away their rights like they already do. That would require some rather hefty intervention by congress, not just jurisprudence.

Re:AI will enable mass spying by janalsncm on Tuesday December 05, 2023 @03:54PM (#38536763)
> current paradigms allow individuals to enter into contracts

And such contracts can be illegal or unenforceable. Just as the parent was suggesting it could be illegal to collect data, it is currently illegal to sell certain drugs. You can’t enter into a contract to sell cannabis across state lines in the United States for example.

Re:AI will enable mass spying by giantg2 on Tuesday December 05, 2023 @06:46PM (#38538561)
It's not going to be illegal or unenforceable based on existing jurisprudence though. You'd need legislative action from congress.
Re:AI will enable mass spying by petsfed on Tuesday December 05, 2023 @02:25PM (#38535704)
You and I are in agreement that the surveillance needs to stop, but I think we differ on how to explain the problem. My explanation follows, but note that its not directed at you.

At its peak, the KGB employed ~500,000 people directly, with untold more employed as informants.

The FBI currently employs ~35,000 people. What if I told you that the FBI could reach the KGB's peak level of reach, without meaningfully increasing its headcount? Would that make a difference?

The technology takes away the cost of the surveillance, which used to be the guardrail. That fundamentally changes the "political" calculus.

The fact that computers in 1945 were prohibitively expensive and required industrial logistics has literally zero bearing on the fact that today most of us have several on our person at all times. Nobody denies that changes to computer manufacturing technologies fundamentally changed the role the computer has in our daily lives. Certainly, it was theoretically possible to put a computer in every household in 1945, but we lacked the "political" will to do so. It does not follow that because historically computers were not a thing in society, we should not adjust our habits, morals, policies, etc today to account for the new landscape.

So why is there always somebody saying "it was always technically possible to [insert dystopian nightmare], and we didn't need special considerations then, so we don't need them now!"?

Re:AI will enable mass spying by edouard-harris on Tuesday December 05, 2023 @03:57PM (#38536811)
This is the correct take. As the cost to do a bad thing decreases, the amount of political will society needs to exert to do that bad thing decreases as well.

In fact, if that cost gets low enough, eventually society needs to start exerting political will just to avoid doing the bad thing. And this does look to be where we're headed with at least some of the knock-on effects of AI. (Though many of the knock-on effects of AI will be wildly positive.)

Re:AI will enable mass spying by red-iron-pine on Wednesday December 06, 2023 @09:47AM (#38544580)
> eventually society needs to start exerting political will just to avoid doing the bad thing

we hit that point years ago. the renewal of the Patriot Act comes to mind.

all they needed to do was to let it expire. literally do nothing.

Re:AI will enable mass spying by arka2147483647 on Tuesday December 05, 2023 @03:16PM (#38536375)
> The FBI currently employs ~35,000 people. What if I told you that the FBI could reach the KGB's peak level of reach,

You are, if anything, underselling the point. AI will allow a future where every person will have their very own agent following them.

Or even worse, as there are multiple private addtech companies doing surveillance, and domestic and foreign intelligence agencies, so you might have a dozen AI agents on your personal case.

Re:AI will enable mass spying by chiefalchemist on Tuesday December 05, 2023 @05:40PM (#38537923)
Aren't we there already? Sure, perhaps the fidelity is a bit grainy, but that's not going to remain as such for long. With the amount of data (for purchase) on the free market, the FBI, KGB, MoSS (China), etc. all have a solid starting foundation, and then they simply add their own layer upon layer on top.

I read "The Age of Surveillance Capitalism" a couple of years ago and she was frighteningly spot on.

https://en.wikipedia.org/wiki/The_Age_of_Surveillance_Capita...

Re:AI will enable mass spying by Teever on Wednesday December 06, 2023 @06:45AM (#38542651)
The solution is sousveillance.

If they watch us, we watch them.

Re:AI will enable mass spying by aidenn0 on Tuesday December 05, 2023 @02:33PM (#38535808)
Cost is one factor, but so is visibility. If we replaced humans following people around with cheap human-sized robots following people around, it would still be noticeable if everybody had a robot following them around.

Instead we track people passively, often with privately owned personal devices (cell phones, ring doorbells) so the tracking ability has become pervasive without any of the overt signs of a police state.

Re:AI will enable mass spying by dfxm12 on Tuesday December 05, 2023 @03:02PM (#38536201)
I think if you bring up a dystopian nightmare, it assumes someone in power acting in bad faith. If their power is great enough, like maybe a government intelligence agency, it doesn't need things like due process, etc., to do what it wants to do. For example, Joe McCarthy & J. Edgar Hoover didn't need the evidence that could have been produced by AI-aided mass surveillance to justify getting people people who opposed his political agenda blackballed from Hollywood, jailed, fired from their jobs, etc.

If everyone involved is acting in good faith, at least ostensibly, there are checks and balances, like due process. It's a fine line and doesn't justify the existence of mass spying, but I think it is an important distinction in this discussion & I think is a valuable lesson for us. We have to push back when the FBI pushes forward. I don't have much faith after what happened to Snowden and the reaction to his whistleblowing though.

Re:AI will enable mass spying by from-nibly on Tuesday December 05, 2023 @04:02PM (#38536856)
That's what this article argues though. Even with good faith acting this would be a disaster. Imagine any time you did something against the law you got fined. The second you drive your unregistered car off your driveway (presumably to re register) you are immediately fined. There may be "due process" cause you DID break the law, but there is no contextual thought behind the massive ticket machine.

Our laws are not built to have the level of enforcement that AI could achieve.

Re:AI will enable mass spying by dfxm12 on Tuesday December 05, 2023 @04:43PM (#38537334)
Interestingly enough, in some places, automation like that, like red light cameras, even after getting installed, were later prohibited. NJ has discussed laws around protecting NJ drivers' privacy from other states' red light cameras, too. It's important not to be complacent. You can imagine literally anything, but action is required to actually change things.
Re:AI will enable mass spying by pempem on Tuesday December 05, 2023 @04:01PM (#38536839)
I think it is greyer than this.

Joe McCarthy and J. Edgar Hoover, distasteful as they are, I believe acted in what they would claim is good faith. The issue isn't that someone is a bad actor. It is that they believe they are a good actor and are busy stripping away others' rights in their pursuit.

Re:AI will enable mass spying by JohnFen on Tuesday December 05, 2023 @04:58PM (#38537512)
Very nearly everybody -- even bad people -- consider themselves one of the "good guys".
Re:AI will enable mass spying by dfxm12 on Tuesday December 05, 2023 @06:01PM (#38538153)
Maybe in their minds they thought the end justified the means, but there's no way anyone, even themselves, mistakes those means for good faith.
Re:AI will enable mass spying by pempem on Wednesday December 06, 2023 @02:09PM (#38548174)
Sure. the question was whether AI will continue to enable mass spying and making the affordability of mass spying a tool humans rely on.

They will. It will. We will see that erosion.

Re:AI will enable mass spying by JohnFen on Tuesday December 05, 2023 @04:56PM (#38537500)
> I think if you bring up a dystopian nightmare, it assumes someone in power acting in bad faith.

I don't agree with this. I think it's entirely possible for a dystopian nightmare to happen without anyone acting in bad faith at all.

"The road to hell is paved with good intentions" is a common phrase for a reason.

Re:AI will enable mass spying by sigilis on Tuesday December 05, 2023 @05:12PM (#38537660)
It may be a common phrase, but I’ve never seen such a road myself. Mostly bad outcomes are preceded by bad intentions, or lazy ones, or selfish ones.

I’d be interested in a couple of examples, if anyone has good ones, but I’m pretty sure that if we put stuff like 737MAX MCAS, the Texas power grid fiasco, etc the count of badly paved roads would be greater.

Re:AI will enable mass spying by jononor on Wednesday December 06, 2023 @06:06AM (#38542456)
The people that support the War on drugs would say it's with good intentions. But it has put a lot of people in jail where it neither benefits them nor people around them, nor society at large. In many cases leading to worse outcomes for affected communities.

War on terror is not without adverse side effects either.

Re:AI will enable mass spying by somenameforme on Wednesday December 06, 2023 @10:48AM (#38545404)
All of the great wars of the 20th century are perfect examples. WW1 started when an assassin with Serbian state backing assassinated the heir (to an 80+ year old Emperor) of Austria-Hungary. Austria-Hungary demands Serbia effectively let them carry out an investigation and enact consequences at their discretion. Austria-Hungary refuses. So Serbia invades them. This causes Serbia's ally Russia to move in on behalf of Serbia. This causes Austria-Hungary's ally Germany to move in on behalf of Austria-Hungary. This resulted in Russia's ally France joining in on the war, and so on.

Soon enough you had Brits killing Germans because a Serbian assassinated an Austro-Hungarian royal. The most messed up thing of all though is that everybody had a very strong pretext of 'just' behavior on their side. It was just like an avalanche of justice that resulted in tens of millions of dying and things not only failing to get better, but getting much much worse.

Since the winners won, and the losers lost, the winners must be right. So they decided to brutally punish the losers for being wrong, Germany among them in this case. The consequences imposed on Germany were extreme to the point that the entire state was bankrupted and driven into hyperinflation and complete collapse. And this set the stage for a young vegetarian from Austria with an knack for rhetoric and riling up crowds to start using the deprivation the state was forced to endure to rally increasingly large numbers of followers to his wacky cause. He was soon to set Germany on a path to proving that WW1 was not only NOT the war to end all wars, but rather was just the warm-up act for what was really about to happen.

Re:AI will enable mass spying by r00fus on Tuesday December 05, 2023 @06:12PM (#38538254)
The other point is when technologies essentially make redundant an entire class of people then those people are more easily repressed.

In this case, it could be the entire US populace that is not part of the surveillance engine.

Re:AI will enable mass spying by dfxm12 on Tuesday December 05, 2023 @02:27PM (#38535730)
Make it a crime for a business to have the wrong opinion when it comes to who they want to serve

FWIW, businesses who refuse to do business with people generally win their legal cases [0], [1], [2], and I'm not sure if they are ever criminal...

0 - https://www.npr.org/2023/06/30/1182121291/colorado-supreme-c...

1 - https://www.nytimes.com/2018/06/04/us/politics/supreme-court...

2 - https://www.dailysignal.com/2023/11/06/christian-wedding-pho...

Re:AI will enable mass spying by mullingitover on Tuesday December 05, 2023 @03:10PM (#38536295)
These are selection bias, businesses who "refuse to do business with people" and then suffer the legal ramifications of their discrimination usually have lawyers who wisely tell them not to fight it in court because they'll rightfully lose. In these particular cases, it took a couple decades of court-packing to install the right reactionaries to get their token wins.
Re:AI will enable mass spying by dfxm12 on Tuesday December 05, 2023 @03:22PM (#38536428)
It would have been easy for the parent poster to not be so incredibly vague. I suspect it's because they are discussing this point in bad faith, ready to move the goalposts when any evidence to the contrary was brought up like this.
Re:AI will enable mass spying by mym1990 on Tuesday December 05, 2023 @02:52PM (#38536078)
A difference in today's world is that private companies are amassing data that then gets turned around to the highest bidder. The government may not have had an interest in collecting the data before but now the friction to obtaining it and the insights is basically just money, which is plenty available.

Your opinion on bannable offenses is pretty bewildering. There was a point in time when people thought it would be crazy to outlaw slavery, from your post I might think that you would not be in support of what eventually happened to that practice.

Re:AI will enable mass spying by aijoe5pack on Wednesday December 06, 2023 @10:14AM (#38544887)
And the highest bidder is often 'not spending legal fees on blocking the government requests'.
Re:AI will enable mass spying by JakeAl on Tuesday December 05, 2023 @03:02PM (#38536212)
I would say instead it's a PEOPLE problem, not a technology problem.

To quote Neil Postman, politics are downstream from technology, because the technology (medium) controls the message. Just look at BigTech interfering with the messages by labeling them "disinfo." If one wants to say BUSINESS POLITICS, then that's probably more accurate, but we haven't solved the Google, MS, DuckDuckGo, Meta interfering with search results problem so I don't think we can trust BigTech to not exploit users even more for their personal data, or trust them not to design AI so it inherently abuses it's power for BigTech's own ends, and they hold all the cards and have been guiding things in the interest of technocracy.

Re:AI will enable mass spying by forward1 on Tuesday December 05, 2023 @03:27PM (#38536489)
Laws limiting collection of data to solve privacy is akin to halting the production of fossil fuels to solve climate change: naive and ignorant of basic economic forces.
Re:AI will enable mass spying by salawat on Tuesday December 05, 2023 @04:19PM (#38537038)
Economic forces serve those that make the Market possible.

People > Markets.

Or to put it explicitly, people have primacy over Markets.

I.e. two people does not a Market make, and a Market with no people is not thing.