News for hackers. Stuff that matters.
Re:ChatGPT broke the EU plan to regulate AI by juancn on Sunday March 05, 2023 @02:43PM (#35033158)
Why the need to bring it under control? Control from what?

It's not the AI that's the issue, it's the use of it that's the problem. The law shouldn't focus on the AI, for example:

>The regulation, proposed by the Commission in 2021, was designed to ban some AI applications like social scoring

Ban social scoring, not the AI, the tool doesn't matter. Would it be good if it was computed by hand on paper instead of through AI? No, so the issue is not the tool.

They fear the amplification factor of such tech, but the amplification factor works for the good and for the bad, so you need to focus just on the bad, not on the tech. Otherwise you end up impairing the good too.

Re:ChatGPT broke the EU plan to regulate AI by bobthepanda on Sunday March 05, 2023 @03:01PM (#35033364)
Control may be the wrong thing here.

Every technology, at some point, will inevitably bring questions of legal liability and culpability, and AI has a large tendency to do so because of how applicable it is. It’s not the worst idea to try and get ahead of the problem by defining a legal framework.

Examples of how a free-for-all has resulted in legal questions;

* police and the judiciary in the US have come under fire several times for using proprietary AI to determine things like sentencing or traffic stops

* there is currently a class action lawsuit in Washington state about whether or not price recommendations by a third party’s algorithm constitutes collusion on price-fixing if enough corporate landlords use it

Re:ChatGPT broke the EU plan to regulate AI by HPsquared on Sunday March 05, 2023 @03:32PM (#35033652)
I don't get it. For the first example, the system is only a tool used and the responsibility is still with whoever does the sentencing/traffic stops etc.

In the second case, how is this different from e.g. Kelley Blue Book for car prices?

Re:ChatGPT broke the EU plan to regulate AI by bobthepanda on Sunday March 05, 2023 @03:55PM (#35033825)
Separating this into two responses.

---

The problem with the first case is that we do not have existing case law about AIs, and we also have no laws on the books that clarify what to do in AI cases, so this is making the lawsuits and investigations very messy and time-consuming, since judges have to waffle about to figure out what the correct, legal thing to do is.

Pretty much all Western law systems judge the severity of action using intent, or mens rea; it doesn't absolve you of crime if you didn't mean to do it, but your penalties will generally be lesser. The people using the algorithm can wash their hands of intent by saying "we signed a contract with a third party for their algorithm and didn't reasonably expect biased outcomes." Then you make the third party a defendant, and then the third party claims "trade secrets" because we have no laws about what is and isn't protected trade secrets with AI, etc. and that becomes a whole legal case on its own that takes even more time for the legal system.

---

The difference in the second case is that the corporate landlords in question are automatically pegging their rates to the algorithm's recommendation and not giving property managers discretion. The algorithm's customers combined also control over half of supply of apartments in the Seattle area.

---

But the point of legal clarity, is to reduce the amount of questions, which both 1) heads off potential issues and 2) makes the issues that come into the legal system faster and clearer to process. It also potentially actually makes things easier for companies who make AIs too, since legal defense spending isn't exactly cheap.

Re:ChatGPT broke the EU plan to regulate AI by theshrike79 on Sunday March 05, 2023 @04:50PM (#35034385)
New Jersey also used AI to determine bail and it failed spectacularly: https://www.wired.com/story/algorithms-supposed-fix-bail-sys...
Re:ChatGPT broke the EU plan to regulate AI by xoa on Sunday March 05, 2023 @05:24PM (#35034789)
Without evaluating the specifics of those exact cases but more whether they do indeed deserve more scrutiny at least, I think the basic issue comes down to the increasing need to consider things from a systems point of view.

>I don't get it. For the first example, the system is only a tool used and the responsibility is still with whoever does the sentencing/traffic stops etc.

Sometimes though the rules of society must take into account the actual reality of humanity, with all our foibles, and work anyway. Pointing the finger at "individual responsibility" doesn't always cut it. Certain tools simply push too far to the edge of well known human mental failure points. If the overall system for activities involving serious life/safety/security/liberty human failure modes tends to push towards these failure modes and lean too heavily on an expectation of human perfection, and then imperfect humans fail resulting in loss, it can be very worth considering whether the problem is human imperfection or if it's just a bad system. The incredible safety record of the modern airline industry for example comes heavily from treating accidents as system failures by default. Outside of a few edge cases that are constantly working to get shrunk, no accident should ever result from just a single problem including human problems, from a single person getting tired or making a mistake. There are checklists and formalized procedures. There are layers and layers of redundancy, of everyone checking each other. We don't just take incredibly complex tools like aircraft and then if one crashes say "well the pilots didn't have the right stuff!"

Or for a current AI-related ongoing change, consider self-driving technology. There have been two overall broad approaches, one "working its way up" from driver-assist tech, and the other aiming to start at full self-driving immediately even if that means tight geographic restrictions and vehicle tech requirements. In the first, the idea is that "the driver is still always in charge" and "it's only a tool" until full self driving is achieved. And perhaps in principle either could get there in the end without wildly different issues.

But in practice, that's not how humans work at scale. For many people if you give them something that works 99.5% of the time and then fails catastrophically 0.5% of the time and tell them that they need to constantly act as if the tool wasn't there and might not be there at any instant, well, they just won't do that consistently. They'll come to depend on it. Attention will wander, distractions will set in, and they won't maintain mental state the same as if they were driving themselves. If there is some warning they may need to take over sure they'll be able to execute a state change and do so, but if it's a matter of seconds, they won't. Humans are creatures of shortcuts and habits, that's just how it is. So maybe L3/L4 driver assist just isn't ok, and saying that it's "only a tool" doesn't cut it.

>In the second case, how is this different from e.g. Kelley Blue Book for car prices?

The issue is if it's all being done automatically, not merely as a recommendation, and at scale.

In general an area the law has yet to really effectively grapple with is that of emergent effects, where individually something would be fine, but with enough scale has an effect that mimics something we already aren't ok with. Here, the effect of fully automated algorithmic pricing of a sufficiently high percentage of the market of nominally independent actors could create the effect of formal collusion to change market prices.

Another example would be AI, networking and storage with sufficient cameras. Putting a security camera out on your property is perfectly legal. So is many cameras. So is saving video, and humans looking at it. There is no "reasonable expectation of privacy" in public per se. Individually there'd be no issue. But if there are a sufficient number, networked, with sufficient storage/memory/computer and AI thrown at it, the effect suddenly changes and becomes as if someone was being persistently trailed/tracked the same as if a GPS tracker had been stuck on them or the like. And worse it's for everyone simultaneously. The sum is greater then the individual parts. Such a system could effectively not just trace everyone's movement but also interactions and start to build up their social network graphs and no doubt all sorts of other personal information.

How to grapple with things that are fine and even incredibly helpful by themselves but become dangerous at scale may be one of the great challenges of this century.

Re:ChatGPT broke the EU plan to regulate AI by thrashh on Sunday March 05, 2023 @05:18PM (#35034722)
Sure but you can’t ban something without knowing what it is yet.

And if you try, you end up writing something vague that doesn’t actually fix the problem and instead bans something else.

Case in point is the EU having to write something vague and it turns out they had no idea what was coming.

Maybe just wait until there is a problem before trying to write vague laws IMO.

Re:ChatGPT broke the EU plan to regulate AI by ethbr0 on Sunday March 05, 2023 @07:12PM (#35035779)
The problem with black boxes is that they beg parallel construction theories.

I.e. "We don't approve loans to {ethnic majority} on purpose. We only use our models, which only rely on historical data." -> No proof, no case, no problem

The point of any AI law should be to put the onus on the model executor to explain how their model doesn't violate existing law.

You can use any model you want, but you can't point to its unexplainability as a free pass for ignoring protected classes.

And if you can't explain its results? Well, then you're opening yourself up to lawsuits.

Re:ChatGPT broke the EU plan to regulate AI by thrashh on Monday March 06, 2023 @01:20AM (#35038057)
Companies can already do that without AI. Why would you legislate just AI and let some other company discriminate?
Re:ChatGPT broke the EU plan to regulate AI by ruszki on Monday March 06, 2023 @01:36AM (#35038125)
Why do you think they would let?
Re:ChatGPT broke the EU plan to regulate AI by warrenronsiek on Monday March 06, 2023 @10:35AM (#35042235)
So ML systems are guilty until they can prove themselves innocent?

Requiring the claimant have some evidence might not be a perfect legal regime, but the converse is a de-facto ban on innovation.

Can a human _prove_ that their decisions are made without bias? No. Are we going to hold them to the same standard proposed here for an AI? Also no. In practice, rules like the one proposed here just enshrine legacy decision systems which are already understood to biased and ineffective.

The most mysterious black box we have is the human brain.

Re:ChatGPT broke the EU plan to regulate AI by ethbr0 on Tuesday March 07, 2023 @07:55AM (#35054774)
A fair point.

What would you say of requiring training data and hyperparameter archiving for subsequent legal review?

Re:ChatGPT broke the EU plan to regulate AI by bobthepanda on Sunday March 05, 2023 @09:39PM (#35036906)
The original regulation doesn’t actually sound that vague. From TFA

> The regulation, proposed by the Commission in 2021, was designed to ban some AI applications like social scoring, manipulation and some instances of facial recognition. It would also designate some specific uses of AI as “high-risk,” binding developers to stricter requirements of transparency, safety and human oversight.

The issue is that as written it would still not cover general AI and that would still be legally grey.

Some of those uses in the US have already been problematic, like Madison Square Garden using computer vision to ban any lawyers from firms suing them from their vast properties, which is actually against various laws like their liquor license.

Re:ChatGPT broke the EU plan to regulate AI by XorNot on Monday March 06, 2023 @01:29AM (#35038095)
That's still focusing on the wrong problem though: if Madison Square garden had simply told security to eject the lawyer, it would be the same issue. The problem isn't facial recognition, it's that they thought they could or should do this at all.
Re:ChatGPT broke the EU plan to regulate AI by janosdebugs on Monday March 06, 2023 @03:32AM (#35038766)
Not entirely. ML algorithms make these processes ridiculously effective. You no longer need to expend the time of a human to make that decision.
Re:ChatGPT broke the EU plan to regulate AI by hourago on Sunday March 05, 2023 @03:36PM (#35033676)
> Ban social scoring, not the AI, the tool doesn't matter.

Automated human classification without recourse nor transparency is what the EU is against. "You cannot get a loan because the AI says so" is not acceptable.

> Would it be good if it was computed by hand on paper instead of through AI?

Yes. As a judge can check what information was used and what algorithm applied to get to a conclusion. And it may declare that use of data or algorithm illegal.

> They fear the amplification factor of such tech, but the amplification factor works for the good and for the bad

Maybe just go slower. Something like an Hippocratic oath can be a good principle to follow for high impact technologies. To do some good may not justify the harm.

Re:ChatGPT broke the EU plan to regulate AI by concordDance on Sunday March 05, 2023 @04:56PM (#35034462)
> "You cannot get a loan because the AI says so" is not acceptable.

To me this makes it seem like acces to loans is a right,in which case the EU should make a lender of last resort that can loan to people who would otherwise get rejected.

Re:ChatGPT broke the EU plan to regulate AI by barrkel on Sunday March 05, 2023 @05:11PM (#35034631)
How do you leap from banning black box AI decisions to thinking it means everything is allowed?
Re:ChatGPT broke the EU plan to regulate AI by edgineer on Sunday March 05, 2023 @06:41PM (#35035494)
Perhaps the assumption is that humans functioning as black box loan deniers is also a problem.
Re:ChatGPT broke the EU plan to regulate AI by px43 on Sunday March 05, 2023 @06:42PM (#35035504)
Haven't loan decisions always been black box? Sometimes they'll attribute decisions to credit scores, but those scoring systems have always been proprietary, and they won't even tell you what data your scoring is based on.
Re:ChatGPT broke the EU plan to regulate AI by gopher_space on Sunday March 05, 2023 @07:24PM (#35035882)
> Haven't loan decisions always been black box?

Not to the people making those decisions. That's brand new.

Re:ChatGPT broke the EU plan to regulate AI by dogma1138 on Sunday March 05, 2023 @08:53PM (#35036594)
People haven’t been making loan decisions for decades in the EU as well. You put numbers into a computer and what comes out is either an approval with a rate or a decline.

No bank EU or not has people manually approving loans.

Re:ChatGPT broke the EU plan to regulate AI by bigDinosaur on Sunday March 05, 2023 @09:10PM (#35036697)
'Black box' doesn't mean 'numbers in a computer', it means 'nobody can explain to me precisely why I was rejected'. A score calculated from an obvious formula is fine (regulations permitting) since you (or a regulator or court or the institution) can establish precisely why you were rejected. A black box system is one in which this cannot be established by any person.

This is obviously bad for both legal and moral reasons. Legally you may be (unintentionally) violating anti-discrimination laws. Morally you may be setting up a system that arbitrarily denies people who are otherwise deserving with little to no recourse.

Re:ChatGPT broke the EU plan to regulate AI by sokoloff on Monday March 06, 2023 @06:13AM (#35039687)
By that definition, hiring and dating appear to be black boxes.
Re:ChatGPT broke the EU plan to regulate AI by bigDinosaur on Monday March 06, 2023 @07:35PM (#35049942)
In both of those you can receive plausible explanations from anyone honest or introspective enough. If you think that all decisions are actually black box emotions that can't be introspected or something then yes, they would be total black boxes, and I suppose the goal would be to minimise that in any system we build that has to discriminate.
Re:ChatGPT broke the EU plan to regulate AI by ClumsyPilot on Sunday March 05, 2023 @09:02PM (#35036651)
You can file a lawsuit 'this bank does not give me loan because I am not white' and check. You can inspect the excell formula in the computer.

It does not matter who personally made that decisi9n, the bank is operating this code and paid someone to write it.

With 'AI' there is no way to know.

Re:ChatGPT broke the EU plan to regulate AI by dogma1138 on Monday March 06, 2023 @09:17AM (#35041255)
No, what you are entitled in the EU is to have the decision reviewed by a human, I fail to see how an AI changes that.
Re:ChatGPT broke the EU plan to regulate AI by ClumsyPilot on Monday March 06, 2023 @08:23PM (#35050278)
No what?

Let's imagine my bank is sexist, the code literally says "if WOMAN, Reject'

You can sue my bank for discrimination, and in process of discovery you can request information and documents from the bank, including the code / formulas.

If you have a solid argument, let's say my bank never approved a mortgage for a woman, the judge will grant your request. You, or someone appointed on your behalf, will look at the code / excel formula, see that it's discriminatory by design, and you can request massive punitive fines, because this demonstrates contempt for the law.

Now let's say I instruct my developers to create a neural network that is as convoluted as possible but is unlikely to approves mortgage for a woman. That can be easily done. There will be no proof that we ever did this on purpose, and even proving that it is discriminatory will be challenging. At best, my bank will get a slap on the wrist.

That is why they are banning AI from some areas of life.

Re:ChatGPT broke the EU plan to regulate AI by dogma1138 on Tuesday March 07, 2023 @01:24PM (#35059020)
That has nothing to do with entitlements…

That isn’t how it would work in reality.

It would be up to the bank to prove that their practices are non discriminatory if there will be a discrepancy between the number of applications issued.

The plaintiffs will be able to sue and win based on the outcome alone.

As far as actual rights go then you have the right to appeal any automated decision and have a human review it without any bias. Which again it doesn’t matter if it’s AI or a an algorithm based on flipping a coin.

Re:ChatGPT broke the EU plan to regulate AI by concordDance on Sunday March 05, 2023 @07:32PM (#35035970)
As the other commentators said, humans are also black box. They can, of course, provide vaguely reasonable justifications but these often aren't the actual reasons and ChatGPT can generate reasonable sounding rationalisations on demand.
Re:ChatGPT broke the EU plan to regulate AI by corbulo on Sunday March 05, 2023 @06:41PM (#35035490)
>Automated human classification without recourse nor transparency is what the EU is against. "You cannot get a loan because the AI says so" is not acceptable.

The credit score system already in place in the US is frequently as arbitrary in some cases already. I don't think I need to preach to HN about that (crypto money and all that). Does Europe do it much differently?

Not an arguement for AI to do it, but the only reason why the current system is better (at least in the US) is its sluggish incompetence.

Re:ChatGPT broke the EU plan to regulate AI by skissane on Sunday March 05, 2023 @07:11PM (#35035771)
> The credit score system already in place in the US is frequently as arbitrary in some cases already. You get punished for just looking at it. I don't think I need to preach to HN about that (crypto money and all that). Does Europe do it much differently?

Almost every country has some kind of credit reporting system, but many of them differ from the US in how they do it. In particular, in many countries, credit bureaus only hold negative information such as failing to pay bills or repay debts – which means if you keep up to date with all your bills and debts, your credit history will be blank. At which point, lenders will generally ask you to provide evidence of your employment history, salary, bank balance, assets, etc, and base their lending decision on that. They may well internally convert that all info into a "score", but every lender is going to have a different scoring system. Here's an article – https://www.businessinsider.com/credit-score-around-the-worl... – which discusses the systems used in different countries, including several European countries. There is no uniform approach to this in Europe – the UK and Germany are closer to the US in their approach, the Netherlands, Spain and France are closer to the "credit bureaus hold negative info only" system.

Re:ChatGPT broke the EU plan to regulate AI by KyeRussell on Sunday March 05, 2023 @07:26PM (#35035899)
Yup. Until recently, Australia only had negative event reporting. Still, you’d regularly have kids that had been brainwashed by US-centric personal finance gurus (and American media more generally) asking how they could boost their “credit score”. Fully willing to sign up for and use credit cards as an 18-year-old student to juice some system they had been led to believe existed in the first place.
Re:ChatGPT broke the EU plan to regulate AI by smnrchrds on Sunday March 05, 2023 @09:52PM (#35036991)
How is the system in Australia now and why was it changed?
Re:ChatGPT broke the EU plan to regulate AI by Ekaros on Monday March 06, 2023 @05:34AM (#35039445)
I think in Finland having too many credit lines would actually hurt you with loans. However well you have handled those. As important factor is total amount of loans or capacity to get them.
Re:ChatGPT broke the EU plan to regulate AI by endless1234 on Monday March 06, 2023 @06:32AM (#35039816)
Yeah, amount of credit cards & the total available credit limit is used as a negative signal when applying for a loan. But I think you'd have to have some completely silly amount for it to _really_ affect the outcome. You can easily show that you've not used the cards, for example. If you have 10 credit cards which you use constantly, it would affect your ability to get a loan. To me this makes sense, but of course, it's what I'm used to.
Re:ChatGPT broke the EU plan to regulate AI by Ekaros on Monday March 06, 2023 @06:44AM (#35039884)
10 cards, with average of 3000 limit. Would mean you could take a 30000 more loans at high interest rates very quickly. It is not about having used and paid them, but capability to get loans beyond what you can manage very quickly.
Re:ChatGPT broke the EU plan to regulate AI by skissane on Monday March 06, 2023 @04:52PM (#35048200)
It turns into a bit of a pointless ritual though - “I need a mortgage, I’m going to cancel cards I don’t use and slash my credit limits to maximise my borrowing power” - but no sooner have I bought the property, I will apply to increase them again, and they are unlikely to say “no”-even if the credit card is issued by the same bank as the mortgage. Or at least, that’s my personal experience in Australia
Re:ChatGPT broke the EU plan to regulate AI by Semaphor on Sunday March 05, 2023 @10:46PM (#35037311)
> the UK and Germany are closer to the US in their approach

Germany here.

a) But we are still not required to "build score"

b) There is currently yet another legal challenge against the Schufa (our credit scoring agency), this time in front of the ECJ.

Re:ChatGPT broke the EU plan to regulate AI by pjmlp on Monday March 06, 2023 @01:44AM (#35038163)
Interesting, specially given how hard it has become to rent anything without giving a Schufa report.
Re:ChatGPT broke the EU plan to regulate AI by Semaphor on Monday March 06, 2023 @01:46AM (#35038173)
Well, so far they more-or-less won every time. Though, from news reports, this time it seems serious. I guess we’ll see.
Re:ChatGPT broke the EU plan to regulate AI by OJFord on Sunday March 05, 2023 @09:04PM (#35036665)
> The credit score system already in place in the US [...] Does Europe do it much differently?

Yes, as far as I'm aware the US & Canada are unique in having 'a credit score' for people; elsewhere there may be agencies offering scoring services to lenders, but it's not something individuals ordinarily nor need to care about, and it's not 'their score' it's just that particular company's (Equifax's, or whoever) rating.

It's not taken as seriously, nor does it need to be.

Re:ChatGPT broke the EU plan to regulate AI by LeanderK on Monday March 06, 2023 @07:16AM (#35040128)
yeah, german here. I know schufa exists but right now it's really barely relevant. I don't plan to take on large debt or something (I think that's what they are used for?) and I've never used it so far.
Re:ChatGPT broke the EU plan to regulate AI by Kranar on Sunday March 05, 2023 @09:15PM (#35036732)
>The credit score system already in place in the US is frequently as arbitrary in some cases already.

The credit score system is not arbitrary, it's a specific formula that applies equally to everyone.

>You get punished for just looking at it.

No you do not. There are hard inquiries and soft inquiries, and an individual viewing their own credit score is considered a soft inquiry which has absolutely no effect on your credit score.

As for Europe, there is no one homogeneous answer. Different parts of Europe handle credit differently. The UK and Germany are very similar to the U.S., whereas in France there is no concept of a credit rating or credit score.

With that said, generally the countries that do not have a credit scoring system are much harder to get a loan from.

Re:ChatGPT broke the EU plan to regulate AI by wb14123 on Sunday March 05, 2023 @10:09PM (#35037098)
> it's a specific formula that applies equally to everyone.

That doesn’t mean the formula is reasonable or transparent. An AI is also a specific formula that applies equally to everyone. It’s about how the formula takes “weight” on the individual’s differences.

> There are hard inquiries and soft inquiries

Why there are “hard inquiries”? Why someone else inquiring my credit score should affect my credit score?

Re:ChatGPT broke the EU plan to regulate AI by schrodinger on Sunday March 05, 2023 @11:40PM (#35037577)
I certainly don’t love the system, but the difference is “checking credit score in order to take more credit (eg a loan or credit card)” (hard) vs “checking credit score for my own knowledge” (soft). This distinction feels reasonable to me.
Re:ChatGPT broke the EU plan to regulate AI by AnthonyMouse on Monday March 06, 2023 @12:50AM (#35037900)
How is it reasonable? Anyone checking your credit score already knows that you're applying for new credit, because you're applying for new credit with them.

Dinging your score over that only punishes you for soliciting credit offers from multiple lenders at once so you can choose the best terms. Which ought to be an antitrust violation.

Re:ChatGPT broke the EU plan to regulate AI by dwallin on Monday March 06, 2023 @02:09AM (#35038279)
It's a defense against the double spend problem. It minimizes potential timing issues that could allow someone to simultaneously taking out multiple credit lines without the ability to properly evaluate the risk.
Re:ChatGPT broke the EU plan to regulate AI by AnthonyMouse on Monday March 06, 2023 @02:23AM (#35038357)
But it isn't, because the reduction in credit score from the query doesn't necessarily prohibit two simultaneous loans, it just makes the terms worse (and so makes default more likely).

And there are obviously better ways to prevent "double spend," like reporting the new loan being granted, which actually should reduce the credit score due to the new debt. It's not as if we can't make computers capable of updating this information in real time.

Re:ChatGPT broke the EU plan to regulate AI by kelnos on Monday March 06, 2023 @04:20AM (#35039062)
The interesting thing I've noticed is that opening a new credit account often doesn't actually get that information on your credit report. It sometimes only shows up after you've made the first payment (either loan or credit card). I wonder if that's why the system dings you for too many hard credit inquiries. I agree with you that there's no reason why this couldn't be fixed, though.
Re:ChatGPT broke the EU plan to regulate AI by shjake on Monday March 06, 2023 @03:02AM (#35038565)
Or rather it discourages people from attempting to apply at multiple places to get the best offer..
Re:ChatGPT broke the EU plan to regulate AI by sokoloff on Monday March 06, 2023 @07:04AM (#35040021)
Typical rate shopping is not discouraged: https://www.experian.com/blogs/ask-experian/do-multiple-loan...
Re:ChatGPT broke the EU plan to regulate AI by kelnos on Monday March 06, 2023 @04:18AM (#35039049)
That's usually not the case, though. I was just looking around at Chase's credit report tracking thing, and they have this to say on credit inquiries:

> The VantageScore credit score model takes rate shopping, e.g., for a mortgage or car loan, into consideration. All inquiries for mortgages, auto loans and major credit cards that appear in your credit file within a 14-day window are interpreted as a single inquiry.

I believe that's the case for the FICO score algorithm as well. I think a 14-day window is probably too short, but it likely does cover most situations.

Re:ChatGPT broke the EU plan to regulate AI by NovemberWhiskey on Monday March 06, 2023 @09:35AM (#35041485)
But if you're applying for, and repeatedly being rejected for, extension of credit by third parties that is absolutely something a pre-existing lender would reasonably consider when thinking about risk.

You have to understand that there is a no "credit denied" feedback into the credit rating system. The standard pattern for an approved credit application is a hard-pull followed by the opening of a new tradeline, both of which affect your score. If you're applying for credit, but not being approved, then that just shows up as a hard-pull with no new line.

The FICO score is also set up specifically to ignore additional hard-pulls for the same type of credit within a bounded period; so if you go shopping for a mortgage (or an auto loan, or a student loan), then multiple queries within a 30 day period are coalesced, and only count once from a scoring perspective.

Re:ChatGPT broke the EU plan to regulate AI by refurb on Monday March 06, 2023 @06:47PM (#35049546)
I dont think its unreasonable for one’s credit score to get dinged if half a dozen lenders check their score - that means the consumer went through the initial stages of trying to get multiple loans.

But more importantly the ding is maybe 10 points which is pretty much irrelevant to the “buckets” that define credit worthiness (>800, 700-800, etc).

Plus individual lenders can look at the report themselves and make their own determination.

Re:ChatGPT broke the EU plan to regulate AI by andsoitis on Monday March 06, 2023 @05:41AM (#35039481)
> An AI is also a specific formula that applies equally to everyone.

AI’s are not “a specific formula” and not only that, it’s decision-making is opaque to humans.

Re:ChatGPT broke the EU plan to regulate AI by NovemberWhiskey on Monday March 06, 2023 @09:46AM (#35041604)
>That doesn’t mean the formula is reasonable or transparent. An AI is also a specific formula that applies equally to everyone.

You can learn literally everything you need to know about how the FICO credit scoring systems works in probably two or three hours of dedicated research, even though the model itself is a trade-secret. When lenders deny credit, they're legally obliged to provide the specific reasons why.

This is not-even-in-the-same-ballpark as AI, where no-one can even tell you how inputs relate to outputs, not even the creators.

Re:ChatGPT broke the EU plan to regulate AI by corbulo on Sunday March 05, 2023 @10:22PM (#35037180)
https://www.cnbc.com/2019/02/27/american-consumer-credit-rat...

https://www.ftc.gov/news-events/news/press-releases/2013/02/...

It's one of the few things thats so obvious its bipartisan. I'm amazed you think its worth defending. There should not be a punishment for LOOKING at a credit score hard or soft, that's insane.

To require someone take on debt in order to have good credit is pretty arbitrary. You can have all the money in the world, but no debt? you're fucked. The fact you can juice your credit with someone elses credit cards is also really arbitrary.

Re:ChatGPT broke the EU plan to regulate AI by Dalewyn on Monday March 06, 2023 @03:11AM (#35038616)
You're misunderstanding the point behind credit scoring.

Banks lending you money don't care (at least not as a primary concern) how much money you have, their first concern is whether you have a history of paying back debt you owe. A credit score scores you on your ability and willingness to pay back your debts on time.

And yes, this means someone who takes on debt with a credit card only to immediately pay the balance before any interest accrues both has a stellar credit score and no debt in any practical sense.

This also means someone who is making their house or car payments properly also has a good credit score, outstanding debts negatively affecting the credit score slightly notwithstanding.

Re:ChatGPT broke the EU plan to regulate AI by sokoloff on Monday March 06, 2023 @06:09AM (#35039662)
> You can have all the money in the world, but no debt? you're fucked.

No, you’d be totally fine paying cash for anything you needed.

Re:ChatGPT broke the EU plan to regulate AI by fsloth on Monday March 06, 2023 @12:49AM (#35037890)
”Does Europe do it much differently?”

Yes (Finland and afaik other nordic countries at least).

The lenders use statistics, not individul spying to set their rates.

Re:ChatGPT broke the EU plan to regulate AI by NovemberWhiskey on Monday March 06, 2023 @09:40AM (#35041544)
Re:ChatGPT broke the EU plan to regulate AI by kelnos on Monday March 06, 2023 @04:10AM (#35038998)
> You get punished for just looking at it.

Not completely false, but misleading: you get penalized if a lender looks at it with the express purpose of using it to decide whether or not to offer you credit (called a "hard pull"). You looking at your own credit report does not penalize you, and certain other activities (like getting pre-approved for a loan) won't either.

The penalty for hard pulls isn't that bad, anyway, and disappears after a relatively short while. I currently have 7 hard pulls (I've been chasing credit card rewards offers lately), but my overall credit score is still over 800.

Re:ChatGPT broke the EU plan to regulate AI by IMTDb on Monday March 06, 2023 @05:35AM (#35039452)
So, GET request not only aren't idempotent but they also affect the party that is read. Who came up with that lovely system ? I gave it roughly 15 seconds of thought and came come up with multiple ways this design fucks up people lives.
Re:ChatGPT broke the EU plan to regulate AI by sokoloff on Monday March 06, 2023 @06:05AM (#35039624)
It’s not a GET request on the credit history; those do not affect the score. It’s a PUT* request on the “considering taking additional credit” record.

* perhaps closer to PATCH as multiple requests in short time are combined as one (as in mortgage shipping)

Re:ChatGPT broke the EU plan to regulate AI by fnordpiglet on Monday March 06, 2023 @09:15AM (#35041239)
The key though is this operation only happens when it’s part of a requested credit evaluation for the purposes of expanding credit. The act of requesting new credit diminishes your credit worthiness. The intent is to throttle issuance of credit by providing for a race condition - if I go out and apply for 100 credit cards at the same time, they each get a credit report without the others line of credit established because they’re all in the pending state. But each request to evaluate the worthiness of credit dampens the quality of credit. At a certain point all credit requests thereafter fail.

On the flip side it also causes a hole that’s increasingly hard to dig out of because if you have bad credit or borderline credit and apply for a card to see if you’re allowed back in at the capitalist buffet, you enter into a feedback loop of diminishing credit worthiness.

It isn’t true however that any form of read changes credit worthiness. There are many routine reads that have no impact. It’s specifically when you’ve directly requested an evaluation for expanded credit. It can’t happen passively, as sometimes banks refresh your credit history and even offer more credit automatically. It also can’t happen for other purposes than expansion of credit.

Re:ChatGPT broke the EU plan to regulate AI by NovemberWhiskey on Monday March 06, 2023 @09:30AM (#35041420)
A hard-pull is not a GET; it's a POST. The semantics are "this person is actively seeking credit, and we are considering whether to extend it to them". The system regards the extent of credit-seeking behavior, and changes to its pattern, as a factor that affects the credit profile.

That's not prima facie unreasonable. If you have someone who suddenly starts applying for lots of personal loans (for example), that's probably something you'd be interested in, as someone who has previously extended credit to that person.

As the prior poster indicated, when you look at your own credit file, it's not a hard pull. Nor is it a hard pull when a creditor updates their records on you as part of ongoing monitoring of your account. It's only a hard pull when the subject is specifically requesting a new, or increased, extension of credit. Those soft-pulls are GETs.

Re:ChatGPT broke the EU plan to regulate AI by andsoitis on Monday March 06, 2023 @05:32AM (#35039425)
> You get punished for just looking at it.

Can you elaborate? Everyone of the banks I use have an affordance on their website/app that allows me to see my credit score, history, etc. The bank puts it pretty front and center, so if even juts viewing it has a negative impact, why do you think the bank would make it so easy?

Re:ChatGPT broke the EU plan to regulate AI by bryanrasmussen on Monday March 06, 2023 @09:29AM (#35041407)
>The credit score system already in place in the US is frequently as arbitrary in some cases already.

people often think that the problems that pertain to their country are universal, but they would be wrong.

Re:ChatGPT broke the EU plan to regulate AI by ComplexSystems on Sunday March 05, 2023 @06:42PM (#35035507)
> Yes. As a judge can check what information was used and what algorithm applied to get to a conclusion. And it may declare that use of data or algorithm illegal.

A ban on "AI social scoring" would be neither necessary nor sufficient to make your scenario a reality.

Re:ChatGPT broke the EU plan to regulate AI by RC_ITR on Sunday March 05, 2023 @11:09PM (#35037434)
> Yes. As a judge can check what information was used and what algorithm applied to get to a conclusion. And it may declare that use of data or algorithm illegal.

Genuinely, why does process matter? Shouldn’t outcomes?

Maybe you’re not from the US, but we have a looooong history of “good unbiased processes” leading to awful and biased outcomes.

Re:ChatGPT broke the EU plan to regulate AI by AnthonyMouse on Monday March 06, 2023 @12:55AM (#35037925)
Outcomes are what the process decides. If you had some other process that could tell you what the outcome should be, you could have just used that as the original process.
Re:ChatGPT broke the EU plan to regulate AI by makeitdouble on Monday March 06, 2023 @03:02AM (#35038563)
To note, the discussion is on the EU side.

Yes, process matters in that they need to be reviewable and fixable. Them being good or unbiased is a function of how much scrutinity and oversight there is, but before even talking about biases, we need to know what's happening.

Even outside of fixing the system, in most countries if your get a credit application refused you can request the info that lead to the decision and act on it (update/fix your credit history for instance). Even if you can't fix specific aspects you at least know what conditions block you and deal with it accordingly (no use in reapplying twelve times if you're banned for life for instance, same way you might want to wait 6 months if it's a matter of prescription)

So yes, knowing what, why and how is as critical as the final outcome.

Re:ChatGPT broke the EU plan to regulate AI by mytailorisrich on Monday March 06, 2023 @08:16AM (#35040571)
Sometimes there seems to be an expectation that people are entitled to a loan if they meet some criteria.

That's not the case. As long as there is no discrimination based on a legally protected characteristic (e.g. race) you can lend to whoever you want based on whatever criteria you want.

Re:ChatGPT broke the EU plan to regulate AI by LatteLazy on Monday March 06, 2023 @08:09AM (#35040513)
The process is what we have to judge because in inputs are bias, so even if with a perfectly fair process you will get bias outcomes...
Re:ChatGPT broke the EU plan to regulate AI by usrbinbash on Monday March 06, 2023 @03:05AM (#35038576)
> To do some good may not justify the harm.

Bread can be baked to feed the needy, or to fill the bellies of soldiers who invade a peaceful neighbor. Who is to blame? The people inventing industrial bakeries, or the people using them to feed their invasion army?

Re:ChatGPT broke the EU plan to regulate AI by ketzu on Sunday March 05, 2023 @03:17PM (#35033522)
> Would it be good if it was computed by hand on paper instead of through AI?

Yes, as long as that is based on clear reasons why the decision was reached. (Unless this was a quip meant to mean "matrix muls with pen and paper are not AI!", personally I'd say they are, the same way bubble sort is bubble sort on paper and in code.)

[1] on the topic "why":

> For example, it is often not possible to find out why an AI system has made a decision or prediction and taken a particular action.

As far as I know, there are some rules around that (especially social scoring), but the regulation was/is targeted to lay out rules minimizing the applications in similar risky areas that do not have those same rules yet.

[1] https://digital-strategy.ec.europa.eu/en/policies/regulatory...

Re:ChatGPT broke the EU plan to regulate AI by rescripting on Sunday March 05, 2023 @02:53PM (#35033253)
Isn't this the same argument as "ban murder, not guns"? Murder is illegal, yes, but fatalities are lower in places with gun control than places without.
Re:ChatGPT broke the EU plan to regulate AI by felipelemos on Sunday March 05, 2023 @03:00PM (#35033339)
In this case it's the opposite: they are trying to ban guns while not making murder a crime.
Re:ChatGPT broke the EU plan to regulate AI by amelius on Sunday March 05, 2023 @05:38PM (#35034931)
Well, it would make sense if they (at least temporarily) banned guns if they didn't know yet that they could be used for murder.
Re:ChatGPT broke the EU plan to regulate AI by ilyt on Sunday March 05, 2023 @07:21PM (#35035860)
It's at "this thing shoots high speed metal projectiles at things far away in speed enough to go thru. We'd like to ban it before it becomes used for murders"
Re:ChatGPT broke the EU plan to regulate AI by hyperhopper on Sunday March 05, 2023 @03:33PM (#35033663)
You should look up Switzerland's gun laws and intentional homicide rate if you think so.

That is a far more complex issue which is far deeper than such a simple correlation.

Re:ChatGPT broke the EU plan to regulate AI by izacus on Sunday March 05, 2023 @04:45PM (#35034317)
Switzerland is top of Europe in gun homicide rates with about 5x the EU average.

You might not be making an example in support of an argument you think you're making ;P

Re:ChatGPT broke the EU plan to regulate AI by talideon on Sunday March 05, 2023 @05:20PM (#35034743)
TBF, much of that is down to suicides, as Switzerland has a much higher rate of suicide by gun than other countries. The general gun homicide rate once they're omitted isn't quite so crazy.
Re:ChatGPT broke the EU plan to regulate AI by briHass on Sunday March 05, 2023 @06:09PM (#35035219)
Same in the US, of course. Suicide by gun counted as 'gun violence' is the classic disingenuous deception. Remove those and gang violence (primarily against rival gangs), and the numbers don't look that scary, which is the issue for those with an agenda.
Re:ChatGPT broke the EU plan to regulate AI by bigDinosaur on Sunday March 05, 2023 @09:13PM (#35036722)
From an international perspective, most reporting about gun control being a big issue in the US appears to come from mass shootings, not the misc. causes such as gang activity or suicides.
Re:ChatGPT broke the EU plan to regulate AI by ericd on Sunday March 05, 2023 @09:47PM (#35036960)
If you look into the stats that reporting typically uses, I've found that mass shootings are frequently defined differently than they're popularly thought of (I believe gang violence is frequently included), and suicides are frequently included in the overall violence stats.
Re:ChatGPT broke the EU plan to regulate AI by concordDance on Sunday March 05, 2023 @05:01PM (#35034534)
But it also has a murder rate less than half of France's.

The people who use guns to kill in Switzerland instead use knives or other objects in France.

(I am admittedly cheating a bit, as Switzerland lacks the high crime subpopulations that France has)

Re:ChatGPT broke the EU plan to regulate AI by hyperhopper on Thursday March 09, 2023 @11:10PM (#35090268)
Yeah, and if you ban blue cars, blue cars will crash less and you'll see more red cars crash.

I specifically said "intentional homicide rate" for a reason, to get ahead of this ridiculous argument that people bring up despite it not holding up or being relevant.

I don't care how the homicide happens, I care that a homicide happened. And despite lots of guns, it doesn't happen a lot in Switzerland compared to the world or even other EU countries. Clearly, guns aren't the problem, the other factors play into it more.

Re:ChatGPT broke the EU plan to regulate AI by talideon on Sunday March 05, 2023 @05:05PM (#35034570)
For the curious, in Switzerland, you don't keep ammo at home, there's proper registration of weapons with proper background checks, and it's treated more as a means of national defense, so having lots of guns is going to get you odd looks from people. Guns aren't seen as something for personal defense: that's the job of the police.

In other words, Switzerland has a much healthier attitude towards gun ownership and usage.

Re:ChatGPT broke the EU plan to regulate AI by suddenclarity on Sunday March 05, 2023 @05:30PM (#35034852)
Isn't that that the argument from pro gun people? It's people and the culture, not the guns. See Sweden for an interesting example. One of Europe's highest gun ownership with little gun violence back in the day. Then it changed and it's now a daily occurrence with gang shootings while the number of legal guns was reduced.
Re:ChatGPT broke the EU plan to regulate AI by akomtu on Sunday March 05, 2023 @06:59PM (#35035655)
Switzerland has a more traditional, not healthier, relationship between the people and the state: the people are subjects who are given tiny freedoms, but are kept on tight leash, because the state has a deep distrust of its people. The abberation with guns is just insecurity of the state: it's small and needs its people to act as part-time military in reserve. If it had a bigger military, the fake gun rights would disappear overnight.
Re:ChatGPT broke the EU plan to regulate AI by ClumsyPilot on Sunday March 05, 2023 @09:13PM (#35036725)
> people are subjects who are given tiny freedoms, but are kept on tight leash,

This take comes across as insulting and I am not even from there.

Do you, by any chance, hail from the land of the free, where government can seize your property without even accusing you of a crime? (Civil forfeuiture)

Re:ChatGPT broke the EU plan to regulate AI by akomtu on Monday March 06, 2023 @12:38AM (#35037843)
You are right to feel insulted, because this relationship is upside down. The founders of "the land of the free" were aware of this problem and that's why everywhere in the founding documents they talk about "the people" that must have liberties, vs "the state" that must be kept on leash. The civil forfeiture problem shows just that: the state has insatiable desire to control the people, and it finds way to do so despite an elaborate framework to keep its tentacles short.
Re:ChatGPT broke the EU plan to regulate AI by dmitriid on Monday March 06, 2023 @01:13AM (#35038017)
And yet all of these issues, when they come up, are invariably happening in the "land of the free", not in the "totalitarian state dystopia of the EU and neighboring countries".
Re:ChatGPT broke the EU plan to regulate AI by talideon on Monday March 06, 2023 @10:56AM (#35042529)
Ah, do you have even the slightest clue about Switzerland?! I mean, it's quite impressive how you seem to have confused Switzerland for a highly centralised country with a distant political structure.

Could you go and do some research on the country before you comment on it?

> If it had a bigger military, the fake gun rights would disappear overnight.

The Swiss military is _huge_ for its size. It has one of the largest militaries per capita in the world.

Re:ChatGPT broke the EU plan to regulate AI by hyperman1 on Monday March 06, 2023 @02:11PM (#35046090)
They are one of the most people-empowering nations ever. If enough people indicate it(50k signatures in 100 days cfr google), a legally binding regerendum must be held. A simple majority can then change the law.

I wish more nations could have that kind of direct acces to their democracy. Even so, the majority of these referenda fail to change anything, so presumably people tend to make more noise than wanting actual change.

Re:ChatGPT broke the EU plan to regulate AI by Tainnor on Monday March 06, 2023 @08:38AM (#35040788)
It's not just the attitude, it's also the sheer number of guns: https://en.wikipedia.org/wiki/Estimated_number_of_civilian_g...

The US is so far ahead of every other country, including Switzerland, that the argument "it works for the Swiss people" makes no sense.

Re:ChatGPT broke the EU plan to regulate AI by dmix on Sunday March 05, 2023 @05:14PM (#35034671)
There's also no national statistics collected in either the US or Canada on whether murders/crimes involving firearms are 'legal' or not. Which is relevant to these debates and you'd think would be of interest to authorities.
Re:ChatGPT broke the EU plan to regulate AI by seanmcdirmid on Monday March 06, 2023 @01:18AM (#35038051)
Switzerland had a huge suicide problem (well by their standards) so they locked up the militia ammunition in communities for the guns Swiss militia members were sent home with.

Also, Switzerland is basically where the USA would be if the first clause of the second amendment was meaningful.

Re:ChatGPT broke the EU plan to regulate AI by aftbit on Sunday March 05, 2023 @02:57PM (#35033306)
Yes, which is also a valid argument. Tools have no alignment. The people using them do. Thus, one should regulate the people, not the tools.
Re:ChatGPT broke the EU plan to regulate AI by ip26 on Sunday March 05, 2023 @03:05PM (#35033408)
How about harmful tools with no practical uses to the general public? Mortars, tanks, ketamine, ICBM GPS units…

You’re taking an absolutist position, so I’d like to explore it.

Re:ChatGPT broke the EU plan to regulate AI by M4v3R on Sunday March 05, 2023 @03:14PM (#35033492)
Curious that you’ve put ketamine, a well known anesthetic used primary by the vets but recently also used in depression treatment [1], in that list of “harmful tools with no practical uses”.

[1] https://en.wikipedia.org/wiki/Ketamine-assisted_psychotherap...

Re:ChatGPT broke the EU plan to regulate AI by ip26 on Sunday March 05, 2023 @03:20PM (#35033555)
Vets and psychotherapists are not “the general public”.

Every item I listed has a clear and valuable purpose, but only in specific contexts.

Re:ChatGPT broke the EU plan to regulate AI by M4v3R on Sunday March 05, 2023 @03:22PM (#35033566)
Yeah I would consider pet owners and people with depression (so groups of people that benefit from this specific tool) a part of general public, both are fairly large groups.
Re:ChatGPT broke the EU plan to regulate AI by ip26 on Sunday March 05, 2023 @03:37PM (#35033679)
And ketamine is employed by trained professionals appropriately in veterinary hospitals and psychotherapy contexts. The public does not need unregulated access to ketamine for this to happen.
Re:ChatGPT broke the EU plan to regulate AI by neural_thing on Sunday March 05, 2023 @08:23PM (#35036368)
Computers are employed by trained professionals appropriately in military contexts. The public does not need access to computers for this to happen.
Re:ChatGPT broke the EU plan to regulate AI by bigDinosaur on Sunday March 05, 2023 @09:14PM (#35036730)
There's no task I cannot complete without ketamine, except for the consumption of ketamine itself. Without a computer I cannot perform my job, nor basically perform any modern professional job.
Re:ChatGPT broke the EU plan to regulate AI by mindslight on Monday March 06, 2023 @12:09AM (#35037708)
This framing is terribly paternalistic. If a person is taking a drug, they themselves are who is possessing and using it. They aren't some mere passive subject for doctors to be acting on. Furthermore, they shouldn't be forced to convince some doctor-bureaucrat they have some specific medical condition, or even a "medical condition" at all, to be allowed the treatment they'd like to try.
Re:ChatGPT broke the EU plan to regulate AI by dns_snek on Sunday March 05, 2023 @04:39PM (#35034267)
Even so, I don't believe it deserves to be on that list. I consider responsible recreational drug use a clear and valuable purpose in its own right. It doesn't inherently lead to individual, much less societal harm and it allows individuals to experience and explore various states of human consciousness, an extension of the fundamental right to bodily autonomy.
Re:ChatGPT broke the EU plan to regulate AI by influx on Sunday March 05, 2023 @03:21PM (#35033558)
If you're open for exploration, what are your thoughts on organisms rights to self defense? What level of self defense should they be able to have if another organism is trying to end their life?
Re:ChatGPT broke the EU plan to regulate AI by ip26 on Sunday March 05, 2023 @03:33PM (#35033657)
There is a tension between the need to level the playing field and the need to minimize the harm potential.

For example, land mines, machine gun emplacements, and chemical weapons can be effective forms of home defense. An intruder would have access to the same equipment, but at least the playing field is level, right? However, an attacker would also be able to inflict astounding mass casualties in moments with this equipment.

On the other side, if the most effective self defense weapon available is a kitchen knife, the playing field is not very level, and a weak victim can be overpowered by an attacker or intruder. However, the ability to inflict mass casualty is greatly limited.

So, I don’t have a specific level to prescribe, but I would start the discussion by framing the decision as a balance between these two elements.

Re:ChatGPT broke the EU plan to regulate AI by influx on Sunday March 05, 2023 @04:56PM (#35034464)
I appreciate the thought you've put into this, and I tend to agree. Ideally, a weaker person would be able to use a tool to provide self defense in the most limited way possible without causing harm or damage to anyone other than the attacker.

Unfortunately the tools we have currently aren't great at that.

Re:ChatGPT broke the EU plan to regulate AI by ilyt on Sunday March 05, 2023 @07:24PM (#35035889)
> Ideally, a weaker person would be able to use a tool to provide self defense in the most limited way possible without causing harm or damage to anyone other than the attacker.

Landmines in the garden it is then. Hard to use offensively.

Re:ChatGPT broke the EU plan to regulate AI by Thiez on Monday March 06, 2023 @05:34AM (#35039443)
A shame if a child that accidentally threw a ball in your garden steps on them, or even just the overweight neighbours cat. Or a visitor stumbles on them duling a bbq. But such casualties are apparently a small price to pay for feeling safe.
Re:ChatGPT broke the EU plan to regulate AI by ilyt on Monday March 06, 2023 @07:25AM (#35040188)
Perfect use case for IoT mines and AI object/face recognition
Re:ChatGPT broke the EU plan to regulate AI by Thiez on Monday March 06, 2023 @08:00AM (#35040442)
Why would a hypothetical attacker wander through the garden anyway, instead of walking the normal path to the front door like a normal person? That face recognition will surely blow up the first pizza delivery person that has the misfortune of delivering to your house. I hope you tip well.
Re:ChatGPT broke the EU plan to regulate AI by int_19h on Sunday March 05, 2023 @06:51PM (#35035585)
FWIW mortars and tanks are legal for the general public to own in US, although it does involve a bunch of forms and tax stamps if they're operable. It doesn't seem to be a problem in practice, though - at least, I've never heard of a legally owned tank or mortar being used for criminal or other harmful purposes.
Re:ChatGPT broke the EU plan to regulate AI by ilyt on Sunday March 05, 2023 @07:23PM (#35035876)
Well, tanks and mortars might've moved the scales on Emu War in favour of australians
Re:ChatGPT broke the EU plan to regulate AI by AnthonyMouse on Monday March 06, 2023 @01:29AM (#35038097)
People are going to bog you down listing all the practical everyday uses for weapons-grade plutonium, but let's try a different tack. Stipulate for sake of argument that there is something dangerous with no beneficial civilian use, so you want to ban it. But there is public demand for the thing, or a lot of people just hate you banning things and will make every effort to thwart you.

Sellers split the item into parts so none of them individually is the completed item but anyone can buy them and stick them together. So you pass a law that says the "lower bit" is the part that's banned, and they can't sell that part. People start selling "80% lower bits" or whatever the nearest not-illegal thing is that can be converted into it. 3D print files for the part appear on the internet, or detailed instructions for how to manufacture one yourself.

What now? Ban 3D printers and CNC machines? Ban anonymous communications or encrypted communications with anyone outside the jurisdiction, so people can't distribute the parts files? Now you're banning things with beneficial public uses. But if anybody can easily reproduce the thing the thing then the ban is ineffective.

Re:ChatGPT broke the EU plan to regulate AI by flir on Monday March 06, 2023 @09:28AM (#35041403)
What's wrong with making manufacture and possession illegal?
Re:ChatGPT broke the EU plan to regulate AI by chipsa on Monday March 06, 2023 @12:36PM (#35044240)
How well did the war on booze go? How well is the war on drugs going?
Re:ChatGPT broke the EU plan to regulate AI by AnthonyMouse on Tuesday March 07, 2023 @02:25AM (#35052561)
And to be more specific, possession and home production are difficult to detect, so enforcement will be ineffective or highly invasive or both. Victimless crime laws erode citizens' respect for the law and government respect for citizens' privacy. That's what's wrong with them.
Re:ChatGPT broke the EU plan to regulate AI by mirchibajji on Monday March 06, 2023 @07:49AM (#35040339)
This is a case of people actively building and deciding to use a tool with plausible deniability built-in. How would you regulate people when they shirk any accountability? It is much more reasonable to require that people use a tool that shows its work.
Re:ChatGPT broke the EU plan to regulate AI by everforward on Monday March 06, 2023 @01:38PM (#35045526)
> How would you regulate people when they shirk any accountability?

This happens with or without AI. It's not too hard to make an algorithm that discriminates against people without doing so explicitly. You can use certain bits of data as proxies for whatever characteristic you want to discriminate against (e.g. ZIP code, household income, marital status, etc).

Due to the myriad of ways to arrive at a discriminatory conclusion, it's easier to regulate results than tools.

One potential solution to your question is to make the laws carry strict liability (I'm assuming the EU has something along those lines). Plausible deniability no longer exists because intent doesn't matter. The company is liable if someone can demonstrate discrimination, regardless of whether it was intentional or accidental.

That ends up pushing towards something similar to what you want. It encourages a tool that can show its work to fend off lawsuits without being directly tied to the tool itself. The other alternative is extensive testing to make sure discrimination doesn't happen, but I think that will still be worrying to companies due to the inability to prove a negative.

Re:ChatGPT broke the EU plan to regulate AI by cheeselip420 on Sunday March 05, 2023 @02:59PM (#35033328)
The upside potential of guns is not even remotely comparable with AI...
Re:ChatGPT broke the EU plan to regulate AI by hyperhopper on Sunday March 05, 2023 @03:35PM (#35033669)
Saving your own life could be argued to be the most important upside possible.
Re:ChatGPT broke the EU plan to regulate AI by talideon on Sunday March 05, 2023 @05:17PM (#35034706)
Given you brought up Switzerland, "saving your own life" isn't a valid reason there: concealed carry isn't legal there, and you need a gun-carrying permit to open-carry outside of some very limited circumstances, such as travelling to and from a shooting range. The only people who can easily get gun-carrying permits are those in security and such.

In Switzerland, guns exist for recreational and competitive shooting, hunting (so long as you have a hunting permit), and national defense. Not personal defense.

Re:ChatGPT broke the EU plan to regulate AI by int_19h on Sunday March 05, 2023 @07:00PM (#35035664)
Czechia is a European country you want to look at for an example that you can have gun laws that allow civilians to own handguns and carry them for defensive purposes without problems.

US is somewhat unique in the Western world across the board - no public healthcare, generally poor social safety net etc - which means that exercises in causal linking of those unique traits to outcomes are wild guesswork, if one is taking a charitable perspective. A non-charitable one is that people mostly just cherry-pick things that compare favorably for whatever political cause they're advancing, and will often outright refuse to believe a similar comparison that is contradictory.

Re:ChatGPT broke the EU plan to regulate AI by dmitriid on Monday March 06, 2023 @01:22AM (#35038065)
> Czechia is a European country you want to look at for an example that you can have gun laws that allow civilians to own handguns and carry them for defensive purposes without problems.

Let's see:

--- start quote ---

A gun in the Czech Republic is available to anybody subject to acquiring a firearms license. Gun licenses may be obtained in a way similar to a driving license – by passing a gun proficiency exam, medical examination and having a clean criminal record.

the issuing authority (police) firearm owners' database is connected to information needed for a background check and red flags any incidents that may lead to loss of license requirements. Similarly, health clearance by the general practitioner is needed for periodical renewal of license (every ten years).

* also very specific restrictions depending on license *

Obtaining the license requires passing a theoretical and practical exam.

https://en.wikipedia.org/wiki/Gun_law_in_the_Czech_Republic

--- end quote ---

Oh look, already more strict than many states in the US (and some states are busy removing any restrictions).

Re:ChatGPT broke the EU plan to regulate AI by int_19h on Monday March 06, 2023 @04:15PM (#35047708)
(I don't know why your comment got flagged, since it's factual. Whoever did this - please don't, this is not a feature meant to be used indicate your disagreement.)

I'm not claiming that Czech gun laws are identical to US. I'm claiming that you can have shall-issue concealed carry and broad access to "assault weapons" for civilians without gun violence problems as seen in US.

Re:ChatGPT broke the EU plan to regulate AI by talideon on Monday March 06, 2023 @10:47AM (#35042387)
First up, Czechia has proper licensing and strict background checks. Maybe not the best choice to compare to the US.

I don't have to take a wild guess around this kind of thing: I'm specifically referring to the gun culture of the US and comparing it to that of Switzerland. There's a different attitude to gun ownership in the two countries, one of which places strong emphasis on responsible ownership and the other which doesn't. That difference has little to do with mess of a healthcare system the US has, nor its poor social safety net (though it's interesting to note that those most obsessed with with getting rid of the safety net and public healthcare correlates with those most obsessed with the US second amendment). Now, what might be interesting to observe is that in Switzerland, rights come with responsibilities, whereas in the US, this attitude is much less prevalent, hence how much more common "rights absolutists" are there.

Personally, I have no issue with people having guns. What I do have a problem with is people who fail to recognise that exercising their right to have those guns comes with a responsibility to the wider community.

Re:ChatGPT broke the EU plan to regulate AI by int_19h on Monday March 06, 2023 @04:12PM (#35047675)
Sure, and I didn't claim that Czechia is the same as US in this regard. I'm merely pointing out that you can have a country with a gun culture that, among other things, enables personal self-defense without all the associated problems that US has which people often assume are intrinsic to gun ownership and defensive use.

I disagree that the situation in US has nothing to do with healthcare and social safety net, though. For example, suicides constitute most gun deaths in general, but this is worse in US because of its generally poor situation with preventative health care, especially mental health care. Similarly, poor social safety net means a lot more people ending up in poverty, which drives up crime including violent gang clashes that cause the majority of gun-related deaths in US. This isn't to say that the prevailing attitudes among American gun owners do not contribute to the problem, either - but I'm sure that, if US would catch up with e.g. Canada when it comes to taking care of its own population, the numbers would strongly reflect that.

And yes, it is ironic and sad that support for RKBA is strongest on the right, which is also the cause for all this. It's not exclusively them, though. The running joke on the subject in many hard left spaces is that "if you go far enough left, you get your gun rights back".

Re:ChatGPT broke the EU plan to regulate AI by cheeselip420 on Tuesday March 07, 2023 @02:37PM (#35060087)
Statistically you're much more likely to lose your life to a gun than to save your life with a gun...
Re:ChatGPT broke the EU plan to regulate AI by antibasilisk on Sunday March 05, 2023 @07:09PM (#35035741)
Correct, AI is more like a nuclear bomb than a gun.
Re:ChatGPT broke the EU plan to regulate AI by theshrike79 on Sunday March 05, 2023 @04:51PM (#35034401)
I'm thinking of this more in the way of "printers got so good so now they have to add tracking dots when people try to print money or IDs".

We need the same thing for AI generated imagery, video and text.

Re:ChatGPT broke the EU plan to regulate AI by zirgs on Sunday March 05, 2023 @06:18PM (#35035293)
What stops me from removing that data manually?

Some AI tools are open source so nothing prevents me from modifying the code and removing the part that adds those watermarks.

Even closed source programs can be patched to remove that functionality.

Re:ChatGPT broke the EU plan to regulate AI by antibasilisk on Sunday March 05, 2023 @07:07PM (#35035725)
FYI this is something you can even do with printer dots
Re:ChatGPT broke the EU plan to regulate AI by ClumsyPilot on Sunday March 05, 2023 @09:17PM (#35036747)
> nothing prevents me from modifying the code and removing the part that adds those watermarks.

These regulations are aimed at major institutions like banks. Those rely on government-provided privilidges and protectuons to exist. In return we expect they follow some rules.

Nobody cares about AI running in your garage.

Re:ChatGPT broke the EU plan to regulate AI by theshrike79 on Monday March 06, 2023 @10:12AM (#35041920)
Again, nothing like this is aimed to prevent 100% of anything.

The tracking dots stop a huge portion of the low hanging fruit, identity thefts, fake money scams etc. Of course they do nothing to people who know how to hack the printer driver and/or firmware to remove tracking, but they aren't the ones being targeted.

Having trackable data in the biggest AI-generators would again stop a metric fuckton of casually made revenge porn and fake news. It won't stop actual professionals from training their own GPT-3 to do the same thing.

Re:ChatGPT broke the EU plan to regulate AI by concordDance on Sunday March 05, 2023 @04:57PM (#35034480)
Seems more like banning cars than guns. Cars can be used pretty effectively for murder but the vast majority of use cases are not killing things.
Re:ChatGPT broke the EU plan to regulate AI by torstenvl on Sunday March 05, 2023 @05:19PM (#35034730)
There are more firearms than cars in the U.S., but motor vehicles cause far more deaths (with the exception of 2020 when nobody was driving).
Re:ChatGPT broke the EU plan to regulate AI by carlhjerpe on Sunday March 05, 2023 @07:01PM (#35035672)
Unrelated but interesting fact, mortality rate per mile driven went up during covid. The reason motor vehicles kill so many people in the US is because of street design, but usually it's all clogged up with traffic to reduce speeds to a non-lethal level.
Re:ChatGPT broke the EU plan to regulate AI by seanmcdirmid on Monday March 06, 2023 @01:16AM (#35038035)
Just a note: gun control doesn’t do much because American gun manufacturers produce more than 10 million guns a year for the domestic consumer market. A ban would basically say no to that. What we have are laws against gun usage without any real constraints on a massive supply.

It doesn’t make sense to use gun ban and gun control interchangeably.

Re:ChatGPT broke the EU plan to regulate AI by whiddershins on Monday March 06, 2023 @08:51AM (#35040959)
If it is, it is good for precisely the same reasons.
Re:ChatGPT broke the EU plan to regulate AI by matchagaucho on Sunday March 05, 2023 @03:11PM (#35033463)
Generating deepfakes of politicians before elections are just another example of the many applications of AI, but not necessarily the fault of the tool.

[1] California laws prohibiting deepfakes https://www.dwt.com/insights/2019/10/california-deepfakes-la...

Re:ChatGPT broke the EU plan to regulate AI by hackerlight on Sunday March 05, 2023 @03:26PM (#35033606)
> It's not the AI that's the issue, it's the use of it that's the problem. Ban social scoring, not the AI, the tool doesn't matter.

This seems backwards and contrary to lessons learned in the past. Once the thing exists, prohibition is infeasible and expensive. Supply will find a way to reaech demand regardless of your multi-billion dollar efforts to prevent that.

It's better to stop $NEFARIOUS_THING being invented in the first place, if possible, and if any regulations that achieve this don't have too many unintended side effects.

Re:ChatGPT broke the EU plan to regulate AI by zpeti on Sunday March 05, 2023 @03:48PM (#35033778)
If you could see the future that works, but I just don’t see how you know what will be used for nefarious purposes in the future.

In fact most technology does both negative and positive things. It’s not obvious banning it completely will be a net positive. Especially with AI. There’s a lot of potentially great uses. Like detecting cancer on CT scans.

Re:ChatGPT broke the EU plan to regulate AI by hackerlight on Sunday March 05, 2023 @03:57PM (#35033852)
I'm not advocating for or against any particular regulation. Whatever gets implemented should be well thought out, because it's easier to destroy upside potential than it is to prevent downside potential. I am aware of this.

All that I'm speaking out against is the mindset of the post I was replying to, where the onus is solely on the user of the tool rather than on the context (laws, situation, people) that leads to the invention of the tool itself. I believe this to be a misunderstanding/misattribution of causality, as well as contrary to learned experience.

Re:ChatGPT broke the EU plan to regulate AI by paulcole on Sunday March 05, 2023 @03:07PM (#35033428)
European politicians love grandstanding on stuff like this. See the USB-C mandate.
Re:ChatGPT broke the EU plan to regulate AI by Aeolos on Sunday March 05, 2023 @03:11PM (#35033465)
As a consumer, the USB-C mandate is amazing and I wish it had been given as soon as USB-C became available.
Re:ChatGPT broke the EU plan to regulate AI by paulcole on Sunday March 05, 2023 @03:13PM (#35033484)
Neat! I guess you’ll be advocating for whatever the next advancement in USB ports is becoming mandated as soon as it’s available, too?
Re:ChatGPT broke the EU plan to regulate AI by Aeolos on Sunday March 05, 2023 @03:16PM (#35033515)
Anything that reduces e-waste, yes.
Re:ChatGPT broke the EU plan to regulate AI by paulcole on Sunday March 05, 2023 @06:13PM (#35035252)
Really, a brand new plug becomes available today, the EU mandates its usage and you think that reduces e-waste?
Re:ChatGPT broke the EU plan to regulate AI by Kbelicius on Monday March 06, 2023 @04:43AM (#35039176)
Yes. What makes you think that it has no effect on, or even increases, e-waste?
Re:ChatGPT broke the EU plan to regulate AI by satvikpendem on Sunday March 05, 2023 @04:43PM (#35034295)
Sure, why not?
Re:ChatGPT broke the EU plan to regulate AI by carlhjerpe on Sunday March 05, 2023 @07:07PM (#35035717)
We won't need backwards incompatible advancements in this space for awhile, you seem grumpy that the EU is doing good for consumers rather than mega corporations.
Re:ChatGPT broke the EU plan to regulate AI by paulcole on Sunday March 05, 2023 @09:19PM (#35036756)
I find it hard to believe that a good use of the EU’s time is regulating USB-C.
Re:ChatGPT broke the EU plan to regulate AI by ilyt on Sunday March 05, 2023 @07:28PM (#35035927)
Yes! Changing plug standard every 10 years and some cables that work with everything beats alternatives.

Fuck, imagine if every devices you ever owned for last 30 years needed total of 3 different cables to connect, it would be fucking amazing.

Re:ChatGPT broke the EU plan to regulate AI by paulcole on Sunday March 05, 2023 @11:34PM (#35037543)
> Fuck, imagine if every devices you ever owned for last 30 years needed total of 3 different cables to connect, it would be fucking amazing.

It basically does. USB-A, USB-C, Lightning, Micro-USB.

Re:ChatGPT broke the EU plan to regulate AI by dragonwriter on Sunday March 05, 2023 @11:42PM (#35037585)
That...doesn't cover anywhere close to everything back to 1993, which would be 30 years.
Re:ChatGPT broke the EU plan to regulate AI by bonzini on Monday March 06, 2023 @01:37AM (#35038127)
Only back to ~2010 which is exactly when the EU introduced the mandate.
Re:ChatGPT broke the EU plan to regulate AI by ilyt on Monday March 06, 2023 @07:23AM (#35040177)
Lightning was introduced in 2012 lmao. Apple used other proprietary connectors before

Stop bullshitting. 4 wouldn't even cover connectors for apple stuff

Re:ChatGPT broke the EU plan to regulate AI by worrycue on Sunday March 05, 2023 @09:12PM (#35036717)
Personally I’m uncomfortable that a centralised government is “choosing the winner” rather than having the standards duke it out on the open market.

In this case, USB-C is pretty much expected to win and be the dominant standard - even Apple was already moving towards it way before the mandate - but it’s the principle of it.

In what other area will the EU elect itself to “choose the winner” next? The whole thing sets a bad precedence and opens up the possibility of corruption - which the EU isn’t immune to.

Re:ChatGPT broke the EU plan to regulate AI by bigDinosaur on Sunday March 05, 2023 @09:17PM (#35036745)
This kind of regulation is one of the most basic functions of government, without which trade between states and countries becomes much more difficult. Of all the things a government can do, requiring certain standards on things like connector types seems the most reasonable.
Re:ChatGPT broke the EU plan to regulate AI by worrycue on Sunday March 05, 2023 @09:35PM (#35036870)
Does the government really knows what the market wants in a standard?

Some people will benefit from their standard being chosen as the winner. This is just corruption waiting to happen.

It’s fine I guess if the standards are functionally identical or the market has already clearly chosen what it wants by mass adopting said standard - USB-C has not reached that state yet - and the government is just “making it official” - ideally in addition to the standard being unlikely to change for a very very long time.

How would you feel if the US government mandated Windows for all desktops and servers and Android for all mobile devices? It improves interoperability …

Or perhaps mandate all programs be written in C++ … again interoperability.

Re:ChatGPT broke the EU plan to regulate AI by bigDinosaur on Sunday March 05, 2023 @11:18PM (#35037475)
It's true that governments can overreach, and frequently do. What I'm saying those is that when it comes to enforcing standards, the basic ability of a government to do so is fine as it's commonly used for immensely beneficial reasons (as in, industries often want the government to regulate a standard and to sign international agreements regulating certain standards because it often makes it way easier to sell and transfer between regions). The standard should be evaluated on its own merits as opposed to a generic opposition to the government setting standards at all, which I see as deeply flawed.
Re:ChatGPT broke the EU plan to regulate AI by worrycue on Monday March 06, 2023 @07:29AM (#35040206)
What concerns me is the government’s ability to evaluate said merits and their responsiveness to market changes that would require a change in the standard. We have plenty of example where governments got it very wrong - see the USSR.

In this case it’s easy. But the next standard, should the the choice no longer be so clear cut between competing standards with their pros and cons. It would also be interesting to see how the EU determines when we should switch to a successor. Why should a bunch of old people in Brussels who in all likelihood can barely operate a smartphone be the ones deciding these matters?

There is also the issue of corruption - which is still fresh in my mind; see Qatar and the EU parliament. As such I rather nigh dictatorial power not be unnecessarily placed in the hands of governments.

Re:ChatGPT broke the EU plan to regulate AI by shash on Monday March 06, 2023 @12:26AM (#35037787)
Right… so we won’t have any regulation on wall socket design or voltages then, I guess. It’ll be great!
Re:ChatGPT broke the EU plan to regulate AI by izacus on Monday March 06, 2023 @08:44AM (#35040866)
Government also "chose the winner" with power sockets in the walls, mains voltage, width of roads, railway gauge and even the units you're allowed to put the milk carton in.

Those bastards, standardizing interoperability and making sure market is open for new competition!

Re:ChatGPT broke the EU plan to regulate AI by anomaly_ on Sunday March 05, 2023 @11:36PM (#35037555)
See you in five years. Good luck with the government intervention.
Re:ChatGPT broke the EU plan to regulate AI by camdenlock on Sunday March 05, 2023 @03:20PM (#35033545)
> Why the need to bring it under control?

So that EU bureaucrats can feel a sense of purpose in their lives.

Re:ChatGPT broke the EU plan to regulate AI by anigbrowl on Sunday March 05, 2023 @05:53PM (#35035072)
What an absurd argument. Social scoring doesn't get computer by hand on paper because it isn't efficient to do so. Introduce automation and it suddenly becomes practical. Same with mass surveillance and a bunch of other stuff, eg scams: https://news.ycombinator.com/item?id=35033971

the amplification factor works for the good and for the bad, so you need to focus just on the bad

That's just hand-waving. You have no plan for dealing with bad things, but you are worried about the loss of good things. This is not so different from saying you want to cash in on opportunity, the wholly predictable downsides of the opportunity are just someone else's problem. Guess what, nobody wants that problem so it just festers in proportion to the enthusiasm with which people chase the upside.

Re:ChatGPT broke the EU plan to regulate AI by GuB-42 on Monday March 06, 2023 @04:14AM (#35039033)
You absolutely don't need a computer to do social scoring. Computers let you take more parameters into account, and do more complex calculations, but you can do basic social scoring by hand, we have been doing that since civilization existed, in a more or less formal way. Traditionally through ancestry (and by extension, race).

And the way we prevent abuse is with anti-discrimination laws, and AI won't change the deals here. If, for example one notices that a company doesn't hire black people even though there are plenty of them applying with suitable qualifications. Regulators could step in and ask what's wrong, and I doubt "that's my AI" will be a satisfactory answer, but neither is "that's Bob".

Re:ChatGPT broke the EU plan to regulate AI by anigbrowl on Monday March 06, 2023 @01:35PM (#35045472)
And the way we prevent abuse is with anti-discrimination laws

Have you not noticed how heavily those are contested in many jurisdictions. If you discover some way to draft legislation on morality such that it's effective, consistent, and widely accepted in a disparate population, I look forward to hearing about it. I can't wait to read about the solution to spam, scams, and discrimination deployed at industrial scale. In the meantime, it's wise to take the amplifying aspect of technology into account and consider its potential for abuse as well as for good.

Re:ChatGPT broke the EU plan to regulate AI by antibasilisk on Sunday March 05, 2023 @07:06PM (#35035713)
>It's not the AI that's the issue, it's the use of it that's the problem

No. It's the AI. Humans are not psychologically capable of interfacing with something whose goal is to appear convincingly human, that can be hugely scaled and that is very unpredictable.

We are currently dealing with a huge number of people who are distraught and grieving because a company changed their product because they developed relationships with a sexy chatbot. This isn't going to stop, and it is not worth the potential benefits, because we have clear examples of harm already.

Re:ChatGPT broke the EU plan to regulate AI by tommyage on Sunday March 05, 2023 @08:30PM (#35036434)
People posting such articles (from sites highly neglectable) without their informed take is ruining this community as well.

We shouldn't raise any questions but leave participations to themselves.

Re:ChatGPT broke the EU plan to regulate AI by nektro on Sunday March 05, 2023 @11:40PM (#35037579)
> It's not the AI that's the issue, it's the use of it that's the problem.

this is exactly what people against gun control say

Re:ChatGPT broke the EU plan to regulate AI by TremendousJudge on Monday March 06, 2023 @12:00AM (#35037660)
The difference is that a gun is a tool with a single use-case.
Re:ChatGPT broke the EU plan to regulate AI by randyrand on Monday March 06, 2023 @12:54AM (#35037918)
there are a lot of use cases for shooting something.

war, policing, defense, hunting, animal control, shooting down flying objects, remotely activating something from afar, immobilizing a car.

Re:ChatGPT broke the EU plan to regulate AI by chongli on Monday March 06, 2023 @02:39AM (#35038442)
Sure, but firearms tend to be specialized for each of these purposes. You’re not going to go moose hunting with a .22 pistol. Just as you’re not going to keep a .30-06 hunting rifle under your pillow for self defence.

In particular, most societies deem automatic rifles to have no legitimate peace-time use, and so outlaw them, while still allowing shotguns and hunting rifles with a license.

Re:ChatGPT broke the EU plan to regulate AI by usrbinbash on Monday March 06, 2023 @03:24AM (#35038716)
a) The use of guns cannot be regulated effectively without physically removing guns from a society.

b) One of the first and foremost items on gun-regulation todo-lists is to get rid of the kind of guns with the specific use-case of making killing people as easy as possible, aka. miltary weapons, automated weapons, easily concealed weapons, etc. So the regulations against guns are already targeting use-cases.

c) Physically controlling guns is a proven method, its effectiveness is supported by decades of evidence in countries implementing it.

Re:ChatGPT broke the EU plan to regulate AI by Veen on Monday March 06, 2023 @06:32AM (#35039817)
> The use of guns cannot be regulated effectively without physically removing guns from a society.

Isn't that like saying theft cannot be regulated effectively without removing the things people want to steal from society? The goal is not perfect gun control, but reducing access to guns and thereby reducing the crime and harm that stems from gun ownership. So it being illegal to own X doesn't mean no one will own and use X, but that fewer people will and law enforcement will be able act against those who do.

Re:ChatGPT broke the EU plan to regulate AI by nivenkos on Monday March 06, 2023 @01:55AM (#35038208)
But credit scores and fraud risk analysis are "social scoring".

And what's wrong with social scoring in general?

Re:ChatGPT broke the EU plan to regulate AI by batmansmk on Monday March 06, 2023 @03:40AM (#35038809)
> Ban social scoring, not the AI, the tool doesn’t matter. Ban shooting people, not the guns, the tool doesn’t matter. :) sorry to be facetious but I find you idealist in your view.

Modern form of AI has regulatory issues: some can’t be audited easily, some can’t be deterministic, some can’t be fair, some use biased data, some can’t be proven to work accurately enough for critical missions.

We already regulate the way we make various decision by law. For instance, we regulate how public market are assigned: price needs to make for 30% of the decision, social impact 20% etc. If the tool cannot demonstrate it considers it with those weights, it shall be banned. You cannot expect judges to understand this complexity. It needs to be codified prior to the issue.

Re:ChatGPT broke the EU plan to regulate AI by varispeed on Monday March 06, 2023 @08:10AM (#35040517)
The ban is also meaningless. E.g. government ban Ponzi schemes, while themselves running pension schemes very much having most of the attributes of a Ponzi scheme.

Which means if government bans apps designed for social scoring, it's probably just so that government has monopoly over scoring people behaviour.

Re:ChatGPT broke the EU plan to regulate AI by nebalee on Monday March 06, 2023 @11:12AM (#35042743)
The proposal bans the use of AI-based social scoring by the governments (public authorities) or on their behalf.