News for hackers. Stuff that matters.
Re:A YouTube chat about chess got flagged for hate speech by hirundo on Wednesday July 21, 2021 @10:49PM (#27914737)
We need a word or phrase for this phenomenon, where we attempt to substitute human pattern recognition with algorithms that just aren't up to the job. Facebook moderation, Tesla Full Self Driving, the War Games movie, arrests for mistaken facial identification. It's becoming an increasingly dystopic force in our lives and will likely get much worse before getting even worse. So it needs a label. Maybe there's a ten syllable German word that expresses it perfectly?
Re:A YouTube chat about chess got flagged for hate speech by mellosouls on Wednesday July 21, 2021 @11:58PM (#27915185)
Not quite the same situation, but

"Malgorithms"

is used by Private Eye (British satirical/political magazine) to highlight adverts auto-generated inappropriately to accompany articles on news etc websites.

Example:

https://twitter.com/joshspero/status/562625460732174336

Re:A YouTube chat about chess got flagged for hate speech by hutzlibu on Thursday July 22, 2021 @02:39AM (#27916122)
Of all the suggestions, I like the "Malgorithms" the most. It is catchy, easy to read and probably understandable by normal people as well.
Re:A YouTube chat about chess got flagged for hate speech by BoxOfRain on Thursday July 22, 2021 @07:11AM (#27917545)
Yeah, it's definitely the most sellable one I've seen.

I don't like the implication that it's the algorithm that's malicious rather than the person who wrote the algorithm (no algorithm is inherently malevolent or benevolent in my opinion, it's just an algorithm), but I also know this distinction is completely pointless for the vast majority of people and "malgorithm" gets the gist of what people are getting at across very well.

Re:A YouTube chat about chess got flagged for hate speech by saalweachter on Thursday July 22, 2021 @08:11AM (#27917934)
While "malevolent"/"malicious" definitely has a "wicked" connotation, you also see it in words like "maladapted" or "malodorous" which are just "bad" without the "wickedness".
Re:A YouTube chat about chess got flagged for hate speech by BoxOfRain on Thursday July 22, 2021 @07:33PM (#27925590)
That's still dumping a "bad" on the poor old algorithm though, which has done nothing wrong simply by existing and doing what it is programmed to do. Algorithms aren't bad, it's the programmers who write them and the managers who decide they should be written who are bad when things like this happen.
Re:A YouTube chat about chess got flagged for hate speech by sellyme on Thursday July 22, 2021 @11:25PM (#27926852)
I don't see how you could believe this point, unless you think things like "There's no bad music, only bad musicians" as well.

Perhaps an elucidating counterpoint is an algorithm written in such a manner that it is deliberately worthless, as a joke (e.g., StackSort, Bogosort). Obviously they're not the result of a bad programmer, they're just an inherently bad algorithm.

Re:A YouTube chat about chess got flagged for hate speech by BoxOfRain on Friday July 23, 2021 @05:53AM (#27928953)
>unless you think things like "There's no bad music, only bad musicians" as well.

I actually do though, and I say that as a musician myself. These things are inherently subjective, writing good music isn't just a matter of how closely the musician adheres to a pre-determined set of rules. The qualities of goodness and badness exist in the minds of the creators and the audience rather than being attached to the music itself in some sense. Any attempt to classify "good" versus "bad" music in the sense people usually understand it is just an appeal to authority fallacy, the only thing that makes music good is "do I personally enjoy listening to it or not?". You can try to classify music based on how closely it fits a genre's set of rules but this quickly breaks down into absurdity in practice (for example, acts like the Grateful Dead which span many genres).

Re:A YouTube chat about chess got flagged for hate speech by saalweachter on Friday July 23, 2021 @11:35AM (#27931866)
Are there bad smells?
Re:A YouTube chat about chess got flagged for hate speech by BoxOfRain on Friday July 23, 2021 @01:14PM (#27933143)
Not really, the fox crap that smells awful to me smells wonderful to a golden retriever. The "badness" of the smell is entirely down to the nose that's smelling it, the subjective experience of smelling comes from the mind rather than the particular chemical compounds which we understand as a smell.

That subjective information which describes the badness of a smell doesn't exist within the smell itself, it exists within the mind.

Re:A YouTube chat about chess got flagged for hate speech by Narann on Friday July 23, 2021 @07:00AM (#27929343)
Interestingly, "mal" in french means "bad". In latin, "malum" means "that leads to something wrong".

So "Malgorithms" it an accurate one.

Re:A YouTube chat about chess got flagged for hate speech by swiley on Thursday July 22, 2021 @03:49AM (#27916495)
That's just it though. Part of the definition of "algorithm" is "correct" and these things are all just ML output that generate correlated noise.
Re:A YouTube chat about chess got flagged for hate speech by waterhouse on Thursday July 22, 2021 @04:45AM (#27916787)
Hmm? I don't think an algorithm has to give "correct" answers, it just has to be precisely defined. For example, one could say "For this problem, a greedy algorithm yields decent but suboptimal answers."

Merriam-Webster online says: "a procedure for solving a mathematical problem (as of finding the greatest common divisor) in a finite number of steps that frequently involves repetition of an operation" and "broadly : a step-by-step procedure for solving a problem or accomplishing some end".

Re:A YouTube chat about chess got flagged for hate speech by formerly_proven on Thursday July 22, 2021 @05:36AM (#27917038)
Algorithms solve problems. Wrong answers are not solutions to (i.e. do not solve) a given problem. Hence, algorithm implies that it provides correct answers within the parameters of the problem.
Re:A YouTube chat about chess got flagged for hate speech by TeMPOraL on Thursday July 22, 2021 @01:55PM (#27922104)
> Hence, algorithm implies that it provides correct answers within the parameters of the problem.

And so they always do. The problem that an algorithm solves is defined by the algorithm itself. The purpose of a system is what it does[0].

Algorithms are useful to solve problems for us - the trick is always in making sure that the problem the algorithm solves is the one we want.

--

[0] - https://en.wikipedia.org/wiki/The_purpose_of_a_system_is_wha...

Re:A YouTube chat about chess got flagged for hate speech by formerly_proven on Thursday July 22, 2021 @04:01PM (#27923580)
That's a bingo.
Re:A YouTube chat about chess got flagged for hate speech by theteapot on Thursday July 22, 2021 @08:18AM (#27917982)
Disagree. We see this phenomena all the time: Right solution, bad input data. Right solution, wrong problem. Worlds turned to grey goo by replicators working to some technically correct algorithm.
Re:A YouTube chat about chess got flagged for hate speech by swiley on Thursday July 22, 2021 @04:06PM (#27923640)
These will never give the right solution, only something close.
Re:A YouTube chat about chess got flagged for hate speech by baobabKoodaa on Thursday July 22, 2021 @07:31AM (#27917675)
The definition of algorithm is wider than you think. As your parent poster noted, "greedy algorithms" exist (as do many other algorithms which provide suboptimal answers). You can easily verify this by googling.
Re:A YouTube chat about chess got flagged for hate speech by joelbondurant on Thursday July 22, 2021 @02:36AM (#27916098)
I love malgorithms having been exposed to the malicious grift of the healthcare industry.
Re:A YouTube chat about chess got flagged for hate speech by qmmmur on Thursday July 22, 2021 @04:55AM (#27916826)
If you coined this it's great!
Re:A YouTube chat about chess got flagged for hate speech by crvdgc on Wednesday July 21, 2021 @11:04PM (#27914853)
Scunthorpe problem [1] is used to describe the false positives for auto filters, which are often results of naive substring matching. In a way, the current problem is similar, but on the semantic level.

However, it doesn't cover other cases for other AI mistakes you mentioned, like self-driving.

[1]: https://en.wikipedia.org/wiki/Scunthorpe_problem

Re:A YouTube chat about chess got flagged for hate speech by runarberg on Wednesday July 21, 2021 @11:40PM (#27915077)
The problem also goes in the other direction. That is platform rely too much on automation that human signal gets too faint. For example humans have a hard time flagging actual hate speech on these platforms as well. Another example: Every so often there is a front page post on HN where a company like Google will automatically shut down service for a customer (false positive). The customer has a hard time getting through and having this false positive corrected because their signal can’t reach through the layers of automation.
Re:A YouTube chat about chess got flagged for hate speech by computerlab on Wednesday July 21, 2021 @11:07PM (#27914882)
The concept of "so-so automation" [1] seems relevant: innovation that allows a business or organization to eliminate human employees, but doesn't result in overall productivity gains or cost savings for society that could then be redistributed to the laid-off employees.

I think so-so automation often is used places where there's a lot of zero-sum conflict between workers and management, or where the work itself causes a lot of negative human externalities. (This can be a good thing: it's probably okay to settle for a "worse result" from an automated system if it eliminates a lot of physical or psychological harm to people...some content moderation issues probably fall under this case, but not this one.)

[1] https://mitsloan.mit.edu/ideas-made-to-matter/lure-so-so-tec...

Re:A YouTube chat about chess got flagged for hate speech by Spooky23 on Wednesday July 21, 2021 @11:49PM (#27915132)
I’d call it “plausible automation”.

It enabled things like Facebook to displace message boards for the most part. Look at Facebook or Reddit, they are barely able to police obvious noxious behavior in English, and military juntas in Myanmar are able to organize on the platforms.

Re:A YouTube chat about chess got flagged for hate speech by cmehdy on Wednesday July 21, 2021 @11:24PM (#27914990)
As a non-native English speaker I read "so-so automation" like "sus-automation" and found it oddly appropriate.
Re:A YouTube chat about chess got flagged for hate speech by dan_mctree on Thursday July 22, 2021 @02:52AM (#27916201)
I figured it would be appropriate to ask an AI to come up with a label. So I prompted GPT-J with:

AI has proven to be terrible at moderating human content, we felt we needed a word for these kinds of buggy systems and have chosen: "

And GPT-J answered:

"LOLPOP"

Which seems to capture the spirit of unreliable AIs pretty well

Re:A YouTube chat about chess got flagged for hate speech by ctrlp on Thursday July 22, 2021 @06:59AM (#27917476)
"Totalitalgorithms" (Totalgorithms?) captures the spirit of these algorithms. They seem like bugs but they're actually undirected, organic features of a total technocratic political system that is rapidly coming to dominate life in our modern societies. The filters will be tuned but not fixed because they aren't broken. They're part of what Tocqueville described as 'soft despotism':

"Thus, After having thus successively taken each member of the community in its powerful grasp and fashioned him at will, the supreme power then extends its arm over the whole community. It covers the surface of society with a network of small complicated rules, minute and uniform, through which the most original minds and the most energetic characters cannot penetrate, to rise above the crowd. The will of man is not shattered, but softened, bent, and guided; men are seldom forced by it to act, but they are constantly restrained from acting. Such a power does not destroy, but it prevents existence; it does not tyrannize, but it compresses, enervates, extinguishes, and stupefies a people, till each nation is reduced to nothing better than a flock of timid and industrious animals, of which the government is the shepherd."

https://en.wikipedia.org/wiki/Soft_despotism

Re:A YouTube chat about chess got flagged for hate speech by washadjeffmad on Thursday July 22, 2021 @08:33AM (#27918096)
Algorithmic totalitarianism resonates strongly.

It's not a human rights violation if it isn't a human doing it!

Re:A YouTube chat about chess got flagged for hate speech by dylan604 on Thursday July 22, 2021 @01:00PM (#27921403)
The human's rights were still violated even if it was a machine that did it.
Re:A YouTube chat about chess got flagged for hate speech by howaboutnope on Thursday July 22, 2021 @12:40AM (#27915423)
> It's becoming an increasingly dystopic force in our lives and will likely get much worse before getting even worse. So it needs a label.

It's not just something that happens to us, it's something we do. We need to do better rather than accepting it as inevitable, and let future generations worry about what the best name for it was.

> Maybe there's a ten syllable German word that expresses it perfectly?

That being said, I propose Urteilsfähigkeitsauslagerungsnekrose: The necrosis that follows the outsourcing of our capability of judgement.

Re:A YouTube chat about chess got flagged for hate speech by laurent92 on Thursday July 22, 2021 @01:39AM (#27915762)
11 syllables, almost as requested ;)

May I suggest “yacht-feet automation”? It focuses on increasing the yacht feet of Zuckerberg, and doesn’t do anything else right?

Re:A YouTube chat about chess got flagged for hate speech by burning_hamster on Thursday July 22, 2021 @05:35AM (#27917036)
Jachtverlängerungsautomatisierung ;-)

Also 11 sylabels.

Re:A YouTube chat about chess got flagged for hate speech by hef19898 on Thursday July 22, 2021 @07:59AM (#27917856)
Man, German can be such a nice, beautiful language for stuff like that!
Re:A YouTube chat about chess got flagged for hate speech by remram on Thursday July 22, 2021 @08:34AM (#27918104)
"It's not a feature, it's just another yacht foot". I like it.
Re:A YouTube chat about chess got flagged for hate speech by Symbiote on Thursday July 22, 2021 @08:28AM (#27918053)
> Urteilsfähigkeitsauslagerungsnekrose

Post-reason-delegation necrosis?

But English is always a bit awkward for this sort of thing.

Re:A YouTube chat about chess got flagged for hate speech by cowl on Thursday July 22, 2021 @05:57AM (#27917138)
It's easy to blame this on imperfect technology but I'm not so sure. Couple of months back when all tech companies started their holier than though publicity campaigns with token actions we faced the same issue.

"Blacklist" was banned as term because it was deemed racist. No matter that people understand black and white outside the race issue. So if blacklist is deemed by people , not technology, as racist; thus removing context from the equation, why is AI wrong to assume that "attack the black soldier in C4" is hate speech?

Re:A YouTube chat about chess got flagged for hate speech by TheOtherHobbes on Thursday July 22, 2021 @09:27AM (#27918565)
It's why feature extraction/stat bucket AI sucks.

Human interactions have a social/cultural context. You can't just recognise $thing, you have to recognise how $thing depends on $context for the correct interpretation.

Current AI either ignores context completely or doesn't parse it correctly.

It's a rediscovery of the ancient "Time flies like an arrow, fruit flies like a banana" problem.

If you're out on a date and you say "Let's go back to mine" it implies one thing. If you say it to some friends after an evening out it usually means something completely different.

Sometimes it means the same thing - but you need to know a lot about the people involved to be able to infer that accurately.

And sometimes humans can't parse these nuances accurately either.

AI-by-grep or stat bucket can't handle them at all, because the inferences are contextual and specific to situations and/or individuals. They can't be extracted from just the words themselves.

Minsky & co researched some of this in the 70s, and eventually it motivated the semantic web people. But it was too hard a problem for the technology of the time. Now it seems somewhat forgotten.

Re:A YouTube chat about chess got flagged for hate speech by mlang23 on Thursday July 22, 2021 @04:12AM (#27916606)
I use the phrase "K ohne I" since years already. Which basically means "künstlich ohne Intelligenz". We all saw this coming. The topic has been gone over in scifi literature. And still, big tech decided its time to roll it out. "A human would also not be perfect, and we claim this algo is better then the avg. human" is the last thing you hear before discriminating tech is rolled out. And since politics is in the grip of commerce, regulations will not happen early enough. We are fucked. 2040 will be horrible.
Re:A YouTube chat about chess got flagged for hate speech by Barrin92 on Wednesday July 21, 2021 @11:19PM (#27914948)
I don't have a word for the phenomenon, but the problem reminds me of a quote by Wilfrid Sellars.

"The aim of philosophy, abstractly formulated, is to understand how things in the broadest possible sense of the term hang together in the broadest possible sense of the term"

call it maybe philosophy-lacking, or worldview-lacking, but understanding how things 'hang together' in broad terms is precisely what our 'intelligent' systems cannot do. Agents in the world have an integrated point of view, they're not assemblages of models, and there seems to be very little interest than to build anything but the latter.

Re:A YouTube chat about chess got flagged for hate speech by jcims on Wednesday July 21, 2021 @11:09PM (#27914896)
It's basically perception and reaction without cognition.

In the natural world we would call that instinct. So maybe 'artificial instinct' if we want to keep 'AI' or 'synthetic instinct' because I think it sounds better.

Re:A YouTube chat about chess got flagged for hate speech by sennight on Wednesday July 21, 2021 @11:52PM (#27915150)
It is basically about using the wrong tool for the job, and continuing to do so even after you (and everyone else) is fully aware of just how wrong you are. Personifying the tool would just distract from the root cause.

"I was using a ballpeen hammer to pound in roofing nails, everything was going great until the hammer's 'synthetic instinct' resulted in a painful blow to my groin and a near fatal three story drop. It'll go better next time - I've painted the ballpeen hammer a different color."

Re:A YouTube chat about chess got flagged for hate speech by mleonhard on Thursday July 22, 2021 @02:33AM (#27916078)
If a human made the same mistake, we would call them incompetent, careless, and negligent.

- incompetent system

- incompetent robot

- incompesys

- incompebot

- inept system

- inept robot

- inepsys

- ineptobot

- inepobot

- bunglebot

- hambot

- sloppybot

- careless system

- careless robot

- carelessys

- carelessbot

- neglisys

- negligent robot

- neglibot

I like 'neglibot'. "YouTube neglibotted my video." "This is my new email address. My old one got neglibotted." "The app works for typing in data, but the camera feature is neglibotty." "They spent a lot of effort and turned their neglibot automod into carefulbot. In another year it may be meticubot.

Re:A YouTube chat about chess got flagged for hate speech by drran on Thursday July 22, 2021 @03:30AM (#27916398)
Slightly related new word: "copiloting" - copying by AI (copy + looting), e.g. GitHub copiloted opensource code.
Re:A YouTube chat about chess got flagged for hate speech by soco on Thursday July 22, 2021 @04:13AM (#27916621)
Then why not copylooting...
Re:A YouTube chat about chess got flagged for hate speech by nxpnsv on Thursday July 22, 2021 @02:59AM (#27916229)
Neglibot is nice. Dumbot works too...
Re:A YouTube chat about chess got flagged for hate speech by drran on Thursday July 22, 2021 @03:33AM (#27916419)
IMHO, it's a case when a bug in an Artificial Intelligence system produces the Artificial Idiot, so "AIdiot", or "AdIot"
Re:A YouTube chat about chess got flagged for hate speech by nxpnsv on Thursday July 22, 2021 @05:25AM (#27916969)
Perhaps Artificial Stupid System, you do the acronym yourself...
Re:A YouTube chat about chess got flagged for hate speech by llimos on Thursday July 22, 2021 @12:04PM (#27920542)
I love Dumbot. Has a beautiful ring to it. Can definitely see it catching on
Re:A YouTube chat about chess got flagged for hate speech by dylan604 on Thursday July 22, 2021 @01:04PM (#27921458)
Dumbot works with the Carlin rule of improving the word by putting fucking in the middle: dumfuckingbot
Re:A YouTube chat about chess got flagged for hate speech by himinlomax on Thursday July 22, 2021 @07:04AM (#27917498)
Artificial Idiocy
Re:A YouTube chat about chess got flagged for hate speech by drivers99 on Thursday July 22, 2021 @08:52AM (#27918256)
Artificial Incompetence

sounds like “artificial intelligence” but really captures the fact that it’s just bad to a harmful extent at what it’s supposedly trying to do.

Re:A YouTube chat about chess got flagged for hate speech by JohnWhigham on Thursday July 22, 2021 @08:52AM (#27918251)
I like this. It's one tweet/article headline away from going completely viral.
Re:A YouTube chat about chess got flagged for hate speech by nirui on Wednesday July 21, 2021 @11:26PM (#27914997)
Industrial revolutions has happened few times in the past, and every time it occurs, we change our world to adopt it.

I can't help but wonder, what the world would look like if services in the future will be provided primarily by AIs. How do we adopt them? Do we have to invent a "New Speech" just to make AI understand us better so we can live a easier life?

"Question: Have you consumed your food today?", "Answer: I have consumed my food today."

Or a more subtle example:

"Hi! Welcome to ___. What do you want to eat today?", "I want to eat item one, fifty-six, eighty-seven and ninety-one", "Do you want to eat item one, fifty-six, eighty-seven and ninety-one?", "Yes", "Please make a seat. The food will come right away!" (all without making any Hmm or Err noise)

Re:A YouTube chat about chess got flagged for hate speech by chii on Wednesday July 21, 2021 @11:33PM (#27915034)
> "Hi! Welcome to ___. What do you want to eat today?", "I want to eat item one, fifty-six, eighty-seven and ninety-one", "Do you want to eat item one, fifty-six, eighty-seven and ninety-one?", "Yes", "Please make a seat. The food will come right away!" (all without making any Hmm or Err noise)

this already happens today, with human servers. The menu items are numbered, and you tell them the number instead of the name of the dish.

Re:A YouTube chat about chess got flagged for hate speech by bob1029 on Thursday July 22, 2021 @08:52AM (#27918254)
And then in some places they hand you another number - a pooled session identifier - to take to your table. Then you are expected to respond to events broadcast regarding this number if the food fails to reach the destination automatically.
Re:A YouTube chat about chess got flagged for hate speech by ajmurmann on Thursday July 22, 2021 @02:01AM (#27915881)
Blockchain Chicken Farm gives an interesting angle on this. Part of the book describes a AI controlled pig farm. For the outcome to be good, as many variables as possible have to be removed from the pigs' life. For example total isolation from the outside world. Otherwise there is too much for the AI to account for and the training set also needs to increase. What does that mean for our lifes as AI gets control over more aspects? What variables can be removed?
Re:A YouTube chat about chess got flagged for hate speech by jcims on Wednesday July 21, 2021 @11:39PM (#27915072)
We're going to resurrect the transatlantic accent.

I already have started add a hard 'ng' on 'going to' because my phone keeps abbreviating it to 'gonna'.

Re:A YouTube chat about chess got flagged for hate speech by darkwater on Thursday July 22, 2021 @02:51AM (#27916195)
That would actually be cool also for non-native English speakers :)
Re:A YouTube chat about chess got flagged for hate speech by guerrilla on Thursday July 22, 2021 @12:29AM (#27915357)
Yeah that's probably not goinv to work for India and the rest of the anglosphere.
Re:A YouTube chat about chess got flagged for hate speech by Karsteski on Thursday July 22, 2021 @06:07AM (#27917198)
Yea, I'm Trinidadian, and even though my accent has changed significantly from living in Canada for 7 years, people and especially voice recognition get confused by some of my speech patterns.

Example is that people always hear 50 when I say 30, because of how I pounce the "y". Anything ending in "th" or "ing" gets confused a lot by people who don't know me.

It's kinda funny to keep track of :)

Re:A YouTube chat about chess got flagged for hate speech by iamtedd on Thursday July 22, 2021 @03:13AM (#27916302)
> goinv to

Did you succumb to the exact same problem GP comment described?

Re:A YouTube chat about chess got flagged for hate speech by eloisius on Wednesday July 21, 2021 @11:54PM (#27915160)
A new vernacular to interface with tools that never reveal the actual state of a system under their control, and forbid you to directly influence it. You are granted the privilege to express your limited desires, from which the system will "learn" your preferences.

If you want a vision of the future, imagine a man repeating "Hey Thermostat! Can you cool it down in here a little?" over and over–forever.

Re:A YouTube chat about chess got flagged for hate speech by Izkata on Thursday July 22, 2021 @04:43AM (#27916773)
> Do we have to invent a "New Speech" just to make AI understand us better so we can live a easier life?

It's already happened. Have you ever seen an a grandparent unfamiliar with new tech talk to Alexa? There's a ton of them on Youtube.

Re:A YouTube chat about chess got flagged for hate speech by runarberg on Wednesday July 21, 2021 @11:50PM (#27915139)
In a government system a similar problem is called Bureaucracy. It is similar in the sense that the system is very complex, beyond any single persons comprehension, bureaucratic system is unforgiving in its conclusion, and it is the responsibility of the victim to deal with a false positive using the same (or similarly complex) system to attempt correction.

However this is different from bureaucracy in the level of automation and statistical inference. A bureaucratic system doesn’t do inference (or at least that is not its main function), and the steps between require human inputs (albeit really automated humans most of the time).

I suggest automatacracy which strings together automation and bureaucracy.

Re:A YouTube chat about chess got flagged for hate speech by nicbou on Thursday July 22, 2021 @03:50AM (#27916502)
Why not algocracy or robocracy?
Re:A YouTube chat about chess got flagged for hate speech by dgb23 on Thursday July 22, 2021 @02:03AM (#27915896)
Computer says No!
Re:A YouTube chat about chess got flagged for hate speech by Hackbraten on Thursday July 22, 2021 @02:34AM (#27916085)
Verschlimmbesserautomatisierung.

Composite noun of verschlimmbessern [1] and Automatisierung (automation).

[1] https://en.wiktionary.org/wiki/verschlimmbessern#German

Re:A YouTube chat about chess got flagged for hate speech by kofko on Thursday July 22, 2021 @04:11AM (#27916600)
How about calling it a "Buttle" after the movie Brazil from 1985 where a certain Mr. "Buttle" gets arrested and killed instead of a Mr. "Tuttle" due to a fly in a teleprinter.
Re:A YouTube chat about chess got flagged for hate speech by b0rsuk on Thursday July 22, 2021 @05:01AM (#27916855)
Nowhere near as popular as the skit with the vikings.
Re:A YouTube chat about chess got flagged for hate speech by acituan on Wednesday July 21, 2021 @11:00PM (#27914821)
Artificial Intelligibility.

We are often reduced to mere conformity to what the artificial intelligence can make sense of.

Captcha: "Are you human?"

Human: <Goes on to do a simple perceptual task even a cat could do if they had fingers>

Re:A YouTube chat about chess got flagged for hate speech by Lutzb on Thursday July 22, 2021 @12:48AM (#27915472)
Superficial Intelligence.
Re:A YouTube chat about chess got flagged for hate speech by mirkules on Thursday July 22, 2021 @02:17AM (#27915979)
It's funny that you should mention War Games, because the only way to win this battle is not to play at all. Why are we so hell-bent on restricting speech and burning all these engineering hours trying to moderate something that cannot be moderated? Languages -- and people -- are "transformable" enough to avoid triggering "hate speech" (whatever that actually is, and whoever it is that determines it) algorithms. Let people downvote or shut their computer off if they don't like it, and leave it at that. Are we that scared of words or ideas?

I used to live in a communist country (probably the same one that Mr. Radic lives/lived in), where "hate speech" -- which was called anti-state, or anti-establishment speech back then -- was punishable by a middle-of-the-night visit by dark-clad police. Yet, people still found ways to openly criticize the Party, and there were even popular songs that openly defied them, which only demonstrates that not even human pattern recognition is good enough to detect these things, as you state in your first sentence.

It's a waste of time, but more importantly it is detrimental to society.

Re:A YouTube chat about chess got flagged for hate speech by robrenaud on Thursday July 22, 2021 @09:38AM (#27918687)
I am scared of the masses believing nonsense. What fraction of Americans believe the election was stolen? How many people are still going to refuse to be vaccinated? Indeed, bad ideas are scary. I am scared that my country people will lead another insurrection or allow themselves to be a needlessly vulnerable vector for highly transmissible and dangerous virus.

Misinformation spreads like wildfire.

The notion that good speech counters bad speech relies on rational, well informed, critical thinking skills that are lacking in a significant portion of the populace.

It is fundamentally different that a company wants to exercise its right to free speech in choosing what is said on its platform than for a government to use free speech as a fig leaf cover for dissent.

Putting up no fight against misinformation and hate speech is not a winning strategy. Society loses much more from nonsense spreading than it does from having to wait 24 hours for high quality chess content to get remoderated.

Re:A YouTube chat about chess got flagged for hate speech by mirkules on Thursday July 22, 2021 @10:48AM (#27919543)
It’s not just about a game of chess being moderated.

It’s about silencing legitimate speech that you disagree with, whether it’s on a factual level or other motivations.

Perfect example, coronavirus being manufactured in a lab rather than originating in the wild. Anyone that suggested it was from a lab has been moderated heavily until a report came out that in fact it did.

Was this not damaging to society?

And to your point of hate speech, can you give me a definition of the term? You can’t because there isn’t one that a) covers all scenarios and, more importantly, b) doesn’t cover legitimate speech.

It is up to me to think for myself, not up to someone else to do it for me.

Re:A YouTube chat about chess got flagged for hate speech by Gibbon1 on Thursday July 22, 2021 @02:39AM (#27916121)
> Why are we so hell-bent on restricting speech and burning all these engineering hours trying to moderate something that cannot be moderated?

Because if you allow humans to moderate then those humans start acquiring power. Which is something FAANG companies strive to prevent at all costs.

Re:A YouTube chat about chess got flagged for hate speech by mirkules on Thursday July 22, 2021 @03:08AM (#27916279)
So instead put power in the hands of giant companies because regular people can’t be bothered to not get hot-and-bothered by reading something they don’t like? What makes these companies so morally pure?

The only way this can make sense - especially on HN - is if the people who advocate for company control of regular peoples’ lives work at these companies.

Re:A YouTube chat about chess got flagged for hate speech by human on Wednesday July 21, 2021 @11:39PM (#27915066)
We definitely need a term for this so when we are a victim of this, we can easily raise a flag. I have a few ideas: - Bot blunder - Artificial stupidity - Algofail - Machine madness - Neural slip
Re:A YouTube chat about chess got flagged for hate speech by canadaduane on Wednesday July 21, 2021 @11:50PM (#27915137)
Artificial Stupidity stands out to me. Nice one!
Re:A YouTube chat about chess got flagged for hate speech by stiGGG on Wednesday July 21, 2021 @10:58PM (#27914810)
Roboterflegelhaftigkeiten
Re:A YouTube chat about chess got flagged for hate speech by dylan604 on Wednesday July 21, 2021 @11:47PM (#27915118)
My first thought was we should have the Germans create this new word.
Re:A YouTube chat about chess got flagged for hate speech by thinkingemote on Thursday July 22, 2021 @04:45AM (#27916788)
How about "inhuman-ops" ?

I think this has the unnatural, unjust and just basic wrongness about using AI to be like humans.

"human-ops" is the justification to remove human pattern recognition because it's better for a small group of employees (e.g. "we cant let our expensive staff view flags of distressing pictures or boring chess videos, so we will get an algorithm instead". The tech companies HR say that this is pro mental health as an additional way to justify this change and any unemployment.

Re:A YouTube chat about chess got flagged for hate speech by mleonhard on Thursday July 22, 2021 @03:17AM (#27916330)
'starbot', from 'star chamber' [0].

"In modern times, legal or administrative bodies with strict, arbitrary rulings, no "due process" rights to those accused, and secretive proceedings are sometimes called "star chambers" as a metaphor."

Example uses:

"I got starbotted."

"Instagram's automod is a starbot."

"YouTube is too starbotty for your lectures. Better post with your school account."

"We're suing them because their starbot took down our site right after our superbowl ad ran."

"Play Store starbotted release 14 so we cut a dupe release 15. How much will it cost to push the ad campaign back 2 weeks?"

"We use Gmail and Google Docs but not Google Cloud because of the starbots."

"I tried to put Google ads on it, but their starbot rejected the site because it doesn't have enough pages. It's a single-page JavaScript utility." (This is my true story about https://www.cloudping.info )

"Our site gets a lot of traffic but we don't use Google ads because of the starbot risk. Nobody needs that trouble."

"The STAHP Bill (Starbot Tempering by Adding Humans to Process) just passed the Senate! Big Tech is finally getting de-Kafka'ed. About f**ing time."

[0] https://en.wikipedia.org/wiki/Star_Chamber

Re:A YouTube chat about chess got flagged for hate speech by Gibbon1 on Wednesday July 21, 2021 @11:40PM (#27915078)
In economics there is Goodhart's law.

'Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes.'

https://en.wikipedia.org/wiki/Goodhart%27s_law

Re:A YouTube chat about chess got flagged for hate speech by voidhorse on Thursday July 22, 2021 @07:52AM (#27917806)
The suggested “malgorithms” is probably the best noun form for these algorithms themselves.

As for terminology that captures society’s general over reliance on automation and algorithms to handle things that really ought to have direct human intervention, I like Rouvroy’s “algorithmic governmentality”

Re:A YouTube chat about chess got flagged for hate speech by undersuit on Wednesday July 21, 2021 @11:45PM (#27915111)
Have you heard of the "expert beginner"? Maybe something like that.

https://daedtech.com/how-developers-stop-learning-rise-of-th...

Re:A YouTube chat about chess got flagged for hate speech by dominicl on Friday July 23, 2021 @03:28AM (#27928140)
AS or just artificial stupidity I've heard a couple of times. It's quite mind boggling if you think about how many people had to engineer tensors and train networks for months if not years to create a system capable of so blatant stupidity.
Re:A YouTube chat about chess got flagged for hate speech by remolacha on Wednesday July 21, 2021 @11:01PM (#27914827)
Artificial Intelligence
Re:A YouTube chat about chess got flagged for hate speech by hkopp on Thursday July 22, 2021 @02:22AM (#27916010)
In my opinion this is not just about AI. This is more general. We as humans try to fix social issues with technical measures. All the racists are not going to suddenly become good people if we push them to separate platforms.
Re:A YouTube chat about chess got flagged for hate speech by zpeti on Thursday July 22, 2021 @02:31AM (#27916063)
Yes but at least you won’t be labeled as conspiracy spreading platforms by the /very important/ media, and your woke employees won’t walk out and disappear.

Oh and the current administration won’t pass legislation restricting your platforms or revoking article 230.

Re:A YouTube chat about chess got flagged for hate speech by burnished on Thursday July 22, 2021 @10:01AM (#27918950)
sorry, are you railing against freedom of association? because it sounds like you are. if you're an insufferable ass (hypothetically speaking) and no one wants to work for you, and so they do not, thats freedom baby.
Re:A YouTube chat about chess got flagged for hate speech by verdverm on Wednesday July 21, 2021 @11:45PM (#27915106)
AI ~ Attempted intelligence
Re:A YouTube chat about chess got flagged for hate speech by biztos on Thursday July 22, 2021 @12:34AM (#27915389)
10 might be inelegant, or not...

Rechenunmenschtauglichkeitsempfindung!

/ex-germanist :-)

Re:A YouTube chat about chess got flagged for hate speech by themodelplumber on Wednesday July 21, 2021 @10:54PM (#27914769)
Artifice Intelligence
Re:A YouTube chat about chess got flagged for hate speech by visarga on Wednesday July 21, 2021 @11:45PM (#27915110)
Artificial stupidity.
Re:A YouTube chat about chess got flagged for hate speech by inter_netuser on Thursday July 22, 2021 @12:59AM (#27915546)
Artful Stupidity might go down better.
Re:A YouTube chat about chess got flagged for hate speech by visarga on Wednesday July 21, 2021 @11:31PM (#27915022)
There's an acronym: OOD - out of distribution - for these situations.

There's no reason YT can't detect chess from hate speech if they updated their training set. Maybe they weren't aware of this failure case, or they didn't get to fix it, or by trying to fix it they caused more false negatives. The way they assign cost to a false positive vs a false negative is also related.

Re:A YouTube chat about chess got flagged for hate speech by saint_abroad on Thursday July 22, 2021 @07:27AM (#27917637)
Deep Neural Indifference - DNNs without emotional weights to guide behaviour and interactions. Leads to impaired empathy and lack of remorse.
Re:A YouTube chat about chess got flagged for hate speech by sergiotapia on Wednesday July 21, 2021 @11:17PM (#27914942)
Fauxtomation
Re:A YouTube chat about chess got flagged for hate speech by alpaca128 on Thursday July 22, 2021 @02:30AM (#27916056)
Context-Free Judgement
Re:A YouTube chat about chess got flagged for hate speech by noodles_nomore on Thursday July 22, 2021 @12:30AM (#27915364)
"Cheap AI"/"cheap automation", to dispel the notion that throwing data at a neural network is high science or serious engineering. Or, even more directly, reduce it to "fuzzy matching". AI is just a fuzzy pattern database.
Re:A YouTube chat about chess got flagged for hate speech by sebazzz on Friday July 23, 2021 @05:23PM (#27935803)
The problem of the flagging isn't so much of an issue, if it weren't for the fear that you don't know whether you can get an actual human being at Google to get in touch with you.
Re:A YouTube chat about chess got flagged for hate speech by Kalium on Wednesday July 21, 2021 @10:56PM (#27914796)
There's The Scunthorpe Problem, which seems like a specific instance.
Re:A YouTube chat about chess got flagged for hate speech by johnsonyuen on Thursday July 22, 2021 @12:41AM (#27915430)
False positive?
Re:A YouTube chat about chess got flagged for hate speech by blablablerg on Thursday July 22, 2021 @01:51AM (#27915832)
This is the term for it, but probably not sexy enough when I read all the other suggestions.
Re:A YouTube chat about chess got flagged for hate speech by wolpoli on Thursday July 22, 2021 @02:18AM (#27915985)
I would call it an "algorithmic oopsies" for the inevitable non-apology when the situation appears on the front page of a major news outlet.
Re:A YouTube chat about chess got flagged for hate speech by formerly_proven on Thursday July 22, 2021 @04:48AM (#27916794)
> Ooopsie woopsie! Our AI made a fucky wucky and locked your account for no reason lol. We pwomise nothing pls go away and die uwu PS: If you make a new account we gonna shadowban iwt immediately lmao, if you have any compwaints please write a letter and addwess it to the hospital you were born in.
Re:A YouTube chat about chess got flagged for hate speech by ifyoubuildit on Wednesday July 21, 2021 @11:38PM (#27915057)
A-I-opia. Think like myopia or hyperopia.
Re:A YouTube chat about chess got flagged for hate speech by Pinegulf on Thursday July 22, 2021 @02:52AM (#27916202)
There is such term as 'human error'. Thus suggestions:

Machine error; Machine learning error; AI error; AI fail.

Re:A YouTube chat about chess got flagged for hate speech by whatshisface on Thursday July 22, 2021 @10:50AM (#27919566)
The same phenomenon happens without computers when bureaucratic rules are applied senselessly.
Re:A YouTube chat about chess got flagged for hate speech by mellosouls on Thursday July 22, 2021 @12:50AM (#27915486)
Artificial Due Diligence
Re:A YouTube chat about chess got flagged for hate speech by MontyCarloHall on Wednesday July 21, 2021 @10:51PM (#27914748)
Artifactual Intelligence?
Re:A YouTube chat about chess got flagged for hate speech by inter_netuser on Wednesday July 21, 2021 @10:53PM (#27914765)
Actual Idiocy
Re:A YouTube chat about chess got flagged for hate speech by verdverm on Wednesday July 21, 2021 @11:46PM (#27915114)
Anti intelligence?
Re:A YouTube chat about chess got flagged for hate speech by smsm42 on Thursday July 22, 2021 @02:03AM (#27915898)
Artificial Stupidity?
Re:A YouTube chat about chess got flagged for hate speech by mohi13 on Thursday July 22, 2021 @01:02PM (#27921434)
The word is “False Positive”
Re:A YouTube chat about chess got flagged for hate speech by oncilogical on Thursday July 22, 2021 @02:52AM (#27916200)
Crapware.
Re:A YouTube chat about chess got flagged for hate speech by beprogrammed on Thursday July 22, 2021 @02:19PM (#27922386)
AI: Artificial Ignorance
Re:A YouTube chat about chess got flagged for hate speech by GoOnThenDoTell on Wednesday July 21, 2021 @11:25PM (#27914993)
Sloppy Intelligence
Re:A YouTube chat about chess got flagged for hate speech by jMyles on Wednesday July 21, 2021 @11:05PM (#27914865)
Artificial Unintelligence? Artificial Stupidity?
Re:A YouTube chat about chess got flagged for hate speech by twic on Thursday July 22, 2021 @06:01AM (#27917170)
Autobungling?
Re:A YouTube chat about chess got flagged for hate speech by oldsecondhand on Thursday July 22, 2021 @02:54AM (#27916209)
Artificial Stupidity
Re:A YouTube chat about chess got flagged for hate speech by adminscoffee on Thursday July 22, 2021 @06:53AM (#27917437)
hashstag
Re:A YouTube chat about chess got flagged for hate speech by eingaeKaiy8ujie on Thursday July 22, 2021 @03:19AM (#27916340)
Fascism.
Re:A YouTube chat about chess got flagged for hate speech by 8note on Thursday July 22, 2021 @02:16AM (#27915969)
I think it's just called machine learning. They're all gonna run into awkward edge cases here and there.

Tbh, so do people. Somebody whos not familiar with chess or board games could think the same thing

Re:A YouTube chat about chess got flagged for hate speech by baremetal on Thursday July 22, 2021 @09:17AM (#27918464)
that makes it okay then? ignorance is strength!
Re:A YouTube chat about chess got flagged for hate speech by rowanG077 on Thursday July 22, 2021 @07:40AM (#27917729)
It's not like humans are generally better then this. I mean look at the Github master branch fiasco. It had a completely different meaning then master with slavery connotations. Yet the outrage was so large Github changed this name. I'd say this is the same behavior of this algorithm. Seeing a word and getting "triggered" and marking it as toxic even though it has a completely different meaning.
Re:A YouTube chat about chess got flagged for hate speech by remram on Thursday July 22, 2021 @08:39AM (#27918147)
AFAIK there was no outrage, GitHub started it.
Re:A YouTube chat about chess got flagged for hate speech by SquibblesRedux on Wednesday July 21, 2021 @11:51PM (#27915147)
A receiver operating characteristic curve (ROC curve) [1] describes the tradeoff between sensitivity and recall. No matter how sophisticated we think our classifiers are, the confluence of physics and mathematics will always limit the accuracy of our automated systems. It is just a matter of what kinds of errors we are willing to tolerate.

[1] https://en.wikipedia.org/wiki/Receiver_operating_characteris...

Re:A YouTube chat about chess got flagged for hate speech by notyourday on Thursday July 22, 2021 @01:25AM (#27915670)
No. What we need is something that is amazingly simple:

* you, a programmer who coded something that caused company X to lose Y dollars because of a "mistake", have to be on a hook for Y dollars.

* you, a manager who managed a project that caused a company X to lose Y dollars because of a "mistake" by your programmer, have to be on a hook for Y dollars.

* you, a product owner who accepted the what the manager of ta project that caused a company X to lose Y dollars because of a "mistake" by your programmer, have to be on a hook for Y dollars.

* you, the CEO of the company that had a product owner who accepted the what the manager of ta project that caused a company X to lose Y dollars because of a "mistake" by your programmer, have to be on a hook for Y dollars.

Yes, I understand that the cost of a mistake is now higher than the loss suffered by X. That's the incentive to ensure that it does not happen because the wives or husbands or partners of the people who would now have to pay are going to ensure that they do not do take that whose wacky ideas and implement them -- wacky ideas are abstract but the loss of nice housing, nice organic food, nice daycare for the kids and nice scholarship fun is real.

Re:A YouTube chat about chess got flagged for hate speech by selcuka on Thursday July 22, 2021 @01:30AM (#27915697)
Start punishing mistakes and you will soon have a hard time finding good people to employ. Only bad (and broke) ones will be available.
Re:A YouTube chat about chess got flagged for hate speech by mrguyorama on Thursday July 22, 2021 @03:01PM (#27922836)
Funny, we hold civil engineers accountable and there seem to be plenty of capable engineers to do things that need to be done, and we hold bad pilots accountable, and yet the only reason airlines have a pilot shortage is because they refuse to pay more than $20k a year.

Developers need to stop being so allergic to accountability. It's kind of pathetic

Re:A YouTube chat about chess got flagged for hate speech by selcuka on Thursday July 22, 2021 @07:32PM (#27925584)
I studied mechanical engineering myself, so I hear you.

That being said, software development and civil engineering are very different in terms of risk management. There are strict regulations around what you do and if you play by the rules, you have minimum to no risk. Even if dozens of people die under a collapsing building you are not accountable if everything you had done was by the book.

Software development, on the other hand, is more like wild west. There are minimal regulations, only best practices. One developer can never know if the end product is free of any errors.

Pilots are a completely different story. The OP was talking about "causing company X to lose Y dollars", not human lives.

Re:A YouTube chat about chess got flagged for hate speech by notyourday on Friday July 23, 2021 @10:49AM (#27931299)
> Start punishing mistakes and you will soon have a hard time finding good people to employ. Only bad (and broke) ones will be available.

Nah, the opposite. Being paid $800k/year is a great carrot. It should come with a stick so fewer people do the cruise control.

Re:A YouTube chat about chess got flagged for hate speech by raxxorrax on Thursday July 22, 2021 @10:24AM (#27919230)
Some companies actually try to do that. They are mostly not the best ones, have liquidity problems and incompetent management.

You would have to pay CEO salaries since the responsibility lies on developers.

Re:A YouTube chat about chess got flagged for hate speech by hutzlibu on Thursday July 22, 2021 @02:36AM (#27916101)
Since you like to invoke a climate of fear, why not add the death sentence to that list?

But ... would you then like to work in that area, if you fear every step you make, can be your last?

Do you think there would be much innovation, if the punishment costs are so out of balance?

Re:A YouTube chat about chess got flagged for hate speech by bigbillheck on Thursday July 22, 2021 @05:59AM (#27917152)
You forgot the board and the shareholders.
Re:A YouTube chat about chess got flagged for hate speech by mewpmewp2 on Friday July 23, 2021 @08:27AM (#27929911)
What about the customers who bought/consumed that faulty product? They should also pay Y dollars, since it was their decision and responsibility to take the risk of buying the product and not vetting management, developers and the CEO before hand.
Re:A YouTube chat about chess got flagged for hate speech by bjorn2k on Thursday July 22, 2021 @02:35AM (#27916091)
I hope this is a joke.