News for hackers. Stuff that matters.
Re:Hugging Face, GitHub and more unite to defend open source... by southerntofu on Sunday July 30, 2023 @05:42AM (#36929491)
I personally believe most of these applications bring net negative to society. I personally see two exceptions that i don't have strong opinions about: machine translation, and ML firmware for camera output quality. There's probably more i'm not aware of.

The former has dubious quality but can be useful in certain contexts where human translation is unavailable.

The latter has anecdotally already failed spectacularly in at least two cases:

https://news.ycombinator.com/item?id=6156238

https://news.ycombinator.com/item?id=29739235

For example, what are positive applications of NLP you can think about? Most applications i hear about would be to replace human customer support with chatbots (very negative) or for intelligence gathering purposes (very negative). There's probably a lot i don't know about.

Re:Hugging Face, GitHub and more unite to defend open source... by saikia81 on Sunday July 30, 2023 @08:27AM (#36930481)
I don't understand your take on a developing technology seems to be: If it doesn't work as I expect it so it should be banned. As the previous commenter mentioned AI is broader.

Also NLP can be used to protect vulnerable groups from online abuse. It protects message boards from porn. It helps people find related content (which they enjoy). It automates categorizing or grouping content/people. Some companies abuse these practices for money.

Don't blame technology for the bad actions of companies. Their intentions would have corrupted whatever technology is available.

Re:Hugging Face, GitHub and more unite to defend open source... by southerntofu on Monday July 31, 2023 @05:56AM (#36940498)
> If it doesn't work as I expect it so it should be banned.

Well yes that's a very reasonable expectation. In most fields, when you sell something that doesn't work, it's called fraud. But in fields where it actually matter for safety, regulations are most stringent, such as in mechanics or medicine. If a car had 1% chance of blowing up killing everyone inside, would it be legal to sell it? Why is it ok for OpenAI to sell a chatbot that has 1% chance to convince you of utter bullshit when you ask it a serious question?

I believe education and communication to be critical to society's wellbeing, so i would hold companies in this field to greater standards.

> Also NLP can be used to protect vulnerable groups from online abuse.

Automated filters do not understand sarcasm, quotation, criticism... Sure that avoids the scunthorpe problem, but for example, auto-moderation bots trying to prevent racist abuse often censor black people calling one another the n word, which is completely ok. Nothing can replace moderation.

> It helps people find related content (which they enjoy).

Maybe, but i doubt it. I've yet to see advertisement/recommendations for content i actually enjoy, or to meet people who have such experiences. I've only ever heard that from advertisers, but maybe you have better experience than i do?

> Don't blame technology for the bad actions of companies. Their intentions would have corrupted whatever technology is available.

Good point! But technology that makes it easier and cheaper to be evil should probably not be encouraged and widely available. At least here in France, i cannot go out and buy a gun or dynamite. Also, bad results of AI are not necessarily a result of malice, but rather a complete misapprehension of the technology which is just completely stupid math and not actual intelligence.

If you're curious I recommend watching James Mickens' USENIX talk on what he calls technological manifest destiny, where he expands on these topics: https://youtube.com/watch?v=ajGX7odA87k