News for hackers. Stuff that matters.

A comment on Some Remarks on Large Language Models – Yoav Goldberg. Parent comment

Re:Some Remarks on Large Language Models – Yoav Goldberg by sgt101 on Tuesday January 03, 2023 @05:46PM (#34239240)
I think ChatGPT is a Chinese Room (as per John Searle's famous description). The problem with this is that ChatGPT has no idea what it is saying and doesn't/can't understand when it is wrong or uncertain (or even when it is right or certain).

I believe that this is dangerous in many valuable applications, and will mean that the current generation of LLM's will be more limited in value that some people believe. I think this is quite similar to the problems that self driving cars have; we can make good ones for sure, but they are not good enough or predictable enough to be trusted and used without significant constraints.

My worry is that LLM's will get used inappropriately and will hurt lots of people, I wonder if there is a way to stop this?

[ Parent | on HN ]
Re:Some Remarks on Large Language Models – Yoav Goldberg by pyrolistical on Tuesday January 03, 2023 @05:54PM (#34239311)
We stop this like any other issue with the law. Somebody is going to use LLM and cause harm. They will then get sued and people will have to reconsider the risk of using LLM.

It’s just a tool

[ Parent | on HN ]
Re:Some Remarks on Large Language Models – Yoav Goldberg by pessimizer on Tuesday January 03, 2023 @06:18PM (#34239551)
Or they will be sued and it will be dismissed, or the entire process might be suppressed based on trade secrets, national security concerns, or lobbyist concerns. Then people will have to evaluate the risk of using LLM by making sure they have enough lawyers, enough cash, or enough connections as a contractor to get away with doing whatever benefits them most.

I don't know what just a tool is supposed to mean. Pistols and nuclear warheads are also tools, they're tools for killing people.

[ Parent | on HN ]
Re:Some Remarks on Large Language Models – Yoav Goldberg by actionfromafar on Tuesday January 03, 2023 @08:19PM (#34240619)
Not just for killing, bur for area denial, never forget.
[ Parent | on HN ]
Re:Some Remarks on Large Language Models – Yoav Goldberg by phonescreen_man on Tuesday January 03, 2023 @10:33PM (#34241691)
As in denial of access to an area? Or something else?
[ Parent | on HN ]