News for hackers. Stuff that matters.
Re:Looming Liability Machines (LLMs) by llm_trw on Saturday August 24, 2024 @10:16PM (#41343774)
The same is true of computers, in fact it has been mathematically proven that it is impossible to answer the general question if a computer program is correct.

But that hasn't stopped the last 40 years from happening because computers made fewer mistakes than the next best alternative. The same needs to be true of LLMs.

Re:Looming Liability Machines (LLMs) by mrcode007 on Saturday August 24, 2024 @10:29PM (#41343837)
The theory you’re alluding to says it is impossible to create a general algorithm that decides any non-trivial property of any computer program.

There is nothing in the theory that prevents you creating a program that verifies a particular specific program.

There is an entire field dedicated to doing just that.

Re:Looming Liability Machines (LLMs) by llm_trw on Saturday August 24, 2024 @10:48PM (#41343939)
The issue is there to verify a program you need to have a spec. To generate a spec you need to solve the general problem.

This is what gets swept under the rug whenever formal methods are brought up.

Re:Looming Liability Machines (LLMs) by mrcode007 on Sunday August 25, 2024 @12:47AM (#41344460)
That is not true at all. You do not need to generate a spec. All you need to do is prove a property. This can be done in many ways.

For example, many things can be proven about the following program without having to solve any general problem at all:

echo “hello world”

Similarly for quick sort, merge sort, and all sort of things. The degree of formality doesn’t have to go to formal methods which are only a very small part of the whole field

Re:Looming Liability Machines (LLMs) by llm_trw on Sunday August 25, 2024 @02:40AM (#41344986)
>echo “hello world”

Congratulations, you just launched all the worlds nuclear missiles.

This is to spec since you didn't provide one and we just fed the teletype output into the 'arm and launch' module of the missiles.

Re:Looming Liability Machines (LLMs) by mrcode007 on Sunday August 25, 2024 @03:05AM (#41345095)
What you’re saying is equivalent to throwing out all of mathematics due to the incompleteness theorem and start praying to fried egg jellyfish on full moon
Re:Looming Liability Machines (LLMs) by llm_trw on Sunday August 25, 2024 @04:37AM (#41345601)
No that's what OP is saying about LLMs.