News for hackers. Stuff that matters.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by Buttons840 on Thursday June 08, 2023 @12:52PM (#36244964)
I've asked it to evaluate Python loops that are about as complex as FizzBuzz, it makes mistakes and even when I direct its attention towards those mistakes it wasn't able to correct itself.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by exitb on Thursday June 08, 2023 @01:09PM (#36245233)
I don’t think it’s a reasonable expectation for a language model to evaluate arbitrary code.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by daveguy on Thursday June 08, 2023 @01:15PM (#36245328)
It's definitely not a reasonable expectation. That doesn't stop the breathless hype from implying it is reasonable.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by williamcotton on Thursday June 08, 2023 @02:24PM (#36246373)
Where is this breathless hype everyone speaks of? All I see is an endless stream of populist hot takes on the exact opposite!
Re:Weird GPT-4 behavior for the specific string “ davidjl” by Culonavirus on Friday June 09, 2023 @02:51AM (#36254246)
"populist hot takes" haha, I'm sorry, but seeing this kind of language in a "gpt can/can't code" debate on a "hacker" forum is just funny to me
Re:Weird GPT-4 behavior for the specific string “ davidjl” by goatlover on Friday June 09, 2023 @06:39AM (#36255878)
There was a post on reddit about how all software was going to be replaced by LLMs, there's a podcast talking about how ChatGPT will become the universal interface that can reconfigure itself as needed depending on the API it's using and what the user needs. There are people claiming programmers will be replaced by prompt engineers. The hype has been everywhere the last few months.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by TeMPOraL on Thursday June 08, 2023 @04:04PM (#36248004)
It's not breathless hype, as much as surprise in the fact that it actually does work, way better than it should.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by Buttons840 on Thursday June 08, 2023 @01:19PM (#36245380)
It's weird that reasoning through complex mathematical proofs is easier (for both me and GPT) than mentally evaluating a short snippet of code. I've done a BSCS, I've done those tests that ask you what the output of a poorly written and tricky loop is, that stuff hurts my brain. In comparison, a mathematical proof, once your ready, feels good.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by Filligree on Thursday June 08, 2023 @01:31PM (#36245556)
"Mentally evaluating a short snippet of code" requires remembering the state of that code, then repeatedly overwriting your memory as you step through it. GPT-4 isn't able to do that; it is in a sense purely functional.

I've had success getting it to evaluate FizzBuzz, but to do so I told it to write out the state of the program one timestep at a time.

https://chat.openai.com/share/c109e946-fb6d-494e-8182-fc93d2...

...this is actually 3.5. 4 wouldn't need as much explanation.

Re:Weird GPT-4 behavior for the specific string “ davidjl” by Verdex on Thursday June 08, 2023 @01:54PM (#36245902)
This feels like an interesting insight into not just why LLMs might have trouble understanding some code, but also why people might have trouble understanding some code.

I wonder how gpt handles code where multiple objects of the same class call the same methods and each individual object calls the same methods with different threads as well as method local variables, class member variables, and static member variables are all in play. [Being fair to our LLM brethren; us meat sacks are sure to hate that hypothetical code as well.]

Re:Weird GPT-4 behavior for the specific string “ davidjl” by Filligree on Thursday June 08, 2023 @04:06PM (#36248021)
If you give me an example, I'll try it. From that description I'm not sure of much more than I hate it. :)
Re:Weird GPT-4 behavior for the specific string “ davidjl” by Verdex on Thursday June 08, 2023 @04:32PM (#36248511)
Off the top of my head, something like this comes to mind:

    class X {
        private static int _staticCount = 0;
        private int _memberCount = 0;

        public uint Stuff(int input) {
            if (input <= 0) {
                return (uint)(_staticCount + 1);
            }

            var y = new Thread(() => { 
                Interlocked.Add(ref X._staticCount, (int)Stuff(input - 1));
                Interlocked.Add(ref _memberCount, (int)Stuff(input - 2));
            });
            y.Start();

            y.Join();

            return (uint)(Stuff(input - 1) + _memberCount); 
        }
    }

    class Program {

        public static void Main() {

            var x = new X();
            var y = new X();
            var z = new X();

            uint resultX = x.Stuff(4);
            uint resultY = y.Stuff(3);
            uint resultZ = z.Stuff(2);


            Console.WriteLine(resultX + resultY + resultZ);
        }

    }
EDIT: Probably should have setup another way to wait for the threads to end, that way all three X classes could be running at the same time. But perhaps this is a good enough start point.

I get 3274511360 when I run it. Although, I had to upgrade everything to uint because I was getting some overflow ... so there might be some of that in the output.

Re:Weird GPT-4 behavior for the specific string “ davidjl” by Filligree on Friday June 09, 2023 @10:04AM (#36257978)
It punted on the request, which is to be fair what I also would do.

> Writing out an exact state of a multi-threaded program line-by-line is inherently challenging due to the inherent unpredictability of thread scheduling. However, I can provide an abstracted example of the flow of execution based on the order of operations in the code. Here is a simplified breakdown:

> x, y, z are instantiated as new X(), _staticCount is 0 for all, _memberCount is 0 for each individually.

> x.Stuff(4) is called.

> Inside Stuff(), check if input <= 0, it's not, hence, skip.

> Create new Thread with lambda function and start it.

> In the new thread, Stuff(input - 1) recursively calls Stuff(3).

> This recursion continues until Stuff(0) is called, returning _staticCount + 1 which is 1.

> This recursion unwinds, incrementing _staticCount and _memberCount at each level.

> After the thread finishes, call Stuff(input - 1) again and add it to _memberCount, effectively doubling the _memberCount.

> Return the final value for Stuff(4) for x.

> Repeat the above steps for y.Stuff(3) and z.Stuff(2).

> Write the sum of resultX, resultY, and resultZ to the console.

> Please note that due to the nature of multi-threaded execution, there is a risk of race conditions. The Interlocked.Add method is used to help prevent these race conditions by making the increment operations atomic. Also, keep in mind that the state of _staticCount after all calls to the Stuff method will be dependent on the interleavings of the threads, and hence, not deterministic.

Re:Weird GPT-4 behavior for the specific string “ davidjl” by Verdex on Friday June 09, 2023 @11:08AM (#36258968)
Interestingly enough, my threads here are deterministic because they always just wait for the execution to finish. So they're the same as not having them.

My plan was to go back and store off the threads generated and have something else wait for them, but I needed to think it through so that it could be done in a way to get deterministic results (like threads only read from member variables and writing to them is done in deterministic order or idempotently). Although, for a contrived example, it was more work than I really wanted to do.

I agree, punting is definitely the right course of action. I sort of have a vague intuition for what's going on here, but hammering down the exact details is just so tedious that I don't want to do it.

Although, it is interesting that the AI basically sees threads and blurts out that the problem is impossible, when they're not actually doing anything in this case.

Re:Weird GPT-4 behavior for the specific string “ davidjl” by Filligree on Friday June 09, 2023 @01:28PM (#36261073)
It explained the code better than I would have, I think. “Inherently challenging” seems… accurate. I bet that if we’d used a data-parallel approach, e.g. with Rayon, it would have handled that better.

As a code assistant, it’s extremely useful if and only if you can check its work. And know how to prompt it.

Re:Weird GPT-4 behavior for the specific string “ davidjl” by waboremo on Thursday June 08, 2023 @01:16PM (#36245335)
It isn't, yet it's used that way.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by krapp on Thursday June 08, 2023 @02:36PM (#36246548)
Everyone is worried about doomsday scenarios like runaway AGI and Skynet, meanwhile the real danger of AI turns out to be people naively assuming it works like the computer in Star Trek, that because it can hold a conversation, is has some form of intelligence and awareness.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by JasonFruit on Thursday June 08, 2023 @03:24PM (#36247301)
Please keep saying this over and over. Even people who get that it doesn't work that way don't seem to grasp the danger of others relying on these tools in inappropriate ways.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by krapp on Thursday June 08, 2023 @08:08PM (#36251196)
The problem is LLMs are kind of an outside context problem for our culture. We're still arguing over the correct language to even describe what it does ("hallucinate"? "confabulate"? "lie?") because every word we have presupposes the existence of a stateful mind with intent. It's a philosophical zombie, which is so counterintuitive most people can't even accept it as a sensible concept.

Between the hype and decades of indoctrination through science fiction about how AI is "supposed" to work, I guess it isn't surprising that this is how things are shaking out. People will learn, the way they learned with the internet, but it will take a few years I think.

Re:Weird GPT-4 behavior for the specific string “ davidjl” by goatlover on Friday June 09, 2023 @06:41AM (#36255892)
The computer in Star Trek seems to only work like a sentient intelligence when you prompt to the Holodeck a certain way, like make a worthy opponent for Data.