News for hackers. Stuff that matters.
Re:OpenAI postmortem – Unexpected responses from ChatGPT by mock-possum on Thursday February 22, 2024 @04:20PM (#39473418)
“We don’t understand why neural networks work” is a myth. It’s not a miracle, it’s just code, and you can step through it to debug it the same way you would any other program.
Re:OpenAI postmortem – Unexpected responses from ChatGPT by zdimension on Thursday February 22, 2024 @05:37PM (#39474303)
You can step-debug a Python program using Windbg but it won't tell you a lot about what's happening since every line is hundreds of CPython API calls.

Sure, you can "step through" a neural network but all you'll ever see are arrays of meaningless floats moving around.