News for hackers. Stuff that matters.
Re:What Is ChatGPT Doing and Why Does It Work? by scottlawson on Tuesday February 14, 2023 @08:55PM (#34799060)
I spent about an hour reading this. I know most people probably won't be able to do the same because of time constraints in their day, but seriously this is the most awesome post about large language models I've read.

Take a second to think about how much time it must have taken to write this, to prepare all of these examples.

This post gave me another way to look at something I already partially understood pieces of. It helps me understand how chatgpt can have these moments of greatness.

If you think of this like a long lecture you can get a lot out of it. It reminds me of a feynman lecture.

Re:What Is ChatGPT Doing and Why Does It Work? by inasio on Tuesday February 14, 2023 @09:42PM (#34799358)
I'm typically a bit wary of Wolfram's posts, but it is very often the case that the content is good enough that I don't mind a bit of self-aggrandizing. This one though I found to be just pure great, super easy and clear intro into the "magic" of LLMs. Thank you.
Re:What Is ChatGPT Doing and Why Does It Work? by GreedClarifies on Tuesday February 14, 2023 @10:57PM (#34799922)
Best comment!

He's clearly brilliant and I read his posts, but usually I have to grit my teeth at least a couple of times due to his self-aggrandizing. But there was almost none of that in this one.

Great stuff.

Re:What Is ChatGPT Doing and Why Does It Work? by PaulDavisThe1st on Wednesday February 15, 2023 @02:01AM (#34800900)
I'm sure you'd have understood more, though, if you had considered Wolfram Language (TM) and also tried a few examples with Wolfram Alpha. /s
Re:What Is ChatGPT Doing and Why Does It Work? by greenornot on Wednesday February 15, 2023 @02:15AM (#34800958)
OK, so I started reading the post and initially had the same feeling. May this have been one of those things where he really leaves his pet peeves behind and contributes something?

But then his lingo started to creep in. Computational irreducibility, linking to how he invented the concept. Rurial space. Geez man, does everything really have to be a promotion of the cult-like New Kind of Science stuff? Full of links to his own unrelated blog posts? It's sad.

I'd really have liked to like the article, he clearly put a lot of effort into it. But I had to stop reading. You can't tell for sure where real explainations end and where his unproven claims start about "knowing" that the universe is just computational and everything just based on some rule from a cellular automaton.

And I've gotten conditioned to never start a sentence with "OK, so". It's now giving me the jiffies.

Re:What Is ChatGPT Doing and Why Does It Work? by pedrow on Wednesday February 15, 2023 @07:24AM (#34802863)
I thought this was an enjoyable and informative article but [0]

> As a personal comparison, my total lifetime output ... has been... [78 million words] And, yes, I’ll train a bot from all of that.

for non-Wolfram fans - take cover there is a potentially infinite future supply!

[0]: https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-... (paragraph 2)

Re:What Is ChatGPT Doing and Why Does It Work? by Upvoter33 on Tuesday February 14, 2023 @10:21PM (#34799674)
I had the same reaction. Wow, what a thing to put together. I wonder how many people could produce such a doc, and how long it would take them.
Re:What Is ChatGPT Doing and Why Does It Work? by sixtram on Wednesday February 15, 2023 @03:49AM (#34801498)
Maybe he produced it with ChatGPT :)
Re:What Is ChatGPT Doing and Why Does It Work? by alchemist1e9 on Tuesday February 14, 2023 @11:27PM (#34800100)
I was estimating more than 1 hour to read it properly. Since you did it in only 1 hour that’s encouraging me to try tomorrow or another day.

I can’t comprehend how ChatGPT can keep such incredible internal state and I’m hoping Wolfram might have some ideas in this post. For instance try the prompt that turns it into a linux terminal and it can closely “hallucinate” approximately the correct changes in state to the host after the commands but long long after the command occurred in the dialogue. To me this shows it extends beyond human language.

Re:What Is ChatGPT Doing and Why Does It Work? by bambax on Wednesday February 15, 2023 @07:16AM (#34802791)
Absolutely agree. It's a fantastic piece. Here's my take on it: https://news.ycombinator.com/item?id=34802764