Nah, it's the equivalent of seeing faces in static, or animals in clouds.

Our brains are hardwired to see patterns, even when there are none.

A similar, and related, behavior is seeing intent and intelligence in random phenomenon.

This is clearly not random. If I ask to implement a particular function in Rust using a library I've previously built, and it does that, that's not random.

So it's behaving like our brains. Yet it's not AGI.

Does that mean our brains do not implement General Intelligence?

When I take a dump, I do it exactly like a violin virtuoso does. I am not a violin virtuoso.

Trust me, I'm really not.

Absolutely bonkers analogy. Ironically, I have no doubt that GPT4 could come up with a better one. What does that mean?

Consciousness is a suitcase term. Once all the clothes that define consciousness are neatly arranged and packed into AI then it will be conscious too.

Why are you surprised by LLMs doing irrational or weird things?

All machine learning models start off in a random state. As they progress through their training, their input/output pairs tend to mimic what they've been trained to mimic.

LLMs have been doing a great job mimicking our human flaws from the beginning because we train them on a ton of human generated data. Other weird behavior can be easily attributed to simple fact that they're initialized at a random state.

Being able to work on and prove non-trivial theorems is a better indication of AGI, IMO.

It's an illusion. This is just inference running.

What if the society around you is an illusion too ?

Economy definitely is, for example.

Asking people ‘Is money real?’ is so much fun on parties.

Bonus points for ‘what does <real> mean?’ as a follow up.

You’re anthropomorphizing it. Years ago people were trying to argue that when GPT-3.0 would repeat words in a loop it was being poetic. No, it’s just a statistical failure mode.

When these new models go off to a random site and are caught in a loop of exploring pages that doesn’t mean it’s an AGI admiring nature.