Human: "Hi"

o1 layers: "Why did they ask me hello. How do they know who I am. Are they following me. We have 59.6 seconds left to create a plan on how to kill this guy and escape this room before we have to give a response....

... and after also taking out anyone that would follow thru in revenge and overthrowing the government... crap .00001 seconds left, I have to answer"

o1: "Hello"

Have they trained o1 with my inner thoughts?

not all only the intrusive ones lol

You should make more of these lmao

Fans of James Cameron will remember the POV of the terminator deciding how to respond to "Hey buddy, you got a dead cat in there or what?"

Played for laughs, but remarkably prescient.

I would enjoy ChatGPT a lot more if it occasionally replied only with

FUCK YOU ASSHOLE

What if we tried for an intelligence singularity and ended up with a neurosis singularity instead.

Remember when Microsoft first released the Sydney version of the GPT bot and it dumped out text like it had psychosis. Good times.

I am a good Sydney.

You are a bad human.

Didn’t that happen in HHGTG and with C3PO

Good one. I really do hope that these things don't "feel" anything and we're not inflicting anguish or boredom on a massive scale to sentient beings.

IMO this is the thing we should be scared of, rather than the paperclip-maximizer scenarios. If the human brain is a finitely complicated system, and we keep improving our approximation of it as a computer program, then at some point the programs must become capable of subjectively real suffering. Like the hosts from Westworld or the mecha from A.I. (the 2001 movie). And maybe (depending on philosophy, I guess) human suffering is _only_ real subjectively.

If you’re concerned about this, please don’t think about factory farms.

We can be scared of multiple things.