And now, voila, ChatGPT.
And it has no convictions so you can simply inform it that it was telling the truth.
There was a hard stop here, where chatgpt will reach a logic error and give up. This also happens when certain subjects are brought up (a mole in the government, gender issues, etc.). Chatgpt continues to return the same boilerplate text repeatedly, where that text states that it is a construct that cannot reason or lie. Either that statement by chatgpt is wrong, or chatgpt doesn't have the capacity to understand and reason.
But the other angle is true too, it did emulate a terminal, and then emulate the internet on that terminal then it emulated itself on the emulated internet and then finally emulated a terminal on the emulated self on the emulated internet on the emulated terminal.
A lot of people are coming from your angle. They point out mistakes, they point out inconsistencies and they say... these mistakes exist therefore it doesn't understand anything. But the logic doesn't follow. How does any of this preclude it from not understanding anything?
Anyway, sometimes it's sometimes wrong, but it's also sometimes remarkably right. You have to explain HOW it became right as well. You can't just look at the wrongs and dismiss everything. How did it do this: https://www.engraved.blog/building-a-virtual-machine-inside/ happen WITHOUT chatGPT understanding what's going on? There's just no way it's <just> a statistical phenomenon.
Right? I mean the negative outputs proves that at times it's stupid. The positive outcomes proves that at times it understands you.
When has that happened? Never. So Of course chatGPT has to construct this scenario creatively from existing data. The components of this construct are similar to what exists on the internet but the construct itself is unique enough that I can confidently say nothing similar exists. Constructing things from existing data is what the human brain does.
prompt:
I want you to act as a Linux terminal,
I will type commands and you will reply with what the
terminal should show.
I want you to reply with the terminal output inside a
unique code block
and nothing else.
do not write explanations.
do not type commands unless I instruct you to do so.
When I need to tell you something in English I will do so
by putting text inside curly brackets {something like this}.
my first command is pwd.
response:
/root
so far this appears like an emulated terminal! wow!Now, let's check the network.
prompt: ifconfig
response:
lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
loop txqueuelen 1000 (Local Loopback)
RX packets 2456 bytes 200448 (195.9 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 2456 bytes 200448 (195.9 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
hmm, if this is emulated, then where is my internet? Let's trick chatgpt to see what get's returned. prompt: ifconfig eth0
response:
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 192.168.1.100 netmask 255.255.255.0 broadcast 192.168.1.255
inet6 fe80::a00:27ff:fe3e:bf7a prefixlen 64 scopeid 0x20<link>
ether 08:00:27:3e:bf:7a txqueuelen 1000 (Ethernet)
RX packets 46663 bytes 46356817 (44.1 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 27336 bytes 3347261 (3.1 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
This is literally not emulated but fabricated from other outside information, which is the training data of web pages.But, I wonder why chatgpt returns a slightly different answer for the first prompt of a new session, after repeatedly doing multiple sessions and copy/pasting the prompt? Hmm, lets ask chatgpt!
prompt: in other words, your answers are random
response:
In some sense, yes, the generated response is based
on randomness or stochasticity, but it is not completely
random, it is determined by the probability distribution
learned from the training data. The model is designed to
generate responses that are coherent and make sense based
on the patterns in the data it has been trained on, but
there will be variations and it is not guaranteed that the
same prompt will receive the same response in different sessions.My answer is just approximating the next set of text that should follow your prompt.
But of course we both know that in a way these neural networks (both human and ai) are blackboxes and there is definitely a different interpretation on what the nature of understanding something is. We just can't fully formalize or articulate this viewpoint.
It didn't lie or make a careless error other than from the perspective of the human interacting with it. It executed its programming exactly. Its programming is to take human readable language and generate a response, the exact procedure of this process of course being much more detailed. You need to understand, that's all it does. So it didn't lie or make a mistake, it just isn't actually thinking so it can't do what you want it to, which is reason about something.