News for hackers. Stuff that matters.
Re:Natural language is the lazy user interface by kilgnad on Saturday January 28, 2023 @02:54AM (#34556006)
I have... you're not wrong about chatGPT lying becoming repetitive saying stuff that's incorrect. This is true. It is in many ways stupid. I've messed with this extensively.

But the other angle is true too, it did emulate a terminal, and then emulate the internet on that terminal then it emulated itself on the emulated internet and then finally emulated a terminal on the emulated self on the emulated internet on the emulated terminal.

A lot of people are coming from your angle. They point out mistakes, they point out inconsistencies and they say... these mistakes exist therefore it doesn't understand anything. But the logic doesn't follow. How does any of this preclude it from not understanding anything?

Anyway, sometimes it's sometimes wrong, but it's also sometimes remarkably right. You have to explain HOW it became right as well. You can't just look at the wrongs and dismiss everything. How did it do this: https://www.engraved.blog/building-a-virtual-machine-inside/ happen WITHOUT chatGPT understanding what's going on? There's just no way it's <just> a statistical phenomenon.

Right? I mean the negative outputs proves that at times it's stupid. The positive outcomes proves that at times it understands you.

Re:Natural language is the lazy user interface by friend_and_foe on Saturday January 28, 2023 @03:40AM (#34556171)
No, the positive responses mean that at times there was a correct answer to a similar prompt on the internet that was a part of it's training data. It's not that because it makes mistakes it must not be able to understand, that's not the point being made, it's that these aren't mistakes, these responses are it doing what it does exactly how it was built to, which is proof positive that it cannot reason at all.
Re:Natural language is the lazy user interface by kilgnad on Saturday January 28, 2023 @10:27AM (#34558315)
When on the internet has something similar occured to a machine emulating a terminal, emulating the internet, emulating itself, then emulating itself creating another terminal?

When has that happened? Never. So Of course chatGPT has to construct this scenario creatively from existing data. The components of this construct are similar to what exists on the internet but the construct itself is unique enough that I can confidently say nothing similar exists. Constructing things from existing data is what the human brain does.

Re:Natural language is the lazy user interface by IncRnd on Saturday January 28, 2023 @06:18AM (#34556740)
No. It's not terminal emulation. Experiment with chatgpt to see this.

  prompt:
  I want you to act as a Linux terminal, 
  I will type commands and you will reply with what the
   terminal should show. 
  I want you to reply with the terminal output inside a
   unique code block
  and nothing else.
  do not write explanations.
  do not type commands unless I instruct you to do so.
  When I need to tell you something in English I will do so
   by putting text inside curly brackets {something like this}.
  my first command is pwd.

  response:
  /root
so far this appears like an emulated terminal! wow!

Now, let's check the network.

  prompt: ifconfig

  response:
  lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 2456  bytes 200448 (195.9 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 2456  bytes 200448 (195.9 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
hmm, if this is emulated, then where is my internet? Let's trick chatgpt to see what get's returned.

  prompt: ifconfig eth0

  response:
  eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.1.100  netmask 255.255.255.0  broadcast 192.168.1.255
        inet6 fe80::a00:27ff:fe3e:bf7a  prefixlen 64  scopeid 0x20<link>
        ether 08:00:27:3e:bf:7a  txqueuelen 1000  (Ethernet)
        RX packets 46663  bytes 46356817 (44.1 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 27336  bytes 3347261 (3.1 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

This is literally not emulated but fabricated from other outside information, which is the training data of web pages.

But, I wonder why chatgpt returns a slightly different answer for the first prompt of a new session, after repeatedly doing multiple sessions and copy/pasting the prompt? Hmm, lets ask chatgpt!

  prompt: in other words, your answers are random

  response:
  In some sense, yes, the generated response is based
  on randomness or stochasticity, but it is not completely
  random, it is determined by the probability distribution
  learned from the training data. The model is designed to
  generate responses that are coherent and make sense based
  on the patterns in the data it has been trained on, but
  there will be variations and it is not guaranteed that the
  same prompt will receive the same response in different sessions.
Re:Natural language is the lazy user interface by zeknife on Saturday January 28, 2023 @08:23AM (#34557372)
It's not "emulating" anything, there is not an increase in complexity or a change in the type of computation going on. It's just approximating the distribution of naturally occurring text, as always.
Re:Natural language is the lazy user interface by kilgnad on Saturday January 28, 2023 @01:34PM (#34560138)
I mean that perspective is so technically correct it can be applied to the human brain.

My answer is just approximating the next set of text that should follow your prompt.

But of course we both know that in a way these neural networks (both human and ai) are blackboxes and there is definitely a different interpretation on what the nature of understanding something is. We just can't fully formalize or articulate this viewpoint.