News for hackers. Stuff that matters.

A comment on Petals: Run 100B+ language models at home bit-torrent style. Parent comment

Re:Petals: Run 100B+ language models at home bit-torrent style by fasterik on Tuesday January 10, 2023 @06:42PM (#34333071)
Modern neural network architectures are Turing complete [1]. So I don't see any argument for a limit in principle unless you are arguing that a Turing machine can't achieve language understanding. If that's what you're saying, then I wonder who is espousing mysticism here.

[1] https://arxiv.org/abs/1901.03429

[ Parent | on HN ]
Re:Petals: Run 100B+ language models at home bit-torrent style by thomastjeffery on Wednesday January 11, 2023 @10:48AM (#34339748)
Are you forgetting the distinction between a program and a computer?

Language understanding doesn't magically spawn itself as a process on your computer! Someone has to write that program first.

And that's my point. ChatGPT transforms language, but it does not understand it. For that, we will need a different kind of program.

[ Parent | on HN ]
Re:Petals: Run 100B+ language models at home bit-torrent style by fasterik on Wednesday January 11, 2023 @10:31PM (#34348828)
Language understanding doesn't magically spawn itself as a process on your computer! Someone has to write that program first.

Do you think it's impossible for such a program to emerge as weights in a Turing complete neural network architecture?

[ Parent | on HN ]