Re:Ilya Sutskever's SSI Inc raises $1B
by Yizahi on Wednesday September 04, 2024 @10:45AM
(#41446420)
Theoretical foundation was slowly built over decades before it started though. And correct me if I'm wrong, but calculations that it was feasible were present before the start too. They had to calculate how to do it, what will be the processes, how to construct it and so on, but theoretically scientists knew that this amount of material can start such process.
On the other hand not only there is no clear path to AI today (also known as AGI, ASI, SI etc.), but even foundations are largely missing. We are debating what is intelligence, how it works, how to even start simulating it, or construct from scratch.
[ Parent
| on HN ]
There are algorithms that should work, they're just galactic[0] or are otherwise expected to use far too much space and time to be practical.
Re:Ilya Sutskever's SSI Inc raises $1B
by ryan93 on Wednesday September 04, 2024 @03:26PM
(#41449666)
That wiki article has nothing to do with AI. The whole AI space attracts BS talk
What do you think AI is? On that one page there's simulated annealing with a logarithmic cooling schedule, Hutter search, and Solomonoff induction, all very much applicable to AI. If you want a fully complete galactic algorithm for AI, look up AIXItl.
Edit: actually I'm not sure if AIXItl is technically galactic or just terribly inefficient, but there's been trouble making it faster and more compact.
Re:Ilya Sutskever's SSI Inc raises $1B
by logicchains on Wednesday September 04, 2024 @11:02AM
(#41446600)
The theoretical foundation of transformers is well understood; they're able to approximate a very wide family of functions, particularly with chain of thought ( https://arxiv.org/abs/2310.07923 ). Training them on next-token-prediction is essentially training them to compress, and more optimal compression requires a more accurate model of the world, so they're being trained to model the world better and better. However you want to define intelligence, for practical purposes models with better and better models of the world are more and more useful.
Re:Ilya Sutskever's SSI Inc raises $1B
by zeroonetwothree on Wednesday September 04, 2024 @12:29PM
(#41447596)
The disagreement here seems merely to be about what we mean by “AGI”. I think there’s reasons to think current approaches will not achieve it, but also reason to think they will.
In any case anyone who is completely sure that we can/can’t achieve AGI is delusional.