News for hackers. Stuff that matters.
Re:Ogma: Interpretable Symbolic General Problem-Solving Model by killthebuddha on Monday June 03, 2024 @12:40PM (#40564447)
On the one hand this is interesting to me because it's closely aligned with my own ideas about what will be the general form of the first AGI systems.

On the other hand, just like with my own ideas, there's very little concrete evidence that they're correct. It looks like the author has been very careful about wording and avoids saying directly "there exists an implementation of these ideas that seems to be working well enough to expect it to scale".

Re:Ogma: Interpretable Symbolic General Problem-Solving Model by mdaniel on Monday June 03, 2024 @01:23PM (#40564922)
Through the magic of "coming soon!" all things are possible
Re:Ogma: Interpretable Symbolic General Problem-Solving Model by Animats on Monday June 03, 2024 @01:43PM (#40565181)
Indeed.

* Paper - coming soon.

* Github repository - coming soon.

* Details about how it works - coming soon.

* Hype - here now.

This is so retro. I went through Stanford CS in the 1980s, just as the "expert system" boom was collapsing, and the "AI winter" was beginning. This is very close to the hype of that era. Many of the Stanford faculty really believed that artificial general intelligence via expert systems was close. If you could just hammer the real world into predicate calculus...

It might be worth revisiting, though. Embedding-based AI may be reaching its limits. If you need to plan or subgoal or compute, it's not quite the right tool for the job. Some other representation may be needed.

(Consider EMACS "org mode". It probably isn't that hard to get an LLM to translate a question into "org mode" form. Then you need a strategy module to decide which subtasks to work on, notice when progress is being made and when it isn't, work on the problem as a tree of subgoals, and combine into a result.)

Re:Ogma: Interpretable Symbolic General Problem-Solving Model by viking123 on Monday June 03, 2024 @02:54PM (#40566106)
Now some supposedly very smart people are thinking if you shove enough data into the LLM, it will magically become like AGI
Re:Ogma: Interpretable Symbolic General Problem-Solving Model by YeGoblynQueenne on Monday June 03, 2024 @04:14PM (#40567009)
Maybe those people are not that very smart after all.
Re:Ogma: Interpretable Symbolic General Problem-Solving Model by rdedev on Monday June 03, 2024 @05:39PM (#40567868)
Can't blame them too much since every other paper points to the fact that more parameters and data is the way forward to new SOTA results.

We have probably reached the limit of scraping publicly available English training data from the Internet. OpenAI is betting on synthetic data. Let's see where that takes them. The sad part is companies like OpenAI only makes money if the answer to AGI is large models and large data. I don't know if they have unknowingly restricted their ideas on AGI based on that

Re:Ogma: Interpretable Symbolic General Problem-Solving Model by yourapostasy on Monday June 03, 2024 @03:41PM (#40566684)
> This is very close to the hype of that era.

I'm too dense to grasp the site's mathematical propositions (I don't have the mathematical grounding to understand Borel algebra not to speak of Borel Hierarchies). So it was no wonder I had a lot of trouble discerning how what it proposes was materially different from expert systems, inductive logic systems, and Cyc. The associative memory layer seems to be picking up some lessons learned from Generative AI, but I'm not clear on that. It will be interesting to keep an eye on this project and where it takes us, and see if it makes more sense when someone comes along and dumbs it down for Blubs like me.