News for hackers. Stuff that matters.
Re:Why Mastering Language Is So Difficult for AI by 317070 on Friday October 07, 2022 @04:36PM (#33126593)
This NN breakthrough in language is only about 2 years old now [0].

People are working on your symbolic logic hybrid approach, but not much interesting has happened yet. This is a bit expected, since the short amount of time, and the fast scaling these language models have done in those last two years. It's been hard to outscale them with any other approach, let alone by the particular one of symbolic logic.

I think the main discripancy with particle research, is that every iteration of bigger models are also significantly better, no diminishing returns in sight.

Better for concrete applications as well. There is therefore no need to claim these models are scaled for scientific reasons in the search of AI, the accountants are happy as it is.

[0] https://arxiv.org/abs/2005.14165

There are no comments on this comment yet.