Anyone who does this and comes away jaded has lost the ability to dream.
It being statistical doesn’t make it useless. It not being some metaphysical concept of awareness doesn’t make it useless.
But the multimodal model support puts the lie to it being just a stochastic parrot of language. The domains it works in -is- more abstract than syntax and grammar even if it’s grounded in it. That’s part of the entire power of the model. In the end it leads to a predicted token but the path it takes is more subtle and complex than a simple Markov chain of tokens.
You said it was true on the surface, and I'm pointing out that it's true at its core. Your amazement at how well it works is based on our inability as humans to find the same patterns in the data as these models do. Ascribing some higher level sense of intelligence or understanding to these systems because of this party trick is anthropomorphizing what they actually are. We would all be better served by keeping in mind how they work, instead of being surprised when they do output the wrong pattern.
> Over time the errors and issues will be smoothed away until it’s still there but it’s not noticeable enough to be a major problem.
Why do you think this is guaranteed? We can keep throwing data and compute at these systems, and while we might continue to get better results, the current systems will never intuitively understand that e.g. 9.11 is lower than 9.2[1], unless those specific examples are in their training data. As we reach the limits of the data we can feed them, and we have to generate synthetic data, there's no reason to believe that the current approaches will ever fix these problems at their core.
> It being statistical doesn’t make it useless. It not being some metaphysical concept of awareness doesn’t make it useless.
I never said it was. I agree that this can be useful, but again, as long as we're aware of their limits. It's good keeping this in mind as we're reaching the peak of inflated expectations of the hype cycle.
[1]: https://towardsdatascience.com/9-11-or-9-9-which-one-is-high...
You might say that this is how humans learn and demonstrate intelligence, but it's not the same thing. We have the ability to advance our understanding of the universe without being explicitly trained on every topic. Until we can build systems that can do this, I wouldn't label them as intelligent.
But, again, this doesn't mean that they can't be useful.
[1]: https://towardsdatascience.com/9-11-or-9-9-which-one-is-high...
[2]: https://www.theguardian.com/technology/2024/mar/08/we-defini...
And, think there is question of 'bad data' so study is bad/invalid, versus studying impact of 'bad data' on responses is the result.
Don't think we can say, statistical systems can have incorrect results, hence we no longer need to study how statistical system produce incorrect results, because we already know they can have incorrect results.
</Sarcasm> Are we in 2024 and people are still just saying "duh its statistics, nothing to see here".