News for hackers. Stuff that matters.
Re:The End of AI Frontiers by eli_gottlieb on Saturday November 07, 2026 @07:46PM (#50409489)
> Another dumb question: can the model be smarter than the data?

There's a mathematical sense in which it cannot be: the data-processing inequality (https://en.wikipedia.org/wiki/Data_processing_inequality). The extent to which that sense is totally counterintuitive to how things normally work in ML nowadays has led to investigating different foundations for information theory: https://arxiv.org/abs/2601.03220.

Re:The End of AI Frontiers by incrudible on Sunday November 08, 2026 @04:51AM (#50411805)
Data isn't "smart", it doesn't contain intelligence. I would argue that LLMs are functionally intelligent, they have learned to what functionally amounts to thinking by training on text (and images, in some cases). They are capable of performing experiments autonomously and make decisions based on out-of-distribution data. Besides (current) lack of online learning, they are limited by their biases and working memory - but so are humans, and I'd like to see a convincing argument on why these mathematical laws should not also apply to humans, which are arguably intelligent.