News for hackers. Stuff that matters.
Re:Past Performance is Not Indicative of Future Results (2020) by version_five on Saturday July 31, 2021 @06:05PM (#28021926)
So you took an undergrad ML course and you're using this as the basis for your conclusions about how ML can scale? You understand modern neural networks as large matrix operations and then attack that idea leading to intelligence as a joke?

I also find it improbable that intelligence will emerge from modern ML without some major leap. But you have added nothing to the discussion, beyond some impressions from undergrad, when we are talking about something that is a very active and evolving research area. It's insulting to researchers and practitioners who have devoted years to studying ML to just dismiss broad areas of applicability because you took a course once.

Re:Past Performance is Not Indicative of Future Results (2020) by skohan on Saturday July 31, 2021 @06:14PM (#28021976)
I'm sorry, I don't mean to insult or offend anyone. I'm just recounting my observations based on my understanding of the subject - and that is really not to disparage the amazing work that's being done, but rather to highlight the scale of the problem you have to solve when you're talking about creating something similar to human intelligence. It's entirely possible I'm wrong about this, and I would love to be proven so.

Do you disagree substantively with anything I have said, or do you just think I could have phrased it better?

Re:Past Performance is Not Indicative of Future Results (2020) by version_five on Saturday July 31, 2021 @06:35PM (#28022086)
Thanks for your reply. I suppose a quick way to summarize my criticism is that it reads to me like you've dismissed the strengths of ML on technical grounds, while you imply you don't have any real technical experience in the field. You make a superficial comparison between the compexity of biology and ML, without providing any real insight, just saying one has lots going on and the other is matrix multiplication.

If your conclusion is that current gradient based methods probably won't scale up to AGI, you're probably right. But if you want to get involved in the discussion of why this is true, what ML actually can and can't do, etc. I would encourage you to learn more about the subject and the current research areas, and draw on that for your discussion points.

Otherwise, it comes across as "I once saw a podcast that said..." type stuff that is hard to take seriously.

No doubt I come across as condescending, please take what I say with the usual weight you'd assign to the views of a random guy on the internet :)

Re:Past Performance is Not Indicative of Future Results (2020) by kortilla on Saturday July 31, 2021 @08:30PM (#28022663)
You don’t have to be an expert in a field to recognize that the current popular approaches to something aren’t even close to getting there.
Re:Past Performance is Not Indicative of Future Results (2020) by Nevermark on Saturday July 31, 2021 @10:46PM (#28023399)
Actually you do have to be an expert to make sweeping statements with any credibility in a young field making advances every day. Huge ones and surprising ones every year.

If you can’t characterize the technical problem that creates a limitation then you are just expressing an uninformed opinion.

Even if you were an expert!

Re:Past Performance is Not Indicative of Future Results (2020) by cycomanic on Sunday August 01, 2021 @03:55AM (#28024614)
Not to get into the rest of the discussion, but I disagree with the classification of ML as a young field. AI is an established field and I would argue that nothing in modern ML is _fundamentally_ so different that it would justify classifying it as a new field.
Re:Past Performance is Not Indicative of Future Results (2020) by Jetrel on Sunday August 01, 2021 @08:48AM (#28025902)
Yeah, it's almost as old as computing - likely 60-70 years old. The thing about it is we had the blueprints for a lot of stuff like neural networks almost at the dawn of computing, but it took almost half a century for us to even begin to try out some of the ideas, because the computing hardware wasn't even close - it would have been like trying to build a CPU out of vacuum tubes.

Once we finally had the tools to even start trying, in the late 80s/early 90s, it took us a very long time to "calibrate" these general ideas and figure out the "devils in the details" that were necessary to make certain ideas viable (for example, neural networks were discarded as a dead end in the 80s, and only considerably later were we able to discover that multi-layer networks essentially "salvaged" the idea).

Machine learning without the era of "modern computers" was a bit like flight before we'd really mastered the internal combustion engine - we understood quite a bit about it, and had theories about a lot of stuff (like the basic shape of a wing), and could successfully build gliders and such. Contrary to a lot of propaganda, the Wright Brothers didn't just arrive in the world like "lightning from a clear sky", but ... it had to become practical to do for us to then move on to putting the ideas through the paces, and all of the established theory from beforehand ran into the usual treatment of "no plan of battle survives contact with the enemy".

Re:Past Performance is Not Indicative of Future Results (2020) by Nevermark on Monday August 02, 2021 @05:23PM (#28042856)
In terms of its origins, and the core algorithms, I agree neural networks have many decades on them.

However until the hardware and software support for mainstream massively parallel execution became available it was a niche tool.

So the level of adoption, experimentation, deployment and research resources available are multiple orders of magnitude greater than 20 or 30 years ago.

As a practitioner (for my entire career) the field still operates as a new field, with enormous areas for new experimentation and interesting new creative advances happening quickly.

So we are still at the beginning.

Re:Past Performance is Not Indicative of Future Results (2020) by version_five on Saturday July 31, 2021 @08:39PM (#28022717)
Thanks for your insight!