News for hackers. Stuff that matters.
Re:Deep Learning Is Easy – Learn Something Harder by blind666 on Wednesday September 06, 2023 @06:02PM (#37412010)
It is interesting to look back and evaluate the preferences / intuitions prominent researchers had in the field (most of whom started their careers experimenting with MNIST-scale of data, at best)

With access to unfathomable amounts of data, especially over the last couple of years, the game changed entirely and is not seeming to cool down anytime soon.

The field, certainly, values engineering a lot more than it used to, and it is exciting to see how major advances together with open-source contributions are going to take us

Re:Deep Learning Is Easy – Learn Something Harder by visarga on Wednesday September 06, 2023 @06:37PM (#37412378)
We have been doing feature engineering, then we got into architecture engineering, and the future is dataset & prompt engineering. All models learn more or less the same, given the same training budget and dataset. But better data makes a better model.

Same for humans, the better the education and more advanced the science, the more we achieve with the same brains. So the main factor is what ideas exist in the training data for both humans and AI.

Re:Deep Learning Is Easy – Learn Something Harder by Ologn on Wednesday September 06, 2023 @06:57PM (#37412562)
> It is interesting to look back and evaluate the preferences / intuitions prominent researchers had in the field (most of whom started their careers experimenting with MNIST-scale of data, at best)

Look back to how HN greeted the victory of the SuperVision team (Alex Krizhevsky, Ilya Sutskever, Geoffrey Hinton) in the 2012 ImageNet Large Scale Visual Recognition Challenge - https://news.ycombinator.com/item?id=4611830