News for hackers. Stuff that matters.
Re:Ask HN: How to get back into AI? by cweill on Saturday December 10, 2022 @02:05PM (#33935668)
I disagree with this comment, and anyone reading it should take it with a big grain of salt. Let's go back to 2016 and replace "LLM" with "Reinforcement Learning". Everyone thought every problem could be solve by RL because it's a looser restriction on the problem space. But then RL failed to deliver real world benefits beyond some very specific circumstances (well defined games), and supervised learning is/was still king for 99% of problems.

Yes, LLMs are amazing but they won't be winning every single Kaggle competition, displacing every other ML algorithms in every setting.

Re:Ask HN: How to get back into AI? by PartiallyTyped on Saturday December 10, 2022 @02:13PM (#33935755)
Sure enough LLMs are not going to win every kaggle competition. But... I am fairly certain that transformers may. Embed all categorical values, scale continuous features by embeddings, and run it through a graph neural network, with high probability it will beat nearly everything.
Re:Ask HN: How to get back into AI? by janalsncm on Saturday December 10, 2022 @05:09PM (#33937425)
Transformers require a lot of data to converge. There’s a reason tree models are still king of kaggle even though transformers have been around for 5 years now.
Re:Ask HN: How to get back into AI? by flooo on Sunday December 11, 2022 @02:20AM (#33940976)
To me, the vast majority of people in the field seem to hold on to the idea that different technology suits different problems.

Also, are you aware that one of the most prominent AI tools of this month (ChatGPT) was obtained with RL!