News for hackers. Stuff that matters.
Re:2022 Letter by hiddencost on Friday December 30, 2022 @04:27PM (#34190304)
One really exciting place things might improve is in data cleaning. Right now preprocessing your data and putting it in a format that can be learned efficiently and without bias is a huge pain // risk. This next generation is allowing us to largely ignore a lot of that work.

Similarly, transfer learning is finally good.

And the models are generalist, few shot learners.

As a consequence, individuals with minimal expertise can set up a world class system to solve niche problems. That's really exciting and it's going to get easier.

Re:2022 Letter by hiddencost on Friday December 30, 2022 @04:29PM (#34190330)
Cross-language learning (what was referred to as an "interlingua" in the 90s) means we're seeing some stunning advances in low resource languages. It used to be that everyone ignored languages other than English, and then provides them with mediocre support.

I think we're at a point where there's very little excuse not to launch in many languages at once.