My feeling is that while the US is phenomenally good at delivering an excellent education to a small set of extremely talented people, I get the feeling that these people go on to not have enough free time to do really interesting work, and rather end up devoting their lives to industry, which is predominantly very conservative[1].
[1]: Obviously, I think this is offset by the fact that US industry is less conservative and more interested in abstract research than it is in most other countries, so you do get really cool research being done. But I think generally speaking, this model isn't as effective as just letting most people in society do more of the stuff that interests them, and less of the stuff that doesn't.
And if you actually had to choose between "top talent" and "mainstream appeal" the latter has orders of magnitude better returns. A larger part of the modern economy is built on that fact, including much of Silicon Valley.
If you could just invest in talent many countries would pass the US in no time. But unsurprisingly those investments mostly yield handshakes and cocktail parties.
I don't think mainstream appeal is irrelevant. I just think that if you fund scientists and technologists to do the work they find interesting, they'll produce something more fundamentally interesting and generally useful than if you fund them to make great products. Great products, after all, include things like Minecraft, pet rocks, and fidget spinners.
I get the feeling that these people go on to enjoy the benefits of their education but then fail to return a suitable dividend to the rest of society.
If the TUM (Technical University of Munich) would have been sucessfull in retaining the top talents they developed, they would count Schmidhuber, Hochreiter, Schaal, etc. to their faculty and be competitive with top institutions. But they didn't and it's a symptom of a larger lack of investment. My university (KIT) also developed some pretty sucessfull researchers in "AI", but they left (for example to Carnegie Mellon, where there's a lot cooperation, especially in machine learning). Prof. Alex Waibel made a pretty important contribution to ConvNets, one could argue they developed out of his time-delay NNs. But, although he's still a Prof at KIT, he's not really that present in karlsruhe.
Just compare the total numbers of papers on NeurIPS of germany to other countries. We are getting obliterated.
I still think that a "reasonably" distributed approach is best for germany (and probably for finnland), but we have to get our shit together! I don't think this is due to our more distributed approach.
It's all pretty frustrating, i think there's a lot of wasted potential here.
However, if I grant that there is a lot of low-hanging fruit out there in the economy that can be attacked with already-existing approaches, then the Finnish approach makes sense to me.
Having a bunch of people who understand statistics, basic machine learning algorithms, and have learned the discipline/soft skills to use them successfully (cross-validate, don't overfit, etc.) might result in a lot of interesting problems being solved.
Moreover, theoretical research in AI is very open and countries with limited resources are better off stand on the shoulders of giants than try and be number 1 themselves. Finland might never beat Russia/China/US AI arms race but they just need to defend themselves should any of these 3 countries monopolize or weaponize on AI.
Unlike the majority of our sciences, ML tech disperses extremely quickly. Software being software. Patents aside, there's nothing that machine learning research is going to give as an advantage nationally other than a couple years of warning that something is coming. On the other hand, if more software devs understood the basics of statistics and ML they'd be able to apply the tech into specialized domains.
The same thing is happening with ML that happened with web dev. Abstracting over the annoying stuff allows developers to attack the problem at the conceptual level. But you can't think conceptually without understanding thing from first principles. For example, I expect developers to understand the definition of accuracy and why maximizing it usually isn't useful.
ML/AI research can continue, but its application and implementation needs to be democratized. Everyone in CS should know ML - it is a tool just like learning algorithms.
Why would you condone not learning a tool that an engineer would use?
I completely and utterly disagree.
2. Where did I not condone? I made an observation what I think leads to better outcomes. I said both is desirable but culturally only one thing seems to happen.
Before you angrily accuse me of "Delusional gatekeeping", maybe re-read (or maybe for the first time read) both the article and my comment.
Your confrontational tone does not help the discussion and is not in the spirit of hackernews to assume the best intentions.
This is honestly what I see when I read your parent comment. If you're offended by it, then may be you can balance your argument so it doesn't appear to be gate-keeping elitism. In fact, you've admitted it is controversial!
I think one could also imagine a world where there will be a cannibalization/consolidation on the lower end of the market because of the democratization (which I am not saying is bad or good because I am not sure about the effects ML has on people and democracies, but that is another discussion).
Rather, I observe that nobody today would hire someone to (in essence) build numpy functionality. Yet there are a lot of jobs in ML/AI currently which amount to building things that will be commoditized within years (and be used by everyone like numpy today). So in my opinion learning AI basics will not necessarily lead to more AI jobs or startups because these basic features are commoditized via big tech open source.
Second, on applications:
My research is actually in the applied domain and that's where my argument mostly stems from. Doing novel, valuable applications in AI requires concentrated resources and expertise. For example, if you think about self-driving cars as an extremely high-value application, they require highly specialized domain expertise in various domains and machine learning combined with massive compute resources.
Simple applications (e.g. applying basic machine learning tools to common workflows and processes) are prone to undergo commoditization precisely because they are obvious. So I do not think the gatekeeping argument holds because there is no way around obtaining deep and wide expertise to generate valuable application IP.
So for a country wanting to focus on applications, I still think there is a good argument that concentrating resources is a more successful approach.
Yes, Simple ML will be a commodity. Like Arduino, Ruby-on-Rails, WordPress, etc.
But in the right hands, having such tools years before the competition, could be a great thing, one that could lead to real competitive advantages.
For example, in Israel ~15% think about starting a business. That's not that far from the whole population.
So if you offered them the right education, and they played with the tools, maybe it would lead to new businesses.
And in the end, it's impossible to tell who will come with that great idea.
The worst move would be to do what the US is doing:
- nationalist xenophobia turning off expats from emigrating
- exacerbating massive inequality disparity/impoverishing it with people living on highway on-ramp embankment worse than S. American favelas (i.e., go to the Bay Area, drive around.. 'nuf said)
- ban the export of new technology with arms controls, killing industries and making a country radioactive to invest/do business in
- make it extraordinarily difficult for moderately wealthy entrepreneurs to work in a country for even a limited time because their passport isn't from one of a dozen or so favored countries
- ban everyone entirely, regardless of their background or achievements, if they happen to have been born in another set of countries
- double-down on fossil fuels, end clean energy tax credits
To me, the best things from Finland are Linus Torvalds, Jarkko Oikarinen and The Hydraulic Press Channel. There's probably others but the wikipedia page for famous Finns was too long.
Well roundedness (or teaching basic elements to many) will not pay off as much, it would likely yield better results for the country to invest heavily at the top.
Observation based on success of machine learning research in highly concentrated organisations (certain universities in the US, DeepMind, etc) versus countries with scattered expertise and resources (e.g. Germany).
If you can afford to, do both, but observationally, this does not seem to happen. Not for a lack of resources but rather the mindset and a society's perspective.