Re:China overtakes US in AI research
by 908B64B197 on Wednesday August 11, 2021 @08:45PM
(#28150240)
Here's the thing: Nobody at any top 50 AI lab reads Chinese papers. Academic fraud, machine-translations and citation rings make the signal to noise ratio to low to bother.
Re:China overtakes US in AI research
by ilamont on Wednesday August 11, 2021 @08:39PM
(#28150184)
The article brings up a number of good points about advances in research from China, but the article also says:
In 2020, China topped the U.S. for the first time in terms of the number of times an academic article on AI is cited by others
Via Nature:
In China, one of the main indicators currently used to evaluate researchers, allocate funding and rank institutions is metrics collected by the Science Citation Index (SCI), a database of articles and citation records for more than 9,000 journals. Since 2009, articles in these journals written by authors from Chinese institutions increased from some 120,000 a year to 450,000 in 2019. Some institutions even pay researchers bonuses for publishing in them.
These practices have incentivized researchers to publish lots of papers at the expense of quality, says Jin Xuan, a chemical engineer at Loughborough University, UK. Evidence suggests that the focus on metrics has also driven a rise in inappropriate practices, such as researchers submitting plagiarized or fraudulent papers, or inappropriately citing their own or a colleague’s work to boost citations.
Re:China overtakes US in AI research
by FuckButtons on Wednesday August 11, 2021 @10:01PM
(#28150768)
Godharts law in action. I think the problem is less that the metric is insufficiently tolerant of being gamed, as it is the research institutions are not sufficiently policing the researchers.
related: https://news.ycombinator.com/item?id=28107614
In 2020, China topped the U.S. for the first time in terms of the number of times an academic article on AI is cited by others
Via Nature:
In China, one of the main indicators currently used to evaluate researchers, allocate funding and rank institutions is metrics collected by the Science Citation Index (SCI), a database of articles and citation records for more than 9,000 journals. Since 2009, articles in these journals written by authors from Chinese institutions increased from some 120,000 a year to 450,000 in 2019. Some institutions even pay researchers bonuses for publishing in them.
These practices have incentivized researchers to publish lots of papers at the expense of quality, says Jin Xuan, a chemical engineer at Loughborough University, UK. Evidence suggests that the focus on metrics has also driven a rise in inappropriate practices, such as researchers submitting plagiarized or fraudulent papers, or inappropriately citing their own or a colleague’s work to boost citations.
https://www.nature.com/articles/d41586-020-00574-8#ref-CR1
Is there some other objective measure of progress in any type of research that can be used to make such comparisons?