Re:U.S. Energy Department to make researchers' papers free
by sitkack on Tuesday August 05, 2014 @12:23PM
(#8137717)
I have been meaning to setup an arxiv mirror (they have instructions on how to do this) and then run all the papers through elastic search.
I'd love to run NN on the abstracts or similarity algos on the equations. It would be fun to do SIFT on the equations an then some deep learning to detect branches of mathematics. Or extract molecular symbols in figures.
12 months is a joke in the timescale of scientific research, most papers already went through up to a year of prep time before publishing. I would like to see a plan that isn't just paying lip service to the ideals of open-access. And Eisen is right about data mining, most journals are terrible in that regard. Even the wonderful arXiv.org doesn't provide citation/reference metadata in their API and they are a groundbreaking leader of the movement. I had to write a scraper to map out an arXiv citation network and there are only a few subfields with enough info to do that. Maybe scientists would make more requests if the APIs were better and the citation information wasn’t copyrighted or obfuscated.