I do have around 450k papers from JSTOR (released legally via archive.org). I have these papers indexed and can expose them via openjournal.
Also, as I mentioned in my previous post, a few guys from Berkeley (Tony Chen et al) are work on peer library which will be a more complete non profit academic search engine.
Good points about the 'barrier'. I'm hoping people will contribute their own papers (even if they are no published).
My ultimate vision would be for people to write their papers within a git repo and then upload/submit their .tex source (along with unit tests). I'm in the process of building some of these features.
Also, experimenting with some ocr and pdf analysis to scrape as much useful contextual information as I can from the papers contributed (for the great benefit of our users)
Thanks for taking the time to respond, streptomycin!
PubMed would be another obvious datasource, if you were going to go that route.
> When I read papers, I often write short notes to myself about
> them, as I imagine most people do.
I picked up a strange habit because of a high school biology teacher.. the vast majority of homework that he assigned was inevitably content creation based on source material. As a consequence, when I read papers now, I compulsively:* re-draw diagrams in different styles
* make tables for data that wasn't presented as a table
* categorize which claims are associated with which citations
* make lists, lots of lists! You can never have enough lists. Gunkel said so: http://ideonomy.mit.edu/gunkel.html
* change the way information is displayed
* demonstrate equations, or at least attempt to work through them
* make up summaries of content
* paste direct excerpts.. which over time deteriorate in usefulness.
So far, every "annotation solution" I have tried just impedes my work, so I always resort to using some HTTP file server to host my files, or write HTML when I want to add markup to my notes.
Do you use a library management tool like Zotero or Mendeley for notetaking, or writing on printouts, or something else?
http://www.researchblogging.org/ is a great website that aggregates more long-form posts about papers, but it has a really shitty UI and it doesn't do anything for short comments on random papers by random non-bloggers.
How do you overcome that barrier? It's not even network effects alone, it's like extreme network effects because the tail is so long in science. I guess it's really the barrier between being high-level discussion about only the latest big-name science news in certain fields, and being a central hub for all kinds of relatively short comments on scientific papers. Seems like a difficult problem to solve.
Have you thought about maybe pre-populating your database with all papers, ready for discussion, rather than having it as a Reddit-like discussion of only recently submitted things? Or is there some other kind of grand vision for where this will go?