News for hackers. Stuff that matters.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by lcvw on Sunday September 05, 2021 @01:38AM (#28421885)
I really hope sci-hub survives this. Sci-hub and libgen are like an entirely different internet, one allowing you to dive as deep as you wish into any technical subject. There’s really no comparison I have found anywhere for the depth of material available. People always point to Wikipedia, but all of that is surface level. If you to build something, research something, or just really delve into it, there’s no substitute for having access to all of the latest textbooks, manuals, and papers. I’ve never found any source paid or otherwise that comes even close.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by KNrDajfZ on Sunday September 05, 2021 @10:07AM (#28424445)
It's the typical Eastern European (or non-US centric) Internet. The IP laws make sense only if people have the capital to buy stuff. When I was a kid in a post-Soviet country, no one ever bought anything original (like a CD with a game). Everything was bootleg or pirated from the Internet.

After [the US lobby started to push for copyright enforcement in the EU under the threat of sanctions](https://falkvinge.net/2011/09/05/cable-reveals-extent-of-lap...), things have changed. The copyright and IP laws that US lobbies push to the world are killing the idea of free Internet and only benefit large corporations that are untouchable.

Elsevier is Dutch-based and they are fierce in suing everyone who tries to get away with getting free papers that were paid for by the taxpayers.

The "free" Internet doesn't exist anymore, but it's good to have places like Russia where the IP law is not strictly enforced, because everything is broken so no one cares.

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by Griffinsauce on Monday September 06, 2021 @01:59AM (#28430826)
> that were paid for by the taxpayers

What do taxpayers have to do with it? I thought it was just a for-profit company?

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by kanche on Monday September 06, 2021 @04:23AM (#28431600)
The content i.e. research papers they publish are mostly from government funded research. Taxpayers fund those but don't get access: we have to buy the results from these for-profit corporations.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by ehvatum on Sunday September 05, 2021 @03:09AM (#28422172)
Yes, it’s a new and better world. On the other side of the $275 per-paper Elsevier paywall, there are researchers who wish more people would read their papers. In my experience digging into robotics kinematics, authors are happy to answer questions and can point me to the right person when I want to send a check to support investigating specific research questions. The paywall deceives; science is neither an institution nor a copyright. It’s people. You can talk to them. You can learn from them and they can learn from you. When you apply their research, they often want to know about it! They might even discuss your application, in future papers. You don’t have to be Siemens or Big University Labs. The situation with for-profit journal publishers is diseased. Who the hell do they think they are? Elsevier should be dead, and Aaron Swartz should be alive.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by BeFlatXIII on Sunday September 05, 2021 @03:21PM (#28426959)
Most authors of scientific papers will gladly send you a free PDF of their papers if you ask them (assuming they remember to check their e-mail and respond in the first place). The profitability of their publisher is of no concern to them.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by Sakos on Sunday September 05, 2021 @10:44PM (#28429726)
This is a solution that doesn't scale for authors or readers. You'll just end up building another sci-hub.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by romwell on Monday September 06, 2021 @02:40PM (#28436666)
That's the point: that the authors also support sci-hub, because it's simply doing what they would do themselves, at scale.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by zekrioca on Sunday September 05, 2021 @07:56PM (#28428918)
Sometimes, it takes days for some authors to reply. When you do research, it is a bit like going deeper and deeper in citations. Sci-hub fix this, specially to universities in developing countries.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by TaylorAlexander on Sunday September 05, 2021 @06:50AM (#28423209)
I have been pleased that The Journal of Field Robotics is well represented on scihub. I have an open source off road robot I am designing and the journal is literally about robots out in fields and stuff. I am a "serious hobbyist" in that I believe my open source contributions to be at least somewhat helpful to others, but it's not the kind of thing that would justify paying for paywalled papers. I just want to glance over the material and keep track of what researchers are up to. Libgen is to me a vision of a world without copyright and intellectual property restrictions and I think it's a much better world than ours.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by tonyarkles on Sunday September 05, 2021 @10:21AM (#28424553)
Wow! The content in JFR is fantastic! Thank you for the pointer!
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by TaylorAlexander on Sunday September 05, 2021 @03:31PM (#28427063)
So glad it was helpful!
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by londons_explore on Sunday September 05, 2021 @02:32AM (#28422035)
I really wish someone could build a better UI for this research internet.

Hyperlinks for all references would be a good start. Finding some way to make some automatic glossary of definitions of technical terms would make scientific papers substantially more accessible too.

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by sleepingsoul on Sunday September 05, 2021 @09:40AM (#28424276)
Have you come across scite (https://scite.ai) yet? We're also innovating in this space by extracting citation statements from full-text articles and classifying their intent.

So let's say paper A cites paper B. If you look at paper B, we show you:

- how many times it was cited

- the direct paragraphs from paper A where it was cited

- the sections from paper A where paper B was referenced

- ... and a lot more

You can also now search these citation statements directly to find evidence-based information pretty quickly.

- Short video to showcase that search: https://www.youtube.com/watch?v=JYjCn-4uMJk

- Website with a bit more details: https://citation.to/

You can also visualize citation networks similar to ConnectedPapers, set notifications for new citations on groups of papers you're interested in, and much more.

(Disclaimer -- I work here!)

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by KNrDajfZ on Sunday September 05, 2021 @10:12AM (#28424478)
No one cares. This thread is about free access to papers and not another paid service that forces you to pay monthly fees for something that could be a free service. In that sense you aren't any better than large online publishers. 8 bucks a month for a scientific paper search engine? Really?
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by ComputerGuru on Sunday September 05, 2021 @10:49AM (#28424738)
I vouched for your comment because you have a very valid point, but you could be more polite in making it. Welcome to HN.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by KNrDajfZ on Sunday September 05, 2021 @10:58AM (#28424809)
Thanks. I am really cranky today. I'll do better next time.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by sleepingsoul on Sunday September 05, 2021 @02:46PM (#28426658)
Hiya,

Well, I definitely agree with your sentiment in a normative sense that scientific papers should be free and readily accessible to all -- in part because a lot of it is funded through tax dollars!

But given the current state of affairs, we're looking at making that information accessible to people without having to pay exorbitant fees to access individual research. We also offer steep discounts for students or anyone in academia.

With that in mind I would push back a little that we're just a scientific paper search engine -- our system does a lot of work in extracting and classifying those citation statements, which makes it more powerful than traditional scientific search engines.

And besides just using our search, a huge time-saving value of our service is the report pages which helps you quickly build a qualitative understanding of how something was cited.

Even if all scientific papers were freely accessible, our report pages allow you to see the direct, relevant snippets from citing papers without having to manually read each and every single one. I think that is quite valuable!

I know I've gone on a little tangent from the original discussion about scihub, and having free and open access to papers, but I did just want to throw that in because I think it's an important distinction. And as much as we all want that free and open world to exist, I think it's also interesting to think about how we can open up that information for people in the interim.

Best,

Ashish

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by abcc8 on Sunday September 05, 2021 @05:32PM (#28428011)
The site sounds interesting, but signing up just to evaluate the results of my first query is a no-go for me.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by geokon on Sunday September 05, 2021 @04:50AM (#28422595)
One thing I've recently discovered is this website: connectedpapers.com/

It builds a graph of referenced papers and makes it easier to narrow down which one are important/foundational for further research

I don't think a glossary would help. What you need to find is a "review paper". These act as a primer to the field for new researchers. They're usually well written, with less jargon and have tons of references for you to dig into. That said, I don't have a good method for finding them.. I just stumble across them haphazardly..

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by stevesimmons on Sunday September 05, 2021 @05:29AM (#28422758)
https://www.semanticscholar.org/ is very good too for reading paper abstracts, links to the references, citations and related papers. The full papers are included, if copyright allows.

The references and citations are tagged and filterable, making it easy to see which are the most cited, or review papers, etc.

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by elcritch on Sunday September 05, 2021 @02:54AM (#28422118)
DOI URIs work great and sci-hub understands them. Figuring out the DOI from the citations section is a bit more annoying still. A meta glossary would be fantastic. 80% of learning a new field is figuring out the jargon.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by goodmachine on Sunday September 05, 2021 @05:25AM (#28422743)
> A meta glossary would be fantastic. 80% of learning a new field is figuring out the jargon.

True!

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by IshKebab on Sunday September 05, 2021 @03:25AM (#28422242)
Yeah it's called Web of Science. It's very good but it's not free unfortunately. And it doesn't go as far as hyperlinking references in PDFs or defining terms. I agree those would be great, but unfortunately there's not much incentive for paper authors to do that.

https://en.wikipedia.org/wiki/Web_of_Science

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by Al-Khwarizmi on Sunday September 05, 2021 @05:36AM (#28422793)
Hyperlinking references in PDFs is trivial for authors if they use LaTeX and the journal/conference template supports it. It's just a matter of ensuring that the bibtex entry has an URL or a DOI, and most bibtex entries copied and pasted from curated sources already have them.

If you are finding many papers without hyperlinked references, it's probably just because they're published in journals whose templates don't support it. In my particular research field, most publication venues' templates starting supporting those links around 3-4 years ago, so my papers from, say, 2015 have no hyperlinks in references, while those from 2019 do. This didn't require any significant extra effort on my part, in fact in general it requires less because well-curated bibtex entries are easier to come by now than some years ago.

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by IshKebab on Sunday September 05, 2021 @09:14AM (#28424106)
It's not adding the links that is hard. It's choosing the destination URL. Where do you link to? I guess you could link to doi.org. Probably better than nothing but still not ideal because it doesn't actually take you to the PDF.

Can you show an example paper with links?

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by foobarbecue on Sunday September 05, 2021 @10:05AM (#28424431)
DOI is the correct thing to link to because the author or publisher has chosen this as their canonical URL for the object. The DOI could and sometimes does point to the pdf, it's just conventional to point to an html version of the paper. It would make a lot of sense to me to standardize a field in the DOI metadata containing the PDF URL. (source: I manage the DataCite membership of a large organization)
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by jltsiren on Sunday September 05, 2021 @11:41AM (#28425148)
Linking directly to the PDF is usually the wrong choice. When you find a new paper, you often want to get the citation metadata, which the PDF document rarely contains in a convenient form. There are often multiple versions of the same paper, and you may want to determine which version you managed to find. Is it a preprint, the final authors' version, the published journal paper, an early version published in conference proceedings, or an unpublished extended version of the paper?
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by ZeroGravitas on Sunday September 05, 2021 @10:13AM (#28424495)
Some of the background data for this is being collected by wikiCite (https://meta.wikimedia.org/wiki/WikiCite) and Scholia https://scholia.toolforge.org/ projects

Part of this involves turning text data of authors into linked data that used to navigate between texts: https://author-disambiguator.toolforge.org/

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by beckman466 on Sunday September 05, 2021 @06:29AM (#28423080)
Have you heard of Alexandra Freeman's Octopus? https://www.science.org/careers/2018/11/meet-octopus-new-vis...

Edit for direct link to Octopus: https://science-octopus.org

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by generalizations on Sunday September 05, 2021 @11:25AM (#28425020)
Seems like a large part of what's needed is just being able to make the pdfs machine-readable, by making decent plain-text versions of the text content. Right now, IIRC, there's no hands-off way to get the text of a pdf. Especially if there's weirdness like multiple-columns (sometimes happens with this stuff).
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by zapataband1 on Sunday September 05, 2021 @11:45AM (#28425183)
Like you said the hard parts are the unstructured data/images/tables. There are pretty-good(80% of the way there) solutions tho. But nothing that could handle millions of paper without error
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by zapataband1 on Sunday September 05, 2021 @11:44AM (#28425176)
Currently working in this field and this is actually the cutting-edge(!!) but it will be 100% possible/robust within the next year or so I believe. Really cool ML techniques being used for htis.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by sleepingsoul on Sunday September 05, 2021 @02:48PM (#28426677)
How well does it work with old OCR'd PDFs? :)
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by generalizations on Sunday September 05, 2021 @10:33PM (#28429681)
I had no idea. Is there anything that's open source, or is it all still being kept proprietary?
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by jpeloquin on Sunday September 05, 2021 @03:56PM (#28427240)
It wouldn't take much to significantly improve things. We don't even have full-text search for paywalled articles. The paid search engines like Web of Science just do title, keywords, and abstract. Even considering the subset of open access articles, Google Scholar and Semantic Scholar do ok but don't offer much in the way of search refinement (e.g., "DTAF" NEAR "collagen"). They're good at finding _something_ related to your query but not good for systematic review.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by TheSpiceIsLife on Sunday September 05, 2021 @03:36AM (#28422284)
What about a Netflix but for science information.

Pay $15 a month for access to a rolling catalogue of science info.

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by mimsee on Sunday September 05, 2021 @04:38AM (#28422540)
Then download everything possible with a small script and the FBI will hunt you down. For those who don’t know, I’m referring to Aaron Swarzt
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by crest on Sunday September 05, 2021 @04:59AM (#28422631)
And the DA will hound you till you drop dead to get re-elected.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by curiousgal on Sunday September 05, 2021 @05:32AM (#28422771)
It's always amusing to see how much people take for granted. $15 is a lot of money for most people. Not to mention that not everyone has access to internation bank accounts.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by smnrchrds on Sunday September 05, 2021 @08:27AM (#28423822)
I think the comment makes fun of the fact that content gets removed from Netflix all the time, so it is not very useful as a reference.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by jules on Sunday September 05, 2021 @04:36AM (#28422528)
Why? The authors write the papers for free, the peer review is done by other scientists for free. Why should this "netflix for science" get to reap the profits by locking it behind a paywall? The reason why predatory publishers still exist is a coordination problem. The journals have prestige built up historically, and the scientists need to publish in prestigious journals for their career. It's a chicken and egg problem.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by faeyanpiraat on Sunday September 05, 2021 @05:52AM (#28422868)
I'm not sure about how fair the whole system is, but if we assume the papers should be free, then a service where the papers are available is still reasonable to have a small fee.

Someone needs to rent and service the servers, update the software, bandwidth costs money, etc..

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by MrManatee on Sunday September 05, 2021 @08:18AM (#28423751)
There's a lot of information, data, and software out there that is available to download for free. Yes there are hosting costs, but there are also people and organizations that are willing to pay them because they believe that it's worth it.

I'm absolutely convinced that if copyrights weren't an issue, there would be enough governments, foundations, universities, corporations, and individuals willing to pay the costs of making scientific publications available to everyone. It wouldn't have to be a paid service.

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by sellyme on Sunday September 05, 2021 @09:50PM (#28429479)
> Someone needs to rent and service the servers, update the software, bandwidth costs money, etc..

Scientific papers use approximately zero bandwidth.

As a point of reference, if I hosted such a website on my home internet connection I would be paying approximately 0.00013 cents per upload. Even users downloading millions of papers would cost me less than a coffee.

Setting up and managing a proportionate payment system would cost more than just eating the bandwidth costs would.

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by qmmmur on Sunday September 05, 2021 @04:52AM (#28422602)
And the papers are often funded by public money.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by dmos62 on Sunday September 05, 2021 @05:33AM (#28422778)
A related cause is to have publicly funded software be published open-source. Check out the FSFE Public Code campaign https://publiccode.eu/.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by GeckoEidechse on Sunday September 05, 2021 @05:01AM (#28422644)
I'm glad initiatives like [Plan S](https://en.m.wikipedia.org/wiki/Plan_S) exist ^^
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by mynameismon on Sunday September 05, 2021 @05:43AM (#28422831)
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by tchalla on Sunday September 05, 2021 @05:17AM (#28422706)
How much does it cost for an author to publish in a Nature or Science journal under Plan S?
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by rsfern on Sunday September 05, 2021 @07:25AM (#28423413)
I don’t know specifically about for Plan S, but most open access fees are in the 3-5k range per article
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by lcvw on Sunday September 05, 2021 @09:49AM (#28424331)
Libraries can get you a physical copy of pretty much any paper or book for completely free. But somehow getting a digital copy is not on the table? It’s just insane, I would happily pay for a service that did this even if it included drm or something. The journals would never go for it though because they live off of the insane rates research institutions pay to subscribe.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by sleepingsoul on Sunday September 05, 2021 @09:42AM (#28424291)
You can more or less do this with scite's Citation Statement Search[1,2], or by setting email notifications when we detect new citation statements to one or more papers (grouped by a topic you're interested in like a disease or drug, an author, or more)[3].

Quick video of our citation statement search to give you a glimpse: https://www.youtube.com/watch?v=JYjCn-4uMJk

[1] https://scite.ai

[2] https://citation.to

[3] https://help.scite.ai/en-us/article/how-can-i-set-alerts-on-...

(Disclaimer -- I work at scite!)

Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by shkkmo on Sunday September 05, 2021 @11:06AM (#28424881)
This self promotion seems off topic and unrelated to the person you are replying to.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by Sakos on Sunday September 05, 2021 @10:46PM (#28429736)
The research was already paid for by us. Make it free as it should be.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by zapataband1 on Sunday September 05, 2021 @11:42AM (#28425158)
That's the best part about a good idea once it's out there! It's hard to kill. Really wish we had come up with an alternative to 20 streaming sites...
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by codewithcheese on Sunday September 05, 2021 @11:44AM (#28425175)
There is. Torrents. The UX can be amazing if you know how, but we dont want spoil the party by sharing.
Re:Today Sci-Hub is 10 years old. I'll publish 2M new articl... by rapnie on Sunday September 05, 2021 @12:50PM (#28425679)
PeerTube at https://joinpeertube.org/ or Owncast at https://owncast.online/

Both support live streams, and are (being) federated and ever more integrated with other Fediverse apps.