News for hackers. Stuff that matters.
Re:The DOI System by natch on Thursday November 18, 2021 @02:53AM (#29263137)
I’ve never understood this as anything other than an oddly secretive power and money grab by some entrenched stakeholders in publishing and document delivery.

They seem to have non-guessable, non-hierarchy-revealing URLs that must be resolved using a database they control.

It strikes me as a showcase of ways to try to get around web standards to make things locked down.

Last time I looked at this (with horror, not with interest), the fees to become a member or to register links were exorbitant and the system itself seemed to be geared around supporting payment and DRM scenarios while making promises to fix non-existing problems (or ones that could be fixed for free using well known standard web practices).

Re:The DOI System by krab on Thursday November 18, 2021 @03:17AM (#29263282)
> non-hierarchy-revealing URLs that must be resolved using a database they control

What do you mean? There is a journal prefix (Nature has 10.1038) and the link usually translates fairly directly to a URL for new articles.

EDIT: Just looked it up in the DOI rules. The registrant chooses the suffix. So the journals are free to maintain 1:1 mapping to URLs if they wish. I assume DOI is popular because people trust that the central entity might do a bit better job with regards to link rot than the journals themselves.

Re:The DOI System by afandian on Thursday November 18, 2021 @03:45AM (#29263433)
To take your point to the next step, how do two otherwise unrelated journals (of which there are tens of thousands) link between each other and solve link rot? Answer: shared open non profit metadata infrastructure.

Disclaimer - I’m at Crossref AMA.

Re:The DOI System by krab on Thursday November 18, 2021 @06:35AM (#29264332)
Theoretically, the journals could publish a canonical URL for each article. But apparently organizations are not good at publishing and maintaining such URLs. Especially in case of mergers and rebrandings.
Re:The DOI System by afandian on Thursday November 18, 2021 @07:55AM (#29264862)
That canonical URL is literally what the DOI system is. Publishers getting together to agree on a shared identifier system, regardless of each publisher's business model.
Re:The DOI System by natch on Thursday November 18, 2021 @03:37AM (#29263381)
Compare the readability and editability of:

nature.com/2021/11/17/news/

versus:

10.1038.123.366.345643

And you ask what I mean. What I mean is the first one is transparently better in several ways.

If I got the syntax wrong, just focus on the first part then, nature.com versus 10.1083. One is more readable than the other.

Re:The DOI System by krab on Thursday November 18, 2021 @06:31AM (#29264314)
Neither your URL nor your DOI resolves. I meant rather the correspondence of

    https://www.nature.com/articles/1771046b0

    to

    10.1038/1771046b0
or

    https://www.nature.com/articles/s41586-021-04114-w
    
    to
    
    10.1038/s41586-021-04114-w
Re:The DOI System by afandian on Thursday November 18, 2021 @07:58AM (#29264896)
Look at the metadata of those two articles.

    https://www.nature.com/articles/1771046b0
    has
    <meta name="dc.identifier" content="doi:10.1038/1771046b0"/>
and

    https://www.nature.com/articles/s41586-021-04114-w
    has
    <meta name="dc.identifier" content="doi:10.1038/s41586-021-04114-w"/>
Re:The DOI System by natch on Friday November 19, 2021 @11:42AM (#29279108)
They aren’t meant to resolve, but to show the difference between friendly and unfriendly ways to construct a URL (or URI if you prefer).

But yes that’s interesting and good to know that sometimes they can choose to use corresponding components in the URL versus DOI.

Re:The DOI System by zoomablemind on Thursday November 18, 2021 @10:10AM (#29266268)
>... Compare the readability and editability

Indeed, I was wondering why not to adopt an approach similar to a Git repo where each leaf (document) is identified with a ref hash.

It could be used with a publisher prefix to segment the hash-space.

Basically, it's a repository of metadata. Each publisher could equally host the whole repo, but extend only their corresponding sub-repo.

The central entity could then maintain the publisher's name-to-id convenience xref and some search facility.

Re:The DOI System by afiori on Thursday November 18, 2021 @08:05AM (#29264940)
> 10.1038/nature.com/2021/11/17/news/xxxxxxx

can be a valid DOI, 10.1038 has the same role as the nature.com domain but with a different governance

Re:The DOI System by afandian on Thursday November 18, 2021 @03:46AM (#29263440)
That’s why the display guidelines stipulate that DOIs are always expressed as URLs.
Re:The DOI System by natch on Thursday November 18, 2021 @03:51AM (#29263470)
Sure, but 10.1083 is still a shitty link compared to nature.com, independent of which url prefix is used.
Re:The DOI System by afandian on Thursday November 18, 2021 @04:15AM (#29263594)
There are different timescales involved.

The resolvability of a DOI is obviously important, and you have found a few examples where the steward of the content (ie publisher) hasn’t updated the links. But in that case DOIs can in theory be redirected to archived versions. That's the price you pay for a large, diverse community of publishers. Don't imagine that publishers would magically be any better at fixing their own websites.

But more broadly, as identifiers, having an agreed scheme helps link publications, datasets, other entities such as funders and institutions. It allows discovery of metadata in a way that’s discoverable by all.

Someone will want to follow those links in 100 years and whatever state DNS or WWW is in, the metadata will be in an open archive somewhere.

(I'm at Crossref, AMA)

Re:The DOI System by uptime on Thursday November 18, 2021 @08:57AM (#29265394)
Taking you up on your AMA, is there a best practice for discovering datasets belonging to articles and vice-versa? I see that Web of Science has a lot of this but they don't make that linkage explicitly available as an export. I have tried querying isSupplementTo and chasing cited works, and I don't expect a smoking gun.

Just now I tried searching Scholix via the web interface for IDs that are linked in Dryad, which is supposed to use the same linking system, and in either direction came up empty.

TIA for any clues!

Re:The DOI System by afandian on Thursday November 18, 2021 @11:09AM (#29267020)
Scholix[0] is a collaboration between a few orgs, including Crossref (DOI registration agency for scholarly content, e.g. articles) and DataCite (DOI registration agency for data sets).

If a DataCite member registers a data set, and mentions a link to a Crossref DOI, that's almost certainly a dataset-article link. Vice versa.

So the data in Scholix is the union of "what citations do article publishers and dataset publishers think exist".

We're working on improving how we process the data citation data, but ultimatley can't improve on what Publishers provide.

Sorry, a bit of a non-answer.

[0] https://www.scholix.org/

Re:The DOI System by austinjp on Friday November 19, 2021 @04:38AM (#29275413)
The https link doesn't work for me, working link: http://www.scholix.org/
Re:The DOI System by teorema on Thursday November 18, 2021 @04:51AM (#29263800)
Journals, even prominent ones, change names for all sorts of reasons. It doesn't happen often but it does happen. The meaningfulness issue can cut both ways.

I think the real problem is the centralized vs federated vs distributed nature of it. IPFS is a good example of how that could have looked; not sure if it could be moved into that space somehow (I'm sure it could in theory, but in practice?)

Re:The DOI System by kergonath on Thursday November 18, 2021 @05:51AM (#29264096)
Dois are not supposed to replace urls. They serve very different purposes. A doi is a unique identifier for a scientific article, that’s all it is.
Re:The DOI System by fsh on Thursday November 18, 2021 @08:06AM (#29264951)
The sole purpose of DOIs is that they never change. The moment Nature decides to update their CMS, the first link is going to 404.
Re:The DOI System by natch on Thursday November 18, 2021 @10:02AM (#29266170)
As is the second link, as many DOIs have.
Re:The DOI System by natch on Thursday November 18, 2021 @03:41AM (#29263411)
> I assume DOI is popular because people trust that the central entity might do a bit better job

First, I don’t know how popular it is.

Second, look at what an absolutely poor job the doi.org site themselves have done keeping their showcased example links from their demonstration document from breaking over the years. See my comment elsewhere here about what I found on archive.org. What am I missing here? It looks like their link rot is close to 100%.

Re:The DOI System by kergonath on Thursday November 18, 2021 @05:49AM (#29264082)
> First, I don’t know how popular it is.

Very. The doi is now the unique key to identify a scientific article.

Researchers like it because it is an easy way to get canonical metadata without having to go through Google Scholar or (dog forbid) something clunky like Science Direct. You just put the doi and bang, you’ve got the article. No issue with a typo in the volume number, or authors who can go by different names (or the same name written differently), or anything like that. It has make managing bibliography databases massively easier.

Editors like it because it’s a very efficient way of checking the information in the bibliographies of submitted manuscripts.

I have no clue about their examples, but in the real life I have never had a link rot issue in ~10 years handling thousands of references.

Re:The DOI System by nickgros on Thursday November 18, 2021 @09:30AM (#29265785)
Easily fetching the canonical metadata is so useful when doing a literature search and collecting sources, or trying to put together a bibliography. In Zotero (and presumably other bibliography managers), you can just plug the DOI in and you instantly have the title, authors, abstract, etc.
Re:The DOI System by tmalsburg2 on Thursday November 18, 2021 @05:47AM (#29264074)
DOIs are not URLs though. They are identifiers, as the name suggests. I don't think URLs were ever intended to be identifiers. At least that's not how they are used, as can be seen from the fact that there is a many-to-many relationship between URLs and pieces of content. Identifiers for published pieces that are independent from where that piece is currently published are useful. Just one example: An article can be published in many places and in many different formats (HTML, print, PDF, ...). The DOI allows us to establish that all these instantiations represent the same publication. You might say that we could use titles instead but these are not unique. We also can't use title + authors because authors change their names. And so on. DOIs therefore address a real need. That's why they've become so successful and omnipresent in academic publishing.
Re:The DOI System by zeckalpha on Thursday November 18, 2021 @08:25AM (#29265087)
URLs evolved into URNs and URIs
Re:The DOI System by Cthulhu_ on Thursday November 18, 2021 @03:29AM (#29263346)
I dunno, looks similar to the ISBN system for books.
Re:The DOI System by watersb on Thursday November 18, 2021 @04:42AM (#29263749)
ISBN = International Standard Book Number

DOI does resemble ISBN, but I can find book info via ISBN without relying on the publisher to maintain a database.

(via Google or ISBN.nu or maybe even the Library of Congress)

ISBN is indeed assigned by the publisher, who has been granted an ISBN prefix by the ISBN Fairy. That's same as DOI.

But DOI feels more like Amazon's book numbering system, their ASIN. That relies on an opaque entity which may well lose track of any particular item, for their own reasons... though ASIN has not been promoted as a standard index.

Re:The DOI System by watersb on Thursday November 18, 2021 @04:47AM (#29263780)
Here's a really old ISBN, which I picked at random because I wrote the book (often also a random process at times) -- almost 25 years ago:

978-0782120813

I had no trouble finding the book via this magic number. I don't know how that compares to a 25 year old DOI for an item that was in limited publication.

(shameless plug, fair, but it's an example for which I happen to know the provenance of the isbn, even before publication, and I also have an idea at how obscure this item turned out to be after public distribution.)

Re:The DOI System by afandian on Thursday November 18, 2021 @05:33AM (#29264008)
Open metadata records dump: https://www.crossref.org/blog/new-public-data-file-120-milli...

DOI Content Negotiation to retrieve metadata in a way that's interoperable between DOI registration agencies: https://citation.crosscite.org/docs.html

Crossref is expressly not opaque. Although we have a legacy codebase, we've committed to fully open source and open data.

https://www.crossref.org/blog/crossrefs-board-votes-to-adopt...

(Disclaimer - I'm at Crossref)

Re:The DOI System by epaulson on Thursday November 18, 2021 @07:21AM (#29264605)
It would be awesome if there actually was a reliable, API-accessible (and reasonably cheap/free for small numbers of automated lookups) database of ISBNs. I want to build my own book inventory system and be able to look up ISBNs in my own tool.