News for hackers. Stuff that matters.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by tokai on Wednesday October 24, 2018 @11:29AM (#18293244)
It is a fun little event that something posted on 4chan is used in a research paper.

But that nobody knows how it should be cited is just plain wrong. They should maybe contact their research library and get a introduction to citing. All citation styles I know of can handle web citations. Anonymous authors is nothing new either. And you have things like the internet archive or Webcite[0] to make sure the web document doesn't disappear. Else it could be cited as personal communication, which usually covers direct communication, but can also be used for nonarchived discussion groups.

The reluctance to cite a source because it's not a peer reviewed research paper, is bordering on cargo cult science. As if going through the motions of scientific publishing should somehow elevate arguments to truth.

[0]https://www.webcitation.org/

Re:Nobody knows how to cite 4chan mathematicians who solved ... by rspeer on Wednesday October 24, 2018 @11:47AM (#18293427)
It's not that nobody knows how to cite it, it's that nobody wants to cite things from outside of academia, perhaps because it lowers their own perceived prestige.

I have seen this in computational linguistics where people frequently don't cite their data sources, which often come from outside of the field or outside academia altogether. Instead they put a link to a webpage in a footnote, which does nothing for assigning credit.

Reviewers don't take anyone to task for it, because they do that too.

For a while, there was a collection of multilingual word counts over OpenSubtitles that everyone was using, and you would acquire it from the OneDrive of the pseudonymous blogger "Hermit Dave". Many people put the link to his blog in a footnote, but I think I was the only person to come up with a citation for (Dave 2011).

People don't even cite Google Books Ngrams and that's got a real paper [1].

[1] Lin, Y., Michel, J.-B., Aiden, E. L., Orwant, J., Brockman, W., and Petrov, S. (2012). Syntactic annotations for the Google Books Ngram Corpus. Proceedings of the ACL 2012 system demonstrations, 169-174.

Re:Nobody knows how to cite 4chan mathematicians who solved ... by throwawaymath on Wednesday October 24, 2018 @12:33PM (#18293927)
To give you a counterpoint, I've read plenty of computer science and mathematics papers where someone cited an arXiv paper by an obscure or unknown researcher. I've even seen blog posts and email correspondence cited. In fact, in one of my own papers I cited an unpublished manuscript which you can't even find on the internet - you have to personally contact the author, who hasn't touched the thing in the last 25 years. For all intents and purposes, this manuscript - while valuable - only exists in the tribal folklore of the research community. But it's still cited and most active people in the field probably have a personal copy of it on their hard drive.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by eindiran on Wednesday October 24, 2018 @01:36PM (#18294580)
I think the difference is that arXiv papers don't have the same perceptions of low prestige attached as a random blog or a 4chan thread does. The issue isn't that the work is (yet) unpublished or that its obscure: its that it is from outside academia or traditionally prestigious sources.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by romwell on Wednesday October 24, 2018 @06:19PM (#18296965)
>academia or traditionally prestigious sources.

You can't really put ArXiV and "traditionally prestigious sources" in the same sentence. Any crackpot can (and does) post on ArXiV.

The reason why I'd be more comfortable citing a paper on ArXiV than a random web page (as a mathematician):

1. ArXiV is the archive for papers. You put something there, it's not going away. You can't even remove your own paper once you make it public there[1]. It's a reliable place I can refer people to.

Personal websites? Well, my own very reliable academic web page has been removed by sysadmins without notice after graduation because "we don't maintain accounts".

2. Unrelated content. ArXiV won't have it - unlike, say, the 4chan thread in question. Do I really want to explain to people that I wasn't citing getting "14 * 14! derps out of the way"?. Not to mention ads, memes and NSFW content - which is also there[2][3]

----------

The other reasons are less important, but are still valid:

3. Presentation. Something on the ArXiV probably is formatted and structured like a readable paper; there are baseline expectations. Reading someone's scratchwork is borderline painful, and a proof on a webpage is usually just that.

Compare [3] to a rewrite[4] - which one is easier to understand at a glance?

4. Reputation. This is different from "traditional prestige". The reputation of ArXiV is that most of the people who do serious work put it there. Most of the people produce nonsense (possibly including yours truly) also put it there, but the probability of any work having been done by someone who is willing to put effort into it goes down dramatically if the work is not on ArXiV.

5. Signaling. Since it's so easy to post there, any work not ArXiV is signaling "I don't care about my work being available to other people in the field". Why one read something that the author doesn't want them to? If they did, they'd put it on the ArXiV.

6. Attribution. A result on ArXiV makes it easy for me to attribute the result to someone. A thread on 4chan? Do I attribute it to everyone who participated? A single anonymous author?

----------

In short: people give credit to blackboard scribbles and napkin proofs that came out of discussions at conferences, but you won't see "4th beer coaster, such-and-such conference banquet, 2018" as something that people cite.

A proof on 4chan is somewhere in the same category.

----------

The disclaimer here is that this applies mostly to new results in mathematics. Old results are not necessarily available online, and often we don't have a choice. Practices in other fields might be different.

---------

[1] https://arxiv.org/help/withdraw

[2]https://warosu.org/sci/thread/S3751105#p3751197

[3]http://4watch.org/superstring/

[4]https://docs.google.com/viewer?a=v&pid=forums&srcid=MTUwMTUx...

Re:Nobody knows how to cite 4chan mathematicians who solved ... by Nomentatus on Wednesday October 24, 2018 @06:57PM (#18297197)
It's up to professors. I've had very important work taken by professors and published by them from my websites without attribution - even my own old professors! They think theft is fine if you aren't a fellow pirate, apparently. Arxiv is used by fellow pirates, so it's off limits, on this view.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by zmw on Thursday October 25, 2018 @03:18AM (#18299078)
That sounds mighty weird, and honestly the statement has certain characteritics that trigger my crackpot alarm (don’t take it personally)... If what you say is true, it’s not like you don’t have recourse — you can write to the publication’s editorial board, or report to your department or institution’s academic disciplinary body (of course, that’s after you have contacted whomever you’re in dispute with; it’s okay, and I’ve had people cold emailing me about my preprint, asking me to mention their only somewhat related and by no means appropriated work...) Also, if you produced whatever result when you were working for a professor, they can publish it under their name (it’s nice to at least have you on the author list, of course), you don’t revoke their right just by publishing it on your own website. Anyway, whining on HN is the about least useful thing you can do.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by Nomentatus on Thursday October 25, 2018 @10:22PM (#18306288)
This is common stuff, and good luck on prompt action! No, I wasn't working for a prof - but note that you yourself just accept that work including ideas can be published by a prof without attribution to the discoverer! That tells us all where the academic mindset is. My noting is your whining, I gather. One can't tarry on life's path to upbraid all the assholes in the world, and legal redress is well out of reach of most of us. One can note it to warn others, and move on.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by romwell on Wednesday October 24, 2018 @07:43PM (#18297433)
Sad to hear that.

What kind of work was that?

Re:Nobody knows how to cite 4chan mathematicians who solved ... by carbocation on Wednesday October 24, 2018 @01:40PM (#18294626)
I have a little personal write-up that is cited in the academic medical literature.

Post: http://james.pirruccello.us/index.php?title=Gamma_gap

Paper: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4668045/

Re:Nobody knows how to cite 4chan mathematicians who solved ... by andrioni on Wednesday October 24, 2018 @02:45PM (#18295202)
It's not entirely uncommon in mathematics to see citations to "personal communication with [insert name of other mathematician here]".
Re:Nobody knows how to cite 4chan mathematicians who solved ... by setr on Wednesday October 24, 2018 @02:21PM (#18294988)
I vaguely remember reading a paper on three-coloring a graph, where the gadget was cited as coming from a children’s puzzles book
Re:Nobody knows how to cite 4chan mathematicians who solved ... by jessriedel on Wednesday October 24, 2018 @12:01PM (#18293592)
> Instead they put a link to a webpage in a footnote, which does nothing for assigning credit.

Why would a footnote be considered less credit than something in the list of references? It's pretty common in my field to use footnotes to give credit to other researchers for ideas that arose in an informal context, e.g., "I thank A. Zee for pointing this out". Indeed, the question of whether prose footnotes are at the bottom of the page rather than displayed intermixed with citations to published sources (as in Physical Review Letters) is just a stylistic choices that varies by journal.

Obviously unpublished sources can't easily be counted into automated citation tracking systems for technical reasons, but if the author wanted that they could publish something (or, e.g., put it in a free repository like the arXiv).

Re:Nobody knows how to cite 4chan mathematicians who solved ... by rspeer on Wednesday October 24, 2018 @01:00PM (#18294225)
Crediting a web page in a footnote is almost no credit at all. The web page didn't compile the data. A person did. Sometimes the person is inconveniently pseudonymous, but other times they should be credited by name.

I added the Google Books Ngrams example slightly later, but: People _do_ publish papers about their data, and their citation counts are often extremely low, because research users continue to use footnotes instead.

Re:Nobody knows how to cite 4chan mathematicians who solved ... by jessriedel on Wednesday October 24, 2018 @02:07PM (#18294873)
Are you talking about someone crediting a webpage without attempting to attach the name of the author? I have never seen this in academic research, ever. Can you link to an example?

In the OP case, the 4chan author was anonymous.

EDIT:

> People _do_ publish papers about their data, and their citation counts are often extremely low, because research users continue to use footnotes instead.

Are you talking about researchers not giving credit for pure data sets? That is a really very different topic.

Re:Nobody knows how to cite 4chan mathematicians who solved ... by rspeer on Wednesday October 24, 2018 @05:28PM (#18296581)
> Are you talking about someone crediting a webpage without attempting to attach the name of the author? I have never seen this in academic research, ever. Can you link to an example?

Let's continue with the Google Ngrams example. All I had to do was search Google Scholar for "Google Ngrams" to find easy examples on the first page of results, like this one: http://www.aclweb.org/anthology/W14-1611

The paper is written by famous Stanford researchers, and they do not cite a single author of their data. Just URLs in footnotes.

This also happens to my research (ConceptNet) all the time. The fact that you haven't noticed it doesn't mean I'm making it up.

I don't see why you think researchers not giving credit for data is a different topic from what I brought up. What I said was, researchers in my field are in the habit of not giving credit for data, and instead they have adopted the convention of using half-assed footnotes with URLs in them, which is not appropriate credit. I speculate that one reason for this habit is that data often comes from inconveniently non-academic sources and would look bad in the bibliography. The habit is so pervasive that authors remain in the habit even when a paper exists.

Re:Nobody knows how to cite 4chan mathematicians who solved ... by jessriedel on Wednesday October 24, 2018 @06:43PM (#18297111)
It's a different topic because the OP dispute (whether to give credit to data generation/creation as comprehensively as to data analysis) is logically distinct from the OP dispute (whether to give different amounts credit to the same sort of contribution based on where/whether it was formally published). The fact that the people you criticize continue to not properly give credit even when a formal publication exists demonstrates this starkly.

For what it's worth, I agree with your criticism.

Re:Nobody knows how to cite 4chan mathematicians who solved ... by Beldin on Wednesday October 24, 2018 @02:23PM (#18295004)
If the persons who compiled a data set (or made a latex package or or or) published a paper on that thing, by all means, cite it.

If they didn't, but they do have a web page on the thing, then give them credits in the currency of the web: links.

GP has a point: if the creators want scientific credit, they can easily get that via ArXiv (or, of course, a peer-reviewed publication). If not: increase their PageRank.

Re:Nobody knows how to cite 4chan mathematicians who solved ... by OscarCunningham on Wednesday October 24, 2018 @12:24PM (#18293839)
> It's pretty common in my field to use footnotes to give credit to other researchers for ideas that arose in an informal context, e.g., "I thank A. Zee for pointing this out".

Is your field Quantum Field Theory?

https://www.kitp.ucsb.edu/zee/

Re:Nobody knows how to cite 4chan mathematicians who solved ... by jessriedel on Wednesday October 24, 2018 @12:26PM (#18293860)
No, quantum information, but I always thought Tony Zee had the best whimsical name to use as an example in these situations :)
Re:Nobody knows how to cite 4chan mathematicians who solved ... by saagarjha on Wednesday October 24, 2018 @06:07PM (#18296894)
> It's not that nobody knows how to cite it, it's that nobody wants to cite things from outside of academia, perhaps because it lowers their own perceived prestige.

Such is academia, I guess. It’s more important to get “prestige” than to properly cite someone else’s work-where it was published should not matter.

Re:Nobody knows how to cite 4chan mathematicians who solved ... by coliveira on Wednesday October 24, 2018 @01:49PM (#18294703)
I don't see a problem with a footnote entry, this is a form of credit. The issue with bibliographic entries is that they are each day more automatically processed, so publishers and editors try to avoid non-standard entries. On the other hand, if you're publishing something in a blog or webpage you're not looking for the kind of credit that is given on a bibliographic citation, so a footnote seems to be just fine.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by timr on Wednesday October 24, 2018 @03:08PM (#18295421)
"It's not that nobody knows how to cite it, it's that nobody wants to cite things from outside of academia, perhaps because it lowers their own perceived prestige."

Unlikely. I can't speak for everybody, but I can speak for myself, and I would be extremely hesitant to cite a random webpage in a journal article for several reasons:

1) It can change. ArXiv has versioning, but even so, this is still a problem. You cite something, and months later you go back and find the thing you cited says something slightly different.

1b) It can disappear. Again, less of an issue for ArXiv, but a big problem for any other website. Linkrot is real.

2) There's probably a better source. Maybe in this example a 4chan thread is the original provenance of an idea, but 99 times out of 100, there's a better, original source for the idea.

3) There's no peer review. Peer-review is not a pre-requisite for publication, but if you don't have it, it just makes people more skeptical of your results.

4) It's perceived as lazy. This is closest to your point (i.e. prestige), but not the same. Like it or not, if you cite informal sources in a paper, people start to wonder about the rigor of everything else you do. It's an intangible, but when you're trying to get papers accepted, intangibles count.

Basically, citing a webpage is risky. You avoid it if you can.

Re:Nobody knows how to cite 4chan mathematicians who solved ... by incompatible on Wednesday October 24, 2018 @05:00PM (#18296338)
For a paper in mathematics, perhaps it would be best to quote the entire proof of interest, if it doesn't appear anywhere else in a peer-reviewed publication. That would avoid the link rot problem. Also make sure archive.org has a copy, if possible.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by timr on Wednesday October 24, 2018 @05:43PM (#18296701)
Sure, you can quote a short proof. But again, that's a niche solution to a niche problem, and it defeats the purpose of having citations. It also doesn't convince anyone else that they should believe the proof you've cited.

Archive.org is not a solution to this problem. Nobody is going to go fishing in archive.org for a citation that has disappeared. Even if you have the URL, what is the correct date to use?

There are just practical problems with link citations, and you don't need to invent malevolent intent to understand why researchers are reluctant to use them.

Re:Nobody knows how to cite 4chan mathematicians who solved ... by presscast on Wednesday October 24, 2018 @12:10PM (#18293690)
>It's not that nobody knows how to cite it, it's that nobody wants to cite things from outside of academia, perhaps because it lowers their own perceived prestige.

What makes you say this? Citing anybody does little to increase your personal prestige. I think the issue has more to do with 4chan not being peer-reviewed, and the proof being so recent that few papers have yet been written.

On the contrary, citing a hot new thing is what academics do best.

Re:Nobody knows how to cite 4chan mathematicians who solved ... by caconym_ on Wednesday October 24, 2018 @12:17PM (#18293766)
Somebody pointed out in the Twitter thread that academics often cite unreviewed papers on arXiv. If true (cannot confirm it myself, not in academia) then the peer-review-as-a-prerequisite-for-citation thing doesn't really hold water.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by ISL on Wednesday October 24, 2018 @12:55PM (#18294163)
Peer review is no prerequisite for citation.

The first paper I looked at for an example (at the top of today's "Recent" papers in PRD), cites three arXiv entries, out of 91 references. https://journals.aps.org/prd/references/10.1103/PhysRevD.98....

Successful peer review in an upstanding journal is a signal of relative reliability and importance, but it is not the arbiter of usefulness.

Re:Nobody knows how to cite 4chan mathematicians who solved ... by sgc on Wednesday October 24, 2018 @08:47PM (#18297744)
Exactly. If I am sure of myself, I will cite anyone with information pertinent to my work. I am their peer and just reviewed it.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by laretluval on Wednesday October 24, 2018 @12:27PM (#18293867)
It depends on the field. In fast moving fields like machine learning it is common to cite unreviewed stuff on arXiv. In slower fields it is less common/accepted.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by rmbeard on Wednesday October 24, 2018 @09:10PM (#18297825)
Not citing sources is plagiarism, are you actually saying that it is the norm in computational linguistics to plagiarize? If so this is extremely worrying.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by noobermin on Wednesday October 24, 2018 @05:24PM (#18296541)
Unless I'm ignorant, no one does that in science. We cite where data or even a quote comes from. Seems perverse not to do so.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by mynewtb on Wednesday October 24, 2018 @04:36PM (#18296119)
Why would you cite a paper on the technical details of your data source in linguistics?
Re:Nobody knows how to cite 4chan mathematicians who solved ... by Zalastax on Wednesday October 24, 2018 @06:04PM (#18296859)
You want reproducibility, the results will be affected a lot by your data source, real citations enable tools like google scholar. Why not cite? I see only drawbacks in continuing with the footnote/no citation trend.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by derblitzmann on Wednesday October 24, 2018 @11:51AM (#18293470)
Well I know for 4chan, each thread is ephemeral and depending on how active a board is, the thread will be deleted. Which I think is the challenge citing it. Since even a day or two after finding it, it can be lost.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by strictnein on Wednesday October 24, 2018 @11:55AM (#18293506)
This is directly addressed in the comment you're responding to.

> "And you have things like the internet archive or Webcite[0] to make sure the web document doesn't disappear."

Re:Nobody knows how to cite 4chan mathematicians who solved ... by komali2 on Wednesday October 24, 2018 @01:25PM (#18294467)
Does that even work on 4chan? On /b/ threads can vanish in less than an hour. There used to be specialized sites such as 4chanarchive to fill the gap, but last I checked most are dead.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by setr on Wednesday October 24, 2018 @02:27PM (#18295053)
Afaik there are various ones still existing, but dunno how ephemeral they are (eg archive.moe supports /b/), and how much they miss

And then you just webarchive archive the archive sites instead of 4chan directly :-)

Re:Nobody knows how to cite 4chan mathematicians who solved ... by TeMPOraL on Wednesday October 24, 2018 @03:53PM (#18295789)
Well, this particular thread still exists; somewhere in the Tweets there there was a link posted to an archived version.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by prepend on Wednesday October 24, 2018 @12:54PM (#18294153)
I read this more that if they follow common web citation guidelines, there’s a strong probability that 4chan will replace the target with goatse, or something worse.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by swebs on Wednesday October 24, 2018 @01:53PM (#18294729)
You can't direct link to 4chan anyway, as posts are cycled out and deleted quite frequently. You would have to archive the page and link to that.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by tomjen3 on Wednesday October 24, 2018 @01:19PM (#18294412)
We cited a random persons blog in my masters thesis, supervisor didn't blink an eye (that person had the most clear and concise formulation of the problem we were trying to solve).
Re:Nobody knows how to cite 4chan mathematicians who solved ... by pbhjpbhj on Wednesday October 24, 2018 @03:27PM (#18295576)
Someone contacted me once wanting to cite a web page I authored in a paper, but I assumed they were trying to social engineer my identity, or similar.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by yipbub on Wednesday October 24, 2018 @11:46AM (#18293407)
I'm not in academia. How is it possible for people to check if the proof is peer reviewed? Do they have to rely on their own verification?
Re:Nobody knows how to cite 4chan mathematicians who solved ... by syn0byte on Wednesday October 24, 2018 @11:55AM (#18293523)
It's a proof. It validates itself or it doesn't.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by throwawaymath on Wednesday October 24, 2018 @12:24PM (#18293831)
That's a non-answer. Peer review is a thing in mathematics precisely because it's difficult to verify if a proof is valid. In a sense you can say something like, "A proof is valid or it isn't", but that's vacuous because you still need someone to check it.

There are many examples available of proofs which have been initially accepted but later discredited in the mathematical community. There are also many examples of proofs which have been polarizing from their first publication. Consider the controversy surrounding Mochizuki and his Inter-Universal Teichmuller Theory. Also consider that there have been credible (though ultimately incorrect) proofs published by credible people for several famous problems, such as P = NP. The academic community at large can't just eyeball a proof and know it to be true, and often even fundamentally flawed proofs require more than a week of careful attention to be declared incorrect.

If you want to argue that peer review is an imperfect system then that's one thing. But to say that a proof is demonstrably true or it isn't ignores the entire complexity of actually figuring out whether or not it's true. Some people can rely upon their own ability to do this, but for the most part the mathematical community is so heavily specialized that even most mathematicians cannot find errors in advanced proofs unless it's their particular subfield of research.

Re:Nobody knows how to cite 4chan mathematicians who solved ... by syn0byte on Wednesday October 24, 2018 @01:58PM (#18294790)
Yes, it was a mostly non-answer to a mostly non-question. It was in response to citing a proof in your own work, not a comment on the need for peer review of proofs in general.

The bulk of your rebuttal is exactly my own point. Peer review doesn't actually prove anything one way or the other. The ultimate truthfulness of a cited proof is all that matters. The idea that cited proofs should be peer reviewed don't add intrinsic validity, it just fosters academic laziness.

"Boy that's a fantastical claim that doesn't seem right; but all the citations are peer reviewed and I see nothing obviously wrong so I guess its true!" -OR- "Boy That's a fantastical claim that doesn't seem right; I don't see anything obviously wrong here so lets double check the cited proofs they based this on."

What's the practical upside to only using peer-reviewed proofs besides speed at the cost of fidelity? What's the practical downside to using unreviewed proofs besides "more work"?

Re:Nobody knows how to cite 4chan mathematicians who solved ... by Jweb_Guru on Wednesday October 24, 2018 @10:05PM (#18298043)
People do use unreviewed proofs. They just mark those results separately from the rest of the paper so that people (correctly) know not to rely on them, or at least to continue to treat them as tainted; they also usually try to avoid relying on such theorems for critical results. Which is a way better solution than what you're proposing, which is to just mix them in with proofs that people are reasonably confident in and hope for the best.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by TimTheTinker on Wednesday October 24, 2018 @12:19PM (#18293795)
Not so fast. Yes, many proofs do follow from formal logic and maths, but new proofs often connect things or draw inferences that haven't been done previously, thus requiring human review to verify.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by new12345 on Wednesday October 24, 2018 @12:50PM (#18294109)
I agree. Its doesn't seems like that big of a deal to cite a web article. What's causing trouble is the stereotype among the research institutions to not trust/value communities like 4chan. I am glad that this is being highlighted.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by marmaduke on Wednesday October 24, 2018 @02:23PM (#18295002)
I don’t see any mention of Zenodo but it is a potential solution for, in their words, the long tail of science. One could post some extract from the 4chan page, post it on Zenodo and have a DOI to work with.
Re:Nobody knows how to cite 4chan mathematicians who solved ... by romwell on Thursday October 25, 2018 @02:13AM (#18298850)
Didn't know about it. Seems to be more for data sets. ArXiV would be a better place for math papers.