To preface: I am speaking in ignorance of the mechanisms of credit and advancement in your field, so I'm undoubtedly overly harsh. I'm not even trying to be fair, because I admittedly don't have the knowledge to do so.
I know academia is a different world from private sector industry, but I would think if the point of a confidential review is for you to do anonymous work to improve someone else's credited work, and their work was improved by incorporating your feedback, you would be happy with the outcome, or else why are you participating in a confidential review process in the first place? There are different mechanisms for publishing words that you want credit for.
When someone incorporates my feedback on code or documentation word-for-word, I might in the worst case be suspicious that they are trying to get my approval without engaging with my criticism, but in most cases I'm flattered that they respect my idea enough to put their name on it. Although, in my world, putting your name on something is more about responsibility than credit. The command is called "git blame" and not "git credit", after all.
Wanting them to incorporate your feedback, but also wanting them to make some change to the wording to avoid plagiarism, smacks of how freshman essays are graded, not how real work gets done.
Like I said, I'm not trying to be fair and don't have the right background to be fair to you. I only speak up because I grew up in an academic family and know that there is a presumption that academic work is more idealistic, more altruistic, and less mercenary than private sector work, and I think it's worth pointing out when the reverse is true.
I can't speak for GP as to whether this was true, or if there are different norms for that sector, or the author was slightly aggressive in asserting their rights, or the assumptions we're making about the content of the criticism are off, but given the article brought a new dimension to it, I thought that worth mentioning.
This is one outcome of peer review, and is an explicit goal of (good) peer reviewers. But it's definitely not the main goal of peer review. The main goal of peer review is assessment. Improvement is something that you can strive for as a secondary outcome, but it's not the main point.
This is a significant and important contrast with code review. Peer review is NOT analogous to code review!
NB: The code review style of improvement-focused review also happens in academia! But it happens within groups rather than between groups. I.e., advisors or post-docs in single research group or university critiquing one another's work will behave more like a code review. Peer review is different.
The same is true in industry, btw. Think of peer review as the thing that happens when a regulator reviews the code from a medical device. They're not interested in making pull requests and doing your work for you. Although they do in principle want you to succeed in your goals, and might provide some feedback along those lines, they're making a yes/no decision. Different function.
> their work was improved by incorporating your feedback, you would be happy with the outcome
There are really two concerns here:
1. confidentiality, and
2. plagiarism.
The first item is probably more important than the second. The typical expectation of reviews is that they are anonymous and private unless stated otherwise (eg openreview). It's incredibly bad form to publish a private correspondence without first asking for permission.
Copying a reviewer verbatim without permission is plagiarism, but it's not really something that anyone actually cares about, per se. I've sometimes asked for permission to incorporate components of reviews verbatim into my papers, and never received anything except enthusiastic "of course". I assume the same would be true in the case above. But even in those cases I say something like: "as helpfully observed by an anonymous reviewer of this paper, [insert quote]".
The key point is that I don't go around publishing explicitly confidential correspondences without permission.
> or else why are you participating in a confidential review process in the first place?
Exactly. Confidential.
Again, surely you can see how publishing someone's confidential words is quite rude, even if the person wouldn't mind those words being published if simply asked.
> Like I said, I'm not trying to be fair and don't have the right background to be fair to you. I only speak up because I grew up in an academic family and know that there is a presumption that academic work is more idealistic, more altruistic, and less mercenary than private sector work, and I think it's worth pointing out when the reverse is true.
Academic work is all of those things in terms of goals, not necessarily in terms of process. I don't know anyone who has a passing familiarity with Academia and doesn't realize that it is incredibly competitive.
Altruism and competition are different axes.
I guess I don't understand what kind of "confidentiality" was violated. To me a violation of confidentiality would be revealing your name and your role in the process, or publishing sensitive information they got via the process, maybe publishing some idea or data you shared with them that you intended to publish yourself later. But they didn't use your name, and you didn't share any sensitive information with them, so I don't get it.
Plagiarism I guess I can see, though the cynic in me says if it was so obvious that their native language wasn't English, it was in the best interest of readers for them not to do the dance of paraphrasing away the plagiarism.
> I don't know anyone who has a passing familiarity with Academia and doesn't realize that it is incredibly competitive.
Yeah, my family who are in academia talk all the time about how petty and cutthroat it is, and I'm sure that played a role in scaring me away from trying it myself, but I can tell they think business must somehow be worse. I get the feeling that deep down they believe they’re seeing a version of human behavior somewhat elevated by the ideals of academia, and however bad it is inside academia, outside, in environments ruled by cruder values, it must be worse.
Once I re-read the submission I wanted to reject it immediately, but I realized that I should get a second opinion first. So I contacted the editors, who agreed that it was blatant plagiarism. Hence, they rejected the paper once I recommended rejection in my second review. So this wasn't just a conversation where I made some suggestions and the authors used them. Even the editors thought it was plagiarism once they looked at it.
An acknowledgment would be impossible because the review was single-blind. The reviewers knew the identities of the authors but not the other way around. What the authors should have done was just re-phrase where they used the term in the paper. They didn't even need to copy my explanation, to be frank. The paper would worked fine without the paragraph they copied. If they just re-phrased the relevant parts no other changes would have been needed and this whole thing could have been avoided.
In the absence of an explicit directive or request from you, given that the authors are from a different culture, how do you expect them to know what was required by them?
I don't mean to be snarky or accusative. Your comment was thoughtful, articulate and detailed, which tells me you are a sophisticated communicator.
But that said, I've often times wondered if this requirement of having to "rewrite in your own words" may do a lot of harm too. It obfuscates that things that people are talking about are actually exactly the same, or make it fuzzy what the exact differences are.
In a particular academic CS area I've witnessed people reproduce again and again the essentially identical description of setting and assumptions, but in being afraid of plagiarism accusations, they over and over re-formulate things which made it nonobvious that things are the same as from other authors or even from their own earlier work.
1. authors submit a paper with expository sections about (eg) some materials being flammable and others inflammable
2. reviewer tries to explain that they have incorrectly understood the meaning of the terms, explains the meaning carefully and maybe suggests the terms they might mean.
3. Authors copy in the explanation and maybe replace incorrect usages with weird tortured phrases
4. Rejection
Obviously this description reads a little bit silly and things were probably more nuanced in practice. I think I’m probably also being uncharitable towards the authors in the example.
4. Rejection
5. Authors replace terms in verbatim copy with weird tortured phrases
6. Authors submit to other journals, get published
This is a very subtle distinction and it sounds like being more explicit about it would have been a good idea.
This seems to confirm my suspicion than these cases are not so much about AI-generated content but rather a result of machine translation.
It's also a common technique for people who don't speak English to translate it... In fact, quite a bit more common.
And sure, there are reasons to translate a phrase from English, to another language, and back to English. This will be familiar to most people who've studied abroad, or done technical conferences on foreign soil, things of that nature. Let's say you're from Bolivia, attending a lecture at an English university, and are planning on referencing some of the content in a paper you're writing, in English. You speak passable English. The lecturer gets into the meat of the topic, and you realize you don't quite understand the context of what they're saying. Some of the conjugations are unfamiliar, so you just write it down as best you can and move on. Later, when writing the paper, you need a way to untangle the phrasing. A simple way is to put it into a translation application, translate to Bolivian, then try to parse it in native tongue. However, you know you have to explain and discuss this section in English; by translating it back, you'll get the English words, but some of the context and grammar structure will be from familiar Bolivian.
So yeah, never say never.
Also, they speak Spanish in Bolivia ;)
Good to know; I've always wondered at the peculiarities of different translation engines, but never really dug into them, as most modern ones seem like neural network black boxes to me. I was pointing out that there are some realistic use cases for doing round trip translations. I've used this technique at a few conferences to help straighten out my hazy understanding of a complex idea in a language I spoke quite poorly. And I do agree it is bad form to use this directly in an academic paper.
> Also, they speak Spanish in Bolivia ;)
To be fair they speak Bolivian Spanish, along with many other native languages! I chose Bolivia as a random target without doing any research, so thanks for the pedantic push to go learn something new; things like this are why I do love HN!
> This will be familiar to most people who've studied abroad
It wasn't to me until now but this explains a lot!
You've never had to do that before? Maybe I run into it a lot due to the nature of the conferences I attend. I know just enough of the language for functional conversation, but as soon as a complex idea is put forward, I need to be able to contextualize the familiar scientific portions of it quickly, and the round trip translation usually helps enough that I can parse it correctly.
Not really, but I came across some teammates in college who didn't seem to be able to follow a conversation yet they seemed to have quite good writing skills. This might be the reason why ;)
https://news.ycombinator.com/item?id=28112208
https://news.ycombinator.com/item?id=28112358
To sum up, the authors did not just use my wording for a short portion. They copied an entire paragraph of my review nearly verbatim. Both the journal and I thought that the authors acted unethically. They violated one of the ethical standards of the journal regarding plagiarism, and these ethical standards were made available to them when they submitted the paper. Those were the rules that I had to evaluate them with for the review, so my hands were tied in some sense. I would also quibble with saying that they mastered the concept, because I really have no way to gauge their understanding if they just copy my own words.
Isn't that what journals are supposed to be for? To help you reach a wider audience?
Is there any way the authors could have kept your definition, and somehow credited you, even anonymously? Because rephrasing definitions is the pinnacle of wasted effort, and leads to confusion - you are asking them to say what you said, but without using your words.
I guess the fear is that they don’t actually understand the definition, and anyone reading the paper will incorrectly believe that they do, improving their reputation in a way they don’t deserve?
I agree that this is not a school assignment, so the nature of plagiarism is a bit different. But you hit the nail right on the head. We should be worried that they are pretending to know something that they really do not. They copied my explanation nearly word-for-word. Doing that does not prove that they actually understand the concept. It only proves that they have copy and paste. Now maybe they did spend some time learning it and looking into, but there is no way to know for sure. The only way to prove that they really understand the concept fundamentally is to make them explain it themselves in their own words. And that is precisely what they should have done.
Why are you so concerned on this ? Isn't the goal of a paper is to communicate information?
>It only proves that they have copy and paste.
Yes they copy paste but it doesn't prove that they don't really understand it.
They may very well found your definition is the best way to describe it.
As long as the reader of the paper understand what being communicated, imo it should be fine?
I can understand if its a school assignment where the goal is specifically to prove that the author know their stuff.
For a scientific paper, requiring a concept to be described in different way for the sake of it seem to be inefficient and wasting time.
Unless this very phrase does the tripping off. Having to rephrase it would be pretty ridiculous though (and illustrates your point).
It's not uncommon for the acknowledgements section of a paper to thank an anonymous reviewer for, e.g., suggesting the authors further investigate a detail that turned out to be important. But in this case, where the authors couldn't write their own explanation of a technical term, maybe it's a bit premature for them to be writing technical papers.
It's not a, its b.
Ok b.
Hey, you copied my answer?
???
But about three sentences into the introduction (where you explain all the background) you start going into "there is also Y's that do Z backwards". Which Y's you compare and connect with is important and says alot about how you think about your X. It might even be a new way of looking at it. So telling other people how you think of it can be important.
And another 5 sentences in you start referencing previous work on the topic. At this point you are crediting other and you get to chose whom to credit how much, with the benefit of hindsight. You refer to papers that are useful to people new in the study of capital letters. What you write here helps them much more than a mere list of papers or a google (well google scholar or ADS or pubmed or what ever) result list, because you can provide a good order to read them or which aspect of X's are best explained where. You also name papers that might be useful to practitioners in the field because they have a particular technique or a good explanation of it.
So it is very much worth while of providing the background that others expect at the beginning of your paper. Even if it requires rewriting that first paragraph several times.
I would have hated that level of navel gazing.
I find it hard to think of any technical terms which have a fixed, well-specified phrase for the definition, much less ones which, if re-used, don't require attribution.
I mean, there are definitional terms like "one meter is the length of the path traveled by light in a vacuum in 1/299 792 458 of a second" or "the discriminant of the quadratic equation is b^2-4ac". Re-use those quoted definitions and no one will blink.
But, what's "evolution", or "electron spin", or "aromaticity"?
Even something as well-defined and concrete as "cosine similarity" has many different variations:
Wikipedia: a measure of similarity between two non-zero vectors of an inner product space. It is defined to equal the cosine of the angle between them, which is also the same as the inner product of the same vectors normalized to both have length 1
SciKit-learn: the normalized dot product of X and Y: K(X, Y) = <X, Y> / (||X||*||Y||)
towardsdatascience.com: the cosine of the angle between the two non-zero vectors
statology.org: For two vectors, A and B, the Cosine Similarity is calculated as: Cosine Similarity = ΣAiBi / (√ΣAi2√ΣBi2)
uchicago.edu: For vectors, it is the cosine of the angle between those vectors.
datadriveninvestor.com: Cosine similarity of two vectors is just the cosine of the angle between two vectors
While certainly equivalent, these definitions show some creative choice in how they are worded, and thus if copied, should be cited.
(I agree that the creativity level is quite low for some of these, and I believe several people might come up with the same description, but that's a different issue than re-using someone else's definition without attribution.)
It's funny because I actually find your exemples to be supporting my point more than yours.
All of these sentences are translation in plain English of the absolutly perfectly defined and commonly accepted definition of cosine similarity. SkiKit-Learn is even just writing the formula.
uchicago.edu and datadriveninvestor.com even use exactly the same words. I mean, if you came to see me complaining someone was plagirising for writing "For vectors, cosine similarity is the cosine of the angle between those vectors.", I would find that laughable.
That is, even given a technical term with a precise agreed upon definition, the description of that term (eg, in English) does not have a precise agreed-upon form.
Incorrect use of the latter may imply plagiarism, and this thread appears to concern that aspect.
Most definitions are not as simple as "cosine similarity".
Your statement, if true, would mean that most dictionaries would use exactly the same words to describe a given, well-specified scientific concept, yes?
What's "Frame dragging" in general relativity?
Wikipedia: the effect on spacetime caused by a rotating mass ... Frame-dragging is an effect on spacetime, predicted by Albert Einstein's general theory of relativity, that is due to non-static stationary distributions of mass–energy.
doi:10.1126/science.aax7007 : the mass-energy current of a rotating body induces a gravitomagnetic field, so-called because it has formal similarities with the magnetic field generated by an electric current (1). This gravitomagnetic interaction drags inertial frames in the vicinity of a rotating mass. (quoting from the preprint at https://arxiv.org/abs/2001.11405 ).
einstein-online.info: a mass’s rotation influences the motion of objects in its neighbourhood
doi:10.3390/universe7020027 : The term "frame-dragging" usually refers to the influence of a rotating massive body on a gyroscope by producing vorticity in the congruence of world-lines of observers outside the rotating object.
doi:10.1142/9789812564818_0002 : A major consequence of General Relativity and related theories of gravity is that all inertial frames are local. These local frames are accelerated, warped and stretched, and rotated with respect to each other due to the surrounding mass-energy distributions. While only their relative rotations are typically called frame dragging effects, this phrase describes a broader range of gravitational influences on inertia.
Very different definitions, because it's hard to express that concept in English. And I think re-using a few of the more extensive definitions, without attribution, is a minor form of plagiarism. (Reusing any follow-up explanation is, as you've agreed, definitely plagiarism.)
You might recall that atrettel wrote "the authors were misusing a particular technical term".
If you dig in to the papers on frame dragging, you'll note similar complaints, like https://arxiv.org/abs/gr-qc/0509025 : "Many accounts of these experiments have been in terms of frame-dragging. We point out that this terminology has given rise to much confusion and that a better description is in terms of spin-orbit and spin-spin effects."
> I would find that laughable
So would I, which is why I commented 'that's a different issue than re-using someone else's definition without attribution'.
No, it definitely doesn't unless you significantly extend what I said in a very uncharitable way to reach that point.
> Most definitions are not as simple as "cosine similarity".
But plenty are. As I said previously, you are going to be hard pressed to constate plagiarism on pure definitions unless you go towards extensive paragraph long ones which are more akin to explanations than what I would refer to as a definition as you did in the comment I am replying to. Actually, if you reread what you just wrote, you are yourself using the world explanation and definitely agree that that can be plagiarised as could very unorthodox and original forms of definition.
But when I read definition, what comes to my mind is akin to the cosine similarity example where even publications reuse mostly the same sentences while applying minor modifications to the subjects or adding an adverb. Thus me pondering the close proximity of the words definition and plagiarism in the original comment until I realized the whole thing was actually about an explanation triggering my reply to someone sharing my initial puzzlement.
I showed several examples of definitions for frame dragging, including ones where re-use would, IMO, constitute "a minor form of plagiarism".
Is your view that re-use of those definitions cannot be plagiarism? If so, why not?
Could you stop pretending you are not understanding my point considering your first example nicely underline it and you yourself admitted it would be laughable to call that plagiarism?
I never was arguing there that the copying of everything you might defined even tenuously as a definition never ever constitute plagiarism. That's a complete strawman. I'm going to stop wasting my time here.
That's a universal statement.
I've been trying to argue that definitions can be plagiarized, with examples which are not "tenuous" but ones which are drawn directly from publications.
That said, the authors did not fabricate their research (as far as I can tell). They just did not know English well, so it was easier to just copy things that you know are phrased well than to learn to write English well. As the saying goes, do not attribute to malice what can be explained by ignorance or laziness. That does not excuse it but it makes it more understandable.
I agree with the article that this is probably just the tip of the iceberg. There are likely many more lesser evils being committed with similar tools that are just much more difficult to spot. I would not have noticed my particular example if I were not a reviewer for the paper, for example. It makes me wonder how big the problem really is.