News for hackers. Stuff that matters.
Re:How Transformers Work – Model Used by Open AI and DeepMind by rasmi on Sunday March 10, 2019 @09:53PM (#19356100)
Here are two more great articles about Transformers:

The Illustrated Transformer (referenced in the parent): http://jalammar.github.io/illustrated-transformer/

The Annotated Transformer: http://nlp.seas.harvard.edu/2018/04/03/attention.html

Re:How Transformers Work – Model Used by Open AI and DeepMind by giacaglia on Monday March 11, 2019 @12:28AM (#19356677)
I reference one of the articles but I hadn’t look at the other one! Very interesting. Thanks for sharing
Re:How Transformers Work – Model Used by Open AI and DeepMind by panic on Monday March 11, 2019 @12:48AM (#19356751)
You do more than reference it -- you've copied a bunch of text and figures from it as well. Search for "The encoder’s inputs first flow through a self-attention layer" and read on from there. Most of the article is a word-for-word copy.
Re:How Transformers Work – Model Used by Open AI and DeepMind by giacaglia on Monday March 11, 2019 @01:03AM (#19356813)
I’ve tried to use a bunch of the figures and information from these articles. I hope it was useful for some people
Re:How Transformers Work – Model Used by Open AI and DeepMind by throwawaymath on Monday March 11, 2019 @01:34AM (#19356906)
Regardless of whether or not it's useful, it's substantially plagiarized from another source. You don't have an inline citation or visual indication that many of the figures are copied from another article on the topic. The same goes for copying paragraphs with extremely minimal modifications.

Slightly changing sentence structure is not paraphrasing or stating in your own words. Pointing a reader to an article for further reading is not the same as a citation.

To put it bluntly, your arrangement of the material, substantial paragraphs, and a significant number of your figures/graphics are copied from elsewhere without citation.

Re:How Transformers Work – Model Used by Open AI and DeepMind by stochastic_monk on Monday March 11, 2019 @07:14AM (#19358058)
The rest of the images are largely from colah’s blog posts; it’s plagiarized from a mix of sources.

Providing links billed as additional reading material doesn’t count as a citation.

Re:How Transformers Work – Model Used by Open AI and DeepMind by giacaglia on Monday March 11, 2019 @01:45AM (#19356939)
I cite them at the end. The idea was to summarize all the articles into one. I will add a note to the self-attention section - that is the one that I used from Jay's blog. My idea was to summarize all the content from these posts and videos that are referenced at the end into one blog post. I hope it was useful for some people
Re:How Transformers Work – Model Used by Open AI and DeepMind by richardhod on Friday March 15, 2019 @04:52AM (#19397838)
That's not good enough. Citations must be in the text, so that nobody mistakes their work for yours. This can be informally like 'Jay describes", or 'Sally's article says', and then your words, or a quote 'in quotation marks' with a link to their work.
Re:How Transformers Work – Model Used by Open AI and DeepMind by giacaglia on Monday March 11, 2019 @01:46AM (#19356944)
I'm adding a note to the self-attention section adding the fact that this was taken from another blog post
Re:How Transformers Work – Model Used by Open AI and DeepMind by danieldk on Monday March 11, 2019 @02:56AM (#19357181)
Note that if the other blog post is not licensed under a license that allows you to do so (such as Creative Commons Share-Alike), you are simply not permitted to copy images or text without explicit permission from the authors. It's not enough to state that it was taken from another post.

Of course, you are allowed to cite excerpts, but then the text should be clearly marked up as a citation.

Re:How Transformers Work – Model Used by Open AI and DeepMind by edejong on Monday March 11, 2019 @03:17AM (#19357240)
The right thing to do is to either bring down the blog post, replacing it with references to the used articles, or quickly transform (pun intended) the paragraphs and graphics into your own. As it stands, it’s plagiarism.