News for hackers. Stuff that matters.
Re:Language models can explain neurons in language models by cschmid on Tuesday May 09, 2023 @01:26PM (#35877590)
Has anyone here found a link to the actual paper? If I click on 'paper', I only see what seems to be an awkward HTML version.
Re:Language models can explain neurons in language models by simonw on Tuesday May 09, 2023 @01:34PM (#35877711)
You mean this? https://openaipublic.blob.core.windows.net/neuron-explainer/...

Would you prefer a PDF?

(I'm always fascinated to hear from people who would rather read a PDF than a web-native paper like this one, especially given that web papers are actually readable on mobile devices. Do you do all of your reading on a laptop?)

Re:Language models can explain neurons in language models by kkylin on Tuesday May 09, 2023 @01:42PM (#35877843)
I personally prefer reading PDF on an iPad so I can mark it up.
Re:Language models can explain neurons in language models by bad_alloc on Tuesday May 09, 2023 @01:37PM (#35877760)
Nope, reading the printed paper on... paper. :)
Re:Language models can explain neurons in language models by probably_wrong on Tuesday May 09, 2023 @01:45PM (#35877895)
The equations look terrible on Firefox for Android, as they are really small - a two-line fraction is barely taller than a single line, forcing me to constantly zoom in and out.

So yes, I would prefer a PDF and have a guarantee that it will look the same no matter where I read it.

Re:Language models can explain neurons in language models by hexomancer on Tuesday May 09, 2023 @02:01PM (#35878110)
> Would you prefer a PDF?

Yes, I was just reading the paper and some of the javascript glitched and deleted all the contents of the document except the last section, making me lose all context and focus. Doesn't really happen with PDF files.

Re:Language models can explain neurons in language models by whimsicalism on Tuesday May 09, 2023 @02:11PM (#35878247)
If you want to draw on it, PDF is usually the best
Re:Language models can explain neurons in language models by superkuh on Tuesday May 09, 2023 @02:16PM (#35878318)
With a pdf I don't have to update my PDF reader multiple times per month just to be able to read text.

A PDF is a text document that includes all the text, images, etc within it in the state you are going to perceive them. That web page is just barely even a document. None of it's contents are natively within it, it all requires executing remote code which pulls down more remote code to run just to get the actual text and images to display... which they don't in my browser. I just see an index with links that don't work and the the "Contributions" which for some reason was actually included as text.

Even as the web goes up it's own asshole in terms of recursive serial loading of javascript/json/whatever from unrelated domains and abandons all backwards compatibility, PDF, as a document, remains readable. I wish the web was still hyperlinked documents. The "application" web sucks for accessibility.

Re:Language models can explain neurons in language models by nerpderp82 on Tuesday May 09, 2023 @03:01PM (#35878922)
> always fascinated

That feels like a loaded phrase. Is it "false confusion" adjacent?

Re:Language models can explain neurons in language models by cschmid on Tuesday May 09, 2023 @04:04PM (#35879682)
My whole workflow of organizing and reading papers is centered on PDFs. While I like having interactive supplemental materials, I want to be able to print, save and annotate the papers I read.