News for hackers. Stuff that matters.
Re:A Visual Guide to Vision Transformers by causal on Tuesday April 16, 2024 @12:40PM (#40054170)
I like this, but think there is some crucial motivation missing in steps 10.1-10.3 regarding what query/key weights are and why they're needed.
Re:A Visual Guide to Vision Transformers by vikiomega9 on Tuesday April 16, 2024 @04:28PM (#40056762)
this post made sense to me https://teltam.github.io/posts/soft-dictionary-keys.html

It helps to think of kqv as a form of look up.

Re:A Visual Guide to Vision Transformers by ThouYS on Tuesday April 16, 2024 @01:06PM (#40054518)
yes, same issue in all transformer tutorials
Re:A Visual Guide to Vision Transformers by lordswork on Tuesday April 16, 2024 @03:24PM (#40056116)
I suspect this is because most people (including people writing these tutorials) don't have a strong grasp on this piece as well.
Re:A Visual Guide to Vision Transformers by causal on Tuesday April 16, 2024 @02:05PM (#40055231)
The 2b1b video was the first to make it click for me
Re:A Visual Guide to Vision Transformers by hotdogscout on Tuesday April 16, 2024 @03:18PM (#40056049)
You mean 3b1b (three blue one brown)?
Re:A Visual Guide to Vision Transformers by causal on Tuesday April 16, 2024 @03:43PM (#40056322)
Ah that's right, miscounted the blues
Re:A Visual Guide to Vision Transformers by abhgh on Tuesday April 16, 2024 @09:17PM (#40059358)
They are like "continuous" databases. See slides 4-5 here [1] - this is from a talk I had given a while ago.

[1] https://drive.google.com/file/d/12uHo9QIfS-jBpVTs3lmQ3BEpxhD...

Re:A Visual Guide to Vision Transformers by challenger-derp on Tuesday April 16, 2024 @10:50AM (#40052716)
Very nice. I wish I could do this sort of scroll story in my digital notes. Is this done with a javascript library?
Re:A Visual Guide to Vision Transformers by md2rp on Tuesday April 16, 2024 @11:34AM (#40053360)
Yes this was done with a combination of GSAP Scrolltrigger https://gsap.com/docs/v3/Plugins/ScrollTrigger/ and https://d3js.org/
Re:A Visual Guide to Vision Transformers by TuringTest on Tuesday April 16, 2024 @12:14PM (#40053863)
That kind of scroll is OK-ish for a background parallax effect, or maybe some pretty fade-in/out effects while elements scroll into view (without changing their relative position in the page).

When it interferes with the main functionality of the page, namely reading the content, they break accessibility, distract over understanding the difficult topic, make the content brittle against changes in the platform (different browsers or future standard updates), and as others pointed out make it difficult or impossible to use alternative presentations.

With most comments commenting on the presentation and not on the content, I think it makes clear that it detracts from the experience more than helps.

Re:A Visual Guide to Vision Transformers by SpaceManNabs on Tuesday April 16, 2024 @11:30AM (#40053293)
Lucas Beyer has a lot of references and material as well that I recommend.
Re:A Visual Guide to Vision Transformers by tantalor on Tuesday April 16, 2024 @11:26AM (#40053238)
Stop scrollytelling! It's awful, nobody should do this.
Re:A Visual Guide to Vision Transformers by 4chandaily on Tuesday April 16, 2024 @11:44AM (#40053509)
Agreed. My scroll wheel should scroll the page, not advance slides or split birds or whatever else. If you need to do this kind of information display, use buttons or a UI widget to control it. Don't hijack the HID devices I use for accessibly operating my computer.

This goes for Scroll Wheels, Scrollbars, the Back Button, the Right Click Button, or any other standard input paradigm. (please) Don't fuck with these! Some of us make use of accessibility features, and messing with our interfaces makes these break or behave in unexpected ways.

Re:A Visual Guide to Vision Transformers by layer8 on Tuesday April 16, 2024 @11:48AM (#40053571)
This. You can’t use reader mode, you can’t save the page as a PDF, you can’t use PageUp/PageDown because you’ll miss some in-between state, and the scroll position where a certain image is shown may not be the preferred one for reading the corresponding text. And the JS will invariably break sooner or later.
Re:A Visual Guide to Vision Transformers by elicash on Tuesday April 16, 2024 @12:38PM (#40054147)
I'd be annoyed if my bank did this, or airlines, or anything where I just need to get a task done.

For personal websites, I actually think individuality and fun and creativity are good.

Re:A Visual Guide to Vision Transformers by observationist on Tuesday April 16, 2024 @12:46PM (#40054252)
It's aggressively inaccessible. I don't know if it's a "I'm a web designer, I know better" thing or what.

Web designers: Don't let form interfere with function. The function of this page is to communicate information about transformers. The form effectively prevents that from happening. Don't do it. No, bad, stop.

[dead]
Re:A Visual Guide to Vision Transformers by bArray on Tuesday April 16, 2024 @10:28AM (#40052400)
Nice! A small piece of feedback: I would have the dimensions mentioned in the text also annotated on the diagram. It wasn't exactly clear how the input data was flattened for example.
Re:A Visual Guide to Vision Transformers by byteknight on Tuesday April 16, 2024 @10:40AM (#40052565)
Would also add, as a 100% math idiot, linear transformations, and how it performs them is not explained.

Entirely plausible this is intended for someone more "mathmatical" than myself but appreciate the work regardless.

Re:A Visual Guide to Vision Transformers by md2rp on Tuesday April 16, 2024 @11:43AM (#40053500)
Thanks for the feedback! I left it out intentionally but probably worth thinking about doing a more fundamental guide!
Re:A Visual Guide to Vision Transformers by md2rp on Tuesday April 16, 2024 @11:45AM (#40053526)
Thanks for the feedback! Will add it in the revision!
Re:A Visual Guide to Vision Transformers by lyapunova on Tuesday April 16, 2024 @01:51PM (#40055009)
To be honest, I actually really like the visual delivery here. It's especially helpful for understanding what's going on with computer vision problems. Please make more!
Re:A Visual Guide to Vision Transformers by nothrowaways on Tuesday April 16, 2024 @08:13PM (#40058969)
Neat
Re:A Visual Guide to Vision Transformers by Jacob__ on Wednesday April 17, 2024 @12:14PM (#40066731)
I like it a lot.
Re:A Visual Guide to Vision Transformers by bilsbie on Wednesday April 17, 2024 @01:12PM (#40067522)
This is great. Is it better to combine this with a language model so it can also apply knowledge about relationships between items?