News for hackers. Stuff that matters.

A comment on Show HN: We've open-sourced our LLM attention visualization library.

Re:Show HN: We've open-sourced our LLM attention visualizati... by ravjo on Sunday June 09, 2024 @11:50AM (#40625255)
Sounds great. Non-engineer, but curious. Is there a walkthrough blog post or video that can help someone appreciate/understand this easily?
[ Parent | on HN ]
Re:Show HN: We've open-sourced our LLM attention visualizati... by swifthesitation on Sunday June 09, 2024 @02:35PM (#40626487)
Attention in transformers, visually explained | Chapter 6, Deep Learning - 3Blue1Brown: https://www.youtube.com/watch?v=eMlx5fFNoYc&t=
[ Parent | on HN ]
Re:Show HN: We've open-sourced our LLM attention visualizati... by lakshith-403 on Sunday June 09, 2024 @02:46PM (#40626569)
Thank you
[ Parent | on HN ]
Re:Show HN: We've open-sourced our LLM attention visualizati... by blackbear_ on Monday June 10, 2024 @06:22AM (#40631999)
Loosely related, but also a great read: https://distill.pub/2020/circuits/zoom-in/
[ Parent | on HN ]