News for hackers. Stuff that matters.

A comment on Show HN: LLM Attention Visualization.

Re:Show HN: LLM Attention Visualization by wopak on Tuesday September 08, 2026 @02:46PM (#49614860)
neat, combining info from two phrases is hard to see without such a tool.

are you worried later-layer attention gets drowned out by earlier layers just because there are more of them contributing to the sum?

[ Parent | on HN ]
Re:Show HN: LLM Attention Visualization by ifz on Tuesday September 08, 2026 @03:03PM (#49615117)
Hmm, I might try to add some controls to limit which layers get summed up. It might be able to reveal more patterns.

Right now only simple correlations are visible.

[ Parent | on HN ]