Re:Show HN: We've open-sourced our LLM attention visualizati...
by lakshith-403 on Sunday June 09, 2024 @02:45PM
(#40626567)
Interesting. I think OpenAI here uses sparse autoencoders to map out sparse activation patterns in networks. Comparing them to how a real person reasons about a situations.
Inspectus, on the other hand is a general tool to visualize how transformer models pay attention to different parts of the data they process.
Inspectus, on the other hand is a general tool to visualize how transformer models pay attention to different parts of the data they process.