News for hackers. Stuff that matters.
Re:Show HN: We've open-sourced our LLM attention visualizati... by lakshith-403 on Sunday June 09, 2024 @02:45PM (#40626567)
Interesting. I think OpenAI here uses sparse autoencoders to map out sparse activation patterns in networks. Comparing them to how a real person reasons about a situations.

Inspectus, on the other hand is a general tool to visualize how transformer models pay attention to different parts of the data they process.

There are no comments on this comment yet.