News for hackers. Stuff that matters.

A comment on Show HN: We've open-sourced our LLM attention visualization library. Parent comment

Re:Show HN: We've open-sourced our LLM attention visualizati... by lakshith-403 on Sunday June 09, 2024 @02:21PM (#40626382)
I'm not a primary user. Just cleaned up the existing codebase to make it open source. But you could use this to visualise attentions and debug the model.

For an example if you're working on a Q&A model, you can check which tokens in the prompt contributed to the output. It's possible to detect issues like output not paying attention to any important part of the prompt.

[ Parent | on HN ]
Re:Show HN: We've open-sourced our LLM attention visualizati... by 3abiton on Monday June 10, 2024 @05:59AM (#40631871)
The issue with the ambiguity of usage plague lots of OSS projects. Guides/Tutorials will always help drive usage much more, just look at the usage of GPT-3 vs ChatGPT (which is GPT-3.5 with WebUI slapped on top of it).
[ Parent | on HN ]