Re:DeepSeek won the best paper award at ACL 2025
by ethan_smith on Saturday August 02, 2025 @03:39AM
(#44765561)
The performance maintenance (or even improvement) isn't surprising - sparse attention can reduce noise by focusing only on relevant tokens. Traditional full attention dilutes focus by attending to everything equally, while NSA's pruning approach mimics how humans selectively process information.
[ Parent
| on HN ]
There are no comments on this comment yet.