Re:Not All Language Model Features Are Linear
by jengels_ on Saturday May 25, 2024 @01:55AM
(#40472918)
Sure, but completeness is a much higher bar than being able to find at least some things we weren’t looking for. And I’m reasonably optimistic that we’re going to make SAEs much better in the future, I agree they’re definitely imperfect right now
https://www.lesswrong.com/posts/BduCMgmjJnCtc7jKc/research-r...