Re:Decomposing Language Models into Understandable Components
by moralestapia on Sunday October 08, 2023 @10:58AM
(#37811052)
See, https://transformer-circuits.pub/2023/may-update/index.html#....
They also reference, https://distill.pub/2020/circuits/equivariance/.
I'd also add, https://distill.pub/2021/multimodal-neurons/.
what is the manifold here and what evidence do you have for this / what does it look like when you "define" them?