News for hackers. Stuff that matters.
Re:Extracting concepts from GPT-4 by leogao on Thursday June 06, 2024 @11:12PM (#40604949)
We were planning to release the paper around this time independent of the other events you mention.

I think it is still predominantly accurate to say that we have no idea how LLMs work. SAEs might eventually change that, but there's still a long way to go.

Re:Extracting concepts from GPT-4 by joaquincabezas on Friday June 07, 2024 @06:14AM (#40607118)
it makes sense that the leaders are building around similar ideas in parallel, for me it's a healthy sign