News for hackers. Stuff that matters.
Re:Extracting concepts from GPT-4 by realPtolemy on Friday June 07, 2024 @02:52AM (#40605975)
Indeed, and the very last section about how they’ve now “open sourced” this research is also a bit vague. They’ve shared their research methodology and findings… But isn’t that obligatory when writing a public paper?
Re:Extracting concepts from GPT-4 by lanceflt on Friday June 07, 2024 @03:20AM (#40606102)
https://github.com/openai/sparse_autoencoder

They actually open sourced it, for GPT-2 which is an open model.

Re:Extracting concepts from GPT-4 by realPtolemy on Friday June 07, 2024 @04:47AM (#40606665)
Thanks, I must have read through the document to hastily.