News for hackers. Stuff that matters.
Re:Snapshots of Incomplete Thoughts by ekez on Saturday November 18, 2023 @06:09PM (#38325790)
The title is an allusion to the experiment which samples the output of the 12th layer of LLaMA-7b. Surprisingly, there is a fair bit of structure on the principle components of those samples.