News for hackers. Stuff that matters.

A comment on We Found an Neuron in GPT-2. Parent comment

Re:We Found an Neuron in GPT-2 by nl on Thursday February 16, 2023 @04:54PM (#34826981)
You could run this analysis on a laptop very easily.

The pile-10k dataset they used for analysis is 33MB, and GPT2 runs ok on a CPU. For the full 10K analysis it's probably quicker to get a GPU though.

[ Parent | on HN ]
Re:We Found an Neuron in GPT-2 by josephmiller on Thursday February 16, 2023 @09:37PM (#34830004)
Author here!

This is correct. We did almost all this work on a Macbook Pro. Although for the pile-10k dataset analysis we used an A100 GPU because it would take many hours to run on a laptop.

[ Parent | on HN ]