Oh for sure, it's still really cool. A few months ago I had agents do some interpretability work on GPT-2 small, reproducing the circular weekday/month features from Engels et al., and it's wild how far you can get with just a bit of prompting, given I know very little about LLM internals myself.

It's like this in every field. If you don't know something, you can ask an AI and get blown away by how much it knows. I can ask it which tools I need to cut a dovetail joint and it'll impress me.

We used to get that feeling from Google, and from books.

The way you put it sounds far far more impressive than the way GP put it though.