Yeah, it definitely looks more magical until you peer behind the curtain, and then it looks obvious. Of course it's all just circuits; of course there are simple patterns to look for in obvious places. But that's with the benefit of cribbing off the thing's work—it's really hellishly clever isn't it, so workmanlike to make such things quotidian.

And of course there's the tendency for LLMs to be completely unable to approach a problem in January, really quite shit in February, rather poor in March, and superhuman in April.