We also have a good idea of how individual neurons work, but struggle a lot with understanding brains. Both LLMs and human brains have a lot of emergent behavior, which is why our understanding the low-level primitives only provides very limited insight.

We still don't have a good lower bound on the complexity of matrix multiplication.