> the network of neurons and how they interact in our wet slow electrochemical brains, while being in theory mathematically equivalent to a software neural network

An LLM so-called neuron are little more than a few foating point number muladds.

> isn't sufficiently well understood to tell us how close the software neural network is to being practically equivalent.

Yes it is. The LLM is nowhere near.