And not only are the matrices small, they're probably known (or assumed) to be well-conditioned.
Inverting even a small hilbert matrix will probably go boom.
Re:Don’t invert that matrix (2010)
by GFK_of_xmaspast on Thursday May 12, 2016 @09:45PM
(#11688099)
Not just well conditioned, but special orthogonal.
In my research, specifically, that spatial mesh can have as many as 10^7 grid points. For linear systems of this size, any exact solution at all is impractical - we exclusively employ iterative approximations built from terms of the form (A^n) b since matrix-vector products are about the only things we can compute in a reasonable amount of time.