It depends on the computational step. Often we "just" need to compute the determinant, in which case we use a trick. In some other cases, we do only need linear solves. Exact inversion of the whole thing is often prohibitive.