> The problem is that it's also computationally expensive and therefore we reduce the stiffness of objects to make it faster.

Are y'all using penalty methods for the collisions? Which model does it use?