Why the thing that keeps them from occupying the same quantum mechanical state by holding them apart (like in neutron stars) is not called force (the fifth one)?

That's actually quite funny that we call 'fundamental forces' only the forces that we can't explain the source of.