No, that's irrelevant: http://hyperphysics.phy-astr.gsu.edu/hbase/mechanics/sphshel...
That's for a hollow shell.
For a solid sphere, there is always force toward the center. (And the closer to the center the lower the force, reaching 0 in the middle.)
No, the force is EXACTLY zero, not just very small.
Inside the cave yes, but not when it's inside the solid mass of the earth. Inside a solid sphere the force is toward the center.
[EDIT] Hmm I think I see the point. The resulting force would be proportional to the ratio (black hole mass / earth's mass). Very small indeed.