Nothing forbids a slight tangential component but the movement of the test particle is inevitably decreasing in r.

Closed orbits are impossible though, all test particles finish at the singularity in a finite amount of proper time.