What you are describing is called "backdriving" the gearbox. Generally speaking, gear trains with high reduction ratios don't like to be backdriven. Small steel gear trains with ratios in the 1000:1 range can destroy themselves when back driven.