I've never thought critically about this - but in free-fall on earth, you are falling through the air which could be used to measure the direction of the fall.