Apples don't usually leap off the ground into trees, though. Of course, that would be more of a heat to kinetic energy conversion to start that process, but I think that's more along the lines of what the original question really meant: why don't things spontaneously launch, rather than having a one way tendency to convert potential energy to kinetic energy to heat energy.
It's hard to see gravity act in isolation: trace particles eventually slow an orbit in the same way that air friction deforms an idealized parabola/elipse by dragging on a ballistic projectile; tidal forces between earth and moon alter the moon's orbit.
But my point was simply to note that you don't have to pre-incorporate an arrow of time to make sense of the laws of gravity, in response to the poster who found this a sticking point and expressed confusion over it.
Reversing a planet's orbit produces another orbit just as valid under the law of gravity. And even at the scale of ordinary experience, gravity doesn't prohibit objects from rising (after all, in the canonical example of tossing a ball through a parabolic arc, there is both a rise and a fall); footage of a ball falling under the influence of gravity reverses into footage of a ball rising under the influence of gravity and vice versa, but never does footage compatible with the law of gravity reverse into footage incompatible with the law of gravity.