If you wanted to get really clever, you could reach at least some orbits without a rocket (other than small corrections) by taking advantage of three-body interactions with the Moon or Sun. This would require even more velocity than just getting into low-Earth orbit, I imagine.