You don't even need the wormhole. You just accelerate away to relativistic speeds then turn around and come back. It doesn't matter which direction you're going, just that you're going _fast_.