Nah. It's not about how fit you are, it's about what type of riding you enjoy. A road bike lets you go faster, but also makes you push yourself more that you otherwise would, because of the geometry and posture. If you prefer to have relaxing rides you're not going to enjoy road bikes, because they're just not built to facilitate them.