As a hobby road cyclist I can recommend doing some core / stability training in addition to cycling. And of course, make sure that your bike and its geometry (saddle and stem height, stack and reach) generally fit you. Biking should not hurt - unless it's due to the high effort you put in.