Actually, the visa regime in Ukraine is pretty soft now. Most people can stay up to 3 months without a visa.

And there are guided tours for the Balaklava Submarine base.

I was in town just last summer, didn't get to go to the base though.