Can you explain what the problem is? I recently switched the mobile formatting so Google would stop complaining that my page wasn't optimized for mobile. But maybe that made things worse.

I left a more detailed reply (https://news.ycombinator.com/item?id=12514009) to the other person in the thread, but basically while trying to zoom I get sent to other posts or images.

Looked fine on iPhone. What phone do you have?

iPhone 6s and safari. If I zoom in on a picture and touch the image at all, when I let go the page navigates to the image as if I clicked on it.

Also in my efforts to zoom in on things, the page registers a left/right swipe and decides I want to go to the next/previous blog post.

I don't quite understand the problem. You say when you touch an image and let go, it navigates to the image as if you clicked on it. Isn't touching and letting go the definition of clicking?