Ah, yes, that is incredibly annoying behaviour. I was getting annoyed at this just yesterday! That would be fine on iOS if it only happened when you flicked the image, but scrolling from the side edges of the screen in Safari should always navigate forward and back.

They must have actually had to do work to override the expected behaviour and break the user experience, which I just don't get.