Interesting. I did the same exercise with the pretrained Xception and 2 dense layers at the end and only got 83% accuracy. Thanks for sharing the tweaks you made, that's good to know. I wasn't aware of those techniques.