The "compatible" epub is the same epub, but with various compatibility enhancements automatically added for different ereading platforms.
Currently only web browsers can render the advanced epubs at 100% fidelity. iBooks might be the only non-browser ereading platform that does a pretty good job with the advanced epubs, as I believe it uses modern Webkit as its renderer. For any other ereader, use the compatible epubs. (Or kepubs for Kobo.)
Poor renderers are a perennial problem in the epub world and there seems to be little interest in improving the situation. Just use the compatible epubs - for reading purposes they're almost equivalent except in some rare edge cases. Or, you can use our 'read online in browser' option to read ebooks directly in your web browser, which will serve you the source of our advanced epubs. But of course reading in a browser is less than ideal.