You can have AMP without Google-injected UI, but only if you rename it, or don’t allow Google to index your page at all.

If Google indexes a page with AMP, and returns is at as a search result, it NEVER actually returns the AMP page, but always the modified one from the cache.