At least the Chrome implementation has a little X in the upper right corner which you can use to delete the Flash object without ever activating the plugin.

Personally, I just don't have Flash enabled at all – it's a security win and I haven't heard my laptop's fans while browsing in ages.