Firefox did the same recently with eg Pocket, if you'd removed it from your toolbar they added it back (and they made the plugin unremovable). Very similar behaviour IMO.