That's a good question. I'm not sure if there is a better way but I would just delete it from <profile>/extensions. You can find <profile> by going to about:support and looking for "Profile Directory" (6th from the top for me).