I always thought the origin was from "bugbear", an irritating or annoying thing that had be endured if not eliminated.