You can middle-click on the taskbar icon to do that -- and it works for other apps, too.