I'm still on KitKat, but I think you can swipe down over the notification to open up a dismiss option underneath the notification.
(at least you can on kitkat, I swipe down over 3 alarms at once and dismiss them all)
I've been happy with Alarm Clock Plus as my wake up alarm. has the ability to set an alarm on some days of the week, and the "skip next" feature.
Clock - I used to be able to dismiss my 7:30 wakeup alarm if I woke up at 7:20 by simply swiping away the notification. But now I can't find any way to suppress the next instance of a recurring alarm.