It's kind of unintuitive, because when they're "on" the beat cycles through your active pizzas. As someone else commented, you can click on the outer edge to turn them back off.

What this really needs is the capability to edit pizzas when they're not currently being cycled through, so you can queue up new rhythms.