I literally just opened the wallet app and clicked the little dismiss X in the top right of the Apple Card ad. It disappeared with a little analog TV powering off animation, collapsing down to a scanline then sliding in horizontally to a little dot and disappearing.

Both before and after I could pull up my other passes easily.