If you part the matrix room, you’ll part the IRC channel.

You can also disconnect from IRC entirely from the bridge admin room.

Finally, if someone joins a channel via Matrix and then disappears without parting or disconnecting, then after 30d we’ll boot them off IRC anyway.