I mean as a passive investor this stuff should terrify you. You're learning that your "passive" is actually quite active. It's why people suggest VTI over VOO/SPY for "true" passive.

If you want to be active then keep your positions but just know and accept the active label.