My argument is that we shouldn’t make drastic changes without ample evidence. Your moon cheese analogy doesn’t address this at all.

You should still use common sense to determine courses of action when you don't have evidence.

Absolutely, common sense is almost always avoiding drastic, often absurd changes (e.g., abolishing police). You might say that common sense is fundamentally a moderate position.