That's the idea behind how they work, but cold diffusion and latent consistency models show that you don't actually need any particular step.