I think you are viewing it not as an iterative process. If you have code that isn't covered by a test, then by all means feel free to refactor such that that code isn't needed.

If you can look at it and see the code is needed, then you are clearly lacking a test that shows why it is needed. You can let both ends inform the next step.