The point of Technical Debt isn't procrastinating about perfection - the point is when you get into a situation where you've dug yourself in so far that you end up screwed.

For example, I consider the entirety of the Virtualization industry to be primarily caused by technical debt surrounding legacy Windows programs. Simpler to convert an old physical server into a VM than to redo the application.

The fact that you actually have the code and can change the codebase = you're far from incurring any insurmountable technical debt.