How is difficult to argue that a former student isn't a student?
She was, officially, his student at the time of the relationship. He admits this. He is trying to argue that, while he was officially her advisor at the time, she had already completed all of the requirements of the degree, and he was only nominally her advisor as a result of academic technicalities.
This isn't even just to protect the student, and I expect that the rule was originally developed when universities didn't care about the potential for the student being abused: it also causes a potential for unfairness to everyone else, especially when the relationship is clandestine.
Academia is somewhat unusual in that relationships within research communities and universities need to be allowed, are rather common and accepted, and often even need to be accommodated by universities. Strict restrictions on them at some universities in the past actually caused serious problems at times. Many situations are accepted, so long as they are appropriately handled, even when there are close professional connections involved, and even, sometimes, between faculty and graduate students, when the student isn't their student.
But sleeping with your students has always been a deadly sin in academia. And this appears to be a case of someone trying to argue that, while he slept with his student, she wasn't really his student at the time. That's a difficult argument to make.