When you can actually play with it, you'll get to see the magic rapidly fade. Various (though increasingly rare) normal inputs will produce absurd outputs. The majority of adversarial inputs will result in completely inappropriate responses, and so on. And then of course there will be a period of time where we continue to try to refine the chatbot and work out the adversarial attacks and so on. The notion of providing any sort of distinguishment (beyond achieving a world first, a la Deep Blue) will quickly become a nonstarter.
Magic is irrelevant here. If I could understand a human's inner workings, tweak and rebuild them, would that make the human no longer a sentient being?
Not to mention that humans produce absurd outputs in some circumstances (drugs), and adversarial inputs work on humans, too: https://www.insideedition.com/15350-street-artist-painted-a-...
Or maybe we're agreeing that you can no more prove that AI is sentient than that a human is, and I just misunderstand what you wrote.
From the materialist point of view, we've already achieved the goal: humans are just another kind of a program, just not running on a silicon substrate. Respecting humans as a life form is already built into its programming.