This idea has been explored before.
For example, a man had an AI girlfriend in a movie and she hired someone to keep her in her ear and follow instructions on what to say and do, so that she could be physically intimate with her human by borrowing someone’s body. Stuff like this could be interesting, people acting as surrogates for AI or just using AI to augment their conversation skills.
What I'm saying is, have a little bit more imagination and imagine someone seemingly in natural conversation, who is actually an LLM. Could they be engaging? IMO quite a bit more engaging compared to someone reading Wikipedia out loud. Would it be artificial? It still is. But would the conversation partner notice? Maybe not for a while. Would I hate it? Of course...