Yeah, I think the effect they are talking about is like getting attached to a fictional character in a novel. Writing good fiction is a different sort of achievement.

It's sort of related since doing well at a Turing test would require generating a convincing fictional character, but there's more to playing well than that.