I think that's because they used the original fake to make the deepfake. If they had used an actual actor (with a completely different face but accurate mouth movement) I think it would have been spot on.