You're pointing at exactly what allows a skilled conman to succeed: To a casual, or even non-expert observer, the difference between a genius and a skilled impersonation of a genius will appear very small. You might not be able to make the distinction, and erroneously consider them equivalent.