What if I do not want to transfer the key over an insecure network of computer networks that are trivial to tamper with?
What if I would prefer to look up or obtain the key via some other means (that I deem more trustworthy that the internet)?
You need some secure, out-of-band, communication means to transfer the key fingerprint to be able to verify it. The whole aim of the CA structure is so I don't need to somehow find a secure means to contact Amazon to verify their key fingerprint prior to first connecting to their website.