My understanding and interest for crypto came by reading "Singh Simon : The Code Book". This book tells the history of cryptography from Persians to quantum computing. Great and surprisingly easy read with great historical stories and presents every idea which leads to today's hashes and private/public key pairs.