The chapter on groups is a good introduction. It is tailored for physical applications but the basic is really nicely presented and can be useful before reading, say, books on cryptography.