The best first book on R I've read is Gelman and Hill's "Data Analysis Using Regression and Multilevel/Hierarchical Models" (http://www.stat.columbia.edu/~gelman/arm/). It's more focused on regression and Bayesian methods than basic probability, but it's a great book that's priced very competitively (only $39.99).