Mathematica is pretty great, but just about any Turing-complete non-esoteric language will suffice for concisely expressing his ’insights’ and doing his ’experiments’. I suppose the lack of boilerplate code made possible by the behind-the-scenes environment is useful (from a practical standpoint), though.
I couldn't get past 10% of the book before I got sick of the "Look how great Mathematica is for describing these algorithms!"