The install-gpu.sh script found in fastai's github can be used to set up the required environment on an Ubuntu box.

A GTX 970 should do. The exercises are designed for GPUs with more memory, so you'll need to use smaller batch sizes here and there.