> If CUDA is so good, it'd be great to know what it does that AMD cards can't.

You are comparing Nvidia software with AMD hardware. It's the AMD software that has been lacking historically.

EDIT: here is a discussion from 2 months ago on CUDA versus ROCm. https://news.ycombinator.com/item?id=38700060