This specific implementation won't easily work on the GPU, it's mostly the grid based ones that are easy to parallelize. You could even stick to common fragment shaders if you wanted to port that to the GPU.
Diamond square should be good enough for initial terrain, but I'd keep it smooth; let the erosion take care of the details.
I'm currently using diamond-square to generate the mountains, and it looks good, but my erosion algorithms tended to look off.
There's a fascinating world of compute shaders with Unity that would push this onto the GPU, but I don't know if I'll get that far with this project.
Thanks for sharing!