Neural networks have non-linearities. There were hacks for doing some sort of general purpose computation using the GPU fixed rendering pipeline, but they're not enough for neural networks especially as understood today. You need general shaders, which were a relatively late development.