GPUs may have existed in the 90's but they were very specialized to graphics and couldn't do general purpose computation like factoring integers.