> every aspect of society that I consider essential, has existed since before the advent of GPUs

Modern computers have allowed these 'forever existing' technologies to scale to our population growth. Try building freeways without modern computers, or performing modern medical interventions without them.