These costs are falling by factors of 2 every year based solely on hardware progress ( gpu tech has beat Moore’s law for DNNs the last several years). ChatGPT may become much cheaper to operate/train in the future.