What happens with excess hardware that’s been already bought? It could take years for all of that to be absorbed by smaller companies. And secondly, if this opens the era of self-training models then why go for a 671B one and not a smaller that’s fine-tuned to a company’s specific needs and can then run on consumer GPUs. At 70B with 8-bit quantization you’re good with just three 3090s.