Even if there's enough GPUs they also needs to be available at a cost that makes it financially viable, both in terms of purchasing price, but also power and cooling. Environmentally it might not look to good to offer LLM answers to a wider audience, there are already concerns about the water consumption of ChatGPT in some regions, see: https://fortune.com/2023/09/09/ai-chatgpt-usage-fuels-spike-...