OpenAI is betting on scaling, which means using more compute per request. More users times more compute is a lot more compute needed. We don't need to assume specifically what techniques will be used.