This is why it may be tough for startups without in-house ML expertise, proprietary weights, and the resources to continually train them to retain a moat. Innovations on the base layer seem to eat light packaging layers for breakfast. I knew a guy who got early access to the GPT-3 beta a few years ago and made a site where you could upload apartment leases and get an explanation. Now with chatGPT you can just ask it for what you want it to do. Of course, both this guy's GPT-3 wrapper app, and chatGPT both give inaccurate but dangerously plausible sounding answers, but that's a different problem.

Because good products meet you where you are, in your workflow, as seamlessly as possible.

Also, presumably they will continue to refine beyond what ChatGPT is doing with better models, smarter prompts, etc.

This is literally a web app. It’s not meeting me anywhere OpenAI’s web app isn’t. There are VS code plugins that people have built that put ChatGPT in your IDE by reverse engineering the API (I wrote one).

Also, without access to the model (eg. by merely calling OpenAI’s API), no one’s refining it. They need access to the actual model (eg. Bloom)

Not with their current implementation, it's literally just making API calls to OpenAI GPT models. They can improve their prompts, but it'll never be better than what OpenAI offers as a first party.