Google and Facebook have long had language models that have been reported to be vastly superior to what was publicly available. The one that a Google engineer claimed was sentient was the most well known example. OpenAI was founded in reaction to these models being hidden away.