If you are frustrated, maybe try building your own? It's not exactly a secret how to train transformer based language models. The data is pretty much publicly available.