I believe the good news is that now they have a way of sustaining the product while giving up a free? service. Does anyone has the link about that article about the marginal costs of inference of LLMs? I wonder how much profitable it is.

Overall interesting times to come. I just hope llama, Alpaca etc will soon be improved, fine-tuned and commoditized.