armin976

https://noemaai.com/

I wanted to share a use case for Noema Overfit, a model-paging system available today in the Noema app. For disclosure, I founded Noema and I am part of the team that has helped develop the system.The way it works is that the non-expert weights remain resident in memory, while the model’s routed expert weights are read from storage as needed. This makes it possible to run models that would...