Yandex YaLM 100B: Largest GPT-Like Neural Network in Open Source Posted by tosh on Sunday December 04, 2022 @08:18AM from the medium.com dept. https://medium.com/yandex/yandex-publishes-yalm-100b-its-the-largest-gpt-like-neural-network-in-open-source-d1df53d0e9a6 ( 3 comments | 4 points | on HN )
Since then, around 70,000 new Transformer models have been released via HF.
There are several models much larger than YaLM, including BigScience BLOOM 176B and Tsinghua GLM-130B.
https://lifearchitect.ai/timeline/
https://lifearchitect.ai/models/