How large are large language models? (2025)

Re:How large are large language models? (2025) by rain1 on Wednesday July 02, 2025 @11:08AM (#44444690)

The Gemma models are too small to be included in this list.

You're right the T5 stuff is very important historically but they're below 11B and I don't have much to say about them. Definitely a very interesting and important set of models though.

[ Parent | on HN ]

Re:How large are large language models? (2025) by tantalor on Wednesday July 02, 2025 @11:46AM (#44445159)

> too small

Eh?

* Gemma 1 (2024): 2B, 7B

* Gemma 2 (2024): 2B, 9B, 27B

* Gemma 3 (2025): 1B, 4B, 12B, 27B

This is the same range as some Llama models which you do mention.

> important historically

Aren't you trying to give a historical perspective? What's the point of this?

[ Parent | on HN ]

Re:How large are large language models? (2025) by kamranjon on Wednesday July 02, 2025 @04:29PM (#44448467)

Since you included GPT-2, everything from Google including T5 would qualify for the list I would think.

[ Parent | on HN ]