Release of Fugaku-LLM – a large language model trained on supercomputer Fugaku

Re:Release of Fugaku-LLM – a large language model trained on... by fnordpiglet on Monday May 13, 2024 @06:51PM (#40349501)

It could be done using abacuses too. A global shortage of GPUs is probably better addressed by producing more GPUs and making techniques more efficient.

[ Parent | on HN ]

Re:Release of Fugaku-LLM – a large language model trained on... by slt2021 on Monday May 13, 2024 @08:04PM (#40350064)

I would love to see human abacus calculating gradients like in 3 body problem https://i.imgur.com/pdz7xGh.jpeg

[ Parent | on HN ]

Re:Release of Fugaku-LLM – a large language model trained on... by fnordpiglet on Monday May 13, 2024 @11:58PM (#40351493)

Yes best scene on tv ever.

[ Parent | on HN ]

Re:Release of Fugaku-LLM – a large language model trained on... by Eisenstein on Monday May 13, 2024 @08:03PM (#40350055)

You are right. I assume that you have a fab ready to go and are licensed to produce CUDA capable GPUs?

[ Parent | on HN ]

Re:Release of Fugaku-LLM – a large language model trained on... by fnordpiglet on Monday May 13, 2024 @11:58PM (#40351494)

I’m certain they’re being built.

[ Parent | on HN ]

Re:Release of Fugaku-LLM – a large language model trained on... by rad_gruchalski on Tuesday May 14, 2024 @05:04AM (#40353091)

so it's being addressed and in the meantime someone has some fun

[ Parent | on HN ]

Re:Release of Fugaku-LLM – a large language model trained on... by fnordpiglet on Tuesday May 14, 2024 @08:24PM (#40361684)

Yeah man I’m down with using super computer clusters for anything. That’s just awesome. But the results seem more like marketing literature for GPU manufacturers to help rationalize more fab spend.

[ Parent | on HN ]