News for hackers. Stuff that matters.

A comment on Open models by OpenAI. Parent comment

Re:Open models by OpenAI by coolspot on Tuesday August 05, 2025 @03:04PM (#44802706)
10B * 2000 t/s = 20,000 GB/s memory bandwidth . Apple hardware can do 1k GB/s .
[ Parent | on HN ]
Re:Open models by OpenAI by oezi on Tuesday August 05, 2025 @05:42PM (#44804764)
That’s why MoE is needed.
[ Parent | on HN ]