News for hackers. Stuff that matters.

A comment on H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark. Parent comment

Re:H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark by jsjohnst on Wednesday June 28, 2023 @08:05PM (#36514540)
Moore’s law never applied to ram and again, you aren’t comparing apples to apples either. There’s a lot of factors that go into building a complete system, so stop trying to apply an old cpu transistor adage to something it was never intended for and maybe you’ll have better success?
[ Parent | on HN ]
Re:H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark by esperent on Thursday June 29, 2023 @02:45AM (#36517192)
Moore's law never applied to GPUs either. I don't know if it even said anything about CPUs, specifically. It's about transistor density vs cost.

Roughly the same tech advances apply to making all three kinds of chips so I think it applies (somewhat) equally to CPU, GPUs, RAM and even SSDs etc.

Bearing in mind that ram lags a few generations behind CPU and GPU (I think DDR5 is 12nm vs latest GPUs around 4nm). And also that Moore's law is not a physical law, even when it was in full swing it was only ever meant as a rough guideline for what to expect over a couple of years period.

[ Parent | on HN ]