News for hackers. Stuff that matters.

A comment on H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark. Parent comment

Re:H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark by raverbashing on Wednesday June 28, 2023 @04:03AM (#36503670)
Variations of specializations I guess

For writing code you don't care about feeding world history to your model. So a smaller model might be better at a specialized task

Sure, having a big multi-modal-model is great, but by having specialized models you can spread tasks better

[ Parent | on HN ]
Re:H100 GPUs Set Standard for Gen AI in Debut MLPerf Benchmark by mlboss on Wednesday June 28, 2023 @10:04AM (#36506657)
But I am sure prompt understanding improves with more text data. Same with reasoning ability.
[ Parent | on HN ]