Cerebras-GPT vs. LLaMA AI Model Performance Comparison

Re:Cerebras-GPT vs. LLaMA AI Model Performance Comparison by nl on Thursday March 30, 2023 @02:02AM (#35368665)

The most relevant reported benchmark results are on https://arxiv.org/abs/2103.03874

They compare it against PaLM and Minerva, both of which are fine tuned on math datasets.

It outperforms both at roughly the same parameter count (eg Llama 65B vs Palm and Minerva 62B) but unclear how much of this is due to encoding vs the many other differences.

It is useful to see that the performance increase is clearly not due to fine turning though.

[ Parent | on HN ]

Re:Cerebras-GPT vs. LLaMA AI Model Performance Comparison by cma on Thursday March 30, 2023 @01:10PM (#35375942)

Where do I look, the paper was from 2021 before llama but did they update it (or you mean the llama paper mentions that benchmark)?

[ Parent | on HN ]

Re:Cerebras-GPT vs. LLaMA AI Model Performance Comparison by nl on Thursday March 30, 2023 @06:40PM (#35379832)

I posted the wrong link sorry!

https://arxiv.org/pdf/2302.13971.pdf (the Llama paper), table 7.

[ Parent | on HN ]