News for hackers. Stuff that matters.
Re:Meta Llama 3 by barrell on Friday April 19, 2024 @12:49AM (#40083525)
Meta Llama 3 8B vs Claude Haiku according to their press releases if anyone else was curious

| Benchmark | Llama3 8B | Claude Haiku |

| ------------- | ----------- | ------------ |

| MMLU ____ | 68.4 ____ | 75.2 _______ |

| GPQA ____ | 34.2 ____ | 33.3 _______ |

| HumanEval | 62.2 ____ | 75.9 _______ |

| GSM-8K __ | 79.6 ____ | 88.9 _______ |

| MATH ____ | 30.0 ____ | 40.9 _______ |

Re:Meta Llama 3 by gliched_robot on Friday April 19, 2024 @12:54AM (#40083540)
This llama model some made it run on an iphone. https://x.com/1littlecoder/status/1781076849335861637?s=46