News for hackers. Stuff that matters.
Re:Meta Llama 3 by bugglebeetle on Thursday April 18, 2024 @06:50PM (#40081572)
Given the incremental increase between GPT-4 and its turbo variant, I would weight “vibes” more heavily than this improvement on MMLU. OpenAI isn’t exactly a very honest or transparent company and the metric is imperfect. As a longtime time user of ChatGPT, I observed it got markedly worse at coding after the turbo release, specifically in its refusal to complete code as specified.

There are no comments on this comment yet.