News for hackers. Stuff that matters.
Re:DPO fine-tuned Mistral 7B beats Llama 70B on MT Bench by brucethemoose2 on Wednesday October 11, 2023 @04:03PM (#37849556)
I dunno. I totally missed this and will check it out.

- Huggingface is less likely to "cheat" by training on tests than other orgs, I think.

- Some finetunes are really good at a particular test (like XWin). This isnt necessarily a bad thing, if they are good at a specific niche.

There are no comments on this comment yet.