Re:Lucidrains/self-rewarding-lm-PyTorch: Self-Rewarding Lang...
by column on Thursday January 25, 2024 @10:31AM
(#39130565)
I kind of disagree. It's not "user friendly" but it is very descriptive. They are codenames afterall. Take "dolphin-2.6-mistral-7b-dpo-laser" for instance : with a little LLM background knowledge, just from the name you know it is a 7 billion parameters model based on Mistral, with a filtered dataset to remove alignment and bias (dolphin), version 2.6 and using the techniques described in the Direct Preference Optimization (https://arxiv.org/pdf/2305.18290.pdf) and Laser (https://arxiv.org/pdf/2312.13558.pdf) papers to improve its output.
[ Parent
| on HN ]
Re:Lucidrains/self-rewarding-lm-PyTorch: Self-Rewarding Lang...
by salad-tycoon on Thursday January 25, 2024 @11:35AM
(#39131398)
And here I was thinking they were somehow using the first three words from my Bitcoin wallet.
Re:Lucidrains/self-rewarding-lm-PyTorch: Self-Rewarding Lang...
by spidersenses on Thursday January 25, 2024 @10:55AM
(#39130871)
Thank you for a great and informative explanation despite my somewhat ignorant take.
I'm an occasional visitor to huggingface, so I'm actually superficially familiar with the taxonomy. I just felt like, even if I tried to satirize it, I wouldn't be able to come up with a crazier name. And that's not even the end of the Cambrian explosion of LLMs.