News for hackers. Stuff that matters.
Re:Lucidrains/self-rewarding-lm-PyTorch: Self-Rewarding Lang... by column on Thursday January 25, 2024 @10:31AM (#39130565)
I kind of disagree. It's not "user friendly" but it is very descriptive. They are codenames afterall. Take "dolphin-2.6-mistral-7b-dpo-laser" for instance : with a little LLM background knowledge, just from the name you know it is a 7 billion parameters model based on Mistral, with a filtered dataset to remove alignment and bias (dolphin), version 2.6 and using the techniques described in the Direct Preference Optimization (https://arxiv.org/pdf/2305.18290.pdf) and Laser (https://arxiv.org/pdf/2312.13558.pdf) papers to improve its output.
Re:Lucidrains/self-rewarding-lm-PyTorch: Self-Rewarding Lang... by salad-tycoon on Thursday January 25, 2024 @11:35AM (#39131398)
And here I was thinking they were somehow using the first three words from my Bitcoin wallet.
Re:Lucidrains/self-rewarding-lm-PyTorch: Self-Rewarding Lang... by spidersenses on Thursday January 25, 2024 @10:55AM (#39130871)
Thank you for a great and informative explanation despite my somewhat ignorant take.

I'm an occasional visitor to huggingface, so I'm actually superficially familiar with the taxonomy. I just felt like, even if I tried to satirize it, I wouldn't be able to come up with a crazier name. And that's not even the end of the Cambrian explosion of LLMs.