Re:A Philosophical Introduction to Language Models
by visarga on Thursday January 11, 2024 @04:31PM
(#38959401)
Yes.
> We follow the “Textbooks Are All You Need” approach, focusing this time on common sense reasoning in natural language, and create a new 1.3 billion parameter model named phi-1.5, with performance on natural language tasks comparable to models 5x larger, and surpassing most non-frontier LLMs on more complex reasoning tasks such as grade-school mathematics and basic coding.
Re:A Philosophical Introduction to Language Models
by ShamelessC on Thursday January 11, 2024 @05:46PM
(#38960534)
Thanks!
Re:A Philosophical Introduction to Language Models
by ignoramous on Thursday January 11, 2024 @04:58PM
(#38959843)
See also Self-Play Fine-Tuning (SPIN) https://arxiv.org/abs/2401.01335 that (per authors) tunes as well as Direct Preference Optimization (DPO).
Interesting. Can you cite anything to back up that claim?