News for hackers. Stuff that matters.
Re:Eliezer Yudkowsky on large language model economics by shenberg on Tuesday March 14, 2023 @11:58AM (#35153617)
It's referred to as distillation in the literature in separate sub-fields (e.g. LRspeech, a paper about low-resource speech-to-text & text-to-speech from Microsoft Research, 2020, uses datasets generated by a large model to train a small one and refers to this as knowledge distillation: https://arxiv.org/abs/2008.03687 )

There are no comments on this comment yet.