News for hackers. Stuff that matters.
Re: by treprinum on Thursday July 27, 2023 @06:31PM (#36901015)
This Stanford seminar video can provide some references:

https://www.youtube.com/watch?v=tVtOevLrt5U

Re: by jph00 on Thursday July 27, 2023 @09:16PM (#36902107)
That video shows examples of new models with one-shot performance better than old models with fine-tuning. It doesn't compare new models with fine-tuning to new models without fine-tuning.
Re: by treprinum on Friday July 28, 2023 @07:41AM (#36905461)
Right, the page 28 of this article mentions "On some benchmarks, task-general models (not explicitly trained to perform a task) surpass prior state-of-the-art performance held by a task-specific model" but they don't provide data for fine-tuning of their very large models:

https://arxiv.org/pdf/2206.07682.pdf