News for hackers. Stuff that matters.
Re:Our Humble Attempt at “How Much Data Is Needed to Fine-Tune by joewferrara on Monday September 25, 2023 @01:52PM (#37647875)
This line between fine tuning and continuous pre-training is what I’m interested in. What is the investment difference between fine tuning, contoured-training and training from scratch? Do you (or anyone else) have any good sources or know of good examples where continuous pre-training is being done?

There are no comments on this comment yet.