News for hackers. Stuff that matters.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by Tostino on Monday April 10, 2023 @11:17AM (#35513344)
The main "issue" with this approach, is you can't iterate quickly. If your idea didn't pan out, you may have wasted some serious time on that one attempt. Not trying to knock it, just wanted to point out that there are potential downsides.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by lostmsu on Wednesday April 12, 2023 @03:43PM (#35545642)
You don't have to restart training though. You can tune hyperparameters and fork one of the previous checkpoints.