News for hackers. Stuff that matters.
Re:Qwen2 LLM Released by danielhanchen on Friday June 07, 2024 @01:37AM (#40605627)
Ye smaller models are fantastic for finetuning and probably on device applications - they can act as like a first pass on most LLM applications, then if it requires a larger model to intervene, then it can pass if off to some larger one. I do have a Colab to finetune 0.5b 2x faster here for those interested: https://colab.research.google.com/drive/1-7tjDdMAyeCueyLAwv6...

There are no comments on this comment yet.