News for hackers. Stuff that matters.
Re:How to Fine-Tune Llama2 by amilios on Thursday July 27, 2023 @12:43AM (#36889008)
It's incredible how far we've come with quantization and parameter-efficient fine-tuning a la QLora. It's legitimately possible to fine-tune multi-billion parameter models on Google Colab or a consumer GPU. I can see how something like this service can be useful to simplify things for those that don't want to deal directly with hardware, but if you do have your own hardware it's amazing how much more you can do with it than before.

There are no comments on this comment yet.