News for hackers. Stuff that matters.
Re:The Coming of Local LLMs by whimsicalism on Tuesday April 11, 2023 @01:50PM (#35528603)
You can infer on your local machine.

I doubt it will take you a year to train a model.

Vicuna-13B cost $300 to train/fine-tune [0]. They trained on an A100 which costs $10k [1].

[0]: https://vicuna.lmsys.org/ [1]: https://github.com/lm-sys/FastChat/blob/main/scripts/train-v...

There are no comments on this comment yet.