News for hackers. Stuff that matters.

A comment on Open-Source Data Collection Platform for LLM Fine-Tuning and RLHF.

Re:Open-Source Data Collection Platform for LLM Fine-Tuning ... by xrd on Monday June 05, 2023 @03:00PM (#36201450)
Looks like no quantized options with llama.cpp?

https://github.com/ggerganov/llama.cpp/issues/1602

[ Parent | on HN ]
Re:Open-Source Data Collection Platform for LLM Fine-Tuning ... by dvilasuero on Monday June 05, 2023 @03:11PM (#36201783)
We're very much looking forward to seeing Falcon-40B support on llama.cpp. For production use cases, this is also highly relevant: https://huggingface.co/blog/sagemaker-huggingface-llm
[ Parent | on HN ]