News for hackers. Stuff that matters.

A comment on The False Promise of Imitating Proprietary LLMs. Parent comment

Re:The False Promise of Imitating Proprietary LLMs by ThorsBane on Friday May 26, 2023 @08:31PM (#36090992)
Any recommended starting points for LORA training llama 30B on a specific niche? Books, tutorials, videos are all appreciated. Thanks for your time!
[ Parent | on HN ]
Re:The False Promise of Imitating Proprietary LLMs by f_devd on Friday May 26, 2023 @09:23PM (#36091233)
Currently SOTA for specialization of LLMs is QLoRA: https://github.com/artidoro/qlora
[ Parent | on HN ]
Re:The False Promise of Imitating Proprietary LLMs by ThorsBane on Friday May 26, 2023 @09:29PM (#36091253)
Thank you very much my friend. Be blessed in all that you do. <3
[ Parent | on HN ]