News for hackers. Stuff that matters.

A comment on How did you fine tune your chatbot?.

Re:How did you fine tune your chatbot? by brucethemoose2 on Sunday July 09, 2023 @04:01PM (#36658301)
Try out Samantha, a llama 33b finetune, which may already be what you want: https://erichartford.com/meet-samantha

Run this one on exLLaMA\tui if you happen to have a 3090/4090 to run it on: https://huggingface.co/TheBloke/Samantha-33B-SuperHOT-8K-GPT...

And otherwise this on any decent PC: https://huggingface.co/TheBloke/Samantha-33B-SuperHOT-8K-GGM...

That would be a good starting point for a finetune if its not quite right.

[ Parent | on HN ]

There are no comments on this comment yet.