News for hackers. Stuff that matters.
Re:Hermes 3: The First Fine-Tuned Llama 3.1 405B Model by d13 on Thursday August 15, 2024 @05:16PM (#41260457)
All base, “text-completion” models are uncensored, including Llama 3. You can make text-completion models behave like an uncensored “instruct” (chat) model simply by providing it with 10 to 20 examples of a chat dialogue in the initial prompt context, making sure to use the model’s exact prompt format. Once the model notices the pattern, it will continue like that.

Surprisingly few people seem to know this. But, this is how chat models were created in the GPT3/2 era before instruct models became the norm.

Re:Hermes 3: The First Fine-Tuned Llama 3.1 405B Model by davidzweig on Thursday August 15, 2024 @09:33PM (#41262277)
I was trying this with the original llama model. I guess the model didn't really know it's meant to be a 'knowledgeable ai assistant', but rather simulated chats it had seen. If you asked it, 'how to make brownies', it might reply, 'idk, can't you google it?'.
Re:Hermes 3: The First Fine-Tuned Llama 3.1 405B Model by d13 on Friday August 16, 2024 @07:10AM (#41265235)
When you prime it with those initial 10-20 examples, the responses need to be in the style that you’d like it to respond to. You can use Claude or ChatGPT to help you write those. The model will then just continue on in that same style.
Re:Hermes 3: The First Fine-Tuned Llama 3.1 405B Model by viraptor on Friday August 16, 2024 @07:26AM (#41265319)
Unfortunately those examples blow up the cost compared to just asking the question. It's a nice workaround, but not always feasible. (Unless everyone adopts context caching like deepseek and anthropic did)
Re:Hermes 3: The First Fine-Tuned Llama 3.1 405B Model by rustcleaner on Thursday August 15, 2024 @11:01PM (#41262748)
I often force compliance out of Llama by starting Llama's response in a very compliant manner.

My favorite use right now is for language translations. I finally feel comfortable browsing foreign languages, knowing Google isn't sitting there as a third party with a coherent view of my foreign language readings!

Re:Hermes 3: The First Fine-Tuned Llama 3.1 405B Model by kenmacd on Friday August 16, 2024 @10:53AM (#41266956)
> by providing it with 10 to 20 examples of a chat dialogue in the initial prompt context

Can you recommended examples (or a source of examples) that would have models act similar to the instruct models?