Re:Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
by davidzweig on Thursday August 15, 2024 @09:33PM
(#41262277)
I was trying this with the original llama model. I guess the model didn't really know it's meant to be a 'knowledgeable ai assistant', but rather simulated chats it had seen. If you asked it, 'how to make brownies', it might reply, 'idk, can't you google it?'.
Re:Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
by d13 on Friday August 16, 2024 @07:10AM
(#41265235)
When you prime it with those initial 10-20 examples, the responses need to be in the style that you’d like it to respond to. You can use Claude or ChatGPT to help you write those. The model will then just continue on in that same style.
Re:Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
by viraptor on Friday August 16, 2024 @07:26AM
(#41265319)
Unfortunately those examples blow up the cost compared to just asking the question. It's a nice workaround, but not always feasible. (Unless everyone adopts context caching like deepseek and anthropic did)
Re:Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
by rustcleaner on Thursday August 15, 2024 @11:01PM
(#41262748)
I often force compliance out of Llama by starting Llama's response in a very compliant manner.
My favorite use right now is for language translations. I finally feel comfortable browsing foreign languages, knowing Google isn't sitting there as a third party with a coherent view of my foreign language readings!
Re:Hermes 3: The First Fine-Tuned Llama 3.1 405B Model
by kenmacd on Friday August 16, 2024 @10:53AM
(#41266956)
> by providing it with 10 to 20 examples of a chat dialogue in the initial prompt context
Can you recommended examples (or a source of examples) that would have models act similar to the instruct models?
Surprisingly few people seem to know this. But, this is how chat models were created in the GPT3/2 era before instruct models became the norm.