Re:Mistral 7B Paper on ArXiv
by tarruda on Wednesday October 11, 2023 @10:29AM
(#37844847)
It is better than llama 2 7b and 13b. I tried the OpenOrca fine tune and it is very good, even when 4-bit quantized
[ Parent
| on HN ]
What does OpenOrca do? It’s just instruction tuning it?
Yes, it is a instruction tune dataset: https://huggingface.co/datasets/Open-Orca/OpenOrca
It felt different from the official Mistral7B-Instruct. One of the highlights with the OpenOrca version is that you can steer the model with a system prompt (eg "You are a 5 year old")