Re:Mixtral 8x7B: A sparse Mixture of Experts language model
by viraptor on Tuesday January 09, 2024 @12:22AM
(#38922655)
There's also some unlocked fine tunings available. Dolphin seems to be a very popular one. (Trained on more coding data) If you want to fit under 32gb, there's https://ollama.ai/library/dolphin-mixtral:8x7b-v2.7-q3_K_M
[ Parent
| on HN ]
Re:Mixtral 8x7B: A sparse Mixture of Experts language model
by NwpierratorR on Tuesday January 09, 2024 @07:05AM
(#38925157)
I haven't played with dolphin-mixtral, but dolphin-mistral gave me a good impression for generic rag application.
There's also developments and experimentation in making it more factual via dpo and laser(afaik so far not very unsuccessful).