Re:Molmo: a family of open multimodal AI models
by comp_raccoon on Wednesday September 25, 2024 @07:46PM
(#41653047)
This is correct! we wanted to show that you can use PixMo dataset and our training code to improve any open model, not just ours!
EDIT: From the post "For the LLM, we have trained models on a variety of choices at different scales and degrees of openness including: the fully open-weight and data OLMo-7B-1024 (using the October, 2024 pre-released weights, which will be public at a later date), the efficient fully open-weight and data OLMoE-1B-7B-0924, open-weight Qwen2 7B, open-weight Qwen2 72B, open-weight Mistral 7B, open-weight Gemma2 9B, and Phi 3 Medium). Today we are releasing 4 samples from this family."