Vision Mamba: Efficient Visual Representation Learning with Bidirectional SSM

Re:Vision Mamba: Efficient Visual Representation Learning wi... by az226 on Thursday February 01, 2024 @11:57AM (#39218113)

Kind of weird we haven’t seen Mistral 7B Mamba. Until that’s out it’s untested vaporware.

[ Parent | on HN ]

Re:Vision Mamba: Efficient Visual Representation Learning wi... by jasonjmcghee on Thursday February 01, 2024 @12:36PM (#39218680)

This isn’t a fine tune. It’s not even a transformer like Qwen, Llama, GPT, Gemini, or Mistral. It’s another approach to language models based on RNNs

[ Parent | on HN ]

Re:Vision Mamba: Efficient Visual Representation Learning wi... by Solvency on Thursday February 01, 2024 @01:23PM (#39219309)

Doesn't the point remain though -- when/where do we demo this?

[ Parent | on HN ]

Re:Vision Mamba: Efficient Visual Representation Learning wi... by junipertea on Thursday February 01, 2024 @01:24PM (#39219341)

There is Mamba 7B pre trained model on hugging face/ LM studio right now.

[ Parent | on HN ]

Re:Vision Mamba: Efficient Visual Representation Learning wi... by neuronexmachina on Thursday February 01, 2024 @12:21PM (#39218457)

Do you mean include it with the Mixtral "Mixture of Experts" model? I'm not sure Mistral Mamba makes sense, since it's a completely different architecture.

[ Parent | on HN ]