When Muse models first started coming out I was pretty excited that Meta models were competitive again based on the benchmarks but after trying them out it feels like Meta is making benchmaxxed models that are exciting on bench cards but not really useful in real world scenarios.

To me that is the main problem with Muse models whether it's Spark, Wonder or Ember. While it reads as frontier on benchmarks it really isn't.

This is evident when you compare Dots and Muse the products as well. The model quality is clearly still far behind.