djacksondev

When Muse models first started coming out I was pretty excited that Meta models were competitive again based on the benchmarks but after trying them out it feels like Meta is making benchmaxxed models that are exciting on bench cards but not really useful in real world scenarios.

To me that is the main problem with Muse models whether it's Spark, Wonder or Ember. While it reads as frontier on benchmarks it really isn't.

This is evident when you compare Dots and Muse the products as well. The model quality is clearly still far behind.

To me Fable's role was always as a planner or plan reviewer, rather than something individuals or organizations would use as the primary driver. In that case, I think these improvements seem worthwhile in exchange for the cost? Ideally in that role, you want the best performing model.

Not sure if the current rise means it's cost prohibitive to use in that form too.