i think that’s exactly the core of the question. There is meaningful decorrelation across models in some domains, like language for instance. but i agree that it’s much less obvious for reasoning.

I don’t think more models is necessarily better, and one of our research questions is also: when does adding another reasoning path actually add useful information, and when is a single strong path better than an ensemble?