For me it seems like this model’s overthinking should be tamed.
Perhaps instead of giving it a one shot task with vague prompt. I wonder how it can perform with much more detailed and constrained prompt (can you please elaborate more on the level of detailness and ambiguity that the prompt is and where does this model seem to overthink the most?)
Also are there any ways to tame such overthinking of models in general?
I hope that once models start becoming smart enough (I think for me it’s already there) or becoming genuinely the Sota. They then start focusing a lot more on optimizing token usage
Perhaps instead of giving it a one shot task with vague prompt. I wonder how it can perform with much more detailed and constrained prompt (can you please elaborate more on the level of detailness and ambiguity that the prompt is and where does this model seem to overthink the most?)
Also are there any ways to tame such overthinking of models in general?
I hope that once models start becoming smart enough (I think for me it’s already there) or becoming genuinely the Sota. They then start focusing a lot more on optimizing token usage