They use a technique called chain-of-thought to make it reason problems out step by step.
As Norvig shows, this reasoning may sometimes be wrong, but that's a different issue.
It's worth repeating this because apparently it's not widely known: these models are following a step-by-step process we'd recognise as reasoning in humans.
Minerva in particular does step by step reasoning:
> we present Minerva, a language model capable of solving mathematical and scientific questions using step-by-step reasoning
https://ai.googleblog.com/2022/06/minerva-solving-quantitati...
They use a technique called chain-of-thought to make it reason problems out step by step.
As Norvig shows, this reasoning may sometimes be wrong, but that's a different issue.
It's worth repeating this because apparently it's not widely known: these models are following a step-by-step process we'd recognise as reasoning in humans.