Perhaps, but LLMs while may be slightly better (or slightly worse) than average humans, if you have 20 instances of the same LLM will have correlated errors whereas 20 humans will be… well, not entirely[0] uncorrelated, but less correlated, in their errors.

[0] We'll still sometimes get an entire office of telephone help-desk people who are all convinced that $1/megabyte is the same as $0.01/megabyte, or whatever that story was a few decades back (I can't Google it any more to find it, there was a recording of the phone call).

it was 0.01¢ and the rep / software was billing it as $0.01 - saying 0.01 of a penny is $0.01.

I may be off by a factor of 10.