News for hackers. Stuff that matters.
Re:Large Language Models as Optimizers by riku_iki on Friday September 08, 2023 @11:58AM (#37435344)
> +50% on Big Bench Hard

its +50% on few tasks.

It is also +50% not against sota, but some their weak baseline.

For example they received large boost on object_counting task where their final result is 86% acc, while current sota from https://arxiv.org/pdf/2210.09261.pdf is 93%

There are no comments on this comment yet.