News for hackers. Stuff that matters.

not_a_feature

If you want a better (and Biomedical) benchmark that evaluates a whole range of models: https://tabbench-bio.eu

or a general one: https://tabarena.ai

Intresting research that i experience myself when using LLMs. Models usually cling to their initial responses but they also overreact to contradictory feedback, deviating from optimal reasoning. These two competing biases, choice-supportive and contradiction-sensitive, should be kept in mind when using LLMs.