Re:Ask HN: Is there an emerging pattern for NEGATIVESKILLS.m...
by MrCoffee7 on Sunday September 13, 2026 @05:37PM
(#49688984)
This paper wasn't for SKILLS per se, but for LLMs, and suggests that LLMs can't follow too many constraints at one time very well https://arxiv.org/abs/2608.12426 . Other papers suggest that LLMs show more information sparsity in the results with negative constraints.
[ Parent
| on HN ]
Re:Ask HN: Is there an emerging pattern for NEGATIVESKILLS.m...
by mehmetoguzderin on Sunday September 13, 2026 @06:08PM
(#49689219)
Good one; reading this briefly took me back to the days of “Needle in a Haystack” being super challenging for LLMs. Maybe there needs to be a benchmark of “Rule in a Haystack” (similar to information one, testing not only independent rules also the ones that need hops) to clarify model performance regarding this. Thank you for the resource.
Re:Ask HN: Is there an emerging pattern for NEGATIVESKILLS.m...
by oofbaroomf on Tuesday September 15, 2026 @01:05PM
(#49715516)
I believe you're looking for IFBench (https://arxiv.org/abs/2507.02833, https://artificialanalysis.ai/evaluations/ifbench, https://github.com/allenai/IFBench)