News for hackers. Stuff that matters.

A comment on Introducing Structured Outputs in the API.

Re:Introducing Structured Outputs in the API by blackcat201 on Tuesday August 06, 2024 @09:10PM (#41177237)
Do beware on some reasoning task, our recent work[0] actually found it may cause some performance degradation as well as possible reasoning weakening in JSON. I really hope they fix this in the latest GPT-4o version.

[0] https://arxiv.org/abs/2408.02442

[ Parent | on HN ]
Re:Introducing Structured Outputs in the API by kiratp on Tuesday August 06, 2024 @10:17PM (#41177629)
Thank you! This confirms my intuition!

Structured generation seems counter to every other signal we have that chain of thought etc improves performance.

[ Parent | on HN ]