News for hackers. Stuff that matters.
Re:Which Table Format Do LLMs Understand Best? (Results for ... by veryrealsid on Sunday October 05, 2025 @11:50AM (#45482472)
I'm surprised by the accuracy, in practice, I feel like I generally have a lot better results
Re:Which Table Format Do LLMs Understand Best? (Results for ... by coeneedell on Sunday October 05, 2025 @11:51AM (#45482493)
Do you measure your results in a repeatable way? In a way where your hypotheses about accuracy are falsifiable? Or do they just “feel” right?
Re:Which Table Format Do LLMs Understand Best? (Results for ... by mattcollins on Sunday October 05, 2025 @02:38PM (#45484033)
I'm the person who ran the test.

The context I used in the test was pretty large. You'll see much better (near 100%) accuracy if you're using smaller amounts of context.

[I chose the context size so that the LLM would be scoring in the ballpark of 50% accuracy (with variation between formats) to maximise the discriminative power of the test.]