News for hackers. Stuff that matters.
Re:Is the doc bot docs, or not? by michaelt on Friday July 11, 2025 @12:05PM (#44533799)
In a single request? Oof.

I was benchmarking some models the other day via openrouter and I got the distinct impression some of these models treat the thinking token budget as a target rather than a maximum.

Re:Is the doc bot docs, or not? by stavros on Friday July 11, 2025 @12:20PM (#44534000)
No no, overall, trying things a few times.