News for hackers. Stuff that matters.
Re:Progressive JSON by tough on Sunday June 01, 2025 @12:21AM (#44148644)
how do you do that exactly?
Re:Progressive JSON by richin13 on Sunday June 01, 2025 @08:42AM (#44150459)
Not the original commenter but I’ve done this too with Pydantic AI (actually the library does it for you). See “Streaming Structured Output” here https://ai.pydantic.dev/output/#streaming-structured-output
Re:Progressive JSON by tough on Sunday June 01, 2025 @02:13PM (#44152740)
Thanks yes! Im aware of structured outputs, llama.cpp has also great support with GBNF and several languages beyond json.

I've been trying to create go/rust ones but its way harder than just json due to all the context/state they carry over

Re:Progressive JSON by danenania on Sunday June 01, 2025 @02:11PM (#44152728)
One way is to eagerly call JSON.parse as fragments are coming in. If you also split on json semantic boundaries like quotes/closing braces/closing brackets, you can detect valid objects and start processing them while the stream continues.
Re:Progressive JSON by tough on Sunday June 01, 2025 @02:16PM (#44152755)
Interesting approach! thanks for sharing