News for hackers. Stuff that matters.
Re:Show HN: Strot – Compile an LLM's intent once, run decisi... by solohunter001 on Monday October 19, 2026 @01:43AM (#50148790)
I was working with a large entries on Batch inference, and yes LLMs are quite expensive to process Billions of contracts at latency, so I in my orignial paper was on the expensive thinking once, run the cheap deterministic result forever.

There are no comments on this comment yet.