dxbhack
Re:Idea to reduce AI token use at large orgs
on Friday August 21, 2026 @12:21PM (#49390370)
This sounds more like a semantic caching layer on top of OpenRouter. The real challenge is knowing which parts of previous work are still reusable and only sending the delta to the model.
Re:Ask HN: If you're burning tokens at scale, what are you using them ...
on Monday August 17, 2026 @12:20PM (#49333517)
We process a lot of business documents at scale, invoices, sales orders, insurance documents and so on. Our token usage easily go beyond 50 to 100 million tokens per day.
We use a routing approach where simpler tasks go to smaller, cheaper models and more complex tasks go to frontier models. We are also working on having our own model for some of these workloads.
Document processing is probably one of our biggest agent use cases for tokens at this scale.
Re:Ask HN: Alternatives to GitHub
on Monday August 17, 2026 @12:12PM (#49333366)
don’t switch reactively, but use the outages as a trigger to evaluate alternatives and make sure a GitHub outage doesn’t stop critical work.