News for hackers. Stuff that matters.
Re:Show HN: Exosphere – Platform for async/batch AI agents by aikin-nivedit on Wednesday May 21, 2025 @11:57PM (#44058645)
Bunch of optimisations for large data, including: Smart Batching, Prompt Caching, Custom Routing Algorithms and hardware planning for batch.

There are no comments on this comment yet.