News for hackers. Stuff that matters.

aikin-nivedit

Bunch of optimisations for large data, including: Smart Batching, Prompt Caching, Custom Routing Algorithms and hardware planning for batch.

Show HN: Exosphere – Platform for async/batch AI agents

Hey HN,We built Exosphere (exosphere.host) – a platform to orchestrate and run batch AI agents on large data with connectors, autoscaling, and affordable inference (up to 75% cheaper). Think of it as a control plane for async AI workloads.Why we built it: Running background AI workflows (like summarising 1M support chats or processing 10K PDFs) is messy – you need queueing, scaling, model...

( Read More... | 2 comments | 2 points | on HN )

Async/Batch AI Agents

Hey everyone,I've been working on a project called exosphere.host. It's a platform focused on running batch AI agents at scale. It’s built for handling large data, supporting open source models, and plugging into common tools and workflows easily. We’re also working on Orbit, our orchestration engine, which will be open sourced soon.I'm hoping to get community thoughts on a few things: - What...

( Read More... | no comments | 2 points | on HN )

Launching V0 of AI Agents to Find You Great AI Engineers

After spending over two years in the recruitment space, talking to hundreds of recruiters and hiring managers and thousands of talented engineers, I was shocked by the inefficiencies in hiring:Recruiters spend 2000+ hours/year just reviewing profiles and gathering basic details—yet, on average, they tend to spend 100+ hours per hire! Candidates juggle job hunting alongside their full-time...

( Read More... | no comments | on HN )

Service to auto route LLM/Model traffic

I suggest creating a service that monitors all the LLMs/AI model deployment services on Azure, AWS, Google Cloud, Groq, Krutrim, and other cloud deployments and routes your traffic based on availability, latency, rate-limiting, and other parameters. Manage everything at the backend, just pay a single unified bill, with no deployments or accounts on any other service. Sounds cool?

( Read More... | 1 comment | on HN )