Launch HN: StarSling (YC P25) – Self-improving CI for agent-volume repos
Every CI job gets its own ephemeral sandbox on the fastest Zen 5 machines and NVMe Disk with unlimited concurrency so a burst of agent PRs all run at once. We’re different from other runners because ours come with agents that cut down your CI bill over time. PRs are generated through our CI harness, which runs an agent loop that’s tuned to improve your CI speed and reduce cost.
Mastra now merges over 1,800 PRs a month and we got their slowest workflow from 29m 56s on GitHub-hosted runners down to 5m 06s (5.87x) on StarSling. We realized the true value of having an agent loop running on top of fast runners when our agents found an 11-month-old performance bottleneck in better-auth. The fix made one of their test jobs 5.4x faster: https://github.com/better-auth/better-auth/pull/10762.
I previously founded StackShare, which grew to over 1.5M developers. Daniel helped build Netflix's internal developer portal. Last year we started building AI agents for DevOps because shipping code to prod fell way behind agentic coding. We hit the CI bottleneck ourselves as we were building agents. Our own agents shipped so many PRs that at peak our job queues were backed up for hours and our CI bill got close to our inference bill.
We now support per-second billing, and just shipped StarSling Disks - persistent disks that give you a 4.9x speedup in dependencies ready over actions/cache. You can see a quick demo of disks in action here : https://www.youtube.com/watch?v=2JrrpRm9Mww.
Our CI harness runs a loop that has agents: - Analyze your workflows, run logs, and machine telemetry - Propose an optimization - Test your unchanged workflow side by side the proposed change - Deterministically judge that the difference is statistically significant - Ship the winner to you as a PR with benchmarks evidence
We benchmarked open source repos on our runners and average 10x speedup in wall clock time with 70% less runner time: - https://github.com/starsling-demo-org/benchmark-gogs (12.8x) - https://github.com/starsling-demo-org/benchmark-shellcheck (5.5x) - https://github.com/starsling-demo-org/benchmark-chatwoot (3.9x) - https://github.com/starsling-demo-org/benchmark-transfer.sh (11.7x) - https://github.com/starsling-demo-org/benchmark-mirotalksfu (36.4x)
Yes, you can do these optimizations yourself with prompts so we’ve released skills for this: https://github.com/starslingdev/skills. The benefit of using our agents is that you don’t need to spend tokens and CI compute finding optimizations yourself.
We started building our runners on AWS at the beginning of the year and realized that was too expensive. But at that time there weren’t any cloud providers that could give us the same machines we were getting on AWS, billed per minute (microVMs). So we convinced a handful of sandbox providers to get Zen 5s and started benchmarking them publicly (https://github.com/starslingdev/hpc-sandbox-benchmarks).
We’ve learned that fast infrastructure is table stakes for CI, but it’s not sufficient on its own. To get fast and cost effective CI you need a process that continues making improvements. We turned CI optimizations from OpenAI, Anthropic, Linear and others into playbooks for your agent: https://starsling.dev/ci-playbooks.
To try it, give your agent this URL: https://docs.starsling.dev/start. You get 2,000 free minutes. Our agents start opening PRs once you've hit about 10,000 minutes.
Today we announced our CI Challenge: if StarSling can't save you at least 10% on your next CI bill, we'll literally give you $1,000. Eligibility and rules here: https://starsling.dev/blog/ci-challenge.
We’d love your feedback on the headless experience and what you’d like to see improved in your own CI setup!
What are some of the most interesting things the AI has caught + fixed so far?
https://github.com/starsling-demo-org/benchmark-gogs/blob/sh...
In our examples with open-source repos above you'll see that most of speedups that lead to a 10X speedup come from code changes or optimizations.
Three things matter.
1 -- How many non-conflicting changes can actually be made at one time (Fan Out)
2 -- How long a critical path takes
3 -- How many times you have to run that critical path. Most orgs run it 2-3x, once before the PR in the agent loop, once in CI, and another in the MQ
This is why most orgs cant get past about 12 PRs an hour.
This is the one we went after. Our agents have to run tsc, lint and the unit tests before they push (it's in a hook), and CI was then doing all three again from scratch. Now the agent records what it ran as a git trailer on the commit and the PR build skips those steps [1]. Anything headed to main still runs everything, so the trailer only has to be trusted on the intermediate pushes.
Builds went from ~10 minutes to 1.5 over a few weeks, and a good third/half of that was this change. It tends to compound too - getting the build time down led to lower contention, warmer caches, faster throughput. All the usual queuing theory stuff.
[1] https://jonathannen.com/dont-run-it-twice/Context
We love Buck2 and Bazel, from first principles. Unfortunately, the DX hurdles of make a codebase hermetic have prevented widespread adoption.
I maintain witness.dev (CNCF) and cilock.dev (Apache 2.0 open core) that builds provenance around SDLC (or ADLC steps). We are experimenting using this to just let the agents land code after they prove their testing. Right now we are expecting a 2x increase in throughput at the same amount of compute
Re-sharding is allowed because it only changes where tests run, not what runs. It has the same sort of parity check as other patches but it also has a cost check to make sure the change doesn't increase runner time by more than 5% by default. We added the cost check after seeing the agents crush wall clock while 10x'ing costs on some test :)
Judging whether or not a test should be trimmed isn't something our agents do yet, because as you alluded to, it's hard. But we're working on it! If you have any ideas or an approach that's worked for you, would love to hear it.
Actual problem tho, congrats on the launch!