It imports your agent config from any supported platform into a universal IR (AgentGraph), then runs autonomous multi-turn conversation simulations against it. A simulator LLM plays the caller, your agent graph handles the routing, and an LLM judge scores transcripts against success criteria. Also supports deterministic rule tests for compliance stuff, PII leakage, required disclosures, forbidden phrases.
Write tests once and they work across platforms. Import from Retell, export to VAPI, run the same test suite. Also does format conversion between platforms if you're migrating.
Has interfaces for CLI (CI/CD), web UI, REST API, and a TUI. Results go into DuckDB so you can query them. Uses LiteLLM via DSPy so it works w/whatever provider you want
We've been building voice agents across Retell, VAPI, LiveKit, and Bland, and the testing story is... rough. Every platform has its own config format, there's no shared way to define what "correct" looks like, and most teams end up doing manual QA by literally calling their agent and listening. So we built voicetest.voicetest is an open source (Apache 2.0) test harness that works across voice...
https://github.com/voicetestdev/voicetest
- test harness for voice agents. - multi platform formats (Retell, VAPI, Bland, LiveKit) compile down to a unified AgentGraph IR - import from one platform, test locally, export to another - use litellm, DSPY to config models, if on a subscription use claudecode as a runner to avoid API call charges - metric judges produce continuous 0-1 scores instead of binary pass/fail since a 0.65 and a 0.35 both fail a 0.7 threshold but represent very different agent behaviors. - persist to DuckDB for querying across test history - adding auto-healing graph mutations where failed tests propose structural + prompt changes to the agent graph and validate against a regression suite
Wrote up the architecture here https://peet.ldee.org/general/2026/02/03/testing-voice-ai-ag...
I built wt to manage the coordination overhead of running multiple AI coding agents (Claude Code, Codex, etc.) concurrently on the same repository.The problem: I'd spin up 3-4 agents working on different features simultaneously, then conflict on files, and resolving those conflicts burns agent context. Git worktrees solve the isolation problem but the native CLI is verbose, lacks primitives for...
Our global health platform is used on smartphones by community health workers around the world to track and monitor their patients offline and on. Our data and ML platforms analyze patient risk, coordinate humanitarian projects, and manage Covid-19 tracking and messaging campaigns. We were named one of the “50 Most Genius Companies” by TIME magazine and have partnerships with the World Health Organization, the Bill and Melinda Gates Foundation, UNICEF, the United Nations Development Program, the World Food Program, and others.
References: https://blog.ona.io/news/2018/11/16/path-bid-story.html, https://blog.ona.io/canopy/covid19/2020/09/01/how-we-launche...
Our Global Health team stack is Android / Java / Postgres / React
Our Data Platform team stack is Django / Clojure / ClojureScript React (om -> reagent)
Our ML team stack is Beam / NiFi / Kafka / SciPy + Jupyter (prototyping) / Superset
We have full-time positions available, as well as fellowships and other opportunities.
Named one of the “50 Most Genius Companies” by TIME magazine, we are a social enterprise building technology products that improve access to essential, life-saving services. We are funded by the World Health Organization, the Bill and Melinda Gates Foundation, UNICEF, the United Nations Development Program, the World Food Program, and others.
Ona's GIT fellowship is a 12-week, Nairobi-based engagement pairing experienced software engineers with a global health or humanitarian open source project.
Our Global Health mobile team stack is Android / Java / Postgres / React
Our Data Platform team stack is Django / Clojure / ClojureScript React (om -> reagent)
Our ML team stack is NiFi / Kafka / SciPy + Jupyter (prototyping) / Superset
We have full-time positions available, as well as fellowships and other opportunities to contribute, https://ona.io/jobs.html
We're looking for developers who want to build foundational data systems that drive change. Our team has worked on projects that record the social infrastructure of entire countries, tally the winners of national elections, reduce infant mortality, and decrease the spread of malaria. We build software that solves real problems and you will too. We were named a TIME Magazine Genius Company of 2018.
Global health stack
* Android, Java, Postgres
Data platform stack
* Python, Clojure, ClojureScript, PostGIS
Data warehouse stack
* NiFi, Kafka, Druid, Superset, React, Redux
Learn about our recent projects and what it's like to work at Ona, https://blog.ona.io/
Join us by applying here, https://ona.io/jobs/sw_eng.html Additional roles listed here, https://ona.io/jobs.html
We're looking for developers who want to build foundational data systems that drive change. Our team has worked on projects that record the social infrastructure of entire countries, tally the winners of national elections, and reduce infant mortality. We build software that solves real problems and you will too.
Global health stack
* Android, Java, Postgres
Data platform stack
* Python, Clojure, ClojureScript, PostGIS
Data warehouse stack
* NiFi, Kafka, Druid, Superset, React, Redux
Learn about our recent projects and what it's like to work at Ona, https://blog.ona.io/
Join us by applying here, https://ona.io/jobs/sw_eng.html
See this readme https://github.com/kobotoolbox/kobocat for reference
We're hiring senior Android and Java engineers for a new Jakarta office focused on building out the OpenSRP frontline healthcare application.
We build data management platforms and mobile health applications used globally to improve child and maternal health, governance, agriculture, access to infrastructure, and government accountability. E.g. our software routed patients during the Ebola crisis in West Africa, counted votes during a Libyan election, is surveying national infrastructure in post-earthquake Nepal, and is scheduling vaccines in Bangladesh, Indonesia, Kenya, Pakistan, Zambia, and soon expanding to more countries per our collaboration with the WHO.
The stack you'll work with depends on the project, active stacks include: Clojure/Script + Om, Django + PostGIS, Android + CouchDB, React, and a Data engineering stack with NiFi + HDFS + Kafka + Druid + Superset, details here, https://blog.ona.io/general/2017/08/30/streaming-ona-data-wi...
In a technical interview we'll ask systems architecture questions, then we'll write and extend code together, then we'll describe our culture and see if it would be a good fit. We're currently hiring interaction designers and senior engineers, https://ona.io/jobs.html, [email protected]
We build data management platforms and tablet health applications used globally to improve child and maternal health, governance, agriculture, access to infrastructure, and government accountability. E.g. our software routed patients during the Ebola crisis in West Africa, counted votes during a Libyan election, is surveying national infrastructure in post-earthquake Nepal, and is scheduling vaccines in Bangladesh, Indonesia, Keny, Pakistan, Zambia, and soon expanding to more countries per our collaboration with the WHO.
The stack you'll work with depends on the project, active stacks include: Clojure/Script + Om, Django + PostGIS, Tomcat + CouchDB, React, and a Data engineering stack with NiFi + HDFS + Kafka + Druid + Superset, details here, https://blog.ona.io/general/2017/08/30/streaming-ona-data-wi...
In a technical interview we'll ask systems architecture questions, then we'll write and extend code together, then we'll describe our culture and see if it would be a good fit. We're currently hiring interaction designers and senior engineers, https://ona.io/jobs.html, [email protected]
We build a data management platform and tablet health application used globally to improve child and maternal health, governance, agriculture, access to infrastructure, and government accountability. E.g. our software routed patients during the ebola crisis in West Africa, counted votes during a Libyan election, is surveying national infrastructure post-earthquake in Nepal, and scheduling vaccines in Bangladesh, Indonesia, Pakistan, Indonesia, Zambia, and other places soon.
The stack you'll work with depends on the project, active stacks: Clojure/Script + Om, Django + PostGIS, Tomcat + CouchDB, see our FOSS at https://github.com/onaio/ and our 2016 roundup https://blog.ona.io/general/2016/12/30/year-in-tech-at-ona.h...
In the interview we'll ask tech and background questions to get to know each other, then we'll write and extend code together, https://ona.io/jobs/senior_sw_eng.html [email protected]@ona.io
We build a data management platform and tablet health application used globally to improve child and maternal health, governance, agriculture, access to infrastructure, and government accountability. E.g. our software routed patients during the ebola crisis in West Africa, counted votes during a Libyan election, is surveying national infrastructure post-earthquake in Nepal, and scheduling vaccines in Bangladesh, Indonesia, Pakistan, Indonesia, Zambia, and other places soon.
The stack you'll work with depends on the project, active stacks: Clojure/Script + Om, Django + PostGIS, Tomcat + CouchDB, see our FOSS at https://github.com/onaio/ and our 2016 roundup https://blog.ona.io/general/2016/12/30/year-in-tech-at-ona.h....
In the interview we'll ask tech and background questions to get to know each other, then we'll write and extend code together, https://ona.io/jobs/senior_sw_eng_android.html, https://ona.io/jobs/project_manager.html [email protected]@ona.io, [email protected]