News for hackers. Stuff that matters.
Re:Ask HN: What Are You Working On? (March 2026) by oren1531 on Tuesday March 10, 2026 @10:55AM (#47324123)
I built agent-triage - CLI that automates diagnosing AI agent failures in production.

I was spending way too much time staring at logs and web dashboards trying to figure out why my multi-agent setups kept failing.

You just point it at your traces (LangSmith, Langfuse, OpenTelemetry, or a JSON file). It pulls the system prompts directly from the logs, extracts the behavioral rules, and uses an LLM-as-a-judge to replay each conversation step-by-step.

It flags exactly which turn broke things, which agent caused it, and traces cascading failures across routing, handoffs, and retrieval.

It aggregates root causes across all of them: "24 out of 51 failures are missing escalations." You know exactly what to fix first.

Runs locally. Only LLM API calls leave your machine. You can try it without installing anything.

https://github.com/converra/agent-triage

There are no comments on this comment yet.