News for hackers. Stuff that matters.

HenryM12

Interesting approach. Once you built the plan/watch system, did it mostly hold up, or have you had to keep revisiting it as workflows started spanning more tools and steps? Roughly how long did it take to implement?

Ask HN: How are you preventing runaway LLM workflows in production?

We’ve been pushing LLM backed workflows into production and are starting to run into reliability edges that observability alone doesn’t solve.Things like:- loops that don’t terminate cleanly- retries cascading across tool calls- cost creeping up inside a single workflow- agents making technically “allowed” but undesirable callsMonitoring here is fine. We can see what’s happening. The harder...

( Read More... | 2 comments | on HN )