Show HN: Wild Moose – Autonomous agent for production debugging
We launched an autonomous agent that helps debug production issues, and we’re curious to get your feedback.
Try our tool with your Datadog’s logs and metrics >> https://app.wildmoose.ai/slack/install
Setup demo >> https://tinyurl.com/mvaj8emf
Today's GenAI devtools, such as Copilot, are limited: they are great for writing code, but we all know that programming is only 20% coding, and 80% debugging.
So how can GenAI be used for debugging? As opposed to code completion or test automation, production debugging is not about generating text. Debugging is mostly about root-cause analysis. We realized two things:
1) Generative AI is drastically changing the way we work with data, thanks to its ability to not only generate queries, but also run code and analyze unstructured data. This enables building better data-exploration experiences with far more intuitive interfaces.
2) RCA is all about exploring different types of data. When you don’t know why a transaction was dropped or which customers are affected – you explore metrics, logs, your code, other people’s code, old slack messages, and whatnot, to figure out what’s broken.
Putting those two together, we built an autonomous agent that helps debug production issues. Our LLM-moose connects to your logs, metrics, and other observability data, and lets you extract and analyze them by conversing with it. Once it gets a task, it will start reasoning, invoking APIs, and running code, until it comes back with an answer.
For example, when requested to “show me IDs of transactions that took over 1 minute today”, the moose will fetch those transactions from Datadog for you. You might then ask it if long-running transactions correlate with a metric such as DB CPU load. The moose will fetch the metric values, visualize them on a graph alongside the long transaction frequency, and give you the answer.
Our moose both runs code and invokes API calls; the interplay between these is nontrivial to design and a fertile ground for innovation. There are “textbook” solutions to let agents write and run code (open sourced by, for example, Open Interpreter), and also to invoke tools/APIs (for example, Gorilla). But doing both together is harder, and yet required. You’re welcome to share your thoughts on this!
If you want to see other integrations, or have ideas for features, or you’ve spotted behaviors of the moose that seem off - we’d love to hear.
Hit us up in the comment or chat with us here >> https://calendly.com/wildmoose-yasmin/30-min
Does this answer your question?
For example, at our company we have a quite a few of alerts set up. Datadog also automatically detects anomalies. It would be neat if this (or something else) could automatically do an initial triage without being prompted and give me a free headstart on issues that come in.
Otherwise, it feels like it's "work" to learn how to use the product, which seems to miss the promise of AI (doing things for us!).
With that said, in my experience, usually, coming up with a good AI question can sometimes be harder than the act of looking for the data itself, i.e. asking "what were the last 3 errors yesterday" is not something I have ever done.
Please feel very free to continue this discussion here -- it's an important one for us!