News for hackers. Stuff that matters.

kvaranasi_

No, that was a completely different project - build websites in minutes, not weeks. But yes, the AI wave did kill that because you can literally make websites in minutes with Claude code today. But it has the same name - Rocketgraph, and I built it.

Show HN: ML condenses billions of logs into a tiny snapshot your LLM can debug

https://github.com/Rocketgraph/rocketgraph

Hi HN, I'm Kaushik, and I built Rocketgraph. I believe that while other spaces have caught up to the AI wave, the observability space is still lagging behind, using the same tools and dashboards that we use to analyse logs from human-written code. But now the code is written and debugged by AI, so we need to rethink how we do observability where the observer itself is an AI.The problem that I...

( Read More... | 3 comments | 6 points | on HN )
Monitoring tools were built with the premise that humans have written the code and humans are reading the logs, querying dashboards. But today, it's far from the truth. The machine writes code and the machine debugs it. But the logging tools have not evolved beyond complex LogQL queries that take weeks to understand the documentation. And not to mention, the ever-evolving logging patterns within the same company.

It is impossible to detect anomalies in log patterns using deterministic methods alone. That is why companies like Datadog, etc have stopped at anomaly detection at the metrics layer. Because they are numbers you can predict. And you can't feed your entire firehose to LLMs because they blow up in compute.

I developed Rocketgraph that generates "snapshots" from billions of logs so that your agents can query and root cause without hallucinating and burning your engineering budget. First, we fingerprint the logs by masking away all the PII stuff, then use fuzzy matching to group together similar logs using TF-IDF. Then we apply IsolationForest to rank the logs with an anomaly score. By now, we have condensed them to 100-1000 log patterns we call a "snapshot". Here is the interesting part: we just make an LLM call with the service graph dependency map to root cause over the log patterns, and the result is something like what is shown. They are highly accurate.

It can be used to detect anomalous retry loops, weird call patterns, unseen formats, etc.

Basically, I'm building Datadog - but the user is an AI agent. A monitoring tool whose output is queryable and consumable by an AI agent.

I would love to hear your thoughts on this.

Hey, I thought this might be helpful to some of you who are working in the observability space. It's a large dataset of real-world logs. You can use it to benchmark your tools. Or test the ones you are building. I am not the author.

Ask HN: How do you look for rare log patterns and RCA?

Hey, I'm just curious. I know that there is a feature in Datadog that shows new log patterns formed and disappeared. So when something goes wrong, what is it that developers look for beyond this? It should be pretty straightforward to find an error in the haystack. By looking at novel error patterns, right?When was the last time you had to spend hours debugging to find the root cause?

( Read More... | no comments | on HN )
I really like this library. It basically masks the PII data and creates log templates from logs. So you can ask questions like "How many times has the database connection timed out?" Or "How many times have users logged out of the app?"
Consider you have logs at ~100k/hour. And you are looking for a log that you have never seen before or one that is rare to find in this pool of 1000s of look-alike errors and warnings.

I built a tool that flags out anomalies. The rarest of the rarest logs by clustering them. This is how it works:

1. connects to existing Loki/New Relic/Datadog, etc - pulls logs from there every few minutes

2. Applies Drain3(https://github.com/logpai/Drain3) - A template miner to retract PIIs. Also, "user 1234 crashed" and "user 5678 crashed" are the same log pattern but different logs.

3. Applies IsolationForest(https://scikit-learn.org/stable/modules/generated/sklearn.en...) - to detect anomalies. It extracts features like when it happened, how many of the logs are errors/warn. What is the log volume and error rate. Then it splits them into trees(forests). The earlier the split, the farther the anomaly. And scores these anomalies.

4. Generate a snapshot of the log clusters formed. Red dots describe the most anomalous log patterns. Clicking on it gives a few samples from that cluster.

Use cases: You can answer questions like "Have we seen this log before?". We stream a compact snapshot of the clusters formed to an endpoint of your choice. Your developer can write a cheap LLM pass to check if it needs to wake a developer at 3 a.m for this? Or just store them in Slack.

Show HN: Compare logs before and after deployment to catch regressions

https://deploydiff.rocketgraph.app

I built this tool that connects to your Kubernetes and Datadog via read access. Collects logs before(60 minutes) and after(15 minutes). And compares them to catch regressions early on. This eliminates the need to jump across 5-6 dashboards to know if the deployment is working as expected, just by looking at the telemetry data. It's a thin intelligence layer for deployments. Usually, you get...

( Read More... | no comments | on HN )

Show HN: Cursor for Observability

https://dashboard.rocketgraph.app

Hi HN, I've been building RocketLogs, an intelligence observability layer that sits on top of Loki, Tempo, and Prometheus.The problem I kept running into: you get paged at 3 AM, open Grafana, flip between six dashboards, grep through logs, try to figure out which deploy went out, and an hour later you maybe have a root cause. You still need to dig through code and find the culprit. The data is...

( Read More... | 1 comment | 2 points | on HN )
Re:Ask HN: Cheaper Datadog Anyone? on Sunday January 11, 2026 @07:19PM (#46582072)
Grafana sucks imo. Their UI is bad, it takes time to setup. It's very difficult to maintain it all together. There should be a free alternative. I'm surprised there is literally no free alternative to Datadog.
Re:Ask HN: Cheaper Datadog Anyone? on Sunday January 11, 2026 @06:18PM (#46581556)
APM, logs, metrics and alerting all on a single pane of glass.

Ask HN: Cheaper Datadog Anyone?

Is it just me or do you guys think Datadog pricing is crazy? I mean even to SEE APM you have to pay like $50/mo minimum. What if my app has just 10 requests per month, can I get for free? No, pay us. What if it's just me building? No, still pay us.But hey we'll give you this metrics page for free which just basically tells you your RAM usage.And the worst part is, there is no proper alternative...

( Read More... | 11 comments | 2 points | on HN )
Re:Ask HN: Moved to SF to build a startup. What next? on Sunday January 11, 2026 @05:52PM (#46581296)
Got it. Yeah I'm building a monitoring tool for web applications. I guess I should start going to some conferences or something. Still figuring it out.
Re:Ask HN: Grafana or Datadog? on Monday September 08, 2025 @10:37PM (#45176750)
can you please email me at kaushik [at] rocketgraph.io
Re:Ask HN: Grafana or Datadog? on Monday September 08, 2025 @10:25PM (#45176687)
can you please email me at [email protected]
Re:Ask HN: Grafana or Datadog? on Monday September 08, 2025 @10:04PM (#45176568)
ok wow. I will check them out and start reaching out. Also any industries I should target with the current idea? Company size/position you have in mind?
Re:Ask HN: Grafana or Datadog? on Monday September 08, 2025 @09:51PM (#45176492)
Okay, I reached out to a few who are cursing DataDog, but also are not fully committed to buying what I'm building. How do I reach out to more people? I mean, it's like I KNOW there is some way here. Because they are not like "I'm happy with DataDog", but it's also not like "We're ready to abandon it for yours". I talked to ones paying like $40k/mo and $80k/mo(DHH).
Re:Ask HN: Grafana or Datadog? on Monday September 08, 2025 @09:41PM (#45176419)
Makes a lot of sense. So I am thinking of building an AI-powered Datadog alternative. Why now? is because with AI I can rapidly build integrations to Ruby, Python and other languages. But I'm really low-confidence on this one, because how do I make it reach a lot of people? Is there a need for this? Because I can make it really cheap.
Re:Ask HN: What are some preventive fault tolerance tools on Sunday January 05, 2025 @10:42AM (#42602491)
What could be one such business domain?

Ask HN: What are some preventive fault tolerance tools

I'm looking for tools that integrate well with AWS Cloudwatch, Datadog and other telemetry logging systems and can predict errors in the infrastructure before they even happen. Possibly even integrate with Github to get PR data and asses if a deployment might have a high chance of failure. Basically create a time-series like representation of all actions in the infrastructure(Infrastructure As...

( Read More... | 2 comments | on HN )
Re:Ask HN: What do you think about CSV to Postgres? on Thursday November 14, 2024 @10:01AM (#42136760)
Yeah. Needs to be more concrete.
Re:Ask HN: What do you think about CSV to Postgres? on Thursday November 14, 2024 @10:00AM (#42136751)
Correct they come into CSV -> analytics. They don't care if we use Postgres or Mongo.
Re:Ask HN: What do you think about CSV to Postgres? on Thursday November 14, 2024 @08:53AM (#42136132)
I think this is probably by using a COPY command. Assuming the file is on the same server as Postgres. But from a windows/linux machine, if a user wants to upload the CSV file, I don't see any options in the market.

Older ยป