News for hackers. Stuff that matters.

A comment on Monitoring Cloudflare's edge network with Prometheus. Parent comment

Re:Monitoring Cloudflare's edge network with Prometheus by zaroth on Sunday September 24, 2017 @09:25PM (#15327463)
Monitoring if the process is running, if the input queue is free, if it will take a new job, etc. seems to me the responsibility for all that should be with whatever supervisor has the ability to reset/restart the service. Then it can report stats on uptime and number of restarts required.

What if the service spins up on demand when it's needed, does its job, and then exits. You want to track how often it starts, how long it runs, how long the job was in the queue, how much CPU/RAM/IO was consumed, etc.

With push that's all part of the cleanup code in the process. With pull it seems like you could completely miss that the process was even ever run?

[ Parent | on HN ]
Re:Monitoring Cloudflare's edge network with Prometheus by bbrazil on Tuesday September 26, 2017 @03:12AM (#15336783)
That's a short lived batch job, for which a different approach is needed - basically push is the sane option there as pull won't cut it. Prometheus has the Pushgateway for this.

The push vs pull debate is relevant for longer running daemons, not batch jobs.

[ Parent | on HN ]