Re:Ask HN: What tech to run and monitor CRON jobs (Python, N...
by threecheese on Tuesday August 17, 2021 @02:52PM
(#28213440)
Many teams use Rundeck for scheduled jobs and runbook automation. It gives you a nice UI and a measure of governance around the process. https://docs.rundeck.com/docs/learning/
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N...
by chudi on Tuesday August 17, 2021 @06:24PM
(#28215503)
Rundeck is a pretty good tool to schedule, save logs and the like.
At my work we have a rundeck server connect via ssh to differents vm and execute the script there, you can configure alarms, parallel execution, plenty of steps it's pretty good you should try it out.
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N...
by jorislacance on Wednesday August 18, 2021 @03:27AM
(#28218504)
that's sadly what we do nowadays, but this is quite an hack somehow; there are hard limits in the monitoring features, not a lot of overview analytics viz too.
Our core issue is that it is a too much tech software, we would like to have PM/PO looking at the health status of things. We could build a dashboard about jobs status elsewhere for sure. But we are hoping to find a better tech to deliver, run and monitor jobs, all in one.
At my work we have a rundeck server connect via ssh to differents vm and execute the script there, you can configure alarms, parallel execution, plenty of steps it's pretty good you should try it out.
We use Azure Timer Functions and/or Logic Apps to run and monitor our jobs. All of those languages are supported.
Some jobs have crazy deps, like puppeteer or selenium, I wonder if you can setup complex environment dependencies with FaaS (docker base image maybe?)
Our core issue is that it is a too much tech software, we would like to have PM/PO looking at the health status of things. We could build a dashboard about jobs status elsewhere for sure. But we are hoping to find a better tech to deliver, run and monitor jobs, all in one.
It has prometheus plugins for monitoring
dogwrap (command-line tool for datadog) to monitor them
How do you deal with the CICD/delivery of your CRON code then using crontab?