News for hackers. Stuff that matters.
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by LikeAnElephant on Tuesday August 17, 2021 @11:57AM (#28211282)
Regarding monitoring: I've come to rely on healthchecks.io to ensure my cron jobs when like I expect.
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by XCSme on Saturday August 28, 2021 @04:04PM (#28341050)
I use the same service and I think it works, no CRON job failed yet though.
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by jorislacance on Wednesday August 18, 2021 @03:20AM (#28218472)
Monitoring solved, how do you deal with the CICD/delivery of your CRON code then?
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by ezekg on Tuesday August 17, 2021 @03:25PM (#28213808)
I run cron jobs using sidekiq-cron and monitor them using https://cronitor.io.
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by jorislacance on Wednesday August 18, 2021 @03:15AM (#28218439)
I found it quickly, but language tied (ruby in this case) :/
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by zbentley on Tuesday August 17, 2021 @01:01PM (#28212135)
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by threecheese on Tuesday August 17, 2021 @02:52PM (#28213440)
Many teams use Rundeck for scheduled jobs and runbook automation. It gives you a nice UI and a measure of governance around the process. https://docs.rundeck.com/docs/learning/
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by jorislacance on Wednesday August 18, 2021 @03:17AM (#28218449)
I didn't know this one, I'll take a look at it, thanks!
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by chudi on Tuesday August 17, 2021 @06:24PM (#28215503)
Rundeck is a pretty good tool to schedule, save logs and the like.

At my work we have a rundeck server connect via ssh to differents vm and execute the script there, you can configure alarms, parallel execution, plenty of steps it's pretty good you should try it out.

Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by jorislacance on Wednesday August 18, 2021 @03:17AM (#28218446)
I didn't know this one, I'll take a look at it, thanks!
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by vyrotek on Tuesday August 17, 2021 @12:13PM (#28211492)
How long of a job do you need to run?

We use Azure Timer Functions and/or Logic Apps to run and monitor our jobs. All of those languages are supported.

Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by jorislacance on Wednesday August 18, 2021 @03:12AM (#28218429)
From 5 minutes to 24h mainly.

Some jobs have crazy deps, like puppeteer or selenium, I wonder if you can setup complex environment dependencies with FaaS (docker base image maybe?)

Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by aprdm on Wednesday August 18, 2021 @03:21AM (#28218478)
Jenkins can work quite well for this. It keeps logs, success/failure, has hooks for multiple notifications and etc.
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by jorislacance on Wednesday August 18, 2021 @03:27AM (#28218504)
that's sadly what we do nowadays, but this is quite an hack somehow; there are hard limits in the monitoring features, not a lot of overview analytics viz too.

Our core issue is that it is a too much tech software, we would like to have PM/PO looking at the health status of things. We could build a dashboard about jobs status elsewhere for sure. But we are hoping to find a better tech to deliver, run and monitor jobs, all in one.

Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by aprdm on Thursday August 19, 2021 @12:30AM (#28230329)
You can template/customize the job view quite a lot in jenkins with HTML. We found it an OK compromise.

It has prometheus plugins for monitoring

Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by jorislacance on Thursday August 19, 2021 @04:14AM (#28231541)
Woh! golden feedback, we should look at doing this too. Appreciate your follow up thanks you!
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by recov on Tuesday August 17, 2021 @01:24PM (#28212430)
A little overkill, but airflow. Free, has history, language agnostic, retries, can handle a large number of time based tasks.
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by jorislacance on Wednesday August 18, 2021 @03:18AM (#28218455)
Very big data alternative!
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by rozenmd on Tuesday August 17, 2021 @06:34PM (#28215560)
There are SaaSes for this, like https://cronhub.io
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by jorislacance on Wednesday August 18, 2021 @03:28AM (#28218515)
We are considering. but it makes us migrate all 'stupid' jobs into API that can be triggered from cronhub.io.
Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by rahimnathwani on Tuesday August 17, 2021 @05:58PM (#28215344)
crontab to run them

dogwrap (command-line tool for datadog) to monitor them

Re:Ask HN: What tech to run and monitor CRON jobs (Python, N... by jorislacance on Wednesday August 18, 2021 @03:23AM (#28218486)
interested about dogwrap, seems very generic for a various cases.

How do you deal with the CICD/delivery of your CRON code then using crontab?