Ask HN: What tech to run and monitor CRON jobs (Python, Node.js, C#)?

[LikeAnElephant]

Regarding monitoring: I've come to rely on healthchecks.io to ensure my cron jobs when like I expect.

[XCSme]

I use the same service and I think it works, no CRON job failed yet though.

[jorislacance]

Monitoring solved, how do you deal with the CICD/delivery of your CRON code then?

[ezekg]

I run cron jobs using sidekiq-cron and monitor them using https://cronitor.io.

[jorislacance]

I found it quickly, but language tied (ruby in this case) :/

[zbentley]

https://deadmanssnitch.com/

[threecheese]

Many teams use Rundeck for scheduled jobs and runbook automation. It gives you a nice UI and a measure of governance around the process. https://docs.rundeck.com/docs/learning/

[jorislacance]

I didn't know this one, I'll take a look at it, thanks!

[chudi]

Rundeck is a pretty good tool to schedule, save logs and the like.

At my work we have a rundeck server connect via ssh to differents vm and execute the script there, you can configure alarms, parallel execution, plenty of steps it's pretty good you should try it out.

[jorislacance]

I didn't know this one, I'll take a look at it, thanks!

[vyrotek]

How long of a job do you need to run?

We use Azure Timer Functions and/or Logic Apps to run and monitor our jobs. All of those languages are supported.

[jorislacance]

From 5 minutes to 24h mainly.

Some jobs have crazy deps, like puppeteer or selenium, I wonder if you can setup complex environment dependencies with FaaS (docker base image maybe?)

[aprdm]

Jenkins can work quite well for this. It keeps logs, success/failure, has hooks for multiple notifications and etc.

[jorislacance]

that's sadly what we do nowadays, but this is quite an hack somehow; there are hard limits in the monitoring features, not a lot of overview analytics viz too.

Our core issue is that it is a too much tech software, we would like to have PM/PO looking at the health status of things. We could build a dashboard about jobs status elsewhere for sure. But we are hoping to find a better tech to deliver, run and monitor jobs, all in one.

[recov]

A little overkill, but airflow. Free, has history, language agnostic, retries, can handle a large number of time based tasks.

[jorislacance]

Very big data alternative!

[rozenmd]

There are SaaSes for this, like https://cronhub.io

[jorislacance]

We are considering. but it makes us migrate all 'stupid' jobs into API that can be triggered from cronhub.io.

[rahimnathwani]

crontab to run them

dogwrap (command-line tool for datadog) to monitor them

[jorislacance]

interested about dogwrap, seems very generic for a various cases.

How do you deal with the CICD/delivery of your CRON code then using crontab?