top | item 30353860

(no title)

samdjstephens | 4 years ago

Interesting, I wouldn’t say that I’ve found it difficult to run in even a small team.

The problem I’ve always had with Airflow has been with non-cron-like use cases, for example data pipelines kicked off when some event occurs. Sensors were often an awkward fit and the HTTP API was quite immature back when I was using it

discuss

order

the_af|4 years ago

Agreed about sensors. We still have some trouble figuring them out and understanding why they sometimes don't trigger when they should.