Elegant workflows with Apache Airflow
Talk about developing powerful workflows in Python code with Apache Airflow.
Slides for a presentation I gave the EuroPython 2017 conference in Rimini, Italy.
2017
Get started developing workflows with Apache Airflow
Apache Airflow is an open-source tool for orchestrating complex computational workflows and data processing pipelines. If you find yourself running cron task which execute ever longer scripts, or keeping a calendar of big data processing batch jobs then Airflow can probably help you. This article provides an introductory tutorial for people who want to get started writing pipelines with Airflow.