Description
Building data pipelines with Apache Airflow - PyCon Italia 2022
Apache Airflow is a popular orchestration tool that uses Python to author workflows, but what is it, what are the architectural components, why do I need this, and how do you get started? If you care about reliably getting your data from source to your big data platforms, this is the talk for you. Moving, refining and enriching data in order to get actionable insights is hard. Apache Airflow, an open source project that makes it easy for data engineers to create repeatable and reliable workflows in Python. This session will be a hands on getting started looking at creating your first workflows and understanding how you can use the features of Apache Airflow to orchestrate your own data pipelines.
Slides:
Speaker: Ricardo Sueiras