Introduction to Airflow in Python

via

DataCamp

Course Features

Duration

4 hours

Delivery Method

Online

Available on

Limited Access

Accessibility

Mobile, Desktop, Laptop

Language

English

Subtitles

English

Level

Beginner

Teaching Type

Self Paced

Video Content

4 hours

Course Description

It can be hard to deliver data on a given schedule. It can be time-consuming to create scripts and implement complicated cron tasks. Airflow can help you avoid this pain by adding scheduling, error handling, reporting and scheduling to your workflows. This course will show you how to use Airflow for production as well as the basics of Airflow. This course will show you how to use Directed Acyclic Graphs (DAGs), to automate data engineering workflows. It will also teach you how to implement data engineering tasks in an easy and repeatable manner that will keep you sane.

Course Overview

Virtual Labs

International Faculty

Post Course Interactions

Hands-On Training,Instructor-Moderated Discussions

Skills You Will Gain

Prerequisites/Requirements

Introduction to Shell

Intermediate Python

What You Will Learn

In this course, you’ll master the basics of Airflow and learn how to implement complex data engineering pipelines in production

Learn how to to implement and schedule data engineering workflows

You'll also learn how to use Directed Acyclic Graphs (DAGs), automate data engineering workflows, and implement data engineering tasks in an easy and repeatable fashion—helping you to maintain your sanity

Course Content

Expand all sections

Module 1: Intro to Airflow

Module 2: Implementing Airflow DAGs

Module 3: Maintaining and monitoring Airflow workflows

Module 4: Building production pipelines in Airflow

Course Instructors

Mike Metzger

Data Engineer Consultant @ Flexible Creations

Mike is a consultant focusing on data engineering and analysis using SQL, Python, and Apache Spark among other technologies. He has a 20+ year history of working with various technologies in the data, networking, and security space.