Building Data Pipelines with Luigi 3 and Python

Data comes from many sources and requires further processing. It is tempting to reinvent the wheel and create your own library to build batch processing data pipelines. Data pipelines can become difficult to maintain. This course, Building Data Pipelines using Luigi and Python, will teach you how to create data pipelines using Luigi or Python. You'll first learn how to create your first data pipelines using Luigi. Next, you will learn how to set up Luigi pipelines. You'll also learn how to manage Luigi pipelines. You'll be able to use your Luigi skills and knowledge to build data pipelines that are simple to maintain once you have completed this course.