Automating a recurring data job

The last step is turning the analysis into a script that runs on a schedule, logs what it did, and fails loudly.

12m
Beginner

Video thumbnail for Automating a recurring data job

Video by BI Insights Inc · YouTube

Check your understanding

3 questions. Unlocks when you finish the video.

Overview

What this lesson covers

Turn a notebook into a parameterised script
Log progress and failures usefully
Schedule the job and alert when it breaks

This lesson sits in Reproducible Workflows, part of Python for Data Work. It assumes what came before it and leads directly into the next lesson in the module.

In this lesson you will:

Turn a notebook into a parameterised script
Log progress and failures usefully
Schedule the job and alert when it breaks

Resources

pandas documentationThe official reference for the tools used in this lesson.