Prefect
Python framework for scheduling and monitoring data pipelines
Featured by Willet
What it is
Prefect turns ordinary Python functions into orchestrated workflows using flow and task decorators, adding scheduling, retries, caching, and event-triggered runs. A bundled server provides a web UI for tracking runs, triggering deployments, and inspecting logs, and it can be self-hosted or replaced by the managed cloud service. Data engineers and ML teams use it to move scripts into production jobs that recover from failures and run on cron or in response to events.