Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

🦾 Take control of your AI agents

No description provided.

🎨 UI for the Free Data Engineering Zoomcamp Course provided by DataTalksClub

The Prefect API and backend

A Data Engineering project. Repository for backend infrastructure and Streamlit app files for a Premier League Dashboard.

The home of the Prefect 1 UI

A simple guide to understand Prefect and make it work with your own docker-compose configuration.

Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate

Code examples showing flow deployment to various types of infrastructure

Example repository showing how to build a data platform with Prefect, dbt and Snowflake

Tools for using Langchain with Prefect

Prefect integrations with AWS.

Collection of Prefect integrations for working with dbt with your Prefect flows.

Production RAG System Course

Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; Kafka for Stream processing

Template to quickly bootstrap a Prefect Collection

Prefect integrations with Ray

Prefect integrations with Google Cloud Platform.

Prefect tasks and subflows for interacting with shell commands.

An end-to-end machine learning (mlops) project

Pocket data flows orchestrated using Prefect

An introductory project to streamline the machine learning pipeline using Prefect and Discord Notifications, from data ingestion to model saving

Maternal Health Risk prediction MLOps pipeline

Examples of using Prefect for background tasks in web applications

Example project demonstrating deployment patterns for real-time streaming workflows with Prefect 2.0

Learn to build a modular real-time feature pipeline, so you avoid Offline-Online Feature Skew, and your deployed ML models work as expected.

Prefect API Authentication/Authorization Proxy for on-premises deployments

A complete pipeline to pull data from Scryfall's "Magic: The Gathering"-API, via Prefect orchestration and dbt transformation.

Prefect integrations for interacting with Databricks.