An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.

This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.

An ETL Orchestration using Apache Airflow to extract CSV files from a Google Drive, validate, transform, and load into a PostgreSQL database.

A comprehensive ELT pipeline for analyzing passenger satisfaction data. Features a modern data architecture with Apache Airflow for extraction, dbt/Snowflake for transformation, Python/Pandas for cleaning, and interactive dashboards for visualization with NextJS.

Reference implementations for orchestration project using Astronomer/Airflow

An example project of how to use local devcontainers with the Astronomer Astro platform

A TCG-style web game for mastering Apache Airflow SQL check operators. Battle the DQ Monster, deploy Astro Observe, and learn about data quality patterns through a simple card game.

An Airflow 3.1+ plugin that turns your Dag list into a playable pixel-art world. Every active Dag becomes a building on a procedurally generated island. Walk your knight around, trigger pipeline runs, read task logs, pause workflows, and destroy broken pipelines with a sword.

Preparation for the Astronomer Airflow 3 Fundamentals Certification. Focused on core concepts like DAGs, scheduling, operators, Airflow architecture, debugging, and monitoring to master workflow orchestration and data pipeline management using Apache Airflow 3.+.

A REST API for James Webb Space Telescope observations that supports both imaging and spectroscopic data, including wavelength ranges, gratings, and spectral resolution.

Este projeto tem como objetivo extrair dados da API FIPE utilizando um ambiente Astronomer com Airflow para orquestração das tarefas que facilita o gerenciamento e implantação de fluxos de trabalho.

Preparing for Airlfow Certification - Testing Knowledge -> New Connection of Neurons in Brain with Training++

ClickML - build MLOps workflow (just click, save and use)

ETL pipeline with Airflow and astronomer - to automate and scheduling the Weather workflows

The Smart Data Warehouse project automates e-commerce data ETL processes using Apache Airflow. It uploads data to Google Cloud Storage, loads it into BigQuery, performs quality checks, and enables visualization in Looker Studio for insightful reporting and analysis.

ELT pipeline: S3 -> Snowflake <-> DBT <> Airflow

Analyse personal Netflix usage

End-to-end data pipeline for hospital readmission analytics using Snowflake, dbt, Airflow, and Power BI.

No description provided.

End-to-end MLOps pipeline with Airflow ETL orchestration, Redis feature store, and real-time ML monitoring using Prometheus & Grafana with automated data drift detection

Modern data stack project: orchestrates Jaffle Shop analytics using Astro/Airflow, models data with dbt, and stores it in DuckDB.

Sentiment Analysis using DistlBERT Transformer from HuggingFace. Also integrated Airflow for end-to-end pipeline

Projeto para Extração de dados de um SQL Server e Carga em um Data Lake Storage Gen2 da Azure (ADLS) usando Airflow Astro CLI e spark para movimentação dos dados entre as camadas tipo medalhão com delta lake.

Apache Airflow MCP server with Bearer token authentication support for Astronomer and standalone Airflow

Airflow for end-to-end analytical pipeline for credit card transactions. Detects changes in a Snowflake Stream and triggers a dbt cloud job.

Pipeline de ELT com airflow, dbt e postgresql

Chess Data Harmony is an ETL data engineering project using different tools like Python with pandas, AWS S3, Snowflake, all orchestrated by Airflow (Astronomer)

The astroIncubator repository is designed as a workspace for developing Airflow DAGs, with a focus on integrating the Compass framework for orchestrating dbt modules.

This project demonstrates how to use Terraform to provision data infrastructure on GCP to facilitate ETL pipeline.