apache-airflow - 技术专题

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Curated list of resources about Apache Airflow

Elyra extends JupyterLab with an AI centric approach.

A series of DAGs/Workflows to help maintain the operation of Airflow

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Construct Apache Airflow DAGs Declaratively via YAML configuration files

Run your dbt Core or dbt Fusion projects as Apache Airflow DAGs and Task Groups with a few lines of code

Apache Airflow tutorial

Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes

Apache Airflow - OpenApi Client for Python

A plugin for Apache Airflow that allows you to edit DAGs in browser

CLI that makes it easy to create, test and deploy Airflow DAGs to Astronomer

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee

AI agent tooling for data engineering workflows.

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Example DAGs using hooks and operators from Airflow Plugins

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces

A Helm chart to install Apache Airflow on Kubernetes