Apache Airflow is a free tool used to write, schedule, and track data jobs. Data teams use it to build multi-step data pipelines using Python code. Key Concepts
- DAGs: Workflows are written as Directed Acyclic Graphs, meaning tasks flow in one direction with no loops.
- Tasks: Small, separate steps of work inside a workflow.
- Scheduling: Runs jobs automatically at set times or dates. Core Features
- Code-based: Build pipelines using standard Python scripts.
- Web Dashboard: View the status of tasks, read logs, and restart failed jobs easily.
- Integrations: Connects with cloud services like AWS, Google Cloud, and Snowflake.
test test test