Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Airflow is a community-driven platform designed for the programmatic creation, scheduling, and monitoring of workflows. With its modular architecture, Airflow employs a message queue to manage an unlimited number of workers, making it highly scalable. The system is capable of handling complex operations through its ability to define pipelines using Python, facilitating dynamic pipeline generation. This flexibility enables developers to write code that can create pipelines on the fly. Users can easily create custom operators and expand existing libraries, tailoring the abstraction level to meet their specific needs. The pipelines in Airflow are both concise and clear, with built-in parametrization supported by the robust Jinja templating engine. Eliminate the need for complex command-line operations or obscure XML configurations! Instead, leverage standard Python functionalities to construct workflows, incorporating date-time formats for scheduling and utilizing loops for the dynamic generation of tasks. This approach ensures that you retain complete freedom and adaptability when designing your workflows, allowing you to efficiently respond to changing requirements. Additionally, Airflow's user-friendly interface empowers teams to collaboratively refine and optimize their workflow processes.
Description
Astronomer is the driving force behind Apache Airflow, the de facto standard for expressing data flows as code. Airflow is downloaded more than 4 million times each month and is used by hundreds of thousands of teams around the world.
For data teams looking to increase the availability of trusted data, Astronomer provides Astro, the modern data orchestration platform, powered by Airflow. Astro enables data engineers, data scientists, and data analysts to build, run, and observe pipelines-as-code.
Founded in 2018, Astronomer is a global remote-first company with hubs in Cincinnati, New York, San Francisco, and San Jose. Customers in more than 35 countries trust Astronomer as their partner for data orchestration.
API Access
Has API
No
API Access
Has API
Yes
Integrations
Apache Druid
Yes
Datakin
Yes
Great Expectations
Yes
Pantomath
Yes
lakeFS
Yes
Beats
Yes
DQOps
Yes
Databricks
No
Datadog
No
Decube
Yes
Integrations
Apache Druid
Yes
Datakin
Yes
Great Expectations
Yes
Pantomath
Yes
lakeFS
Yes
Beats
No
DQOps
No
Databricks
Yes
Datadog
Yes
Decube
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
Yes
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
Yes
Online Support
Yes
Types of Training
Training Docs
No
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
The Apache Software Foundation
Founded
1999
Country
United States
Website
airflow.apache.org
Vendor Details
Company Name
Astronomer
Founded
2018
Country
United States
Website
www.astronomer.io
Product Features
Workflow Management
Access Controls/Permissions
No
Approval Process Control
No
Business Process Automation
No
Calendar Management
No
Compliance Tracking
No
Configurable Workflow
No
Customizable Dashboard
No
Document Management
No
Forms Management
No
Graphical Workflow Editor
No
Mobile Access
No
No-Code
No
Task Management
No
Third Party Integrations
No
Workflow Configuration
No
Product Features
Big Data
Collaboration
No
Data Blends
No
Data Cleansing
Yes
Data Mining
No
Data Visualization
No
Data Warehousing
No
High Volume Processing
Yes
No-Code Sandbox
No
Predictive Analytics
No
Templates
No
Data Extraction
Disparate Data Collection
Yes
Document Extraction
No
Email Address Extraction
No
IP Address Extraction
No
Image Extraction
No
Phone Number Extraction
No
Pricing Extraction
No
Web Data Extraction
No
Data Governance
Access Control
No
Data Discovery
No
Data Mapping
No
Data Profiling
No
Deletion Management
No
Email Management
No
Policy Management
No
Process Management
No
Roles Management
No
Storage Management
No
Data Management
Customer Data
No
Data Analysis
Yes
Data Capture
Yes
Data Integration
Yes
Data Migration
Yes
Data Quality Control
Yes
Data Security
Yes
Information Governance
Yes
Master Data Management
No
Match & Merge
No
Data Preparation
Collaboration Tools
No
Data Access
No
Data Blending
No
Data Cleansing
Yes
Data Governance
Yes
Data Mashup
Yes
Data Modeling
No
Data Transformation
Yes
Machine Learning
No
Visual User Interface
No
DevOps
Approval Workflow
No
Dashboard
No
KPIs
No
Policy Management
No
Portfolio Management
No
Prioritization
No
Release Management
No
Timeline Management
No
Troubleshooting Reports
No
Integration
Dashboard
Yes
ETL - Extract / Transform / Load
Yes
Metadata Management
Yes
Multiple Data Sources
Yes
Web Services
Yes