Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Dataform provides a platform for data analysts and engineers to create and manage scalable data transformation pipelines in BigQuery using solely SQL from a single, integrated interface. The open-source core language allows teams to outline table structures, manage dependencies, include column descriptions, and establish data quality checks within a collective code repository, all while adhering to best practices in software development, such as version control, various environments, testing protocols, and comprehensive documentation. A fully managed, serverless orchestration layer seamlessly oversees workflow dependencies, monitors data lineage, and executes SQL pipelines either on demand or on a schedule through tools like Cloud Composer, Workflows, BigQuery Studio, or external services. Within the browser-based development interface, users can receive immediate error notifications, visualize their dependency graphs, link their projects to GitHub or GitLab for version control and code reviews, and initiate high-quality production pipelines in just minutes without exiting BigQuery Studio. This efficiency not only accelerates the development process but also enhances collaboration among team members.
Description
Kestra is a free, open-source orchestrator based on events that simplifies data operations while improving collaboration between engineers and users. Kestra brings Infrastructure as Code to data pipelines. This allows you to build reliable workflows with confidence.
The declarative YAML interface allows anyone who wants to benefit from analytics to participate in the creation of the data pipeline. The UI automatically updates the YAML definition whenever you make changes to a work flow via the UI or an API call. The orchestration logic can be defined in code declaratively, even if certain workflow components are modified.
API Access
Has API
No
API Access
Has API
Yes
Integrations
Apache Cassandra
No
Apache Spark
No
Couchbase
No
Debezium
No
GitHub
Yes
Google Cloud BigQuery
Yes
Google Cloud Managed Service for Apache Airflow
Yes
Julia
No
Kubernetes
No
MotherDuck
No
Integrations
Apache Cassandra
Yes
Apache Spark
Yes
Couchbase
Yes
Debezium
Yes
GitHub
No
Google Cloud BigQuery
No
Google Cloud Managed Service for Apache Airflow
No
Julia
Yes
Kubernetes
Yes
MotherDuck
Yes
Pricing Details
Free
Free Trial
No
Free Version
Yes
Pricing Details
No price information available.
Free Trial
Yes
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
No
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
Yes
Mac
Yes
Linux
Yes
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
Yes
In Person
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
Yes
In Person
Yes
Vendor Details
Company Name
Founded
1998
Country
United States
Website
cloud.google.com/dataform
Vendor Details
Company Name
Kestra
Founded
2022
Country
France
Website
kestra.io