Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

A web-based notebook facilitates interactive data analytics and collaborative documentation using SQL, Scala, and other languages. With an IPython interpreter, it delivers a user experience similar to that of Jupyter Notebook. The latest version introduces several enhancements, including a dynamic form at the note level, a note revision comparison tool, and the option to execute paragraphs sequentially rather than simultaneously, as was the case in earlier versions. Additionally, an interpreter lifecycle manager ensures that idle interpreter processes are automatically terminated, freeing up resources when they are not actively being utilized. This improvement not only optimizes performance but also enhances the overall user experience.

Description

Deequ is an innovative library that extends Apache Spark to create "unit tests for data," aiming to assess the quality of extensive datasets. We welcome any feedback and contributions from users. The library requires Java 8 for operation. It is important to note that Deequ version 2.x is compatible exclusively with Spark 3.1, and the two are interdependent. For those using earlier versions of Spark, the Deequ 1.x version should be utilized, which is maintained in the legacy-spark-3.0 branch. Additionally, we offer legacy releases that work with Apache Spark versions ranging from 2.2.x to 3.0.x. The Spark releases 2.2.x and 2.3.x are built on Scala 2.11, while the 2.4.x, 3.0.x, and 3.1.x releases require Scala 2.12. The primary goal of Deequ is to perform "unit-testing" on data to identify potential issues early on, ensuring that errors are caught before the data reaches consuming systems or machine learning models. In the sections that follow, we will provide a simple example to demonstrate the fundamental functionalities of our library, highlighting its ease of use and effectiveness in maintaining data integrity.

API Access

Has API No 

API Access

Has API No 

Screenshots View All

Screenshots View All

Integrations

Apache Spark Yes 
Alluxio Yes 
Apache Cassandra Yes 
Apache Flink Yes 
Apache Geode Yes 
Apache Hive Yes 
Apache Ignite Yes 
Domino Enterprise AI Platform Yes 
Hadoop Yes 
Java Yes 
JavaScript Yes 
OctoData Yes 
PostgreSQL Yes 
QueryPie Yes 
SQL Yes 
Scala Yes 
Warp 10 Yes 
Yandex Data Proc Yes 
Zepl Yes 

Integrations

Apache Spark Yes 
Alluxio No 
Apache Cassandra No 
Apache Flink No 
Apache Geode No 
Apache Hive No 
Apache Ignite No 
Domino Enterprise AI Platform No 
Hadoop No 
Java No 
JavaScript No 
OctoData No 
PostgreSQL No 
QueryPie No 
SQL No 
Scala No 
Warp 10 No 
Yandex Data Proc No 
Zepl No 

Pricing Details

No price information available.
Free Trial No 
Free Version No 

Pricing Details

No price information available.
Free Trial No 
Free Version No 

Deployment

Web-Based Yes 
On-Premises No 
iPhone App No 
iPad App No 
Android App No 
Windows No 
Mac No 
Linux No 
Chromebook No 

Deployment

Web-Based Yes 
On-Premises No 
iPhone App No 
iPad App No 
Android App No 
Windows No 
Mac No 
Linux No 
Chromebook No 

Customer Support

Business Hours No 
Live Rep (24/7) No 
Online Support Yes 

Customer Support

Business Hours No 
Live Rep (24/7) No 
Online Support Yes 

Types of Training

Training Docs Yes 
Webinars No 
Live Training (Online) No 
In Person No 

Types of Training

Training Docs Yes 
Webinars No 
Live Training (Online) No 
In Person No 

Vendor Details

Company Name

Apache

Founded

1999

Country

United. States

Website

zeppelin.apache.org

Vendor Details

Company Name

Deequ

Website

github.com/awslabs/deequ

Product Features

IDE

Code Completion No 
Compiler No 
Cross Platform Support No 
Debugger No 
Drag and Drop UI No 
Integrations and Plugins No 
Multi Language Support No 
Project Management No 
Text Editor / Code Editor No 

Product Features

Alternatives

Alternatives

JupyterLab Reviews

JupyterLab

Jupyter
Spark Streaming Reviews

Spark Streaming

Apache Software Foundation
MLlib Reviews

MLlib

Apache Software Foundation
Apache Spark Reviews

Apache Spark

Apache Software Foundation
Apache Mahout Reviews

Apache Mahout

Apache Software Foundation