Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Deequ is an innovative library that extends Apache Spark to create "unit tests for data," aiming to assess the quality of extensive datasets. We welcome any feedback and contributions from users. The library requires Java 8 for operation. It is important to note that Deequ version 2.x is compatible exclusively with Spark 3.1, and the two are interdependent. For those using earlier versions of Spark, the Deequ 1.x version should be utilized, which is maintained in the legacy-spark-3.0 branch. Additionally, we offer legacy releases that work with Apache Spark versions ranging from 2.2.x to 3.0.x. The Spark releases 2.2.x and 2.3.x are built on Scala 2.11, while the 2.4.x, 3.0.x, and 3.1.x releases require Scala 2.12. The primary goal of Deequ is to perform "unit-testing" on data to identify potential issues early on, ensuring that errors are caught before the data reaches consuming systems or machine learning models. In the sections that follow, we will provide a simple example to demonstrate the fundamental functionalities of our library, highlighting its ease of use and effectiveness in maintaining data integrity.
Description
IBM Analytics for Apache Spark offers a versatile and cohesive Spark service that enables data scientists to tackle ambitious and complex inquiries while accelerating the achievement of business outcomes. This user-friendly, continually available managed service comes without long-term commitments or risks, allowing for immediate exploration. Enjoy the advantages of Apache Spark without vendor lock-in, supported by IBM's dedication to open-source technologies and extensive enterprise experience. With integrated Notebooks serving as a connector, the process of coding and analytics becomes more efficient, enabling you to focus more on delivering results and fostering innovation. Additionally, this managed Apache Spark service provides straightforward access to powerful machine learning libraries, alleviating the challenges, time investment, and risks traditionally associated with independently managing a Spark cluster. As a result, teams can prioritize their analytical goals and enhance their productivity significantly.
API Access
Has API
No
API Access
Has API
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
Yes
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Deequ
Website
github.com/awslabs/deequ
Vendor Details
Company Name
IBM
Founded
1911
Country
United States
Website
www.ibm.com/analytics/ca/en/technology/cloud-data-services/spark-as-a-service/
Product Features
Product Features
Data Analysis
Data Discovery
No
Data Visualization
No
High Volume Processing
No
Predictive Analytics
No
Regression Analysis
No
Sentiment Analysis
No
Statistical Modeling
No
Text Analytics
No
Data Science
Access Control
No
Advanced Modeling
No
Audit Logs
No
Data Discovery
No
Data Ingestion
No
Data Preparation
No
Data Visualization
No
Model Deployment
No
Reports
No
Integration
Dashboard
No
ETL - Extract / Transform / Load
No
Metadata Management
No
Multiple Data Sources
No
Web Services
No