Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Bigtop is a project under the Apache Foundation designed for Infrastructure Engineers and Data Scientists who need a thorough solution for packaging, testing, and configuring leading open source big data technologies. It encompasses a variety of components and projects, such as Hadoop, HBase, and Spark, among others. By packaging Hadoop RPMs and DEBs, Bigtop simplifies the management and maintenance of Hadoop clusters. Additionally, it offers an integrated smoke testing framework, complete with a collection of over 50 test files to ensure reliability. For those looking to deploy Hadoop from scratch, Bigtop provides vagrant recipes, raw images, and in-progress docker recipes. The framework is compatible with numerous Operating Systems, including Debian, Ubuntu, CentOS, Fedora, and openSUSE, among others. Moreover, Bigtop incorporates a comprehensive set of tools and a testing framework that evaluates various aspects, such as packaging, platform, and runtime, which are essential for both new deployments and upgrades of the entire data platform, rather than just isolated components. This makes Bigtop a vital resource for anyone aiming to streamline their big data infrastructure.
Description
You determine the cluster size, node specifications, and a range of services, while Yandex Data Proc effortlessly sets up and configures Spark, Hadoop clusters, and additional components. Collaboration is enhanced through the use of Zeppelin notebooks and various web applications via a user interface proxy. You maintain complete control over your cluster with root access for every virtual machine. Moreover, you can install your own software and libraries on active clusters without needing to restart them. Yandex Data Proc employs instance groups to automatically adjust computing resources of compute subclusters in response to CPU usage metrics. Additionally, Data Proc facilitates the creation of managed Hive clusters, which helps minimize the risk of failures and data loss due to metadata issues. This service streamlines the process of constructing ETL pipelines and developing models, as well as managing other iterative operations. Furthermore, the Data Proc operator is natively integrated into Apache Airflow, allowing for seamless orchestration of data workflows. This means that users can leverage the full potential of their data processing capabilities with minimal overhead and maximum efficiency.
API Access
Has API
Yes
API Access
Has API
Yes
Integrations
Apache HBase
Yes
Apache Spark
Yes
Hadoop
Yes
Apache Airflow
No
Apache Flume
No
Apache Hive
No
Apache Zeppelin
No
Beats
Yes
Jenkins
Yes
Jira
Yes
Integrations
Apache HBase
Yes
Apache Spark
Yes
Hadoop
Yes
Apache Airflow
Yes
Apache Flume
Yes
Apache Hive
Yes
Apache Zeppelin
Yes
Beats
No
Jenkins
No
Jira
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
$0.19 per hour
Free Trial
Yes
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
Yes
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
No
Vendor Details
Company Name
Apache Software Foundation
Founded
1999
Country
United States
Website
bigtop.apache.org
Vendor Details
Company Name
Yandex
Founded
1997
Country
Russia
Website
cloud.yandex.com/en/services/data-proc
Product Features
Software Testing
Automated Testing
No
Black-Box Testing
No
Dynamic Testing
No
Issue Tracking
No
Manual Testing
No
Quality Assurance Planning
No
Reporting / Analytics
No
Static Testing
No
Test Case Management
No
Variable Testing Methods
No
White-Box Testing
No