Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Amazon EC2 G4 instances are specifically designed to enhance the performance of machine learning inference and applications that require high graphics capabilities. Users can select between NVIDIA T4 GPUs (G4dn) and AMD Radeon Pro V520 GPUs (G4ad) according to their requirements. The G4dn instances combine NVIDIA T4 GPUs with bespoke Intel Cascade Lake CPUs, ensuring an optimal mix of computational power, memory, and networking bandwidth. These instances are well-suited for tasks such as deploying machine learning models, video transcoding, game streaming, and rendering graphics. On the other hand, G4ad instances, equipped with AMD Radeon Pro V520 GPUs and 2nd-generation AMD EPYC processors, offer a budget-friendly option for handling graphics-intensive workloads. Both instance types utilize Amazon Elastic Inference, which permits users to add economical GPU-powered inference acceleration to Amazon EC2, thereby lowering costs associated with deep learning inference. They come in a range of sizes tailored to meet diverse performance demands and seamlessly integrate with various AWS services, including Amazon SageMaker, Amazon ECS, and Amazon EKS. Additionally, this versatility makes G4 instances an attractive choice for organizations looking to leverage cloud-based machine learning and graphics processing capabilities.
Description
NVIDIA DGX Cloud Serverless Inference provides a cutting-edge, serverless AI inference framework designed to expedite AI advancements through automatic scaling, efficient GPU resource management, multi-cloud adaptability, and effortless scalability. This solution enables users to reduce instances to zero during idle times, thereby optimizing resource use and lowering expenses. Importantly, there are no additional charges incurred for cold-boot startup durations, as the system is engineered to keep these times to a minimum. The service is driven by NVIDIA Cloud Functions (NVCF), which includes extensive observability capabilities, allowing users to integrate their choice of monitoring tools, such as Splunk, for detailed visibility into their AI operations. Furthermore, NVCF supports versatile deployment methods for NIM microservices, granting the ability to utilize custom containers, models, and Helm charts, thus catering to diverse deployment preferences and enhancing user flexibility. This combination of features positions NVIDIA DGX Cloud Serverless Inference as a powerful tool for organizations seeking to optimize their AI inference processes.
API Access
Has API
Yes
API Access
Has API
Yes
Integrations
Amazon Web Services (AWS)
Yes
AMD Radeon ProRender
Yes
Amazon EC2
Yes
Amazon EKS
Yes
Amazon Elastic Inference
Yes
Amazon SageMaker
Yes
CUDA
Yes
CoreWeave
No
Google Cloud Platform
No
Helm
No
Integrations
Amazon Web Services (AWS)
Yes
AMD Radeon ProRender
No
Amazon EC2
No
Amazon EKS
No
Amazon Elastic Inference
No
Amazon SageMaker
No
CUDA
No
CoreWeave
Yes
Google Cloud Platform
Yes
Helm
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
Yes
Vendor Details
Company Name
Amazon
Founded
1994
Country
United States
Website
aws.amazon.com/ec2/instance-types/g4/
Vendor Details
Company Name
NVIDIA
Founded
1993
Country
United States
Website
developer.nvidia.com/dgx-cloud/serverless-inference
Product Features
Deep Learning
Convolutional Neural Networks
No
Document Classification
No
Image Segmentation
No
ML Algorithm Library
No
Model Training
No
Neural Network Modeling
No
Self-Learning
No
Visualization
No