Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
AWS Inferentia accelerators, engineered by AWS, aim to provide exceptional performance while minimizing costs for deep learning (DL) inference tasks. The initial generation of AWS Inferentia accelerators supports Amazon Elastic Compute Cloud (Amazon EC2) Inf1 instances, boasting up to 2.3 times greater throughput and a 70% reduction in cost per inference compared to similar GPU-based Amazon EC2 instances. Numerous companies, such as Airbnb, Snap, Sprinklr, Money Forward, and Amazon Alexa, have embraced Inf1 instances and experienced significant advantages in both performance and cost. Each first-generation Inferentia accelerator is equipped with 8 GB of DDR4 memory along with a substantial amount of on-chip memory. The subsequent Inferentia2 model enhances capabilities by providing 32 GB of HBM2e memory per accelerator, quadrupling the total memory and decoupling the memory bandwidth, which is ten times greater than its predecessor. This evolution in technology not only optimizes the processing power but also significantly improves the efficiency of deep learning applications across various sectors.
Description
Amazon EC2 G4 instances are specifically designed to enhance the performance of machine learning inference and applications that require high graphics capabilities. Users can select between NVIDIA T4 GPUs (G4dn) and AMD Radeon Pro V520 GPUs (G4ad) according to their requirements. The G4dn instances combine NVIDIA T4 GPUs with bespoke Intel Cascade Lake CPUs, ensuring an optimal mix of computational power, memory, and networking bandwidth. These instances are well-suited for tasks such as deploying machine learning models, video transcoding, game streaming, and rendering graphics. On the other hand, G4ad instances, equipped with AMD Radeon Pro V520 GPUs and 2nd-generation AMD EPYC processors, offer a budget-friendly option for handling graphics-intensive workloads. Both instance types utilize Amazon Elastic Inference, which permits users to add economical GPU-powered inference acceleration to Amazon EC2, thereby lowering costs associated with deep learning inference. They come in a range of sizes tailored to meet diverse performance demands and seamlessly integrate with various AWS services, including Amazon SageMaker, Amazon ECS, and Amazon EKS. Additionally, this versatility makes G4 instances an attractive choice for organizations looking to leverage cloud-based machine learning and graphics processing capabilities.
API Access
Has API
No
API Access
Has API
Yes
Integrations
AMD Radeon ProRender
No
AWS EC2 Trn3 Instances
Yes
AWS Parallel Computing Service
Yes
Amazon EC2
No
Amazon EC2 Inf1 Instances
Yes
Amazon EC2 Trn1 Instances
Yes
Amazon EKS
No
Amazon Elastic Inference
No
Amazon SageMaker
No
Amazon Web Services (AWS)
No
Integrations
AMD Radeon ProRender
Yes
AWS EC2 Trn3 Instances
No
AWS Parallel Computing Service
No
Amazon EC2
Yes
Amazon EC2 Inf1 Instances
No
Amazon EC2 Trn1 Instances
No
Amazon EKS
Yes
Amazon Elastic Inference
Yes
Amazon SageMaker
Yes
Amazon Web Services (AWS)
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
Yes
Vendor Details
Company Name
Amazon
Founded
2006
Country
United States
Website
aws.amazon.com/machine-learning/inferentia/
Vendor Details
Company Name
Amazon
Founded
1994
Country
United States
Website
aws.amazon.com/ec2/instance-types/g4/
Product Features
Deep Learning
Convolutional Neural Networks
No
Document Classification
No
Image Segmentation
No
ML Algorithm Library
No
Model Training
No
Neural Network Modeling
No
Self-Learning
No
Visualization
No
Infrastructure-as-a-Service (IaaS)
Analytics / Reporting
No
Configuration Management
No
Data Migration
No
Data Security
No
Load Balancing
No
Log Access
No
Network Monitoring
No
Performance Monitoring
No
SLA Monitoring
No
Product Features
Deep Learning
Convolutional Neural Networks
No
Document Classification
No
Image Segmentation
No
ML Algorithm Library
No
Model Training
No
Neural Network Modeling
No
Self-Learning
No
Visualization
No