Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Amazon Elastic Inference provides an affordable way to enhance Amazon EC2 and Sagemaker instances or Amazon ECS tasks with GPU-powered acceleration, potentially cutting deep learning inference costs by as much as 75%. It is compatible with models built on TensorFlow, Apache MXNet, PyTorch, and ONNX. The term "inference" refers to the act of generating predictions from a trained model. In the realm of deep learning, inference can represent up to 90% of the total operational expenses, primarily for two reasons. Firstly, GPU instances are generally optimized for model training rather than inference, as training tasks can handle numerous data samples simultaneously, while inference typically involves processing one input at a time in real-time, resulting in minimal GPU usage. Consequently, relying solely on GPU instances for inference can lead to higher costs. Conversely, CPU instances lack the necessary specialization for matrix computations, making them inefficient and often too sluggish for deep learning inference tasks. This necessitates a solution like Elastic Inference, which optimally balances cost and performance in inference scenarios.
Description
Deep learning frameworks like TensorFlow, PyTorch, Caffe, Torch, Theano, and MXNet have significantly enhanced the accessibility of deep learning by simplifying the design, training, and application of deep learning models. Fabric for Deep Learning (FfDL, pronounced “fiddle”) offers a standardized method for deploying these deep-learning frameworks as a service on Kubernetes, ensuring smooth operation. The architecture of FfDL is built on microservices, which minimizes the interdependence between components, promotes simplicity, and maintains a stateless nature for each component. This design choice also helps to isolate failures, allowing for independent development, testing, deployment, scaling, and upgrading of each element. By harnessing the capabilities of Kubernetes, FfDL delivers a highly scalable, resilient, and fault-tolerant environment for deep learning tasks. Additionally, the platform incorporates a distribution and orchestration layer that enables efficient learning from large datasets across multiple compute nodes within a manageable timeframe. This comprehensive approach ensures that deep learning projects can be executed with both efficiency and reliability.
API Access
Has API
No
API Access
Has API
Yes
Integrations
PyTorch
Yes
TensorFlow
Yes
Amazon EC2
Yes
Amazon EC2 G4 Instances
Yes
Amazon Web Services (AWS)
Yes
Caffe
No
Kubernetes
No
MXNet
Yes
Torch
No
Integrations
PyTorch
Yes
TensorFlow
Yes
Amazon EC2
No
Amazon EC2 G4 Instances
No
Amazon Web Services (AWS)
No
Caffe
Yes
Kubernetes
Yes
MXNet
No
Torch
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Amazon
Founded
2006
Country
United States
Website
aws.amazon.com/machine-learning/elastic-inference/
Vendor Details
Company Name
IBM
Founded
1911
Country
United States
Website
developer.ibm.com/open/projects/fabric-for-deep-learning-ffdl/
Product Features
Infrastructure-as-a-Service (IaaS)
Analytics / Reporting
No
Configuration Management
No
Data Migration
No
Data Security
No
Load Balancing
No
Log Access
No
Network Monitoring
No
Performance Monitoring
No
SLA Monitoring
No
Product Features
Deep Learning
Convolutional Neural Networks
No
Document Classification
No
Image Segmentation
No
ML Algorithm Library
No
Model Training
No
Neural Network Modeling
No
Self-Learning
No
Visualization
No