Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

IREN’s AI Cloud is a cutting-edge GPU cloud infrastructure that utilizes NVIDIA's reference architecture along with a high-speed, non-blocking InfiniBand network capable of 3.2 TB/s, specifically engineered for demanding AI training and inference tasks through its bare-metal GPU clusters. This platform accommodates a variety of NVIDIA GPU models, providing ample RAM, vCPUs, and NVMe storage to meet diverse computational needs. Fully managed and vertically integrated by IREN, the service ensures clients benefit from operational flexibility, robust reliability, and comprehensive 24/7 in-house support. Users gain access to performance metrics monitoring, enabling them to optimize their GPU expenditures while maintaining secure and isolated environments through private networking and tenant separation. The platform empowers users to deploy their own data, models, and frameworks such as TensorFlow, PyTorch, and JAX, alongside container technologies like Docker and Apptainer, all while granting root access without any limitations. Additionally, it is finely tuned to accommodate the scaling requirements of complex applications, including the fine-tuning of extensive language models, ensuring efficient resource utilization and exceptional performance for sophisticated AI projects.

Description

NVIDIA DGX Cloud Serverless Inference provides a cutting-edge, serverless AI inference framework designed to expedite AI advancements through automatic scaling, efficient GPU resource management, multi-cloud adaptability, and effortless scalability. This solution enables users to reduce instances to zero during idle times, thereby optimizing resource use and lowering expenses. Importantly, there are no additional charges incurred for cold-boot startup durations, as the system is engineered to keep these times to a minimum. The service is driven by NVIDIA Cloud Functions (NVCF), which includes extensive observability capabilities, allowing users to integrate their choice of monitoring tools, such as Splunk, for detailed visibility into their AI operations. Furthermore, NVCF supports versatile deployment methods for NIM microservices, granting the ability to utilize custom containers, models, and Helm charts, thus catering to diverse deployment preferences and enhancing user flexibility. This combination of features positions NVIDIA DGX Cloud Serverless Inference as a powerful tool for organizations seeking to optimize their AI inference processes.

API Access

Has API No 

API Access

Has API Yes 

Screenshots View All

Screenshots View All

Integrations

Llama Yes 
Amazon Web Services (AWS) No 
CoreWeave No 
Docker Yes 
Falcon AI Yes 
Google Cloud Platform No 
Microsoft Azure No 
Mistral AI Yes 
NVIDIA AI Foundations No 
NVIDIA DGX Cloud No 
NVIDIA NIM No 
NVIDIA virtual GPU Yes 
Nebius No 
Oracle Cloud Infrastructure No 
PyTorch Yes 
Splunk Cloud Platform No 
Stability AI Yes 
TensorFlow Yes 
WEKA Yes 
Yotta No 

Integrations

Llama Yes 
Amazon Web Services (AWS) Yes 
CoreWeave Yes 
Docker No 
Falcon AI No 
Google Cloud Platform Yes 
Microsoft Azure Yes 
Mistral AI No 
NVIDIA AI Foundations Yes 
NVIDIA DGX Cloud Yes 
NVIDIA NIM Yes 
NVIDIA virtual GPU No 
Nebius Yes 
Oracle Cloud Infrastructure Yes 
PyTorch No 
Splunk Cloud Platform Yes 
Stability AI No 
TensorFlow No 
WEKA No 
Yotta Yes 

Pricing Details

No price information available.
Free Trial No 
Free Version No 

Pricing Details

No price information available.
Free Trial No 
Free Version No 

Deployment

Web-Based Yes 
On-Premises No 
iPhone App No 
iPad App No 
Android App No 
Windows No 
Mac No 
Linux No 
Chromebook No 

Deployment

Web-Based Yes 
On-Premises No 
iPhone App No 
iPad App No 
Android App No 
Windows No 
Mac No 
Linux No 
Chromebook No 

Customer Support

Business Hours No 
Live Rep (24/7) Yes 
Online Support Yes 

Customer Support

Business Hours Yes 
Live Rep (24/7) No 
Online Support Yes 

Types of Training

Training Docs Yes 
Webinars Yes 
Live Training (Online) Yes 
In Person No 

Types of Training

Training Docs Yes 
Webinars Yes 
Live Training (Online) Yes 
In Person Yes 

Vendor Details

Company Name

IREN

Country

Australia

Website

www.iren.com/solutions/gpu-cloud/ai-cloud

Vendor Details

Company Name

NVIDIA

Founded

1993

Country

United States

Website

developer.nvidia.com/dgx-cloud/serverless-inference

Product Features

Alternatives

Alternatives