Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
NVIDIA Cloud Functions (NVCF) is a serverless API tailored for deploying and managing AI tasks on GPUs, ensuring security, scalability, and dependable performance. It accommodates various access methods, including HTTP polling, HTTP streaming, and gRPC protocols, for interacting with workloads. Primarily, Cloud Functions is optimized for brief, preemptable tasks such as inferencing and model fine-tuning. Users can choose between two types of functions: "Container" and "Helm Chart," enabling them to customize functions according to their specific needs. Since workloads are transient and preemptable, it is crucial for users to save their progress diligently. Additionally, models, containers, helm charts, and other essential resources are stored and retrieved from the NGC Private Registry. To begin utilizing NVCF, users can refer to the quickstart guide for functions, which outlines a comprehensive workflow for establishing and launching a container-based function utilizing the fastapi_echo_sample container. This resource not only highlights the ease of setup but also encourages users to explore the full potential of NVIDIA’s serverless infrastructure.
Description
Execute code within a secure, resilient, and automatically scalable framework without the need to create or manage virtual machines. As the demand for function executions rises, the service dynamically provisions extra instances of your function to handle the increased load. All functions operate concurrently, and the runtime environment is distributed across three availability zones to maintain service continuity even if one zone experiences issues. You can set up and ready function instances to handle incoming requests efficiently, which helps to eliminate cold starts and allows for the rapid processing of workloads of any magnitude. Grant your functions access to your Virtual Private Cloud (VPC) to enhance communication with private resources, including database clusters, virtual machines, and Kubernetes nodes. Additionally, Serverless Functions monitors and logs details about function executions, providing insights into operational flow and performance metrics; you also have the option to specify logging methods within your function's code. Furthermore, you can initiate cloud functions in both synchronized mode and with delayed execution capabilities for greater flexibility. This approach allows for streamlined processes that can adapt to varying workloads efficiently.
API Access
Has API
Yes
API Access
Has API
Yes
Integrations
Kubernetes
Yes
Bash
No
C#
No
Datadog
Yes
Docker
Yes
Go
No
Grafana Cloud
Yes
Helm
Yes
Java
No
NVIDIA DGX Cloud
Yes
Integrations
Kubernetes
Yes
Bash
Yes
C#
Yes
Datadog
No
Docker
No
Go
Yes
Grafana Cloud
No
Helm
No
Java
Yes
NVIDIA DGX Cloud
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
$0.012240 per GB
Free Trial
Yes
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
Yes
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
Yes
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
Yes
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
No
Vendor Details
Company Name
NVIDIA
Founded
1993
Country
United States
Website
docs.nvidia.com/cloud-functions/index.html
Vendor Details
Company Name
Yandex
Founded
1997
Country
Russia
Website
cloud.yandex.com/en/services/functions
Product Features
Product Features
Serverless
API Proxy
No
Application Integration
No
Data Stores
No
Developer Tooling
No
Orchestration
No
Reporting / Analytics
No
Serverless Computing
No
Storage
No