Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
NVIDIA Cloud Functions (NVCF) is a serverless API tailored for deploying and managing AI tasks on GPUs, ensuring security, scalability, and dependable performance. It accommodates various access methods, including HTTP polling, HTTP streaming, and gRPC protocols, for interacting with workloads. Primarily, Cloud Functions is optimized for brief, preemptable tasks such as inferencing and model fine-tuning. Users can choose between two types of functions: "Container" and "Helm Chart," enabling them to customize functions according to their specific needs. Since workloads are transient and preemptable, it is crucial for users to save their progress diligently. Additionally, models, containers, helm charts, and other essential resources are stored and retrieved from the NGC Private Registry. To begin utilizing NVCF, users can refer to the quickstart guide for functions, which outlines a comprehensive workflow for establishing and launching a container-based function utilizing the fastapi_echo_sample container. This resource not only highlights the ease of setup but also encourages users to explore the full potential of NVIDIA’s serverless infrastructure.
Description
Targon offers a secure cloud computing environment designed for efficiently scaling AI workloads with high-speed GPUs and CPUs suitable for training and deployment purposes. With a user-friendly API, SDK, and CLI, it simplifies the management of various workloads, including rentals, serverless applications, persistent volumes, web endpoints, and inference of large language models. At its core, Targon leverages confidential computing principles without compromise, utilizing a decentralized network of trusted execution environments to enhance security. The Targon Virtual Machine maintains data confidentiality through hardware-backed protection powered by Intel TDX, while NVIDIA's Confidential Computing and PCIe Confidentiality technologies safeguard data even on untrusted hardware. Users can choose to deploy confidential compute environments, establish connections to GPU servers with configured SSH keys, or leverage serverless containers that intelligently auto-scale in response to user traffic demands. This flexibility allows organizations to tailor their computing resources to meet fluctuating needs while ensuring stringent security measures are upheld.
API Access
Has API
Yes
API Access
Has API
Yes
Integrations
Bittensor
No
Datadog
Yes
Docker
Yes
Google Cloud Platform
No
Grafana Cloud
Yes
Helm
Yes
Kubernetes
Yes
NVIDIA DGX Cloud
Yes
NVIDIA DGX Cloud Serverless Inference
Yes
Shopify
No
Integrations
Bittensor
Yes
Datadog
No
Docker
No
Google Cloud Platform
Yes
Grafana Cloud
No
Helm
No
Kubernetes
No
NVIDIA DGX Cloud
No
NVIDIA DGX Cloud Serverless Inference
No
Shopify
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
Yes
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
NVIDIA
Founded
1993
Country
United States
Website
docs.nvidia.com/cloud-functions/index.html
Vendor Details
Company Name
Manifold Labs
Country
United States
Website
targon.com