NVIDIA Open Agent Safety Platform Integrations

NVIDIA OpenShell serves as an open and secure runtime environment specifically designed for autonomous AI agents, regulating their execution, access rights, and the pathways for inference traffic. Instead of embedding security within the model or application, it maintains safety measures in the surrounding environment, meaning that nothing is allowed by default; permissions are assigned through established policies, and enforcement mechanisms operate outside the agent process to prevent any circumvention via prompts. Each autonomous agent operates within a confined sandbox, which restricts direct network connectivity, limits file access, and implements kernel-level monitoring of system calls to ensure rigorous oversight. Acting as the control plane, a gateway is responsible for user authentication, lifecycle management of sandboxes, and the provision of policies, settings, credentials, and inference configurations to the agents. Additionally, a supervisor operates externally to each sandbox, scrutinizing network requests according to policies at various levels—including binary, destination, method, and path—and only grants access to credentials when explicitly permitted, thus enhancing the overall security framework. This layered architecture ensures that the agents function effectively while maintaining robust security protocols throughout their operations.

NVIDIA DOCA serves as a comprehensive platform that enhances the potential of NVIDIA BlueField DPUs and NVIDIA ConnectX SuperNICs, specifically tailored for agentic AI infrastructure. It offers a suite of SDKs, libraries, production-ready microservices, drivers, management tools, and orchestration frameworks that facilitate the creation and management of accelerated infrastructure services spanning networking, AI-native storage, cybersecurity, observability, and lifecycle management. By utilizing DOCA, developers can efficiently offload, accelerate, and isolate infrastructure workloads, thereby liberating host computing resources for various AI services and applications. In terms of networking, it provides functionalities such as virtual switching, packet processing, multi-tenant isolation, advanced traffic management, RDMA acceleration, and software-defined networking capabilities. On the storage side, DOCA supports KV cache infrastructure, NVMe over Fabrics, storage virtualization, and software-defined storage services, enabling a seamless integration of storage solutions. Overall, DOCA significantly enhances operational efficiency and flexibility in managing advanced infrastructure.