Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

Grok Voice 3.0 is an advanced speech-to-speech model that is accessible via the Grok Voice Agent API, designed for developers creating real-time voice applications. This model processes both audio and text inputs, delivering spoken audio or text outputs through a WebSocket connection while enabling features such as conversational turn-taking, interruptions, and function execution. Developers have the flexibility to link this model with custom functions and various server-side tools, which may include web searches, X searches, collections, or remote MCP servers. The API is crafted for use in interactive voice agents that enhance customer support and service call experiences, and it is also implemented for voice communication within Tesla vehicles and Grok Bot. Billing operates on a usage-based model, charging for audio by the minute and text input events separately. Additionally, the API documentation provides comprehensive setup instructions along with examples for clients using Python and JavaScript, ensuring that developers can easily integrate the functionality into their applications. This robust feature set empowers developers to create more engaging and efficient voice interaction systems.

Description

Grok Voice Think Fast 2.0 stands as the premier voice model from xAI, designed for the creation of real-time assistants, telephone agents, and interactive voice systems capable of bidirectional audio and text streaming via WebSocket. Developers have the flexibility to tailor various system parameters, such as the level of reasoning effort, the choice between built-in or custom voices, automatic voice activity detection on the server side, as well as configurable settings for silence duration, idle re-engagement, playback speed, and the ability to resume sessions following temporary disconnections. The model processes audio in several formats, including PCM, G.711 μ-law, G.711 A-law, and Opus, accepting both JSON and raw binary frames, with the adaptability to adjust PCM sample rates ranging from standard telephone quality to 48 kHz. It boasts support for over 20 languages with native-like accents, features automatic language recognition, generates natural responses in the user's preferred language, and facilitates smooth code-switching. Additionally, the inclusion of language hints and the ability to incorporate up to 100 key terms significantly enhance the accuracy of transcribing regional dialects, names, product identifiers, codes, addresses, and other specialized vocabulary, while pronunciation adjustments ensure the spoken output is correct and intelligible. This versatility makes Grok Voice Think Fast 2.0 an invaluable tool for developers looking to enhance user interaction through voice technology.

API Access

Has API Yes 

API Access

Has API Yes 

Screenshots View All

Screenshots View All

Integrations

Grok Yes 
Grok Voice Agent Yes 
Grok Voice Agent Builder Yes 
Grok Bot Yes 
Model Context Protocol (MCP) Yes 
Twilio Yes 
Vercel AI Gateway No 

Integrations

Grok Yes 
Grok Voice Agent Yes 
Grok Voice Agent Builder Yes 
Grok Bot No 
Model Context Protocol (MCP) No 
Twilio No 
Vercel AI Gateway Yes 

Pricing Details

$0.08/min
Audio is $0.08 per minute. Text-only input events are $0.004 each. Server-VAD sessions are billed for the full session duration; push-to-talk sessions are billed for audio sent and received.
Free Trial Yes 
Free Version No 

Pricing Details

No price information available.
Free Trial No 
Free Version No 

Deployment

Web-Based Yes 
On-Premises No 
iPhone App No 
iPad App No 
Android App No 
Windows No 
Mac No 
Linux No 
Chromebook No 

Deployment

Web-Based Yes 
On-Premises No 
iPhone App No 
iPad App No 
Android App No 
Windows No 
Mac No 
Linux No 
Chromebook No 

Customer Support

Business Hours No 
Live Rep (24/7) No 
Online Support Yes 

Customer Support

Business Hours No 
Live Rep (24/7) No 
Online Support Yes 

Types of Training

Training Docs Yes 
Webinars No 
Live Training (Online) No 
In Person No 

Types of Training

Training Docs Yes 
Webinars No 
Live Training (Online) No 
In Person No 

Vendor Details

Company Name

SpaceXSI

Founded

2023

Country

United States

Website

x.ai/api/voice

Vendor Details

Company Name

SpaceXSI

Founded

2023

Country

United States

Website

docs.x.ai/developers/model-capabilities/audio/speech-to-speech

Product Features

Alternatives

No Alternatives

Alternatives