Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

Inworld Realtime STT is a streaming API for speech-to-text that captures more than just spoken words. This innovative tool merges low-latency speech recognition with voice profiling capabilities, allowing it to analyze emotions, vocal style, accent, age, and pitch from raw audio inputs, which enhances the responsiveness and expressiveness of downstream LLMs and TTS systems. Developers have the flexibility to stream audio in real time, transcribe entire files, or gather voice profile signals via a single, comprehensive API. The system features real-time bidirectional streaming over WebSocket, synchronous transcription for complete audio files, and offers voice profile signals for each streaming segment, all while supporting multiple providers through one model ID. Each audio segment provides a dynamic profile of the speaker, complete with confidence scores, equipping LLMs with structured context that indicates the emotional state of the user, such as whether they sound sad, frustrated, soft-spoken, high-pitched, or calm. This capability allows for a more nuanced interaction, enriching the user experience by adapting responses to the speaker’s emotional tone and vocal characteristics.

Description

Mistral AI has introduced Voxtral Transcribe 2, an advanced suite of speech-to-text models that provides remarkably fast, high-quality audio transcription and speaker identification, supporting a diverse range of languages. This collection features Voxtral Mini Transcribe V2, which is tailored for batch transcription and includes functionalities like word-level timestamps, context biasing, and compatibility with 13 different languages, alongside Voxtral Realtime, which is optimized for live speech recognition with adjustable latency that can drop below 200 ms for immediate use cases. Both models excel in transcription accuracy while maintaining efficiency and cost-effectiveness; Mini Transcribe V2 is noted for its exceptional performance and minimal error rates, while Realtime is made available as open-source under the Apache 2.0 license, enabling developers to implement it on edge devices or within secure environments. Furthermore, the innovative technology embedded in these models represents a significant leap forward in transcription solutions, catering to various applications across industries.

API Access

Has API Yes 

API Access

Has API Yes 

Screenshots View All

Screenshots View All

Integrations

No details available.

Integrations

No details available.

Pricing Details

Free
Free Trial No 
Free Version Yes 

Pricing Details

$14.99 per month
Free Trial Yes 
Free Version Yes 

Deployment

Web-Based Yes 
On-Premises No 
iPhone App No 
iPad App No 
Android App No 
Windows No 
Mac No 
Linux No 
Chromebook No 

Deployment

Web-Based Yes 
On-Premises No 
iPhone App Yes 
iPad App Yes 
Android App Yes 
Windows No 
Mac No 
Linux No 
Chromebook No 

Customer Support

Business Hours No 
Live Rep (24/7) No 
Online Support Yes 

Customer Support

Business Hours No 
Live Rep (24/7) No 
Online Support Yes 

Types of Training

Training Docs Yes 
Webinars No 
Live Training (Online) Yes 
In Person No 

Types of Training

Training Docs Yes 
Webinars No 
Live Training (Online) Yes 
In Person No 

Vendor Details

Company Name

Inworld

Founded

2021

Country

United States

Website

inworld.ai/speech-to-text

Vendor Details

Company Name

Mistral AI

Founded

2023

Country

France

Website

mistral.ai/news/voxtral-transcribe-2

Product Features

Product Features

Alternatives

Inworld TTS Reviews

Inworld TTS

Inworld

Alternatives

Voxtral Reviews

Voxtral

Mistral AI