Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Dessa is an innovative speech-to-speech AI model developed by Block, specifically designed for exploring conversational voice technologies and their various applications. This model uniquely processes audio inputs and generates audio outputs directly, bypassing the need for an intermediary text conversion. Instead of relying on text as a foundation, it has been built from the ground up using actual human conversations, enabling it to facilitate full-duplex communication, where it can listen and speak simultaneously. Designed to operate locally on advanced hardware like the MacBook Pro equipped with an M4 Max chip or superior, Dessa effectively captures nuanced conversational elements such as emotions, sarcasm, laughter, pauses, and turn-taking, which are often diminished in text-based communication systems. Aimed primarily at AI safety researchers and developers, it serves as a powerful tool for examining voice model dynamics, privacy implications, and the intricacies of real-time interactions. Importantly, Dessa is not intended for general business use or as a hosted voice-agent solution, marking its specific role in the realm of research and development within the voice technology landscape. This specificity underscores its potential to deepen understanding of voice interactions and inform future AI advancements.
Description
Inworld AI's Realtime TTS-2 represents a cutting-edge voice model designed for instantaneous dialogue, aiming to create a conversational experience that is as human-like as it sounds. This innovative system captures the entirety of an interaction, analyzing the user’s tone, rhythm, and emotional nuances, while also allowing developers to provide voice direction using simple English commands, similar to prompting an AI model. Unlike traditional speech generation that operates in isolation, this model incorporates the context of previous exchanges, ensuring that tone and pacing evolve throughout the conversation, meaning a response can have a completely different impact depending on the preceding context, such as humor or sadness. Furthermore, the Voice Direction feature empowers developers to guide the delivery of speech as a director would with an actor, using intuitive natural language rather than rigid emotion controls or sliders. Additionally, developers can integrate inline nonverbal cues like [sigh], [breathe], and [laugh] directly into the text, which the model seamlessly transforms into corresponding audio events. Notably, Realtime TTS-2 maintains a consistent voice identity across over 100 languages, allowing for smooth language transitions within a single interaction, enhancing its applicability in diverse multilingual settings. This capability ensures that conversations remain fluid and authentic, further bridging the gap between human and machine communication.
API Access
Has API
No
API Access
Has API
Yes
Integrations
ChatGPT
No
Claude
No
Gemini
No
Grok
No
Perplexity
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
$25 per month
Free Trial
No
Free Version
Yes
Deployment
Web-Based
No
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
Yes
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
No
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
Yes
In Person
No
Vendor Details
Company Name
Block
Founded
2009
Country
United States
Website
block.xyz/dessa
Vendor Details
Company Name
Inworld
Founded
2021
Country
United States
Website
inworld.ai/blog/realtime-tts-2
Product Features
Product Features
Text to Speech
API
No
Adjust Speaking Rate / Pitch
No
Audio Optimization
No
Custom Lexicons
No
Different Voice Choices
No
Multi-Language Support
No
Synchronize Speech
No