Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Canopy Labs has unveiled Orpheus, an innovative suite of advanced speech large language models (LLMs) aimed at achieving human-like speech generation capabilities. Utilizing the Llama-3 architecture, these models have been trained on an extensive dataset comprising over 100,000 hours of English speech, allowing them to generate speech that exhibits natural intonation, emotional depth, and rhythmic flow that outperforms existing high-end closed-source alternatives. Orpheus also features zero-shot voice cloning, enabling users to mimic voices without any need for prior fine-tuning, and provides easy-to-use tags for controlling emotion and intonation. The models are engineered for low latency, achieving approximately 200ms streaming latency for real-time usage, which can be further decreased to around 100ms when utilizing input streaming. Canopy Labs has made available both pre-trained and fine-tuned models with 3 billion parameters under the flexible Apache 2.0 license, with future intentions to offer smaller models with 1 billion, 400 million, and 150 million parameters to cater to devices with limited resources. This strategic move is expected to broaden accessibility and application potential across various platforms and use cases.
Description
Piper is a rapidly operating, localized neural text-to-speech (TTS) system that is particularly optimized for devices like the Raspberry Pi 4, aiming to provide top-notch speech synthesis capabilities without the dependence on cloud infrastructure. It employs neural network models developed with VITS and subsequently exported to ONNX Runtime, which facilitates both efficient and natural-sounding speech production. Supporting a diverse array of languages, Piper includes English (both US and UK dialects), Spanish (from Spain and Mexico), French, German, and many others, with downloadable voice options available. Users have the flexibility to operate Piper through command-line interfaces or integrate it seamlessly into Python applications via the piper-tts package. The system boasts features such as real-time audio streaming, JSON input for batch processing, and compatibility with multi-speaker models, enhancing its versatility. Additionally, Piper makes use of espeak-ng for phoneme generation, transforming text into phonemes before generating speech. It has found applications in various projects, including Home Assistant, Rhasspy 3, and NVDA, among others, illustrating its adaptability across different platforms and use cases. With its emphasis on local processing, Piper appeals to users looking for privacy and efficiency in their speech synthesis solutions.
API Access
Has API
No
API Access
Has API
No
Integrations
Baseten
Yes
GitHub
Yes
Google Colab
Yes
Hugging Face
Yes
JSON
No
Llama 3
Yes
Python
No
VoiSpark
Yes
Integrations
Baseten
No
GitHub
No
Google Colab
No
Hugging Face
No
JSON
Yes
Llama 3
No
Python
Yes
VoiSpark
No
Pricing Details
No price information available.
Free Trial
Yes
Free Version
No
Pricing Details
Free
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
No
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
Yes
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
Yes
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Canopy Labs
Country
United States
Website
canopylabs.ai/model-releases
Vendor Details
Company Name
Rhasspy
Country
United States
Website
github.com/rhasspy/piper
Product Features
Text to Speech
API
No
Adjust Speaking Rate / Pitch
No
Audio Optimization
No
Custom Lexicons
No
Different Voice Choices
No
Multi-Language Support
No
Synchronize Speech
No
Product Features
Text to Speech
API
No
Adjust Speaking Rate / Pitch
No
Audio Optimization
No
Custom Lexicons
No
Different Voice Choices
No
Multi-Language Support
No
Synchronize Speech
No