Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Aya Expanse revolutionizes the field of multilingual AI by serving as a research model that adeptly handles 101 languages, utilizing cutting-edge instruction tuning and cross-lingual transfer methods. The model's unique approach merges a carefully selected open source dataset with efficient pretraining processes, allowing it to deliver exceptional results for both low- and high-resource languages. This innovation not only enhances performance but also successfully lowers infrastructure expenses by up to 30%, establishing a new standard for scalable and inclusive language modeling in the industry. As a result, Aya Expanse is poised to make a significant impact on the future of AI language processing.
Description
Large language models, often requiring extensive computational resources for training over long periods, have demonstrated impressive proficiency in zero- and few-shot learning tasks. Due to the high investment needed for their development, replicating these models poses a significant challenge for many researchers. Furthermore, access to the few models available via API is limited, as users cannot obtain the complete model weights, complicating academic exploration. In response to this, we introduce Open Pre-trained Transformers (OPT), a collection of decoder-only pre-trained transformers ranging from 125 million to 175 billion parameters, which we intend to share comprehensively and responsibly with interested scholars. Our findings indicate that OPT-175B exhibits performance on par with GPT-3, yet it is developed with only one-seventh of the carbon emissions required for GPT-3's training. Additionally, we will provide a detailed logbook that outlines the infrastructure hurdles we encountered throughout the project, as well as code to facilitate experimentation with all released models, ensuring that researchers have the tools they need to explore this technology further.
API Access
Has API
No
API Access
Has API
No
Screenshots View All
No images available
Integrations
No details available.
Integrations
No details available.
Pricing Details
Free
Free Trial
No
Free Version
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Cohere
Founded
2019
Country
Canada
Website
cohere.com/research/aya
Vendor Details
Company Name
Meta
Founded
2004
Country
United States
Website
www.meta.com