Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Introducing an open-source AI model that can be fine-tuned, distilled, and deployed across various platforms. Our newest instruction-tuned model comes in three sizes: 8B, 70B, and 405B, giving you options to suit different needs. With our open ecosystem, you can expedite your development process using a diverse array of tailored product offerings designed to meet your specific requirements. You have the flexibility to select between real-time inference and batch inference services according to your project's demands. Additionally, you can download model weights to enhance cost efficiency per token while fine-tuning for your application. Improve performance further by utilizing synthetic data and seamlessly deploy your solutions on-premises or in the cloud. Take advantage of Llama system components and expand the model's capabilities through zero-shot tool usage and retrieval-augmented generation (RAG) to foster agentic behaviors. By utilizing 405B high-quality data, you can refine specialized models tailored to distinct use cases, ensuring optimal functionality for your applications. Ultimately, this empowers developers to create innovative solutions that are both efficient and effective.
Description
Olmo 3 represents a comprehensive family of open models featuring variations with 7 billion and 32 billion parameters, offering exceptional capabilities in base performance, reasoning, instruction, and reinforcement learning, while also providing transparency throughout the model development process, which includes access to raw training datasets, intermediate checkpoints, training scripts, extended context support (with a window of 65,536 tokens), and provenance tools. The foundation of these models is built upon the Dolma 3 dataset, which comprises approximately 9 trillion tokens and utilizes a careful blend of web content, scientific papers, programming code, and lengthy documents; this thorough pre-training, mid-training, and long-context approach culminates in base models that undergo post-training enhancements through supervised fine-tuning, preference optimization, and reinforcement learning with accountable rewards, resulting in the creation of the Think and Instruct variants. Notably, the 32 billion Think model has been recognized as the most powerful fully open reasoning model to date, demonstrating performance that closely rivals that of proprietary counterparts in areas such as mathematics, programming, and intricate reasoning tasks, thereby marking a significant advancement in open model development. This innovation underscores the potential for open-source models to compete with traditional, closed systems in various complex applications.
API Access
Has API
No
API Access
Has API
No
Integrations
AI/ML API
Yes
AiAssistWorks
Yes
ChatLLM
Yes
Cyte
Yes
DataChain
Yes
Deep Infra
Yes
Double
Yes
Flowith
Yes
Hyperbolic
Yes
Klee
Yes
Integrations
AI/ML API
No
AiAssistWorks
No
ChatLLM
No
Cyte
No
DataChain
No
Deep Infra
No
Double
No
Flowith
No
Hyperbolic
No
Klee
No
Pricing Details
Free
Free Trial
No
Free Version
Yes
Pricing Details
Free
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
Yes
Mac
Yes
Linux
Yes
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
Yes
In Person
No
Vendor Details
Company Name
Meta
Founded
2004
Country
United States
Website
llama.meta.com
Vendor Details
Company Name
Ai2
Founded
2014
Country
United States
Website
allenai.org/blog/olmo3