Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
The TinyLlama initiative seeks to pretrain a Llama model with 1.1 billion parameters using a dataset of 3 trillion tokens. With the right optimizations, this ambitious task can be completed in a mere 90 days, utilizing 16 A100-40G GPUs. We have maintained the same architecture and tokenizer as Llama 2, ensuring that TinyLlama is compatible with various open-source projects that are based on Llama. Additionally, the model's compact design, consisting of just 1.1 billion parameters, makes it suitable for numerous applications that require limited computational resources and memory. This versatility enables developers to integrate TinyLlama seamlessly into their existing frameworks and workflows.
Description
Vicuna-13B is an open-source conversational agent developed through the fine-tuning of LLaMA, utilizing a dataset of user-shared dialogues gathered from ShareGPT. Initial assessments, with GPT-4 serving as an evaluator, indicate that Vicuna-13B achieves over 90% of the quality exhibited by OpenAI's ChatGPT and Google Bard, and it surpasses other models such as LLaMA and Stanford Alpaca in more than 90% of instances. The entire training process for Vicuna-13B incurs an estimated expenditure of approximately $300. Additionally, the source code and model weights, along with an interactive demonstration, are made available for public access under non-commercial terms, fostering a collaborative environment for further development and exploration. This openness encourages innovation and enables users to experiment with the model's capabilities in diverse applications.
API Access
Has API
API Access
Has API
Screenshots View All
No images available
Pricing Details
Free
Free Trial
Free Version
Pricing Details
Free
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
TinyLlama
Website
github.com/jzhang38/TinyLlama
Vendor Details
Company Name
lmsys.org
Founded
2023
Website
lmsys.org