Chinchilla Description

Chinchilla is an advanced language model that operates with a compute budget comparable to Gopher while having 70 billion parameters and utilizing four times the amount of data. This model consistently and significantly surpasses Gopher (280 billion parameters), as well as GPT-3 (175 billion), Jurassic-1 (178 billion), and Megatron-Turing NLG (530 billion), across a wide variety of evaluation tasks. Additionally, Chinchilla's design allows it to use significantly less computational power during the fine-tuning and inference processes, which greatly enhances its applicability in real-world scenarios. Notably, Chinchilla achieves a remarkable average accuracy of 67.5% on the MMLU benchmark, marking over a 7% enhancement compared to Gopher, showcasing its superior performance in the field. This impressive capability positions Chinchilla as a leading contender in the realm of language models.

Integrations

Reviews

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Company Details

Company:
Google DeepMind
Headquarters:
United States
Website:
arxiv.org/abs/2203.15556

Media

Get Started
Recommended Products
Veeam Data Platform v13.1 - Get Your Free Trial Icon
Veeam Data Platform v13.1 - Get Your Free Trial

Secure by design, portable by default. Recover clean, fast, anywhere. Start a free trial.

Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
Try it Free

Product Details

Platforms
Web-Based
Windows
Mac
Linux
On-Premises
Types of Training
Training Docs

Chinchilla User Reviews

Write a Review
  • Previous
  • Next