Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Introducing the next iteration of our open-source large language model, this version features model weights along with initial code for the pretrained and fine-tuned Llama language models, which span from 7 billion to 70 billion parameters. The Llama 2 pretrained models have been developed using an impressive 2 trillion tokens and offer double the context length compared to their predecessor, Llama 1. Furthermore, the fine-tuned models have been enhanced through the analysis of over 1 million human annotations. Llama 2 demonstrates superior performance against various other open-source language models across multiple external benchmarks, excelling in areas such as reasoning, coding capabilities, proficiency, and knowledge assessments. For its training, Llama 2 utilized publicly accessible online data sources, while the fine-tuned variant, Llama-2-chat, incorporates publicly available instruction datasets along with the aforementioned extensive human annotations. Our initiative enjoys strong support from a diverse array of global stakeholders who are enthusiastic about our open approach to AI, including companies that have provided valuable early feedback and are eager to collaborate using Llama 2. The excitement surrounding Llama 2 signifies a pivotal shift in how AI can be developed and utilized collectively.
Description
Tinker is an innovative training API tailored for researchers and developers, providing comprehensive control over model fine-tuning while simplifying the complexities of infrastructure management. It offers essential primitives that empower users to create bespoke training loops, supervision techniques, and reinforcement learning workflows. Currently, it facilitates LoRA fine-tuning on open-weight models from both the LLama and Qwen families, accommodating a range of model sizes from smaller variants to extensive mixture-of-experts configurations. Users can write Python scripts to manage data, loss functions, and algorithmic processes, while Tinker autonomously takes care of scheduling, resource distribution, distributed training, and recovery from failures. The platform allows users to download model weights at various checkpoints without the burden of managing the computational environment. Delivered as a managed service, Tinker executes training jobs on Thinking Machines’ proprietary GPU infrastructure, alleviating users from the challenges of cluster orchestration and enabling them to focus on building and optimizing their models. This seamless integration of capabilities makes Tinker a vital tool for advancing machine learning research and development.
API Access
Has API
No
API Access
Has API
Yes
Integrations
AICamp
Yes
Amazon Bedrock
Yes
AnythingLLM
Yes
DataChain
Yes
Decopy AI
Yes
Deep Infra
Yes
Ema
Yes
Evertune
Yes
Gopher
Yes
Graydient AI
Yes
Integrations
AICamp
No
Amazon Bedrock
No
AnythingLLM
No
DataChain
No
Decopy AI
No
Deep Infra
No
Ema
No
Evertune
No
Gopher
No
Graydient AI
No
Pricing Details
Free
Free Trial
No
Free Version
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
Yes
Mac
Yes
Linux
Yes
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Meta
Founded
2004
Country
United States
Website
ai.meta.com/llama/
Vendor Details
Company Name
Thinking Machines Lab
Country
United States
Website
thinkingmachines.ai/tinker/