Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

Instruction-following models like GPT-3.5 (text-DaVinci-003), ChatGPT, Claude, and Bing Chat have seen significant advancements in their capabilities, leading to a rise in their usage among individuals in both personal and professional contexts. Despite their growing popularity and integration into daily tasks, these models are not without their shortcomings, as they can sometimes disseminate inaccurate information, reinforce harmful stereotypes, and use inappropriate language. To effectively tackle these critical issues, it is essential for researchers and scholars to become actively involved in exploring these models further. However, conducting research on instruction-following models within academic settings has posed challenges due to the unavailability of models with comparable functionality to proprietary options like OpenAI’s text-DaVinci-003. In response to this gap, we are presenting our insights on an instruction-following language model named Alpaca, which has been fine-tuned from Meta’s LLaMA 7B model, aiming to contribute to the discourse and development in this field. This initiative represents a step towards enhancing the understanding and capabilities of instruction-following models in a more accessible manner for researchers.

Description

We are excited to present MPT-7B, the newest addition to the MosaicML Foundation Series. This transformer model has been meticulously trained from the ground up using 1 trillion tokens of diverse text and code. It is open-source and ready for commercial applications, delivering performance on par with LLaMA-7B. The training process took 9.5 days on the MosaicML platform, requiring no human input and incurring an approximate cost of $200,000. With MPT-7B, you can now train, fine-tune, and launch your own customized MPT models, whether you choose to begin with one of our provided checkpoints or start anew. To provide additional options, we are also introducing three fine-tuned variants alongside the base MPT-7B: MPT-7B-Instruct, MPT-7B-Chat, and MPT-7B-StoryWriter-65k+, the latter boasting an impressive context length of 65,000 tokens, allowing for extensive content generation. These advancements open up new possibilities for developers and researchers looking to leverage the power of transformer models in their projects.

API Access

Has API

API Access

Has API

Screenshots View All

Screenshots View All

Integrations

Axolotl
BERT
ChatGPT
Dolly
GPT-4
Llama
Ludwig
MosaicML
Stable LM

Integrations

Axolotl
BERT
ChatGPT
Dolly
GPT-4
Llama
Ludwig
MosaicML
Stable LM

Pricing Details

No price information available.
Free Trial
Free Version

Pricing Details

Free
Free Trial
Free Version

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Vendor Details

Company Name

Stanford Center for Research on Foundation Models (CRFM)

Country

United States

Website

crfm.stanford.edu/2023/03/13/alpaca.html

Vendor Details

Company Name

MosaicML

Founded

2021

Country

United States

Website

www.mosaicml.com/blog/mpt-7b

Product Features

Product Features

Alternatives

LTM-1 Reviews

LTM-1

Magic AI

Alternatives

Dolly Reviews

Dolly

Databricks
Falcon-40B Reviews

Falcon-40B

Technology Innovation Institute (TII)
Alpaca Reviews

Alpaca

Stanford Center for Research on Foundation Models (CRFM)
Llama 2 Reviews

Llama 2

Meta
MPT-7B Reviews

MPT-7B

MosaicML
Falcon-40B Reviews

Falcon-40B

Technology Innovation Institute (TII)