Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
LLaMA-Factory is an innovative open-source platform aimed at simplifying and improving the fine-tuning process for more than 100 Large Language Models (LLMs) and Vision-Language Models (VLMs). It accommodates a variety of fine-tuning methods such as Low-Rank Adaptation (LoRA), Quantized LoRA (QLoRA), and Prefix-Tuning, empowering users to personalize models with ease. The platform has shown remarkable performance enhancements; for example, its LoRA tuning achieves training speeds that are up to 3.7 times faster along with superior Rouge scores in advertising text generation tasks when compared to conventional techniques. Built with flexibility in mind, LLaMA-Factory's architecture supports an extensive array of model types and configurations. Users can seamlessly integrate their datasets and make use of the platform’s tools for optimized fine-tuning outcomes. Comprehensive documentation and a variety of examples are available to guide users through the fine-tuning process with confidence. Additionally, this platform encourages collaboration and sharing of techniques among the community, fostering an environment of continuous improvement and innovation.
Description
StableVicuna represents the inaugural large-scale open-source chatbot developed through reinforced learning from human feedback (RLHF). It is an advanced version of the Vicuna v0 13b model, which has undergone further instruction fine-tuning and RLHF training. To attain the impressive capabilities of StableVicuna, we use Vicuna as the foundational model and adhere to the established three-stage RLHF framework proposed by Steinnon et al. and Ouyang et al. Specifically, we perform additional training on the base Vicuna model with supervised fine-tuning (SFT), utilizing a blend of three distinct datasets. The first is the OpenAssistant Conversations Dataset (OASST1), which consists of 161,443 human-generated messages across 66,497 conversation trees in 35 languages. The second dataset is GPT4All Prompt Generations, encompassing 437,605 prompts paired with responses created by GPT-3.5 Turbo. Lastly, the Alpaca dataset features 52,000 instructions and demonstrations that were produced using OpenAI's text-davinci-003 model. This collective approach to training enhances the chatbot's ability to engage effectively in diverse conversational contexts.
API Access
Has API
No
API Access
Has API
No
Integrations
ChatGLM
Yes
DeepSeek
Yes
Gemma
Yes
LLaVA
Yes
Llama
Yes
Llama 3
Yes
MLflow
Yes
Mistral AI
Yes
Mixtral 8x22B
Yes
Mixtral 8x7B
Yes
Integrations
ChatGLM
No
DeepSeek
No
Gemma
No
LLaVA
No
Llama
No
Llama 3
No
MLflow
No
Mistral AI
No
Mixtral 8x22B
No
Mixtral 8x7B
No
Pricing Details
Free
Free Trial
No
Free Version
Yes
Pricing Details
Free
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
Yes
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
hoshi-hiyouga
Website
github.com/hiyouga/LLaMA-Factory
Vendor Details
Company Name
Stability AI
Founded
2019
Country
United Kingdom
Website
stability.ai/
Product Features
Product Features
Artificial Intelligence
Chatbot
No
For Healthcare
No
For Sales
No
For eCommerce
No
Image Recognition
No
Machine Learning
No
Multi-Language
No
Natural Language Processing
No
Predictive Analytics
No
Process/Workflow Automation
No
Rules-Based Automation
No
Virtual Personal Assistant (VPA)
No
Chatbot
Call to Action
No
Context and Coherence
No
Human Takeover
No
Inline Media / Videos
No
Machine Learning
No
Natural Language Processing
No
Payment Integration
No
Prediction
No
Ready-made Templates
No
Reporting / Analytics
No
Sentiment Analysis
No
Social Media Integration
No
Conversational AI
Code-free Development
No
Contextual Guidance
No
For Developers
No
Intent Recognition
No
Multi-Languages
No
Omni-Channel
No
On-Screen Chats
No
Pre-configured Bot
No
Reusable Components
No
Sentiment Analysis
No
Speech Recognition
No
Speech Synthesis
No
Virtual Assistant
No