Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Ling 2.6 represents an independently developed and open-source series of large language models created by Ant Group, utilizing a Mixture of Experts (MoE) architecture to enhance inference efficiency, long context modeling, training methodologies, and collaborative reasoning for AI agents. By employing this MoE architecture, Ling effectively directs each token to engage only the most pertinent expert subnetworks, significantly reducing the computational load while preserving the extensive capabilities of the model. This series makes strides in long-sequence modeling, exemplified by Ling-2.6-1T, which accommodates a native context window of up to 1 million tokens and offers a 256K context window through its official API; additionally, Ling-2.6-flash features a native 256K context window, enabling it to handle around 200,000 characters in lengthy inputs. These models are meticulously crafted to ensure dependable retrieval of long-range information without any discernible loss of quality, regardless of whether the data is located at the start, middle, or end of the context. This innovative approach to long-context processing sets a new benchmark for efficiency and reliability in language model performance.
Description
This repository showcases the research preview of LongLLaMA, an advanced large language model that can manage extensive contexts of up to 256,000 tokens or potentially more. LongLLaMA is developed on the OpenLLaMA framework and has been fine-tuned utilizing the Focused Transformer (FoT) technique. The underlying code for LongLLaMA is derived from Code Llama. We are releasing a smaller 3B base variant of the LongLLaMA model, which is not instruction-tuned, under an open license (Apache 2.0), along with inference code that accommodates longer contexts available on Hugging Face. This model's weights can seamlessly replace LLaMA in existing systems designed for shorter contexts, specifically those handling up to 2048 tokens. Furthermore, we include evaluation results along with comparisons to the original OpenLLaMA models, thereby providing a comprehensive overview of LongLLaMA's capabilities in the realm of long-context processing.
API Access
Has API
Yes
API Access
Has API
No
Integrations
Claude Code
Yes
Hermes Agent
Yes
Kilo Code
Yes
OpenAI
Yes
OpenClaw
Yes
OpenRouter
Yes
Integrations
Claude Code
No
Hermes Agent
No
Kilo Code
No
OpenAI
No
OpenClaw
No
OpenRouter
No
Pricing Details
$0.0028 per 1M tokens
Free Trial
No
Free Version
No
Pricing Details
Free
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Ant Group
Founded
2014
Country
China
Website
developer.ant-ling.com/en/docs/models/ling/
Vendor Details
Company Name
LongLLaMA
Website
github.com/CStanKonrad/long_llama