Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Ling 3.0 Flash represents an advanced language model optimized for long-term agent workflows, characterized by swift response times, minimal activation levels, and consistent tool usage. Incorporating a Mixture-of-Experts structure, it boasts a staggering 124 billion parameters in total, with 5.1 billion parameters activated per token, which enhances its capability while maintaining efficient inference. This model features an impressive native context window of 256K tokens, which can be expanded to accommodate up to 1 million tokens, ensuring effective retrieval of information from any part of lengthy contexts. When compared to its predecessor, the original Flash model, Ling 3.0 Flash significantly enhances stability for prolonged tasks, improves the accuracy of tool-calling, better adheres to instructions, and shows greater compatibility with agent harnesses and coding tasks. Additionally, its refined spatial awareness allows it to create grids of physical scenes and evaluate relative positions effectively, while its hybrid reasoning capabilities boost success rates across a range of task complexities. Overall, Ling 3.0 Flash exemplifies a significant leap forward in language modeling technology, ensuring users can achieve superior performance across diverse applications.
Description
This repository showcases the research preview of LongLLaMA, an advanced large language model that can manage extensive contexts of up to 256,000 tokens or potentially more. LongLLaMA is developed on the OpenLLaMA framework and has been fine-tuned utilizing the Focused Transformer (FoT) technique. The underlying code for LongLLaMA is derived from Code Llama. We are releasing a smaller 3B base variant of the LongLLaMA model, which is not instruction-tuned, under an open license (Apache 2.0), along with inference code that accommodates longer contexts available on Hugging Face. This model's weights can seamlessly replace LLaMA in existing systems designed for shorter contexts, specifically those handling up to 2048 tokens. Furthermore, we include evaluation results along with comparisons to the original OpenLLaMA models, thereby providing a comprehensive overview of LongLLaMA's capabilities in the realm of long-context processing.
API Access
Has API
Yes
API Access
Has API
No
Integrations
Claude Code
Yes
Hermes Agent
Yes
Kilo Code
Yes
OpenClaw
Yes
OpenRouter
Yes
ZenMux
Yes
Integrations
Claude Code
No
Hermes Agent
No
Kilo Code
No
OpenClaw
No
OpenRouter
No
ZenMux
No
Pricing Details
No price information available.
Free Trial
Yes
Free Version
No
Pricing Details
Free
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Ant Group
Founded
2014
Country
China
Website
www.ant-ling.com
Vendor Details
Company Name
LongLLaMA
Website
github.com/CStanKonrad/long_llama