Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Scale AI is excited to introduce Defense Llama, a specialized Large Language Model (LLM) developed from Meta’s Llama 3, tailored specifically to enhance American national security initiatives. Designed for exclusive use within controlled U.S. government settings through Scale Donovan, Defense Llama equips our military personnel and national security experts with the generative AI tools needed for various applications, including the planning of military operations and the analysis of adversary weaknesses.
With its training grounded in a comprehensive array of materials, including military doctrines and international humanitarian laws, Defense Llama adheres to the Department of Defense (DoD) guidelines on armed conflict and aligns with the DoD’s Ethical Principles for Artificial Intelligence. This structured foundation allows the model to deliver precise, relevant, and insightful responses tailored to the needs of its users. By providing a secure and efficient generative AI platform, Scale is committed to enhancing the capabilities of U.S. defense personnel in their critical missions. The integration of such technology marks a significant advancement in how national security objectives can be achieved.
Description
LTM-2-mini operates with a context of 100 million tokens, which is comparable to around 10 million lines of code or roughly 750 novels. This model employs a sequence-dimension algorithm that is approximately 1000 times more cost-effective per decoded token than the attention mechanism used in Llama 3.1 405B when handling a 100 million token context window. Furthermore, the disparity in memory usage is significantly greater; utilizing Llama 3.1 405B with a 100 million token context necessitates 638 H100 GPUs per user solely for maintaining a single 100 million token key-value cache. Conversely, LTM-2-mini requires only a minuscule portion of a single H100's high-bandwidth memory for the same context, demonstrating its efficiency. This substantial difference makes LTM-2-mini an appealing option for applications needing extensive context processing without the hefty resource demands.
API Access
Has API
No
API Access
Has API
No
Integrations
Scale Donovan
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
No
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Scale AI
Founded
2016
Country
United States
Website
scale.com/blog/defense-llama
Vendor Details
Company Name
Magic AI
Founded
2022
Country
United States
Website
magic.dev/