Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Amazon Nova Micro is an advanced text-only AI model optimized for rapid language processing at a very low cost. With capabilities in reasoning, translation, and code completion, it offers over 200 tokens per second in response generation, making it suitable for fast-paced, real-time applications. Nova Micro supports fine-tuning with text inputs, and its efficiency in understanding and generating text makes it a cost-effective solution for AI-driven applications requiring high performance and quick outputs.
Description
LTM-2-mini operates with a context of 100 million tokens, which is comparable to around 10 million lines of code or roughly 750 novels. This model employs a sequence-dimension algorithm that is approximately 1000 times more cost-effective per decoded token than the attention mechanism used in Llama 3.1 405B when handling a 100 million token context window. Furthermore, the disparity in memory usage is significantly greater; utilizing Llama 3.1 405B with a 100 million token context necessitates 638 H100 GPUs per user solely for maintaining a single 100 million token key-value cache. Conversely, LTM-2-mini requires only a minuscule portion of a single H100's high-bandwidth memory for the same context, demonstrating its efficiency. This substantial difference makes LTM-2-mini an appealing option for applications needing extensive context processing without the hefty resource demands.
API Access
Has API
No
API Access
Has API
No
Integrations
Amazon Bedrock
Yes
Amazon Nova
Yes
Amazon Nova Act
Yes
Amazon Nova Canvas
Yes
Amazon Nova Forge
Yes
Amazon Nova Lite
Yes
Amazon Nova Premier
Yes
Amazon Nova Pro
Yes
Amazon Nova Reel
Yes
Amazon Web Services (AWS)
Yes
Integrations
Amazon Bedrock
No
Amazon Nova
No
Amazon Nova Act
No
Amazon Nova Canvas
No
Amazon Nova Forge
No
Amazon Nova Lite
No
Amazon Nova Premier
No
Amazon Nova Pro
No
Amazon Nova Reel
No
Amazon Web Services (AWS)
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
No
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Amazon
Founded
1994
Country
United States
Website
aws.amazon.com/ai/generative-ai/nova/
Vendor Details
Company Name
Magic AI
Founded
2022
Country
United States
Website
magic.dev/