Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
On June 23, 2025, Microsoft unveiled Mu, an innovative 330-million-parameter encoder–decoder language model specifically crafted to enhance the agent experience within Windows environments by effectively translating natural language inquiries into function calls for Settings, all processed on-device via NPUs at a remarkable speed of over 100 tokens per second while ensuring impressive accuracy. By leveraging Phi Silica optimizations, Mu’s encoder–decoder design employs a fixed-length latent representation that significantly reduces both computational demands and memory usage, achieving a 47 percent reduction in first-token latency and a decoding speed that is 4.7 times greater on Qualcomm Hexagon NPUs when compared to other decoder-only models. Additionally, the model benefits from hardware-aware tuning techniques, which include a thoughtful 2/3–1/3 split of encoder and decoder parameters, shared weights for input and output embeddings, Dual LayerNorm, rotary positional embeddings, and grouped-query attention, allowing for swift inference rates exceeding 200 tokens per second on devices such as the Surface Laptop 7, along with sub-500 ms response times for settings-related queries. This combination of features positions Mu as a groundbreaking advancement in on-device language processing capabilities.
Description
NetsPresso serves as an advanced platform for optimizing AI models with a strong focus on hardware awareness. It facilitates on-device AI applications across various sectors, making it an essential tool for developing hardware-aware AI models. The incorporation of lightweight models like LLaMA and Vicuna allows for highly efficient text generation capabilities. Additionally, BK-SDM represents a streamlined version of Stable Diffusion models. Vision-Language Models (VLMs) effectively merge visual information with natural language processing. By addressing challenges associated with cloud and server-based AI solutions—such as limited connectivity, high expenses, and privacy concerns—NetsPresso stands out in the field. Furthermore, it operates as an automated model compression platform, effectively reducing the size of computer vision models to ensure they can function independently on smaller and less powerful edge devices. By optimizing target models through various compression techniques, the platform successfully minimizes AI models while maintaining their performance integrity. This dual focus on efficiency and effectiveness positions NetsPresso as a leader in the field of AI optimization.
API Access
Has API
No
API Access
Has API
No
Integrations
Arduino IDE
No
Arm MAP
No
Intel SceneScape
No
LaunchX
No
MQX RTOS
No
NVIDIA AI Enterprise
No
Python
No
Qualcomm AI Hub
No
Raspberry Pi OS
No
Integrations
Arduino IDE
Yes
Arm MAP
Yes
Intel SceneScape
Yes
LaunchX
Yes
MQX RTOS
Yes
NVIDIA AI Enterprise
Yes
Python
Yes
Qualcomm AI Hub
Yes
Raspberry Pi OS
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
No
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
Yes
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Microsoft
Founded
1975
Country
United States
Website
blogs.windows.com/windowsexperience/2025/06/23/introducing-mu-language-model-and-how-it-enabled-the-agent-in-windows-settings/
Vendor Details
Company Name
Nota AI
Founded
2015
Country
South Korea
Website
www.nota.ai/netspresso