Alternatives to Athene-V2

Qwen3-Coder is a versatile coding model that comes in various sizes, prominently featuring the 480B-parameter Mixture-of-Experts version with 35B active parameters, which naturally accommodates 256K-token contexts that can be extended to 1M tokens. This model achieves impressive performance that rivals Claude Sonnet 4, having undergone pre-training on 7.5 trillion tokens, with 70% of that being code, and utilizing synthetic data refined through Qwen2.5-Coder to enhance both coding skills and overall capabilities. Furthermore, the model benefits from post-training techniques that leverage extensive, execution-guided reinforcement learning, which facilitates the generation of diverse test cases across 20,000 parallel environments, thereby excelling in multi-turn software engineering tasks such as SWE-Bench Verified without needing test-time scaling. In addition to the model itself, the open-source Qwen Code CLI, derived from Gemini Code, empowers users to deploy Qwen3-Coder in dynamic workflows with tailored prompts and function calling protocols, while also offering smooth integration with Node.js, OpenAI SDKs, and environment variables. This comprehensive ecosystem supports developers in optimizing their coding projects effectively and efficiently.

Qwen2.5-Max is an advanced Mixture-of-Experts (MoE) model created by the Qwen team, which has been pretrained on an extensive dataset of over 20 trillion tokens and subsequently enhanced through methods like Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF). Its performance in evaluations surpasses that of models such as DeepSeek V3 across various benchmarks, including Arena-Hard, LiveBench, LiveCodeBench, and GPQA-Diamond, while also achieving strong results in other tests like MMLU-Pro. This model is available through an API on Alibaba Cloud, allowing users to easily integrate it into their applications, and it can also be interacted with on Qwen Chat for a hands-on experience. With its superior capabilities, Qwen2.5-Max represents a significant advancement in AI model technology.

Upstage has unveiled Solar Pro 2, a cutting-edge large language model designed for frontier-scale applications, capable of managing intricate tasks and workflows in various sectors including finance, healthcare, and law. This model is built on a streamlined architecture with 31 billion parameters, ensuring exceptional multilingual capabilities, particularly in Korean, where it surpasses even larger models on key benchmarks such as Ko-MMLU, Hae-Rae, and Ko-IFEval, while maintaining strong performance in English and Japanese as well. In addition to its advanced language comprehension and generation abilities, Solar Pro 2 incorporates a sophisticated Reasoning Mode that significantly enhances the accuracy of multi-step tasks across a wide array of challenges, from general reasoning assessments (MMLU, MMLU-Pro, HumanEval) to intricate mathematics problems (Math500, AIME) and software engineering tasks (SWE-Bench Agentless), achieving problem-solving efficiency that rivals or even surpasses that of models with double the parameters. Furthermore, its enhanced tool-use capabilities allow the model to effectively engage with external APIs and data, broadening its applicability in real-world scenarios. This innovative design not only demonstrates exceptional versatility but also positions Solar Pro 2 as a formidable player in the evolving landscape of AI technologies.

Smaug-72B is a formidable open-source large language model (LLM) distinguished by several prominent features: Exceptional Performance: It currently ranks first on the Hugging Face Open LLM leaderboard, outperforming models such as GPT-3.5 in multiple evaluations, demonstrating its ability to comprehend, react to, and generate text that closely resembles human writing. Open Source Availability: In contrast to many high-end LLMs, Smaug-72B is accessible to everyone for use and modification, which encourages cooperation and innovation within the AI ecosystem. Emphasis on Reasoning and Mathematics: This model excels particularly in reasoning and mathematical challenges, a capability attributed to specialized fine-tuning methods developed by its creators, Abacus AI. Derived from Qwen-72B: It is essentially a refined version of another robust LLM, Qwen-72B, which was launched by Alibaba, thereby enhancing its overall performance. In summary, Smaug-72B marks a notable advancement in the realm of open-source artificial intelligence, making it a valuable resource for developers and researchers alike. Its unique strengths not only elevate its status but also contribute to the ongoing evolution of AI technology.

Mistral 7B is a language model with 7.3 billion parameters that demonstrates superior performance compared to larger models such as Llama 2 13B on a variety of benchmarks. It utilizes innovative techniques like Grouped-Query Attention (GQA) for improved inference speed and Sliding Window Attention (SWA) to manage lengthy sequences efficiently. Released under the Apache 2.0 license, Mistral 7B is readily available for deployment on different platforms, including both local setups and prominent cloud services. Furthermore, a specialized variant known as Mistral 7B Instruct has shown remarkable capabilities in following instructions, outperforming competitors like Llama 2 13B Chat in specific tasks. This versatility makes Mistral 7B an attractive option for developers and researchers alike.

Cohere's Command A Translate is a robust machine translation solution designed for enterprises, offering secure and top-notch translation capabilities in 23 languages pertinent to business. It operates on an advanced 111-billion-parameter framework with an 8K-input / 8K-output context window, providing superior performance that outshines competitors such as GPT-5, DeepSeek-V3, DeepL Pro, and Google Translate across various benchmarks. The model facilitates private deployment options for organizations handling sensitive information, ensuring they maintain total control of their data, while also featuring a pioneering “Deep Translation” workflow that employs an iterative, multi-step refinement process to significantly improve translation accuracy for intricate scenarios. RWS Group’s external validation underscores its effectiveness in managing demanding translation challenges. Furthermore, the model's parameters are accessible for research through Hugging Face under a CC-BY-NC license, allowing for extensive customization, fine-tuning, and adaptability for private implementations, making it an attractive option for organizations seeking tailored language solutions. This versatility positions Command A Translate as an essential tool for enterprises aiming to enhance their communication across global markets.

FLUX.1 Krea [dev] is a cutting-edge, open-source diffusion transformer with 12 billion parameters, developed through the collaboration of Krea and Black Forest Labs, aimed at providing exceptional aesthetic precision and photorealistic outputs while avoiding the common “AI look.” This model is fully integrated into the FLUX.1-dev ecosystem and is built upon a foundational model (flux-dev-raw) that possesses extensive world knowledge. It utilizes a two-phase post-training approach that includes supervised fine-tuning on a carefully selected combination of high-quality and synthetic samples, followed by reinforcement learning driven by human feedback based on preference data to shape its stylistic outputs. Through the innovative use of negative prompts during pre-training, along with custom loss functions designed for classifier-free guidance and specific preference labels, it demonstrates substantial enhancements in quality with fewer than one million examples, achieving these results without the need for elaborate prompts or additional LoRA modules. This approach not only elevates the model's output but also sets a new standard in the field of AI-driven visual generation.

Tülu 3 is a cutting-edge language model created by the Allen Institute for AI (Ai2) that aims to improve proficiency in fields like knowledge, reasoning, mathematics, coding, and safety. It is based on the Llama 3 Base and undergoes a detailed four-stage post-training regimen: careful prompt curation and synthesis, supervised fine-tuning on a wide array of prompts and completions, preference tuning utilizing both off- and on-policy data, and a unique reinforcement learning strategy that enhances targeted skills through measurable rewards. Notably, this open-source model sets itself apart by ensuring complete transparency, offering access to its training data, code, and evaluation tools, thus bridging the performance divide between open and proprietary fine-tuning techniques. Performance assessments reveal that Tülu 3 surpasses other models with comparable sizes, like Llama 3.1-Instruct and Qwen2.5-Instruct, across an array of benchmarks, highlighting its effectiveness. The continuous development of Tülu 3 signifies the commitment to advancing AI capabilities while promoting an open and accessible approach to technology.

Qwen2 represents a collection of extensive language models crafted by the Qwen team at Alibaba Cloud. This series encompasses a variety of models, including base and instruction-tuned versions, with parameters varying from 0.5 billion to an impressive 72 billion, showcasing both dense configurations and a Mixture-of-Experts approach. The Qwen2 series aims to outperform many earlier open-weight models, including its predecessor Qwen1.5, while also striving to hold its own against proprietary models across numerous benchmarks in areas such as language comprehension, generation, multilingual functionality, programming, mathematics, and logical reasoning. Furthermore, this innovative series is poised to make a significant impact in the field of artificial intelligence, offering enhanced capabilities for a diverse range of applications.

Qwen2.5-VL-32B represents an advanced AI model specifically crafted for multimodal endeavors, showcasing exceptional skills in reasoning related to both text and images. This iteration enhances the previous Qwen2.5-VL series, resulting in responses that are not only of higher quality but also more aligned with human-like formatting. The model demonstrates remarkable proficiency in mathematical reasoning, nuanced image comprehension, and intricate multi-step reasoning challenges, such as those encountered in benchmarks like MathVista and MMMU. Its performance has been validated through comparisons with competing models, often surpassing even the larger Qwen2-VL-72B in specific tasks. Furthermore, with its refined capabilities in image analysis and visual logic deduction, Qwen2.5-VL-32B offers thorough and precise evaluations of visual content, enabling it to generate insightful responses from complex visual stimuli. This model has been meticulously optimized for both textual and visual tasks, making it exceptionally well-suited for scenarios that demand advanced reasoning and understanding across various forms of media, thus expanding its potential applications even further.

Pixtral Large is an expansive multimodal model featuring 124 billion parameters, crafted by Mistral AI and enhancing their previous Mistral Large 2 framework. This model combines a 123-billion-parameter multimodal decoder with a 1-billion-parameter vision encoder, allowing it to excel in the interpretation of various content types, including documents, charts, and natural images, all while retaining superior text comprehension abilities. With the capability to manage a context window of 128,000 tokens, Pixtral Large can efficiently analyze at least 30 high-resolution images at once. It has achieved remarkable results on benchmarks like MathVista, DocVQA, and VQAv2, outpacing competitors such as GPT-4o and Gemini-1.5 Pro. Available for research and educational purposes under the Mistral Research License, it also has a Mistral Commercial License for business applications. This versatility makes Pixtral Large a valuable tool for both academic research and commercial innovations.

K2 Think represents a groundbreaking open-source advanced reasoning model that has been developed in collaboration between the Institute of Foundation Models at MBZUAI and G42. Even with its relatively modest 32 billion parameters, K2 Think achieves performance that rivals that of leading models with significantly larger parameter counts. Its strength lies in mathematical reasoning, where it has secured top rankings on prestigious benchmarks such as AIME ’24/’25, HMMT ’25, and OMNI-Math-HARD. This model is part of a wider initiative of UAE-developed open models, which includes Jais (for Arabic), NANDA (for Hindi), and SHERKALA (for Kazakh), and it builds upon the groundwork established by the K2-65B, a fully reproducible open-source foundation model released in 2024. K2 Think is crafted to be open, efficient, and adaptable, featuring a web app interface that facilitates user exploration, and its innovative approach to parameter positioning marks a significant advancement in the realm of compact architectures for high-level AI reasoning. Additionally, its development highlights a commitment to enhancing access to state-of-the-art AI technologies in various languages and domains.

Kimi K2 represents a cutting-edge series of open-source large language models utilizing a mixture-of-experts (MoE) architecture, with a staggering 1 trillion parameters in total and 32 billion activated parameters tailored for optimized task execution. Utilizing the Muon optimizer, it has been trained on a substantial dataset of over 15.5 trillion tokens, with its performance enhanced by MuonClip’s attention-logit clamping mechanism, resulting in remarkable capabilities in areas such as advanced knowledge comprehension, logical reasoning, mathematics, programming, and various agentic operations. Moonshot AI offers two distinct versions: Kimi-K2-Base, designed for research-level fine-tuning, and Kimi-K2-Instruct, which is pre-trained for immediate applications in chat and tool interactions, facilitating both customized development and seamless integration of agentic features. Comparative benchmarks indicate that Kimi K2 surpasses other leading open-source models and competes effectively with top proprietary systems, particularly excelling in coding and intricate task analysis. Furthermore, it boasts a generous context length of 128 K tokens, compatibility with tool-calling APIs, and support for industry-standard inference engines, making it a versatile option for various applications. The innovative design and features of Kimi K2 position it as a significant advancement in the field of artificial intelligence language processing.

Phi-4-mini-reasoning is a transformer-based language model with 3.8 billion parameters, specifically designed to excel in mathematical reasoning and methodical problem-solving within environments that have limited computational capacity or latency constraints. Its optimization stems from fine-tuning with synthetic data produced by the DeepSeek-R1 model, striking a balance between efficiency and sophisticated reasoning capabilities. With training that encompasses over one million varied math problems, ranging in complexity from middle school to Ph.D. level, Phi-4-mini-reasoning demonstrates superior performance to its base model in generating lengthy sentences across multiple assessments and outshines larger counterparts such as OpenThinker-7B, Llama-3.2-3B-instruct, and DeepSeek-R1. Equipped with a 128K-token context window, it also facilitates function calling, which allows for seamless integration with various external tools and APIs. Moreover, Phi-4-mini-reasoning can be quantized through the Microsoft Olive or Apple MLX Framework, enabling its deployment on a variety of edge devices, including IoT gadgets, laptops, and smartphones. Its design not only enhances user accessibility but also expands the potential for innovative applications in mathematical fields.

Qwen2-VL represents the most advanced iteration of vision-language models within the Qwen family, building upon the foundation established by Qwen-VL. This enhanced model showcases remarkable capabilities, including: Achieving cutting-edge performance in interpreting images of diverse resolutions and aspect ratios, with Qwen2-VL excelling in visual comprehension tasks such as MathVista, DocVQA, RealWorldQA, and MTVQA, among others. Processing videos exceeding 20 minutes in length, enabling high-quality video question answering, engaging dialogues, and content creation. Functioning as an intelligent agent capable of managing devices like smartphones and robots, Qwen2-VL utilizes its sophisticated reasoning and decision-making skills to perform automated tasks based on visual cues and textual commands. Providing multilingual support to accommodate a global audience, Qwen2-VL can now interpret text in multiple languages found within images, extending its usability and accessibility to users from various linguistic backgrounds. This wide-ranging capability positions Qwen2-VL as a versatile tool for numerous applications across different fields.

Qwen-7B is the 7-billion parameter iteration of Alibaba Cloud's Qwen language model series, also known as Tongyi Qianwen. This large language model utilizes a Transformer architecture and has been pretrained on an extensive dataset comprising web texts, books, code, and more. Furthermore, we introduced Qwen-7B-Chat, an AI assistant that builds upon the pretrained Qwen-7B model and incorporates advanced alignment techniques. The Qwen-7B series boasts several notable features: It has been trained on a premium dataset, with over 2.2 trillion tokens sourced from a self-assembled collection of high-quality texts and codes across various domains, encompassing both general and specialized knowledge. Additionally, our model demonstrates exceptional performance, surpassing competitors of similar size on numerous benchmark datasets that assess capabilities in natural language understanding, mathematics, and coding tasks. This positions Qwen-7B as a leading choice in the realm of AI language models. Overall, its sophisticated training and robust design contribute to its impressive versatility and effectiveness.

Sky-T1-32B-Preview is an innovative open-source reasoning model crafted by the NovaSky team at UC Berkeley's Sky Computing Lab. It delivers performance comparable to proprietary models such as o1-preview on various reasoning and coding assessments, while being developed at a cost of less than $450, highlighting the potential for budget-friendly, advanced reasoning abilities. Fine-tuned from Qwen2.5-32B-Instruct, the model utilized a meticulously curated dataset comprising 17,000 examples spanning multiple fields, such as mathematics and programming. The entire training process was completed in just 19 hours using eight H100 GPUs with DeepSpeed Zero-3 offloading technology. Every component of this initiative—including the data, code, and model weights—is entirely open-source, allowing both academic and open-source communities to not only replicate but also improve upon the model's capabilities. This accessibility fosters collaboration and innovation in the realm of artificial intelligence research and development.

ERNIE X1.1 is Baidu’s latest reasoning AI model, designed to raise the bar for accuracy, reliability, and action-oriented intelligence. Compared to ERNIE X1, it delivers a 34.8% boost in factual accuracy, a 12.5% improvement in instruction compliance, and a 9.6% gain in agentic behavior. Benchmarks show that it outperforms DeepSeek R1-0528 and matches the capabilities of advanced models such as GPT-5 and Gemini 2.5 Pro. The model builds upon ERNIE 4.5 with additional mid-training and post-training phases, reinforced by end-to-end reinforcement learning. This approach helps minimize hallucinations while ensuring closer alignment to user intent. The agentic upgrades allow it to plan, make decisions, and execute tasks more effectively than before. Users can access ERNIE X1.1 through ERNIE Bot, Wenxiaoyan, or via API on Baidu’s Qianfan platform. Altogether, the model delivers stronger reasoning capabilities for developers and enterprises that demand high-performance AI.

Phi-4-reasoning-plus is an advanced reasoning model with 14 billion parameters, enhancing the capabilities of the original Phi-4-reasoning. It employs reinforcement learning for better inference efficiency, processing 1.5 times the number of tokens compared to its predecessor, which results in improved accuracy. Remarkably, this model performs better than both OpenAI's o1-mini and DeepSeek-R1 across various benchmarks, including challenging tasks in mathematical reasoning and advanced scientific inquiries. Notably, it even outperforms the larger DeepSeek-R1, which boasts 671 billion parameters, on the prestigious AIME 2025 assessment, a qualifier for the USA Math Olympiad. Furthermore, Phi-4-reasoning-plus is accessible on platforms like Azure AI Foundry and HuggingFace, making it easier for developers and researchers to leverage its capabilities. Its innovative design positions it as a top contender in the realm of reasoning models.

QwQ-Max-Preview is a cutting-edge AI model based on the Qwen2.5-Max framework, specifically engineered to excel in areas such as complex reasoning, mathematical problem-solving, programming, and agent tasks. This preview showcases its enhanced capabilities across a variety of general-domain applications while demonstrating proficiency in managing intricate workflows. Anticipated to be officially released as open-source software under the Apache 2.0 license, QwQ-Max-Preview promises significant improvements and upgrades in its final iteration. Additionally, it contributes to the development of a more inclusive AI environment, as evidenced by the forthcoming introduction of the Qwen Chat application and streamlined model versions like QwQ-32B, which cater to developers interested in local deployment solutions. This initiative not only broadens accessibility but also encourages innovation within the AI community.

GPT-Realtime, OpenAI's latest and most sophisticated speech-to-speech model, is now available via the fully operational Realtime API. This model produces audio that is not only highly natural but also expressive, allowing users to finely adjust elements such as tone, speed, and accent. It is capable of understanding complex human audio cues, including laughter, can switch languages seamlessly in the middle of a conversation, and accurately interprets alphanumeric information such as phone numbers in various languages. With a notable enhancement in reasoning and instruction-following abilities, it has achieved impressive scores of 82.8% on the BigBench Audio benchmark and 30.5% on MultiChallenge. Additionally, it features improved function calling capabilities, demonstrating greater reliability, speed, and accuracy, with a score of 66.5% on ComplexFuncBench. The model also facilitates asynchronous tool invocation, ensuring that dialogues flow smoothly even during extended calls. Furthermore, the Realtime API introduces groundbreaking features like support for image input, integration with SIP phone networks, connections to remote MCP servers, and the ability to reuse conversation prompts effectively. These advancements make it an invaluable tool for enhancing communication technology.

Devstral is a collaborative effort between Mistral AI and All Hands AI, resulting in an open-source large language model specifically tailored for software engineering. This model demonstrates remarkable proficiency in navigating intricate codebases, managing edits across numerous files, and addressing practical problems, achieving a notable score of 46.8% on the SWE-Bench Verified benchmark, which is superior to all other open-source models. Based on Mistral-Small-3.1, Devstral boasts an extensive context window supporting up to 128,000 tokens. It is designed for optimal performance on high-performance hardware setups, such as Macs equipped with 32GB of RAM or Nvidia RTX 4090 GPUs, and supports various inference frameworks including vLLM, Transformers, and Ollama. Released under the Apache 2.0 license, Devstral is freely accessible on platforms like Hugging Face, Ollama, Kaggle, Unsloth, and LM Studio, allowing developers to integrate its capabilities into their projects seamlessly. This model not only enhances productivity for software engineers but also serves as a valuable resource for anyone working with code.

GPT-J represents an advanced language model developed by EleutherAI, known for its impressive capabilities. When it comes to performance, GPT-J showcases a proficiency that rivals OpenAI's well-known GPT-3 in various zero-shot tasks. Remarkably, it has even outperformed GPT-3 in specific areas, such as code generation. The most recent version of this model, called GPT-J-6B, is constructed using a comprehensive linguistic dataset known as The Pile, which is publicly accessible and consists of an extensive 825 gibibytes of language data divided into 22 unique subsets. Although GPT-J possesses similarities to ChatGPT, it's crucial to highlight that it is primarily intended for text prediction rather than functioning as a chatbot. In a notable advancement in March 2023, Databricks unveiled Dolly, a model that is capable of following instructions and operates under an Apache license, further enriching the landscape of language models. This evolution in AI technology continues to push the boundaries of what is possible in natural language processing.

Yi-Lightning, a product of 01.AI and spearheaded by Kai-Fu Lee, marks a significant leap forward in the realm of large language models, emphasizing both performance excellence and cost-effectiveness. With the ability to process a context length of up to 16K tokens, it offers an attractive pricing model of $0.14 per million tokens for both inputs and outputs, making it highly competitive in the market. The model employs an improved Mixture-of-Experts (MoE) framework, featuring detailed expert segmentation and sophisticated routing techniques that enhance its training and inference efficiency. Yi-Lightning has distinguished itself across multiple fields, achieving top distinctions in areas such as Chinese language processing, mathematics, coding tasks, and challenging prompts on chatbot platforms, where it ranked 6th overall and 9th in style control. Its creation involved an extensive combination of pre-training, targeted fine-tuning, and reinforcement learning derived from human feedback, which not only enhances its performance but also prioritizes user safety. Furthermore, the model's design includes significant advancements in optimizing both memory consumption and inference speed, positioning it as a formidable contender in its field.

GLM-4.6 builds upon the foundations laid by its predecessor, showcasing enhanced reasoning, coding, and agent capabilities, resulting in notable advancements in inferential accuracy, improved tool usage during reasoning tasks, and a more seamless integration within agent frameworks. In comprehensive benchmark evaluations that assess reasoning, coding, and agent performance, GLM-4.6 surpasses GLM-4.5 and competes robustly against other models like DeepSeek-V3.2-Exp and Claude Sonnet 4, although it still lags behind Claude Sonnet 4.5 in terms of coding capabilities. Furthermore, when subjected to practical tests utilizing an extensive “CC-Bench” suite that includes tasks in front-end development, tool creation, data analysis, and algorithmic challenges, GLM-4.6 outperforms GLM-4.5 while nearing parity with Claude Sonnet 4, achieving victory in approximately 48.6% of direct comparisons and demonstrating around 15% improved token efficiency. This latest model is accessible through the Z.ai API, providing developers the flexibility to implement it as either an LLM backend or as the core of an agent within the platform's API ecosystem. In addition, its advancements could significantly enhance productivity in various application domains, making it an attractive option for developers looking to leverage cutting-edge AI technology.

CodeQwen serves as the coding counterpart to Qwen, which is a series of large language models created by the Qwen team at Alibaba Cloud. Built on a transformer architecture that functions solely as a decoder, this model has undergone extensive pre-training using a vast dataset of code. It showcases robust code generation abilities and demonstrates impressive results across various benchmarking tests. With the capacity to comprehend and generate long contexts of up to 64,000 tokens, CodeQwen accommodates 92 programming languages and excels in tasks such as text-to-SQL queries and debugging. Engaging with CodeQwen is straightforward—you can initiate a conversation with just a few lines of code utilizing transformers. The foundation of this interaction relies on constructing the tokenizer and model using pre-existing methods, employing the generate function to facilitate dialogue guided by the chat template provided by the tokenizer. In alignment with our established practices, we implement the ChatML template tailored for chat models. This model adeptly completes code snippets based on the prompts it receives, delivering responses without the need for any further formatting adjustments, thereby enhancing the user experience. The seamless integration of these elements underscores the efficiency and versatility of CodeQwen in handling diverse coding tasks.

Falcon Mamba 7B marks a significant milestone as the inaugural open-source State Space Language Model (SSLM), presenting a revolutionary architecture within the Falcon model family. Celebrated as the premier open-source SSLM globally by Hugging Face, it establishes a new standard for efficiency in artificial intelligence. In contrast to conventional transformers, SSLMs require significantly less memory and can produce lengthy text sequences seamlessly without extra resource demands. Falcon Mamba 7B outperforms top transformer models, such as Meta’s Llama 3.1 8B and Mistral’s 7B, demonstrating enhanced capabilities. This breakthrough not only highlights Abu Dhabi’s dedication to pushing the boundaries of AI research but also positions the region as a pivotal player in the global AI landscape. Such advancements are vital for fostering innovation and collaboration in technology.

LLaVA, or Large Language-and-Vision Assistant, represents a groundbreaking multimodal model that combines a vision encoder with the Vicuna language model, enabling enhanced understanding of both visual and textual information. By employing end-to-end training, LLaVA showcases remarkable conversational abilities, mirroring the multimodal features found in models such as GPT-4. Significantly, LLaVA-1.5 has reached cutting-edge performance on 11 different benchmarks, leveraging publicly accessible data and achieving completion of its training in about one day on a single 8-A100 node, outperforming approaches that depend on massive datasets. The model's development included the construction of a multimodal instruction-following dataset, which was produced using a language-only variant of GPT-4. This dataset consists of 158,000 distinct language-image instruction-following examples, featuring dialogues, intricate descriptions, and advanced reasoning challenges. Such a comprehensive dataset has played a crucial role in equipping LLaVA to handle a diverse range of tasks related to vision and language with great efficiency. In essence, LLaVA not only enhances the interaction between visual and textual modalities but also sets a new benchmark in the field of multimodal AI.

An advanced End-to-End MLLM is designed to accept various forms of references and effectively ground responses. The Ferret Model utilizes a combination of Hybrid Region Representation and a Spatial-aware Visual Sampler, which allows for detailed and flexible referring and grounding capabilities within the MLLM framework. The GRIT Dataset, comprising approximately 1.1 million entries, serves as a large-scale and hierarchical dataset specifically crafted for robust instruction tuning in the ground-and-refer category. Additionally, the Ferret-Bench is a comprehensive multimodal evaluation benchmark that simultaneously assesses referring, grounding, semantics, knowledge, and reasoning, ensuring a well-rounded evaluation of the model's capabilities. This intricate setup aims to enhance the interaction between language and visual data, paving the way for more intuitive AI systems.

We are excited to announce the launch of Phi-2, a language model featuring 2.7 billion parameters that excels in reasoning and language comprehension, achieving top-tier results compared to other base models with fewer than 13 billion parameters. In challenging benchmarks, Phi-2 competes with and often surpasses models that are up to 25 times its size, a feat made possible by advancements in model scaling and meticulous curation of training data. Due to its efficient design, Phi-2 serves as an excellent resource for researchers interested in areas such as mechanistic interpretability, enhancing safety measures, or conducting fine-tuning experiments across a broad spectrum of tasks. To promote further exploration and innovation in language modeling, Phi-2 has been integrated into the Azure AI Studio model catalog, encouraging collaboration and development within the research community. Researchers can leverage this model to unlock new insights and push the boundaries of language technology.

The QwQ-32B model, created by Alibaba Cloud's Qwen team, represents a significant advancement in AI reasoning, aimed at improving problem-solving skills. Boasting 32 billion parameters, it rivals leading models such as DeepSeek's R1, which contains 671 billion parameters. This remarkable efficiency stems from its optimized use of parameters, enabling QwQ-32B to tackle complex tasks like mathematical reasoning, programming, and other problem-solving scenarios while consuming fewer resources. It can handle a context length of up to 32,000 tokens, making it adept at managing large volumes of input data. Notably, QwQ-32B is available through Alibaba's Qwen Chat service and is released under the Apache 2.0 license, which fosters collaboration and innovation among AI developers. With its cutting-edge features, QwQ-32B is poised to make a substantial impact in the field of artificial intelligence.

The NVIDIA Llama Nemotron family comprises a series of sophisticated language models that are fine-tuned for complex reasoning and a wide array of agentic AI applications. These models shine in areas such as advanced scientific reasoning, complex mathematics, coding, following instructions, and executing tool calls. They are designed for versatility, making them suitable for deployment on various platforms, including data centers and personal computers, and feature the ability to switch reasoning capabilities on or off, which helps to lower inference costs during less demanding tasks. The Llama Nemotron series consists of models specifically designed to meet different deployment requirements. Leveraging the foundation of Llama models and enhanced through NVIDIA's post-training techniques, these models boast a notable accuracy improvement of up to 20% compared to their base counterparts while also achieving inference speeds that can be up to five times faster than other leading open reasoning models. This remarkable efficiency allows for the management of more intricate reasoning challenges, boosts decision-making processes, and significantly lowers operational expenses for businesses. Consequently, the Llama Nemotron models represent a significant advancement in the field of AI, particularly for organizations seeking to integrate cutting-edge reasoning capabilities into their systems.

DeepSeekMath is an advanced 7B parameter language model created by DeepSeek-AI, specifically engineered to enhance mathematical reasoning capabilities within open-source language models. Building upon the foundation of DeepSeek-Coder-v1.5, this model undergoes additional pre-training utilizing 120 billion math-related tokens gathered from Common Crawl, complemented by data from natural language and coding sources. It has shown exceptional outcomes, achieving a score of 51.7% on the challenging MATH benchmark without relying on external tools or voting systems, positioning itself as a strong contender against models like Gemini-Ultra and GPT-4. The model's prowess is further bolstered by a carefully curated data selection pipeline and the implementation of Group Relative Policy Optimization (GRPO), which improves both its mathematical reasoning skills and efficiency in memory usage. DeepSeekMath is offered in various formats including base, instruct, and reinforcement learning (RL) versions, catering to both research and commercial interests, and is intended for individuals eager to delve into or leverage sophisticated mathematical problem-solving in the realm of artificial intelligence. Its versatility makes it a valuable resource for researchers and practitioners alike, driving innovation in AI-driven mathematics.

DeepSeek-R1 is a cutting-edge open-source reasoning model created by DeepSeek, aimed at competing with OpenAI's Model o1. It is readily available through web, app, and API interfaces, showcasing its proficiency in challenging tasks such as mathematics and coding, and achieving impressive results on assessments like the American Invitational Mathematics Examination (AIME) and MATH. Utilizing a mixture of experts (MoE) architecture, this model boasts a remarkable total of 671 billion parameters, with 37 billion parameters activated for each token, which allows for both efficient and precise reasoning abilities. As a part of DeepSeek's dedication to the progression of artificial general intelligence (AGI), the model underscores the importance of open-source innovation in this field. Furthermore, its advanced capabilities may significantly impact how we approach complex problem-solving in various domains.

EXAONE Deep represents a collection of advanced language models that are enhanced for reasoning, created by LG AI Research, and come in sizes of 2.4 billion, 7.8 billion, and 32 billion parameters. These models excel in a variety of reasoning challenges, particularly in areas such as mathematics and coding assessments. Significantly, the EXAONE Deep 2.4B model outshines other models of its size, while the 7.8B variant outperforms both open-weight models of similar dimensions and the proprietary reasoning model known as OpenAI o1-mini. Furthermore, the EXAONE Deep 32B model competes effectively with top-tier open-weight models in the field. The accompanying repository offers extensive documentation that includes performance assessments, quick-start guides for leveraging EXAONE Deep models with the Transformers library, detailed explanations of quantized EXAONE Deep weights formatted in AWQ and GGUF, as well as guidance on how to run these models locally through platforms like llama.cpp and Ollama. Additionally, this resource serves to enhance user understanding and accessibility to the capabilities of EXAONE Deep models.

Qwen2.5-VL marks the latest iteration in the Qwen vision-language model series, showcasing notable improvements compared to its predecessor, Qwen2-VL. This advanced model demonstrates exceptional capabilities in visual comprehension, adept at identifying a diverse range of objects such as text, charts, and various graphical elements within images. Functioning as an interactive visual agent, it can reason and effectively manipulate tools, making it suitable for applications involving both computer and mobile device interactions. Furthermore, Qwen2.5-VL is proficient in analyzing videos that are longer than one hour, enabling it to identify pertinent segments within those videos. The model also excels at accurately locating objects in images by creating bounding boxes or point annotations and supplies well-structured JSON outputs for coordinates and attributes. It provides structured data outputs for documents like scanned invoices, forms, and tables, which is particularly advantageous for industries such as finance and commerce. Offered in both base and instruct configurations across 3B, 7B, and 72B models, Qwen2.5-VL can be found on platforms like Hugging Face and ModelScope, further enhancing its accessibility for developers and researchers alike. This model not only elevates the capabilities of vision-language processing but also sets a new standard for future developments in the field.

Llama 4 Maverick is a cutting-edge multimodal AI model with 17 billion active parameters and 128 experts, setting a new standard for efficiency and performance. It excels in diverse domains, outperforming other models such as GPT-4o and Gemini 2.0 Flash in coding, reasoning, and image-related tasks. Llama 4 Maverick integrates both text and image processing seamlessly, offering enhanced capabilities for complex tasks such as visual question answering, content generation, and problem-solving. The model’s performance-to-cost ratio makes it an ideal choice for businesses looking to integrate powerful AI into their operations without the hefty resource demands.

Phi-4-mini-flash-reasoning is a 3.8 billion-parameter model that is part of Microsoft's Phi series, specifically designed for edge, mobile, and other environments with constrained resources where processing power, memory, and speed are limited. This innovative model features the SambaY hybrid decoder architecture, integrating Gated Memory Units (GMUs) with Mamba state-space and sliding-window attention layers, achieving up to ten times the throughput and a latency reduction of 2 to 3 times compared to its earlier versions without compromising on its ability to perform complex mathematical and logical reasoning. With a support for a context length of 64K tokens and being fine-tuned on high-quality synthetic datasets, it is particularly adept at handling long-context retrieval, reasoning tasks, and real-time inference, all manageable on a single GPU. Available through platforms such as Azure AI Foundry, NVIDIA API Catalog, and Hugging Face, Phi-4-mini-flash-reasoning empowers developers to create applications that are not only fast but also scalable and capable of intensive logical processing. This accessibility allows a broader range of developers to leverage its capabilities for innovative solutions.

Introducing the next iteration of our open-source large language model, this version features model weights along with initial code for the pretrained and fine-tuned Llama language models, which span from 7 billion to 70 billion parameters. The Llama 2 pretrained models have been developed using an impressive 2 trillion tokens and offer double the context length compared to their predecessor, Llama 1. Furthermore, the fine-tuned models have been enhanced through the analysis of over 1 million human annotations. Llama 2 demonstrates superior performance against various other open-source language models across multiple external benchmarks, excelling in areas such as reasoning, coding capabilities, proficiency, and knowledge assessments. For its training, Llama 2 utilized publicly accessible online data sources, while the fine-tuned variant, Llama-2-chat, incorporates publicly available instruction datasets along with the aforementioned extensive human annotations. Our initiative enjoys strong support from a diverse array of global stakeholders who are enthusiastic about our open approach to AI, including companies that have provided valuable early feedback and are eager to collaborate using Llama 2. The excitement surrounding Llama 2 signifies a pivotal shift in how AI can be developed and utilized collectively.

Reka Flash 3 is a cutting-edge multimodal AI model with 21 billion parameters, crafted by Reka AI to perform exceptionally well in tasks such as general conversation, coding, following instructions, and executing functions. This model adeptly handles and analyzes a myriad of inputs, including text, images, video, and audio, providing a versatile and compact solution for a wide range of applications. Built from the ground up, Reka Flash 3 was trained on a rich array of datasets, encompassing both publicly available and synthetic information, and it underwent a meticulous instruction tuning process with high-quality selected data to fine-tune its capabilities. The final phase of its training involved employing reinforcement learning techniques, specifically using the REINFORCE Leave One-Out (RLOO) method, which combined both model-based and rule-based rewards to significantly improve its reasoning skills. With an impressive context length of 32,000 tokens, Reka Flash 3 competes effectively with proprietary models like OpenAI's o1-mini, making it an excellent choice for applications requiring low latency or on-device processing. The model operates at full precision with a memory requirement of 39GB (fp16), although it can be efficiently reduced to just 11GB through the use of 4-bit quantization, demonstrating its adaptability for various deployment scenarios. Overall, Reka Flash 3 represents a significant advancement in multimodal AI technology, capable of meeting diverse user needs across multiple platforms.

DeepSeek-Coder-V2 is an open-source model tailored for excellence in programming and mathematical reasoning tasks. Utilizing a Mixture-of-Experts (MoE) architecture, it boasts a staggering 236 billion total parameters, with 21 billion of those being activated per token, which allows for efficient processing and outstanding performance. Trained on a massive dataset comprising 6 trillion tokens, this model enhances its prowess in generating code and tackling mathematical challenges. With the ability to support over 300 programming languages, DeepSeek-Coder-V2 has consistently outperformed its competitors on various benchmarks. It is offered in several variants, including DeepSeek-Coder-V2-Instruct, which is optimized for instruction-based tasks, and DeepSeek-Coder-V2-Base, which is effective for general text generation. Additionally, the lightweight options, such as DeepSeek-Coder-V2-Lite-Base and DeepSeek-Coder-V2-Lite-Instruct, cater to environments that require less computational power. These variations ensure that developers can select the most suitable model for their specific needs, making DeepSeek-Coder-V2 a versatile tool in the programming landscape.

We are thrilled to present DBRX, a versatile open LLM developed by Databricks. This innovative model achieves unprecedented performance on a variety of standard benchmarks, setting a new benchmark for existing open LLMs. Additionally, it equips both the open-source community and enterprises crafting their own LLMs with features that were once exclusive to proprietary model APIs; our evaluations indicate that it outperforms GPT-3.5 and competes effectively with Gemini 1.0 Pro. Notably, it excels as a code model, outperforming specialized counterparts like CodeLLaMA-70B in programming tasks, while also demonstrating its prowess as a general-purpose LLM. The remarkable quality of DBRX is complemented by significant enhancements in both training and inference efficiency. Thanks to its advanced fine-grained mixture-of-experts (MoE) architecture, DBRX elevates the efficiency of open models to new heights. In terms of inference speed, it can be twice as fast as LLaMA2-70B, and its total and active parameter counts are approximately 40% of those in Grok-1, showcasing its compact design without compromising capability. This combination of speed and size makes DBRX a game-changer in the landscape of open AI models.

Claude Sonnet 4.5 represents Anthropic's latest advancement in AI, crafted to thrive in extended coding environments, complex workflows, and heavy computational tasks while prioritizing safety and alignment. It sets new benchmarks with its top-tier performance on the SWE-bench Verified benchmark for software engineering and excels in the OSWorld benchmark for computer usage, demonstrating an impressive capacity to maintain concentration for over 30 hours on intricate, multi-step assignments. Enhancements in tool management, memory capabilities, and context interpretation empower the model to engage in more advanced reasoning, leading to a better grasp of various fields, including finance, law, and STEM, as well as a deeper understanding of coding intricacies. The system incorporates features for context editing and memory management, facilitating prolonged dialogues or multi-agent collaborations, while it also permits code execution and the generation of files within Claude applications. Deployed at AI Safety Level 3 (ASL-3), Sonnet 4.5 is equipped with classifiers that guard against inputs or outputs related to hazardous domains and includes defenses against prompt injection, ensuring a more secure interaction. This model signifies a significant leap forward in the intelligent automation of complex tasks, aiming to reshape how users engage with AI technologies.

StarCoder and StarCoderBase represent advanced Large Language Models specifically designed for code, developed using openly licensed data from GitHub, which encompasses over 80 programming languages, Git commits, GitHub issues, and Jupyter notebooks. In a manner akin to LLaMA, we constructed a model with approximately 15 billion parameters trained on a staggering 1 trillion tokens. Furthermore, we tailored the StarCoderBase model with 35 billion Python tokens, leading to the creation of what we now refer to as StarCoder. Our evaluations indicated that StarCoderBase surpasses other existing open Code LLMs when tested against popular programming benchmarks and performs on par with or even exceeds proprietary models like code-cushman-001 from OpenAI, the original Codex model that fueled early iterations of GitHub Copilot. With an impressive context length exceeding 8,000 tokens, the StarCoder models possess the capability to handle more information than any other open LLM, thus paving the way for a variety of innovative applications. This versatility is highlighted by our ability to prompt the StarCoder models through a sequence of dialogues, effectively transforming them into dynamic technical assistants that can provide support in diverse programming tasks.

In honor of Archimedes, whose 2311th anniversary we celebrate this year, we are excited to introduce our inaugural Mathstral model, a specialized 7B architecture tailored for mathematical reasoning and scientific exploration. This model features a 32k context window and is released under the Apache 2.0 license. Our intention behind contributing Mathstral to the scientific community is to enhance the pursuit of solving advanced mathematical challenges that necessitate intricate, multi-step logical reasoning. The launch of Mathstral is part of our wider initiative to support academic endeavors, developed in conjunction with Project Numina. Much like Isaac Newton during his era, Mathstral builds upon the foundation laid by Mistral 7B, focusing on STEM disciplines. It demonstrates top-tier reasoning capabilities within its category, achieving remarkable results on various industry-standard benchmarks. Notably, it scores 56.6% on the MATH benchmark and 63.47% on the MMLU benchmark, showcasing the performance differences by subject between Mathstral 7B and its predecessor, Mistral 7B, further emphasizing the advancements made in mathematical modeling. This initiative aims to foster innovation and collaboration within the mathematical community.