Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

DiffusionGemma is an innovative open model that investigates text diffusion, representing a remarkably rapid method for generating text. Released under the Apache 2.0 license, this 26 billion parameter Mixture of Experts (MoE) model advances beyond the usual sequential token generation typical of autoregressive models. Instead, it produces entire blocks of text at once, achieving text generation speeds that are up to four times faster on GPUs. Drawing from the parameter efficiency of the Gemma 4 family and Gemini Diffusion research, DiffusionGemma incorporates a unique diffusion head that enhances generation speed significantly. It is particularly aimed at researchers and developers looking to optimize speed-sensitive, interactive local workflows, including in-line editing, swift iterations, and non-linear narrative forms. By reallocating the decode bottleneck from memory bandwidth to computational power, it can produce over 1,000 tokens per second on a single NVIDIA H100 and more than 700 tokens per second on an NVIDIA GeForce RTX 5090. This breakthrough allows for a new level of efficiency in text generation that could reshape various applications in natural language processing.

Description

EmbeddingGemma 2 is a versatile and lightweight multimodal embedding model that facilitates the mapping of text, code, images, video, and audio into a unified embedding space, which is useful for applications such as search, retrieval, classification, routing, and RAG. It is constructed on the Gemma 4 framework and distributed under the Apache 2.0 license, featuring an impressive 740 million parameters while being fine-tuned for efficient on-device inference. Its flexible architecture allows for the use of only 270 million parameters for text-centric tasks, and it includes additional vision and audio encoders for comprehensive multimodal capabilities. Furthermore, the innovative Matryoshka Representation Learning technique enables developers to compress output vectors from 768 dimensions down to 512, 256, or even 128 dimensions, effectively reducing the storage and memory demands for local vector databases. The model is equipped with an 8K-token context window, providing the capability to handle up to 5.5 minutes of audio, 29 images, 58 video frames, or various combinations of these inputs seamlessly on local hardware. This adaptability makes it particularly valuable for developers seeking to enhance their applications with rich multimedia integration.

API Access

Has API No 

API Access

Has API Yes 

Screenshots View All

Screenshots View All

Integrations

Gemini Enterprise Agent Platform Yes 
Gemma Yes 
NVIDIA NIM Yes 

Integrations

Gemini Enterprise Agent Platform No 
Gemma No 
NVIDIA NIM No 

Pricing Details

Free
Free Trial No 
Free Version Yes 

Pricing Details

No price information available.
Free Trial No 
Free Version No 

Deployment

Web-Based No 
On-Premises Yes 
iPhone App No 
iPad App No 
Android App No 
Windows Yes 
Mac Yes 
Linux Yes 
Chromebook No 

Deployment

Web-Based Yes 
On-Premises No 
iPhone App No 
iPad App No 
Android App No 
Windows No 
Mac No 
Linux No 
Chromebook No 

Customer Support

Business Hours No 
Live Rep (24/7) No 
Online Support Yes 

Customer Support

Business Hours No 
Live Rep (24/7) No 
Online Support Yes 

Types of Training

Training Docs Yes 
Webinars No 
Live Training (Online) No 
In Person No 

Types of Training

Training Docs Yes 
Webinars No 
Live Training (Online) No 
In Person No 

Vendor Details

Company Name

Google

Founded

1998

Country

United States

Website

blog.google/innovation-and-ai/technology/developers-tools/diffusion-gemma-faster-text-generation/

Vendor Details

Company Name

Google

Founded

1998

Country

United States

Website

blog.google/innovation-and-ai/technology/developers-tools/embeddinggemma-2/

Product Features

Product Features

Alternatives

Gemini Diffusion Reviews

Gemini Diffusion

Google DeepMind

Alternatives

No Alternatives
Mercury 2 Reviews

Mercury 2

Inception
ByteDance Seed Reviews

ByteDance Seed

ByteDance
Mercury Coder Reviews

Mercury Coder

Inception Labs