Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

Checkstep is a robust AI-driven content moderation solution specifically designed for large Trust and Safety teams. This versatile platform analyzes various media types, including text, images, video, and audio, utilizing a customizable policy engine that encompasses all significant types of abuse while directing exceptional cases to human moderators via dedicated review queues. With its AI Marketplace, Checkstep allows the integration of third-party detection models, ensuring that teams are not confined to a single vendor. Furthermore, the platform includes comprehensive transparency reporting features that address compliance with the Digital Services Act and the UK Online Safety Act, providing necessary statements of reasons and facilitating appeals. Notable organizations such as Trustpilot, JustGiving, Daily Mail, and Star Stable rely on Checkstep to effectively manage and moderate user-generated content. This commitment to adaptability and compliance makes Checkstep an essential tool for any team focused on maintaining a safe online environment.

Description

Shieldstral is an innovative multimodal safety classifier with a 3B parameter open-weight structure, adept at assessing text, images, and combined text-plus-image content based on dynamically defined policies during inference. Rather than adhering to a static set of harm categories, it approaches moderation as a binary question-and-answer format: users submit a contextual instruction outlining the evaluation criteria and strictness, pose a yes-or-no safety inquiry, and present the content for assessment. The model processes the “yes” and “no” logits to generate a continuous, calibrated safety score, enabling applications to prioritize or rank outcomes based on confidence levels instead of relying on a single categorical label. This design effectively integrates prompt classification, response moderation, refusal detection, toxicity assessment, and multimodal safety evaluation into a singular interface, empowering teams to modify policies without the need for model retraining. Shieldstral's versatility allows it to analyze prompts, responses, pairs of prompts and responses, images, and images paired with text, making it a comprehensive tool for safety evaluation. As such, it represents a significant advancement in the field of content moderation.

API Access

Has API

API Access

Has API

Screenshots View All

No images available

Screenshots View All

Integrations

Mistral AI

Integrations

Mistral AI

Pricing Details

No price information available.
Free Trial
Free Version

Pricing Details

No price information available.
Free Trial
Free Version

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Vendor Details

Company Name

Checkstep

Website

www.checkstep.com

Vendor Details

Company Name

Mistral AI

Founded

2023

Country

France

Website

mistral.ai/news/shieldstral/

Product Features

Content Moderation

Artificial Intelligence
Audio Moderation
Brand Moderation
Comment Moderation
Customizable Filters
Image Moderation
Moderation by Humans
Reporting / Analytics
Social Media Moderation
User-Generated Content (UGC) Moderation
Video Moderation

Product Features

Content Moderation

Artificial Intelligence
Audio Moderation
Brand Moderation
Comment Moderation
Customizable Filters
Image Moderation
Moderation by Humans
Reporting / Analytics
Social Media Moderation
User-Generated Content (UGC) Moderation
Video Moderation

Alternatives

Alternatives