Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
RagMetrics serves as a robust evaluation and trust platform for conversational GenAI, aimed at measuring the performance of AI chatbots, agents, and RAG systems both prior to and following their deployment. It offers ongoing assessments of AI-generated responses, focusing on factors such as accuracy, relevance, hallucination occurrences, reasoning quality, and the behavior of tools utilized in real interactions.
The platform seamlessly integrates with current AI infrastructures, enabling it to monitor live conversations without interrupting the user experience. With features like automated scoring, customizable metrics, and in-depth diagnostics, it clarifies the reasons behind any failures in AI responses and provides solutions for improvement. Users can conduct offline evaluations, A/B testing, and regression testing, while also observing performance trends in real-time through comprehensive dashboards and alerts.
RagMetrics is versatile, being both model-agnostic and deployment-agnostic, which allows it to support a variety of language models, retrieval systems, and agent frameworks. This adaptability ensures that teams can rely on RagMetrics to enhance the effectiveness of their conversational AI solutions across diverse environments.
Description
Scritch serves as an AI recovery agent tailored for support and product teams within B2B software organizations. Its software development kit (SDK) links a failed action within an application to a recovery process that analyzes the server's response alongside pertinent read-only data. This process translates the issue into simple terms and solicits information from the user that only they would possess. When a modification is required, Scritch seeks approval and verifies through code that the solution is effective before notifying the user that they can proceed. Teams have the flexibility to outline the tools and repair procedures accessible to the agent. In instances where Scritch is unable to resolve an issue, it compiles a detailed explanation and case history for the support team and can seamlessly transfer the case to associated ticketing and messaging systems. Typical scenarios include issues like rejected invoices, unsuccessful imports or uploads, expired sessions, and access-related problems. Importantly, the product focuses specifically on addressing technical barriers in B2B applications, steering clear of consumer-oriented tasks such as social media ban appeals or content moderation challenges, ensuring that it remains dedicated to enhancing operational efficiency in the business sector.
API Access
Has API
No
API Access
Has API
Yes
Screenshots View All
No images available
Screenshots View All
No images available
Integrations
Discord
No
Intercom
No
Jira
No
Linear
No
Slack
No
Zendesk
No
Integrations
Discord
Yes
Intercom
Yes
Jira
Yes
Linear
Yes
Slack
Yes
Zendesk
Yes
Pricing Details
$20/month
Free Trial
Yes
Free Version
No
Pricing Details
$0.25/recovery
The first 25 recoveries are free with no card required. After adding a card, recoveries remain free for 14 days; afterward, successful recoveries cost $0.25 each. No per-seat charge or monthly minimum; a monthly spend cap is set by the customer ($50 default). Enterprise plans are priced by recovery volume and can run on the customer's servers.
Free Trial
Yes
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
No
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
RagMetrics
Founded
2024
Country
United States
Website
ragmetrics.ai/
Vendor Details
Company Name
Okapi Works
Country
Belgium
Website
scritch.xyz/
Product Features
Product Features
Customer Service
Alerts / Escalation
No
Appointment Management
No
Call Center Management
No
Email Management
No
Knowledge Base
No
Live Chat
No
Performance Metrics
No
Queue Management
No
Self Service Portal
No
Social Media Integration
No
Surveys & Feedback
No
Virtual Assistant
No
Workflow Management
No
Alternatives
Alternatives
No Alternatives