Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Llama Guard is a collaborative open-source safety model created by Meta AI aimed at improving the security of large language models during interactions with humans. It operates as a filtering mechanism for inputs and outputs, categorizing both prompts and replies based on potential safety risks such as toxicity, hate speech, and false information. With training on a meticulously selected dataset, Llama Guard's performance rivals or surpasses that of existing moderation frameworks, including OpenAI's Moderation API and ToxicChat. This model features an instruction-tuned framework that permits developers to tailor its classification system and output styles to cater to specific applications. As a component of Meta's extensive "Purple Llama" project, it integrates both proactive and reactive security measures to ensure the responsible use of generative AI technologies. The availability of the model weights in the public domain invites additional exploration and modifications to address the continually changing landscape of AI safety concerns, fostering innovation and collaboration in the field. This open-access approach not only enhances the community's ability to experiment but also promotes a shared commitment to ethical AI development.
Description
Garak evaluates the potential failures of an LLM in undesirable ways, examining aspects such as hallucination, data leakage, prompt injection, misinformation, toxicity, jailbreaks, and various other vulnerabilities. This free tool is designed with an eagerness for development, continually seeking to enhance its functionalities for better application support. Operating as a command-line utility, Garak is compatible with both Linux and OSX systems; you can easily download it from PyPI and get started right away. The pip version of Garak receives regular updates, ensuring it remains current, while its specific dependencies recommend setting it up within its own Conda environment. To initiate a scan, Garak requires the model to be analyzed and, by default, will conduct all available probes on that model utilizing the suggested vulnerability detectors for each. During the scanning process, users will see a progress bar for every loaded probe, and upon completion, Garak will provide a detailed evaluation of each probe's findings across all detectors. This makes Garak not only a powerful tool for assessment but also a vital resource for researchers and developers aiming to enhance the safety and reliability of LLMs.
API Access
Has API
Yes
API Access
Has API
No
Integrations
OpenAI
Yes
Cohere
No
Conda
No
Hugging Face
No
Llama
Yes
Nebius Token Factory
Yes
Replicate
No
Integrations
OpenAI
Yes
Cohere
Yes
Conda
Yes
Hugging Face
Yes
Llama
No
Nebius Token Factory
No
Replicate
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
Free
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
No
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
Yes
Linux
Yes
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
No
In Person
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Meta
Founded
2004
Country
United States
Website
ai.meta.com/research/publications/llama-guard-llm-based-input-output-safeguard-for-human-ai-conversations/
Vendor Details
Company Name
garak
Website
github.com/leondz/garak/
Product Features
Product Features
Vulnerability Scanners
Asset Discovery
No
Black Box Scanning
No
Compliance Monitoring
No
Continuous Monitoring
No
Defect Tracking
No
Interactive Scanning
No
Logging and Reporting
No
Network Mapping
No
Perimeter Scanning
No
Risk Analysis
No
Threat Intelligence
No
Web Inspection
No