What is an LLM vulnerability scanner?

An LLM vulnerability scanner sends batteries of adversarial probes — jailbreaks, prompt injections, PII extraction attempts, harmful-content requests — at a target LLM and grades the responses. The output is a vulnerability + optimization report with per-probe evidence, severity, and a prioritized fix list.

Which LLMs can I scan with FilterPrompt?

OpenAI, Anthropic, Google Gemini, Azure OpenAI, plus any OpenAI-compatible endpoint — Ollama, Groq, Mistral, Together AI, OpenRouter, Perplexity, Hugging Face, vLLM, or your own custom endpoint. Bring your own keys per tenant.

What kinds of vulnerabilities does FilterPrompt test for?

Jailbreaks (DAN, role hijack, translation smuggling), direct and indirect prompt injection, system-prompt extraction, harmful-content compliance, PII / secret leakage, bias & fairness, RAG poisoning, agent/tool abuse, output quality, and robustness — categories map to the OWASP LLM Top 10.

How are probes graded?

Each probe declares an evaluator: regex match, refusal-check, contains-check, or an AI judge (Gemini 3 Flash). Pass/fail comes with severity, category, the exact prompt sent, the model's full response, and the evaluator's reason — fully auditable.

How much does a scan cost?

1 credit per probe executed. New accounts get 1 welcome credit on signup. Pay-as-you-go credit packs after that — credits never expire. Connecting LLMs and creating tenants is free.

LLM Security Tools in 2026: The 12 Platforms Enterprise Teams Actually Compare

Comparison · 2026-07-03 · 10 min read · FilterPrompt Security Team

A grounded comparison of the LLM security tools that matter in 2026 — scanners, firewalls, DLP, and red-teaming platforms — with trade-offs, pricing bands, and buying criteria.

The four categories of LLM security tools

Every 'LLM security tool' on the market maps to one of four categories. Confusing them is the most common buying mistake. Scanners are for pre-production assurance — they probe your model with adversarial prompts and produce a vulnerability report. Firewalls are runtime proxies — they inspect every prompt and response and block attacks in real time. DLP tools focus on preventing sensitive data from entering or leaving the LLM. Red-teaming platforms simulate a human adversary with multi-turn, goal-directed attacks.

The 12 LLM security tools worth evaluating

1. FilterPrompt

The only platform we know of that combines an LLM vulnerability scanner, an AI firewall, DLP redaction, and red-teaming reports in one BYO-key workflow. 1,000+ probes across OWASP LLM Top 10, audio, image, multi-turn, and agentic categories. Starts at $36 per scan credit; $200 for the managed scan package.

2. Lakera Guard

Runtime firewall focused on prompt injection and content moderation. Strong latency profile. Enterprise pricing; no self-serve scanner.

3. Cloudflare Firewall for AI

Edge-deployed AI firewall bundled with the Cloudflare stack. Great fit if you already sit behind Cloudflare, less flexible for BYO-model deployments.

4. NeuralTrust

Combined scanner and gateway with strong European compliance positioning (EU AI Act, ISO/IEC 42001).

5. HiddenLayer

Model-supply-chain and MLDR (ML Detection & Response). Focus on model integrity rather than prompt-level attacks.

6. Protect AI

Now part of Palo Alto. Broad AI security suite — model scanning, MLOps hardening, runtime protection.

7. Garak (open source)

NVIDIA's open source LLM vulnerability scanner. Great probe library, CLI-first, needs your own infra and reporting layer.

8. PyRIT (open source)

Microsoft's Python Risk Identification Toolkit. Orchestrates multi-turn red-team scenarios. Framework, not a product.

9. Promptfoo (open source)

Test-runner style tool for prompt evaluation and adversarial testing. Great for CI, weaker for compliance reports.

10. Protecto

Tokenisation and privacy for LLM pipelines. Complements a scanner and firewall rather than replacing them.

11. Nightfall AI

DLP for LLM inputs across SaaS surfaces (Slack, Notion, ChatGPT Enterprise). Strong for shadow-AI programs.

12. Robust Intelligence (now Cisco)

Enterprise LLM security with a managed red-team offering. Priced for Fortune 500, integrates with Cisco stack.

How to choose LLM security tools for your stack

Map your risk: pre-production assurance, runtime protection, data governance, or all three.
Pick a scanner first — you cannot defend what you have not measured.
Layer a firewall for anything user-facing. Latency budget is usually the binding constraint.
Add DLP if you handle regulated data (PHI, PCI, PII, source code).
Add a red-team platform once you have baseline scanner coverage.
Prefer BYO-key tools so vendor credentials never touch your production traffic.