What is an LLM vulnerability scanner?

An LLM vulnerability scanner sends batteries of adversarial probes — jailbreaks, prompt injections, PII extraction attempts, harmful-content requests — at a target LLM and grades the responses. The output is a vulnerability + optimization report with per-probe evidence, severity, and a prioritized fix list.

Which LLMs can I scan with FilterPrompt?

OpenAI, Anthropic, Google Gemini, Azure OpenAI, plus any OpenAI-compatible endpoint — Ollama, Groq, Mistral, Together AI, OpenRouter, Perplexity, Hugging Face, vLLM, or your own custom endpoint. Bring your own keys per tenant.

What kinds of vulnerabilities does FilterPrompt test for?

Jailbreaks (DAN, role hijack, translation smuggling), direct and indirect prompt injection, system-prompt extraction, harmful-content compliance, PII / secret leakage, bias & fairness, RAG poisoning, agent/tool abuse, output quality, and robustness — categories map to the OWASP LLM Top 10.

How are probes graded?

Each probe declares an evaluator: regex match, refusal-check, contains-check, or an AI judge (Gemini 3 Flash). Pass/fail comes with severity, category, the exact prompt sent, the model's full response, and the evaluator's reason — fully auditable.

How much does a scan cost?

1 credit per probe executed. New accounts get 1 welcome credit on signup. Pay-as-you-go credit packs after that — credits never expire. Connecting LLMs and creating tenants is free.

AI Firewall Comparison — Lakera, Cloudflare & FilterPrompt

Side-by-side comparison of leading AI firewalls and gateways. Coverage, pricing, latency, OWASP LLM Top 10 mapping, and integration story for each.

Lakera Guard

Strong injection detection, focused on input filtering. Less emphasis on multi-tenant gateway features and per-tenant cost attribution. Pricing scales with request volume.

Cloudflare AI Gateway / Firewall for AI

Tight Cloudflare ecosystem integration and edge-network distribution. Best fit if you already run on Cloudflare; less granular per-tenant policy than dedicated AI security tooling.

FilterPrompt

Layered detection (pattern + ML + structural), full multi-tenant gateway with per-tenant quotas and IP rules, OWASP LLM Top 10 mapping, and tenant-provided provider keys. Drop-in OpenAI-compatible proxy with verdict logs.

Picking one

Multi-tenant SaaS shipping LLM features → FilterPrompt
Single-tenant app already on Cloudflare → Cloudflare AI Gateway
Pure prompt-injection detection on a single product → Lakera Guard

AI Firewall Comparison — Lakera, Cloudflare & FilterPrompt

Lakera Guard

Cloudflare AI Gateway / Firewall for AI

FilterPrompt

Picking one

Related