FilterPrompt — AI Security Testing & Vulnerability Scanner logo

OWASP LLM Top 10 Testing: Scope, Evidence and Reports

Guide · 2026-05-12 · 6 min read · FilterPrompt Security Team

Learn how prompt-based AI vulnerability testing differs from live protection: connect a target, evaluate responses, review findings and retest.

FilterPrompt is AI Security Testing & Vulnerability Scanner. It submits adversarial prompts to a connected LLM or AI application, analyses model responses, identifies vulnerabilities and generates reports with test evidence. It does not block live traffic, redact customer requests or act as a firewall.

Testing and enforcement are different jobs

A vulnerability scanner submits adversarial prompts to discover observed weaknesses. A runtime control applies policy to live interactions. Do not describe a scanner as a proxy, redaction service or a guarantee that attacks are blocked.

Choose a test scope

Identify the endpoint, model configuration, system instructions, retrieval sources and tool permissions that must be assessed. Use an authorized sandbox and synthetic data. Document excluded layers and manually review high-impact results.

Run an authorized assessment with FilterPrompt

  1. Create an account and connect an LLM using your own provider credentials. Use an authorized staging target and synthetic data.
  2. Choose a scan suite and review the probe selection and credit estimate. Test your application endpoint when you need coverage of its retrieval, tools and safeguards.
  3. Run the tests. FilterPrompt sends adversarial prompts and evaluates the responses against the selected criteria.
  4. Open the report and inspect each failing prompt, response, severity and evaluation reason. Manually confirm important findings; mark false positives with a reason when appropriate.
  5. Record remediation work with an owner in your existing issue tracker. Make changes in your application and retest the affected cases.
FilterPrompt vulnerability report with test evidence
Review the test prompt, model response and evaluation before accepting a finding.

What a scan can and cannot establish

Results describe the tested endpoint, configuration and prompts at that point in time. A passing scan is not a guarantee of security, certification or legal compliance. Testing a raw provider model does not test the access controls, retrieval sources or tools in your application. Test limits and provider costs must be agreed before running an assessment.

Related