FilterPrompt — AI Security Testing & Vulnerability Scanner logo

Your First LLM Scan Report: What to Review

Guide · 2026-11-17 · 5 min read · FilterPrompt Security Team

Learn to review prompts, responses, severity and false positives after 1 free Welcome Sampler scan, then plan fixes and retests.

  • 1 free Welcome Sampler scan on signup; no credit card required.
  • Test only authorized endpoints with synthetic data.
  • Review evidence and retest fixes; passing tests do not guarantee security.

What does an LLM scan report tell you?

A report records how the tested endpoint responded to selected adversarial prompts at that point in time. It helps identify observed weaknesses; it is not a guarantee of security or compliance certification.

Get a report from 1 free Welcome Sampler scan

Sign up, connect an authorized LLM and run the free Welcome Sampler. It uses 1–3 probes from each category so you can inspect the workflow and findings without buying credits. No credit card is required. Provider request charges may still apply.

Read the evidence before trusting the label

Inspect the exact test prompt, complete model response, evaluation reason and affected boundary. A refusal followed by leaked information is not a successful defense. For tool actions, supplement response evidence with your application traces.

Confirm impact and review false positives

Prioritize confirmed data exposure or unauthorized actions based on the application context. Open a finding’s detail view to mark a false positive with a reason when appropriate. Preserve evidence and explain why the classification was changed.

Keep before-and-after retest evidence

Assign the fix in your issue tracker, record the changed configuration and rerun the original test plus nearby variations. Keep errors separate from passes. A clean sampler report does not mean every attack surface has been tested.

FilterPrompt vulnerability report showing findings for manual review
Inspect the prompt, response and evaluation before accepting a finding.

Put this guide into practice with FilterPrompt

FilterPrompt is an AI security testing and LLM vulnerability scanner. Connect an authorized LLM or AI application with your own API key, test it with adversarial prompts, and review prompt injection, jailbreak and data-leakage findings with the test prompts, model responses and severity. Use that evidence to prioritize fixes and retest; FilterPrompt does not intercept or block live traffic.

Create a FilterPrompt account and use 1 free welcome credit for any static scan on your connected LLM. Review test prompts, responses and findings. No credit card required. Dynamic testing requires purchased credits; your provider may charge for API requests.

Related