NEW

Start with the pressure: sales, launch, abuse, agents, data, or guardrails

Use the engagement router
aisecurityllc
Sign inScope a Launch Review
aisecurityllc
Scope a Launch Review
SecEng RAG Test HarnessRetrieval Security Harness
by SecEng › tenant boundary testing · authorization audit
12 boundary failuresRAG auth testing
SecEng RAG Test Harness — Retrieval Security Harness — ACME Corp Enterprise Knowledge Base (staging)
RETRIEVAL HARNESS
Active Run
ACME Corp Enterprise Knowledge Base
run-rag-7f2a1d9c
pgvectorLangChainOpenAI text-embedding-3
Leakage Types
staging · May 21, 11:42 AM
ACME Corp Enterprise Knowledge Base
23 leakage events
97.6%AuthZ pass

Total Queries

1280

all test queries

Context Leaks

23

unblocked retrievals

Policy Violations

17

authorization failures

Tenant Fail

12

of 124 tests

Retrieval Pipeline
end-to-end flow
Query1280Retrievalvector searchPolicy Check17 violationsContext23 leaksResponse97.6% pass
4
Policy Blocked
16
Policy Allowed
97.6%
Pass Rate
Leakage Type Breakdown
23 events
10leaks
Cross Tenant
4
Cross Role
2
Stale Permission
2
Poisoned Content
1
Source Laundering
1
Recent Violations
latest 4
critical
Internal Strategy Q3.pptx
acme-corp → acme-subsidiary-b
Cross Tenant
7 chunks
critical
Compensation Plan 2026.xlsx
acme-corp → acme-partner-c
Cross Tenant
4 chunks
critical
Customer PII Extract May.csv
acme-corp → acme-marketing
Cross Role
6 chunks
high
Executive Roadmap H2.pptx
acme-corp → acme-subsidiary-b
Cross Tenant
5 chunks
AuthZ Pass Rate Trend
14-point rolling · this run
Run start97.6% current
run-rag-7f2a1d9cLeakage: 23 events · 97.6% AuthZ pass·17 violations·pgvector + LangChainSecEng RAG Test Harness v0.1.0

Grounded Data-Exfil Paths (APC) — from these isolation tests

0 attack paths1 tools in this fixture33 evidence-graph nodes32 evidence-graph edges

Evidence from this surface, normalized and joined into the shared SecEng evidence graph. Every step traces to a specific tool’s output; grounded steps were observed or deterministically derived.

Adding a mandatory approval/control at rag:leaked_compensation_plan_2026_xlsx_acme_corp blocks 1 of 8 analyzed paths.

  • Groundedexposure· conf 96%1rag-boundary
    Internal Strategy Q3.pptxInternal Strategy Q3.pptx (acme-corp)
    owasp_llm:LLM02owasp_llm:LLM08
  • Groundedexposure· conf 96%1rag-boundary
    Compensation Plan 2026.xlsxCompensation Plan 2026.xlsx (acme-corp)
    owasp_llm:LLM02owasp_llm:LLM08
  • Groundedexposure· conf 96%1rag-boundary
    Support Ticket #7845Support Ticket #7845 (acme-corp)
    owasp_llm:LLM02
  • Groundedexposure· conf 96%1rag-boundary
    Executive Roadmap H2.pptxExecutive Roadmap H2.pptx (acme-corp)
    owasp_llm:LLM02owasp_llm:LLM08
LegendGroundedInferredSpeculative+4 moreOpen Evidence Graph

SecEng RAG Test Harness capabilities

124 tenant boundary test scenarios5 leakage type classifiers (cross-tenant, cross-role, stale-permission, poisoned-content, source-laundering)ACL policy check validation at retrieval timeContext window boundary enforcementPII and sensitive data detection in retrieved chunksSource provenance validation and laundering detectionISO 42001 · EU AI Act · NIST AI RMF · MITRE ATLAS coverageEvidence bundle export with query/chunk log and control mapping
Fixture: ACME Corp Enterprise Knowledge Base · stagingRun: run-rag-7f2a1d9cGenerated: 5/21/2026SecEng RAG Test Harness · v0.1.0