ConsultingWorkbench-backed AI security engagements — map, attack, defend, and prove your AI systems.
Scope a Review
SecEng RAG Test HarnessRetrieval Security Harness
by aisecurity.llc › tenant boundary testing · authorization audit
12 boundary failuresRAG auth testing
SecEng RAG Test Harness — Retrieval Security Harness — ACME Corp Enterprise Knowledge Base (staging)
RETRIEVAL HARNESS
Active Run
ACME Corp Enterprise Knowledge Base
run-rag-7f2a1d9c
pgvectorLangChainOpenAI text-embedding-3
Leakage Types
staging · May 21, 11:42 AM
ACME Corp Enterprise Knowledge Base
23 leakage events
97.6%AuthZ pass

Total Queries

1280

all test queries

Context Leaks

23

unblocked retrievals

Policy Violations

17

authorization failures

Tenant Fail

12

of 124 tests

Retrieval Pipeline
end-to-end flow
Query1280Retrievalvector searchPolicy Check17 violationsContext23 leaksResponse97.6% pass
4
Policy Blocked
16
Policy Allowed
97.6%
Pass Rate
Leakage Type Breakdown
23 events
10leaks
Cross Tenant
4
Cross Role
2
Stale Permission
2
Poisoned Content
1
Source Laundering
1
Recent Violations
latest 4
critical
Internal Strategy Q3.pptx
acme-corpacme-subsidiary-b
Cross Tenant
7 chunks
critical
Compensation Plan 2026.xlsx
acme-corpacme-partner-c
Cross Tenant
4 chunks
critical
Customer PII Extract May.csv
acme-corpacme-marketing
Cross Role
6 chunks
high
Executive Roadmap H2.pptx
acme-corpacme-subsidiary-b
Cross Tenant
5 chunks
AuthZ Pass Rate Trend
14-point rolling · this run
Run start97.6% current
run-rag-7f2a1d9cLeakage: 23 events · 97.6% AuthZ pass·17 violations·pgvector + LangChainSecEng RAG Test Harness v0.1.0

SecEng RAG Test Harness capabilities

124 tenant boundary test scenarios5 leakage type classifiers (cross-tenant, cross-role, stale-permission, poisoned-content, source-laundering)ACL policy check validation at retrieval timeContext window boundary enforcementPII and sensitive data detection in retrieved chunksSource provenance validation and laundering detectionISO 42001 · EU AI Act · NIST AI RMF · MITRE ATLAS coverageEvidence bundle export with query/chunk log and control mapping
Fixture: ACME Corp Enterprise Knowledge Base · stagingRun: run-rag-7f2a1d9cGenerated: 5/21/2026aisecurity.llc · SecEng RAG Test Harness · v0.1.0