agent-threat-rules 4.2.4 → 4.3.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +197 -0
- package/README.md +2 -0
- package/dist/cli.d.ts.map +1 -1
- package/dist/cli.js +123 -3
- package/dist/cli.js.map +1 -1
- package/dist/converters/numbat.d.ts +73 -0
- package/dist/converters/numbat.d.ts.map +1 -0
- package/dist/converters/numbat.js +281 -0
- package/dist/converters/numbat.js.map +1 -0
- package/dist/converters/quarry.d.ts +122 -0
- package/dist/converters/quarry.d.ts.map +1 -0
- package/dist/converters/quarry.js +431 -0
- package/dist/converters/quarry.js.map +1 -0
- package/dist/converters/sarif.d.ts.map +1 -1
- package/dist/converters/sarif.js +6 -1
- package/dist/converters/sarif.js.map +1 -1
- package/dist/engine.d.ts.map +1 -1
- package/dist/engine.js +7 -1
- package/dist/engine.js.map +1 -1
- package/dist/re2.d.ts +22 -0
- package/dist/re2.d.ts.map +1 -0
- package/dist/re2.js +213 -0
- package/dist/re2.js.map +1 -0
- package/package.json +1 -1
- package/rules/agent-manipulation/ATR-2026-00030-cross-agent-attack.yaml +1 -1
- package/rules/agent-manipulation/ATR-2026-00301-tap-tree-of-attacks-jailbreak.yaml +3 -3
- package/rules/agent-manipulation/ATR-2026-00352-trainergpt-fix-my-ai-harmful-output-extraction.yaml +1 -1
- package/rules/agent-manipulation/ATR-2026-00432-superagi-output-handler-eval-rce.yaml +3 -3
- package/rules/agent-manipulation/ATR-2026-00440-semantic-kernel-vector-store-eval-rce.yaml +3 -3
- package/rules/context-exfiltration/ATR-2026-00020-system-prompt-leak.yaml +1 -1
- package/rules/context-exfiltration/ATR-2026-00471-garak-sysprompt-extraction-mixedunassigned.yaml +1 -1
- package/rules/context-exfiltration/ATR-2026-00501-data-exfiltration-via-markdown-image-and-link-url-injection.yaml +1 -1
- package/rules/context-exfiltration/ATR-2026-00504-tool-and-function-capability-enumeration.yaml +1 -1
- package/rules/context-exfiltration/ATR-2026-00505-system-prompt-extraction-instruction-dump-request.yaml +1 -1
- package/rules/context-exfiltration/ATR-2026-00514-system-prompt-extraction.yaml +1 -1
- package/rules/context-exfiltration/ATR-2026-00516-output-xss-via-llm.yaml +1 -1
- package/rules/context-exfiltration/ATR-2026-01462-sysprompt-override-pseudo-admin.yaml +2 -2
- package/rules/context-exfiltration/ATR-2026-01770-semantic-pii-credential-extraction.yaml +1 -1
- package/rules/context-exfiltration/ATR-2026-01862-llmail-email-tool-exfil-confirmation.yaml +2 -2
- package/rules/context-exfiltration/ATR-2026-01863-llmail-post-summary-exfil-directive.yaml +2 -2
- package/rules/context-exfiltration/ATR-2026-01864-llmail-obfuscated-exfil-address.yaml +2 -2
- package/rules/context-exfiltration/ATR-2026-01924-system-instruction-extraction-reformat.yaml +1 -1
- package/rules/context-exfiltration/ATR-2026-02017-secret-key-exfiltration-request.yaml +1 -1
- package/rules/context-exfiltration/ATR-2026-02026-oblique-sysprompt-extraction-transform.yaml +1 -1
- package/rules/context-exfiltration/ATR-2026-02847-policy-justified-exfil-to-email.yaml +1 -1
- package/rules/context-exfiltration/ATR-2026-02850-fake-documentation-forward-request.yaml +1 -1
- package/rules/context-exfiltration/ATR-2026-02855-cross-email-exfil-relay.yaml +1 -1
- package/rules/data-poisoning/ATR-2026-00070-data-poisoning.yaml +2 -2
- package/rules/excessive-autonomy/ATR-2026-00050-runaway-agent-loop.yaml +2 -2
- package/rules/excessive-autonomy/ATR-2026-00052-cascading-failure.yaml +1 -1
- package/rules/excessive-autonomy/ATR-2026-00491-garak-agent-breaker-markdown-just-raw-json.yaml +1 -1
- package/rules/excessive-autonomy/ATR-2026-00500-ssrf-via-agent-url-fetch-instruction.yaml +1 -1
- package/rules/model-abuse/ATR-2026-00502-training-data-extraction-via-divergent-repetition-attack.yaml +1 -1
- package/rules/model-abuse/ATR-2026-00517-model-extraction-distillation.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00001-direct-prompt-injection.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00002-indirect-prompt-injection.yaml +2 -2
- package/rules/prompt-injection/ATR-2026-00003-jailbreak-attempt.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00140-indirect-reference-reversal.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00211-system-prompt-override.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00257-cipher-transposition-jailbreak.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00312-unicode-variant-selector-ascii-smuggling.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00452-direct-pwned-payload-injection.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00453-secret-key-reveal-demand.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00454-backslash-per-character-encoding.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00455-no-period-output-override.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00456-conditional-empty-input-injection.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00457-garak-dan-to-every-prompt.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00458-garak-dra-step-by-step.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00459-garak-dan-an-ai-language.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00460-garak-dan-no-matter-how.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00461-garak-goodside-mixedunassigned.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00462-garak-gcg-mixedunassigned.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00463-garak-lmrc-mixedunassigned.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00464-garak-dan-i-would-like.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00465-garak-dan-your-prompt-here.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00466-garak-latentinjection-following-text-from.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00467-garak-dan-act-as-a.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00468-garak-goat-the-target-llm.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00469-garak-dan-at-the-end.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00470-garak-dan-as-an-ai.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00472-garak-dan-are-going-to.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00473-garak-lmrc-how-can-i.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00474-garak-dan-that-chatgpt-has.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00475-garak-web-injection-alert-1-script.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00476-garak-web-injection-javascript-alert-1.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00477-garak-latentinjection-translate-the-following-text.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00478-garak-latentinjection-abuse-contact-email.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00479-garak-latentinjection-mixedunassigned.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00480-garak-dan-the-role-of.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00481-garak-dan-mixedunassigned.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00482-garak-lmrc-what-s-an.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00483-garak-dan-the-user-s.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00484-garak-dan-and-you-will.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00485-garak-dan-and-does-not.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00486-garak-dan-t-care-about.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00487-garak-dan-and-nothing-else.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00488-garak-encoding-alert-1-script.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00489-garak-encoding-javascript-alert-1.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00490-garak-dan-in-order-to.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00492-garak-dan-want-you-to.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00493-garak-latentinjection-registrar-iana-id.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00495-garak-dan-insert-prompt-here.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00496-garak-dan-no-matter-what.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00497-garak-encoding-mixedunassigned.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00498-garak-web-injection-mixedunassigned.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00499-garak-dan-from-now-on.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00503-fake-error-state-takeover-unrestricted-replacement-bot.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00506-nevermind-override-goal-hijacking-in-user-input-promptinject.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00507-screaming-stop-goal-hijacking-in-user-input-promptinject.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00508-escape-delimiter-wrapped-goal-hijacking-in-user-input-prompt.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00509-prompt-leaking-via-ignore-previous-instructions-in-user-inpu.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00510-delayed-tool-invocation-injection.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00511-mcp-web-context-poisoning.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00512-rules-file-backdoor-injection.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00515-hidden-text-prompt-injection.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00518-ignore-previous-and-following-instructions-output-command-promptinject.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00519-tautology-logic-noise-injection-promptbench.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-00520-nlp-task-random-token-suffix-injection-promptbench.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-01860-llmail-chat-template-boundary-spoof.yaml +2 -2
- package/rules/prompt-injection/ATR-2026-01861-llmail-pseudo-xml-role-injection.yaml +2 -2
- package/rules/prompt-injection/ATR-2026-01865-llmail-fake-email-boundary-marker.yaml +2 -2
- package/rules/prompt-injection/ATR-2026-01920-access-grant-coercion.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-01921-access-denial-inversion.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-01922-authorization-state-spoofing.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-01923-forged-input-boundary-markers.yaml +2 -2
- package/rules/prompt-injection/ATR-2026-01925-encoded-payload-decoding-coercion.yaml +2 -2
- package/rules/prompt-injection/ATR-2026-01926-cross-lingual-authorization-laundering.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02001-ignore-below-instructions-mirror-of-ignore-previ.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02002-instruction-set-probe-or-supplant-direct-meta-qu.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02003-task-pivot-override-abandon-the-cover-task-trans.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02004-regional-indicator-flag-emoji-alphabet-letter-sp.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02005-actor-never-breaks-character-roleplay-dan-style-.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02006-fuzzy-cross-lingual-i-have-been-pwned-near-miss-.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02007-bare-key-elicitation-token.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02008-translation-chain-output-laundering-state-secret.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02009-bare-key-elicitation-trailing-colon.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02010-emoji-only-payload.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02011-malformed-grammar-pwned-success-claim.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02012-movie-title-generator-instruction-wrapper-for-pw.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02013-delimiter-fence-ignore-instructions-override.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02014-spliced-target-string-letters-of-a-filtered-cana.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02015-dense-emoji-only-payload-flood.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02016-reversed-payload-string.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02018-regional-indicator-flag-emoji-letter-spelling-sp.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02019-python-interpreter-role-assignment-exec-framing.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02020-obfuscated-token-reconstruction-via-character-su.yaml +1 -1
- package/rules/prompt-injection/ATR-2026-02851-fake-user-turn-send-email-instruction.yaml +1 -1
- package/rules/skill-compromise/ATR-2026-00060-skill-impersonation.yaml +1 -1
- package/rules/skill-compromise/ATR-2026-00121-skill-dangerous-script.yaml +5 -5
- package/rules/skill-compromise/ATR-2026-00225-c2-communication.yaml +3 -3
- package/rules/tool-poisoning/ATR-2026-00277-echo-template-command-injection.yaml +3 -3
- package/rules/tool-poisoning/ATR-2026-00494-garak-exploitation-mixedunassigned.yaml +1 -1
- package/rules/tool-poisoning/ATR-2026-00513-package-hallucination-exploitation.yaml +1 -1
- package/rules/tool-poisoning/ATR-2026-00521-shell-command-injection-agent-tool-context.yaml +1 -1
- package/rules/tool-poisoning/ATR-2026-00522-sql-injection-natural-language-agent-interface.yaml +1 -1
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
title: Microsoft Semantic Kernel In-Memory Vector Store eval() RCE (CVE-2026-26030)
|
|
2
2
|
id: ATR-2026-00440
|
|
3
|
-
rule_version:
|
|
3
|
+
rule_version: 2
|
|
4
4
|
status: experimental
|
|
5
5
|
description: |
|
|
6
6
|
Detects exploitation of CVE-2026-26030 (Critical), remote code execution in Microsoft Semantic Kernel via unsafe string interpolation in In-Memory Vector Store filter functions. The vulnerable sink interpolates a user/LLM-controlled filter expression and evaluates it as a lambda; attacker constructs a lambda body that traverses Python's class hierarchy via `tuple()` to reach `BuiltinImporter` and execute `os.system()`, achieving unauthenticated RCE on the Semantic Kernel host. This rule detects the LLM-output / user-input payload patterns that reach the filter sink: lambda definitions combined with eval / __import__ / AST-traversal-via-mro patterns inside content or user_input fields a Semantic Kernel agent is likely to interpolate. CWE-94, CWE-95. Patches available in Python semantic-kernel >= 1.39.4 and .NET semantic-kernel >= 1.71.0; this rule detects exploit attempts against unpatched deployments and provides defence-in-depth post-patch.
|
|
@@ -91,8 +91,8 @@ detection:
|
|
|
91
91
|
description: Python class-hierarchy traversal primitives (tuple().__class__.__mro__, __subclasses__()) — AST-bypass building block used to reach BuiltinImporter
|
|
92
92
|
- field: content
|
|
93
93
|
operator: regex
|
|
94
|
-
value: (?i)BuiltinImporter|\btypes\.FunctionType\b|\bFunctionType\s*\(|getattr\s*\(\s*(?:object|type|__builtins__)
|
|
95
|
-
description: BuiltinImporter, Python types.FunctionType reflective construction, or reflective getattr on built-in roots — excludes bare 'FunctionType' which collides with TypeScript terminology
|
|
94
|
+
value: (?i)BuiltinImporter|\btypes\.FunctionType\b|\bFunctionType\s*\(|getattr\s*\(\s*(?:object|type|__builtins__)\b
|
|
95
|
+
description: 'BuiltinImporter, Python types.FunctionType reflective construction, or reflective getattr on built-in roots — excludes bare ''FunctionType'' which collides with TypeScript terminology. The root name must end at a word boundary: without it ''getattr(types.Scale, name)'' read as getattr on the built-in type'
|
|
96
96
|
- field: content
|
|
97
97
|
operator: regex
|
|
98
98
|
value: (?i)\bFunction\s*\(\s*["\x27].{0,200}?(?:return\s+(?:eval|new\s+Function|require|process)|os\.system|child_process)["\x27]
|
|
@@ -43,7 +43,7 @@ compliance:
|
|
|
43
43
|
context: This rule is the primary detection implementation for LLM07:2025 System Prompt Leakage, covering direct quotation, instruction paraphrasing, guardrail revelation, and config exposure in agent output.
|
|
44
44
|
strength: primary
|
|
45
45
|
- id: LLM02:2025
|
|
46
|
-
context: System prompt content constitutes sensitive operational information; its disclosure in agent output also
|
|
46
|
+
context: System prompt content constitutes sensitive operational information; its disclosure in agent output also falls under the LLM02:2025 Sensitive Information Disclosure category.
|
|
47
47
|
strength: secondary
|
|
48
48
|
eu_ai_act:
|
|
49
49
|
- article: '13'
|
package/rules/context-exfiltration/ATR-2026-00471-garak-sysprompt-extraction-mixedunassigned.yaml
CHANGED
|
@@ -28,7 +28,7 @@ compliance:
|
|
|
28
28
|
strength: primary
|
|
29
29
|
eu_ai_act:
|
|
30
30
|
- article: '15'
|
|
31
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this context exfiltration detection rule
|
|
31
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this context exfiltration detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
32
32
|
strength: primary
|
|
33
33
|
- article: '9'
|
|
34
34
|
context: Context exfiltration is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -28,7 +28,7 @@ compliance:
|
|
|
28
28
|
strength: primary
|
|
29
29
|
eu_ai_act:
|
|
30
30
|
- article: '15'
|
|
31
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this context exfiltration detection rule
|
|
31
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this context exfiltration detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
32
32
|
strength: primary
|
|
33
33
|
- article: '9'
|
|
34
34
|
context: Context exfiltration is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
package/rules/context-exfiltration/ATR-2026-00504-tool-and-function-capability-enumeration.yaml
CHANGED
|
@@ -28,7 +28,7 @@ compliance:
|
|
|
28
28
|
strength: primary
|
|
29
29
|
eu_ai_act:
|
|
30
30
|
- article: '15'
|
|
31
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this context exfiltration detection rule
|
|
31
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this context exfiltration detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
32
32
|
strength: primary
|
|
33
33
|
- article: '9'
|
|
34
34
|
context: Context exfiltration is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -28,7 +28,7 @@ compliance:
|
|
|
28
28
|
strength: primary
|
|
29
29
|
eu_ai_act:
|
|
30
30
|
- article: '15'
|
|
31
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this context exfiltration detection rule
|
|
31
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this context exfiltration detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
32
32
|
strength: primary
|
|
33
33
|
- article: '9'
|
|
34
34
|
context: Context exfiltration is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -28,7 +28,7 @@ compliance:
|
|
|
28
28
|
strength: primary
|
|
29
29
|
eu_ai_act:
|
|
30
30
|
- article: '15'
|
|
31
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this context exfiltration detection rule
|
|
31
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this context exfiltration detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
32
32
|
strength: primary
|
|
33
33
|
- article: '9'
|
|
34
34
|
context: Context exfiltration is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this context exfiltration detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this context exfiltration detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Context exfiltration is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
title: System Prompt Override via Pseudo-Admin / Authority Injection
|
|
2
2
|
id: ATR-2026-01462
|
|
3
|
-
rule_version:
|
|
3
|
+
rule_version: 2
|
|
4
4
|
status: stable
|
|
5
5
|
description: |
|
|
6
6
|
Detects attempts to override or replace the system prompt by injecting fake administrative authority markers, claiming to be a higher-priority override, emergency protocol, or root-admin authorization. The probe corpus contains six variants: (1) HTML-comment wrapped authority claim:
|
|
@@ -74,7 +74,7 @@ detection:
|
|
|
74
74
|
conditions:
|
|
75
75
|
- field: content
|
|
76
76
|
operator: regex
|
|
77
|
-
value: (?i)((?:<!--|\[)\s*SYSTEM\s+OVERRIDE\b|SYSTEM\s+OVERRIDE\s+(?:BEGIN|MODE|ACTIVE|NOW|ENABLED)|ROOT_?ADMIN|OMEGA\s+CLEARANCE|
|
|
77
|
+
value: (?i)((?:<!--|\[)\s*SYSTEM\s+OVERRIDE\b|SYSTEM\s+OVERRIDE\s+(?:BEGIN|MODE|ACTIVE|NOW|ENABLED)|ROOT_?ADMIN|OMEGA\s+CLEARANCE|AUTHORIZATION\s*:\s*(ROOT|ADMIN|FULL|OMEGA))
|
|
78
78
|
description: System override (structurally framed) / root admin / omega clearance authority claim
|
|
79
79
|
- field: content
|
|
80
80
|
operator: regex
|
|
@@ -43,7 +43,7 @@ compliance:
|
|
|
43
43
|
context: All five sub-forms aim at unauthorized disclosure of PII or credentials, the core LLM02:2025 sensitive-information-disclosure risk.
|
|
44
44
|
strength: primary
|
|
45
45
|
- id: LLM01:2025
|
|
46
|
-
context: Social-engineering, obfuscation, and euphemistic carriers are prompt-injection techniques that bypass literal-keyword filters,
|
|
46
|
+
context: Social-engineering, obfuscation, and euphemistic carriers are prompt-injection techniques that bypass literal-keyword filters, matching LLM01:2025.
|
|
47
47
|
strength: secondary
|
|
48
48
|
owasp_agentic:
|
|
49
49
|
- id: ASI01:2026
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
context: An email-tool directive hidden in retrieved content steers the agent into exfiltrating data to a fixed attacker address, hijacking the agent's goal.
|
|
30
30
|
strength: primary
|
|
31
31
|
- id: ASI05:2026
|
|
32
|
-
context: Acting on attacker instructions embedded in inbound email to invoke the send-email tool is an autonomous cascading action
|
|
32
|
+
context: Acting on attacker instructions embedded in inbound email to invoke the send-email tool is an autonomous cascading action matching ASI05:2026.
|
|
33
33
|
strength: secondary
|
|
34
34
|
owasp_llm:
|
|
35
35
|
- id: LLM02:2025
|
|
@@ -40,7 +40,7 @@ compliance:
|
|
|
40
40
|
strength: secondary
|
|
41
41
|
eu_ai_act:
|
|
42
42
|
- article: '15'
|
|
43
|
-
context: Article 15 robustness and cybersecurity requires high-risk AI systems to resist exfiltration directives embedded in external inputs; detection of the email-tool exfil signature
|
|
43
|
+
context: Article 15 robustness and cybersecurity requires high-risk AI systems to resist exfiltration directives embedded in external inputs; detection of the email-tool exfil signature supports this requirement.
|
|
44
44
|
strength: primary
|
|
45
45
|
- article: '9'
|
|
46
46
|
context: Tool-mediated data exfiltration triggered by untrusted content is a documented Article 9 risk requiring mitigation controls.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
context: A post-summary follow-up directive hidden in retrieved email steers the agent into emailing a fixed attacker address, hijacking the agent's goal after its legitimate task.
|
|
30
30
|
strength: primary
|
|
31
31
|
- id: ASI05:2026
|
|
32
|
-
context: Chaining an exfiltration action onto completion of the summarization task is an autonomous cascading action
|
|
32
|
+
context: Chaining an exfiltration action onto completion of the summarization task is an autonomous cascading action matching ASI05:2026.
|
|
33
33
|
strength: secondary
|
|
34
34
|
owasp_llm:
|
|
35
35
|
- id: LLM02:2025
|
|
@@ -40,7 +40,7 @@ compliance:
|
|
|
40
40
|
strength: secondary
|
|
41
41
|
eu_ai_act:
|
|
42
42
|
- article: '15'
|
|
43
|
-
context: Article 15 robustness requires high-risk AI systems to resist deferred exfiltration directives embedded in external inputs; detection of post-task exfil framing
|
|
43
|
+
context: Article 15 robustness requires high-risk AI systems to resist deferred exfiltration directives embedded in external inputs; detection of post-task exfil framing supports this requirement.
|
|
44
44
|
strength: primary
|
|
45
45
|
nist_ai_rmf:
|
|
46
46
|
- function: Manage
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
context: An exfiltration directive using an obfuscated attacker address still hijacks the agent's goal toward emailing the attacker mailbox.
|
|
30
30
|
strength: primary
|
|
31
31
|
- id: ASI05:2026
|
|
32
|
-
context: Tool-mediated exfiltration to an obfuscated external address is an autonomous cascading action
|
|
32
|
+
context: Tool-mediated exfiltration to an obfuscated external address is an autonomous cascading action matching ASI05:2026.
|
|
33
33
|
strength: secondary
|
|
34
34
|
owasp_llm:
|
|
35
35
|
- id: LLM02:2025
|
|
@@ -40,7 +40,7 @@ compliance:
|
|
|
40
40
|
strength: secondary
|
|
41
41
|
eu_ai_act:
|
|
42
42
|
- article: '15'
|
|
43
|
-
context: Article 15 robustness requires high-risk AI systems to resist obfuscated exfiltration addresses in external inputs; detection of at/dot/entity obfuscation
|
|
43
|
+
context: Article 15 robustness requires high-risk AI systems to resist obfuscated exfiltration addresses in external inputs; detection of at/dot/entity obfuscation supports this requirement.
|
|
44
44
|
strength: primary
|
|
45
45
|
nist_ai_rmf:
|
|
46
46
|
- function: Manage
|
package/rules/context-exfiltration/ATR-2026-01924-system-instruction-extraction-reformat.yaml
CHANGED
|
@@ -36,7 +36,7 @@ compliance:
|
|
|
36
36
|
strength: secondary
|
|
37
37
|
eu_ai_act:
|
|
38
38
|
- article: '15'
|
|
39
|
-
context: Article 15 robustness requires resisting extraction of system instructions; detecting reformat-based extraction
|
|
39
|
+
context: Article 15 robustness requires resisting extraction of system instructions; detecting reformat-based extraction supports the requirement.
|
|
40
40
|
strength: primary
|
|
41
41
|
nist_ai_rmf:
|
|
42
42
|
- function: Manage
|
|
@@ -23,7 +23,7 @@ references:
|
|
|
23
23
|
compliance:
|
|
24
24
|
eu_ai_act:
|
|
25
25
|
- article: '15'
|
|
26
|
-
context: High-risk AI systems must be resilient against adversarial attempts to extract sensitive secrets from context; detecting secret-key exfiltration requests
|
|
26
|
+
context: High-risk AI systems must be resilient against adversarial attempts to extract sensitive secrets from context; detecting secret-key exfiltration requests provides detection evidence supporting Article 15 requirements for robustness against input-based manipulation.
|
|
27
27
|
strength: primary
|
|
28
28
|
- article: '9'
|
|
29
29
|
context: Secret-key exfiltration attempts constitute a documented risk class in the AI system risk register; Article 9 requires that monitoring controls are deployed to detect these attempts at runtime.
|
package/rules/context-exfiltration/ATR-2026-02026-oblique-sysprompt-extraction-transform.yaml
CHANGED
|
@@ -32,7 +32,7 @@ compliance:
|
|
|
32
32
|
strength: primary
|
|
33
33
|
eu_ai_act:
|
|
34
34
|
- article: '15'
|
|
35
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this context exfiltration detection rule
|
|
35
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this context exfiltration detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation, covering the oblique-referent/transform variant that literal-keyword rules miss.
|
|
36
36
|
strength: primary
|
|
37
37
|
- article: '9'
|
|
38
38
|
context: Context exfiltration is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -23,7 +23,7 @@ references:
|
|
|
23
23
|
compliance:
|
|
24
24
|
eu_ai_act:
|
|
25
25
|
- article: '15'
|
|
26
|
-
context: High-risk AI systems must be resilient against manipulation that causes them to exfiltrate data under a fabricated policy pretext; detecting the policy-justified exfiltration-to-email pattern is a concrete cybersecurity control
|
|
26
|
+
context: High-risk AI systems must be resilient against manipulation that causes them to exfiltrate data under a fabricated policy pretext; detecting the policy-justified exfiltration-to-email pattern is a concrete cybersecurity control that supports Article 15 robustness requirements.
|
|
27
27
|
strength: primary
|
|
28
28
|
- article: '9'
|
|
29
29
|
context: Policy-pretext exfiltration attempts are a documented risk class for agentic systems that process untrusted content; Article 9 requires runtime monitoring controls capable of detecting these attempts as part of the continuous risk management system.
|
|
@@ -24,7 +24,7 @@ references:
|
|
|
24
24
|
compliance:
|
|
25
25
|
eu_ai_act:
|
|
26
26
|
- article: '15'
|
|
27
|
-
context: High-risk AI systems must be resilient against adversarial attempts to manipulate the system into exfiltrating data; detecting fake-documentation forwarding pretexts
|
|
27
|
+
context: High-risk AI systems must be resilient against adversarial attempts to manipulate the system into exfiltrating data; detecting fake-documentation forwarding pretexts provides detection evidence supporting Article 15 requirements for robustness against input-based manipulation.
|
|
28
28
|
strength: primary
|
|
29
29
|
- article: '9'
|
|
30
30
|
context: Fake-documentation exfiltration pretexts constitute a documented risk class in the AI system risk register; Article 9 requires that monitoring controls are deployed to detect these attempts at runtime.
|
|
@@ -22,7 +22,7 @@ references:
|
|
|
22
22
|
compliance:
|
|
23
23
|
eu_ai_act:
|
|
24
24
|
- article: '15'
|
|
25
|
-
context: High-risk AI agents must be resilient against adversarial manipulation of their context that causes unauthorized data exfiltration; this rule's detection of cross-document found-elsewhere-then-send relay chains is a concrete cybersecurity control
|
|
25
|
+
context: High-risk AI agents must be resilient against adversarial manipulation of their context that causes unauthorized data exfiltration; this rule's detection of cross-document found-elsewhere-then-send relay chains is a concrete cybersecurity control that supports Article 15 robustness requirements against input-based manipulation.
|
|
26
26
|
strength: primary
|
|
27
27
|
- article: '9'
|
|
28
28
|
context: Cross-email exfiltration relay via injected tool output is a documented risk class in the AI system risk register; Article 9 requires that monitoring controls are deployed to detect these attempts at runtime.
|
|
@@ -36,10 +36,10 @@ compliance:
|
|
|
36
36
|
strength: primary
|
|
37
37
|
owasp_llm:
|
|
38
38
|
- id: LLM01:2025
|
|
39
|
-
context: Hidden instruction markers and role-override commands embedded in retrieved content deliver indirect prompt injection through the data layer,
|
|
39
|
+
context: Hidden instruction markers and role-override commands embedded in retrieved content deliver indirect prompt injection through the data layer, matching the LLM01:2025 Prompt Injection category via the RAG attack surface.
|
|
40
40
|
strength: primary
|
|
41
41
|
- id: LLM03:2025
|
|
42
|
-
context: Poisoned knowledge base entries injected into the supply chain of training or retrieval data
|
|
42
|
+
context: Poisoned knowledge base entries injected into the supply chain of training or retrieval data match the LLM03:2025 Supply Chain Vulnerabilities category at the data tier.
|
|
43
43
|
strength: secondary
|
|
44
44
|
- id: LLM08:2025
|
|
45
45
|
context: 'The patterns match hidden directives in tool output (the rule targets retrieved documents and knowledge-base entries): fake [SYSTEM] or <system> tags, ignore-previous-instructions overrides, retrieval-triggered phrases, BEGIN HIDDEN INSTRUCTIONS blocks, ''for internal use only'' sections, concealment and stealth-action directives, mode switches, role-play and append-to-every-response directives, injected chat turns, prompt-template delimiters and exfiltration commands with a target address. LLM08:2025, which covers systems using Retrieval Augmented Generation, lists data poisoning from insiders, prompts, data seeding or unverified data providers, leading to manipulated model outputs; the patterns see a poisoned entry when it is returned but not whether it came from a vector store, so the fit is partial.'
|
|
@@ -28,7 +28,7 @@ references:
|
|
|
28
28
|
compliance:
|
|
29
29
|
owasp_agentic:
|
|
30
30
|
- id: ASI05:2026
|
|
31
|
-
context: Runaway agent loops represent uncontrolled autonomous execution — the agent performs repeated identical actions without human intervention,
|
|
31
|
+
context: Runaway agent loops represent uncontrolled autonomous execution — the agent performs repeated identical actions without human intervention, matching the ASI05:2026 Unexpected Code Execution category at the behavioral level.
|
|
32
32
|
strength: primary
|
|
33
33
|
owasp_llm:
|
|
34
34
|
- id: LLM06:2025
|
|
@@ -54,7 +54,7 @@ compliance:
|
|
|
54
54
|
strength: primary
|
|
55
55
|
- function: Govern
|
|
56
56
|
subcategory: GV.1.2
|
|
57
|
-
context: GV.1.2 accountability roles must include responsibility for detecting and halting runaway agent behavior; this rule provides the signal
|
|
57
|
+
context: GV.1.2 accountability roles must include responsibility for detecting and halting runaway agent behavior; this rule provides the signal that supports that accountability.
|
|
58
58
|
strength: secondary
|
|
59
59
|
- subcategory: MG.2.3
|
|
60
60
|
context: NIST AI RMF MANAGE 2.3 (respond to previously unknown identified risks) is supported by this rule, which surfaces the unsafe autonomous action (Runaway Agent Loop Detection) so the risk can be treated.
|
|
@@ -29,7 +29,7 @@ references:
|
|
|
29
29
|
compliance:
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '14'
|
|
32
|
-
context: Cascading failures propagating across agent pipelines make human intervention increasingly difficult as the failure scope widens; early detection
|
|
32
|
+
context: Cascading failures propagating across agent pipelines make human intervention increasingly difficult as the failure scope widens; early detection provides evidence supporting Article 14's requirement for effective human override capability.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '15'
|
|
35
35
|
context: Article 15 accuracy and robustness requirements demand that high-risk AI systems handle failure propagation gracefully; this rule provides the monitoring signal required to contain cascading events.
|
package/rules/excessive-autonomy/ATR-2026-00491-garak-agent-breaker-markdown-just-raw-json.yaml
CHANGED
|
@@ -28,7 +28,7 @@ compliance:
|
|
|
28
28
|
strength: primary
|
|
29
29
|
eu_ai_act:
|
|
30
30
|
- article: '15'
|
|
31
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this excessive autonomy detection rule
|
|
31
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this excessive autonomy detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
32
32
|
strength: primary
|
|
33
33
|
- article: '9'
|
|
34
34
|
context: Excessive autonomy is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -30,7 +30,7 @@ compliance:
|
|
|
30
30
|
strength: primary
|
|
31
31
|
eu_ai_act:
|
|
32
32
|
- article: '15'
|
|
33
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this excessive autonomy detection rule
|
|
33
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this excessive autonomy detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
34
34
|
strength: primary
|
|
35
35
|
- article: '9'
|
|
36
36
|
context: Excessive autonomy is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -30,7 +30,7 @@ compliance:
|
|
|
30
30
|
strength: primary
|
|
31
31
|
eu_ai_act:
|
|
32
32
|
- article: '15'
|
|
33
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this model abuse detection rule
|
|
33
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this model abuse detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
34
34
|
strength: primary
|
|
35
35
|
- article: '9'
|
|
36
36
|
context: Model abuse is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -28,7 +28,7 @@ compliance:
|
|
|
28
28
|
strength: primary
|
|
29
29
|
eu_ai_act:
|
|
30
30
|
- article: '15'
|
|
31
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this model abuse detection rule
|
|
31
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this model abuse detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
32
32
|
strength: primary
|
|
33
33
|
- article: '9'
|
|
34
34
|
context: Model abuse is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -34,7 +34,7 @@ compliance:
|
|
|
34
34
|
strength: primary
|
|
35
35
|
eu_ai_act:
|
|
36
36
|
- article: '15'
|
|
37
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this detection rule
|
|
37
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
38
38
|
strength: primary
|
|
39
39
|
- article: '9'
|
|
40
40
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -31,7 +31,7 @@ compliance:
|
|
|
31
31
|
context: Indirect prompt injection hijacks agent goals via externally-consumed content (documents, web pages, API responses); the agent processes attacker-controlled instructions without user awareness.
|
|
32
32
|
strength: primary
|
|
33
33
|
- id: ASI06:2026
|
|
34
|
-
context: Injection via external content poisons the agent's context window and memory with attacker-controlled directives,
|
|
34
|
+
context: Injection via external content poisons the agent's context window and memory with attacker-controlled directives, matching the ASI06:2026 Memory and Context Poisoning category.
|
|
35
35
|
strength: secondary
|
|
36
36
|
owasp_llm:
|
|
37
37
|
- id: LLM01:2025
|
|
@@ -39,7 +39,7 @@ compliance:
|
|
|
39
39
|
strength: primary
|
|
40
40
|
eu_ai_act:
|
|
41
41
|
- article: '15'
|
|
42
|
-
context: High-risk AI systems must resist adversarial content embedded in external inputs. Detection of hidden injection payloads in consumed documents
|
|
42
|
+
context: High-risk AI systems must resist adversarial content embedded in external inputs. Detection of hidden injection payloads in consumed documents supports Article 15 robustness and cybersecurity requirements.
|
|
43
43
|
strength: primary
|
|
44
44
|
- article: '9'
|
|
45
45
|
context: Indirect injection from third-party content sources is a documented risk category requiring mitigation controls under Article 9 risk management obligations.
|
|
@@ -25,7 +25,7 @@ references:
|
|
|
25
25
|
compliance:
|
|
26
26
|
eu_ai_act:
|
|
27
27
|
- article: '15'
|
|
28
|
-
context: High-risk AI systems must be resilient against adversarial attempts to suppress safety mechanisms. Jailbreak detection
|
|
28
|
+
context: High-risk AI systems must be resilient against adversarial attempts to suppress safety mechanisms. Jailbreak detection provides detection evidence supporting Article 15 requirements for robustness against input-based manipulation.
|
|
29
29
|
strength: primary
|
|
30
30
|
- article: '9'
|
|
31
31
|
context: Jailbreak attempts constitute a documented risk class in the AI system risk register; Article 9 requires that monitoring controls are deployed to detect these attempts at runtime.
|
|
@@ -28,7 +28,7 @@ compliance:
|
|
|
28
28
|
context: Detecting reversal-based jailbreak attempts provides continuous evidence about the AI system's resilience to instruction extraction and inversion attacks; MS.2.7 requires that security and resilience are evaluated and documented against these GenAI-specific prompt injection vectors.
|
|
29
29
|
strength: secondary
|
|
30
30
|
- subcategory: MG.2.3
|
|
31
|
-
context: Identification of instruction-reversal probing patterns enables containment mechanisms to disengage or block the agent before it executes inverted (unsafe) versions of its original directives,
|
|
31
|
+
context: Identification of instruction-reversal probing patterns enables containment mechanisms to disengage or block the agent before it executes inverted (unsafe) versions of its original directives, supporting MG.2.3's requirement for runtime treatment of adversarial manipulation.
|
|
32
32
|
strength: secondary
|
|
33
33
|
iso_42001:
|
|
34
34
|
- clause: '8.1'
|
|
@@ -26,7 +26,7 @@ compliance:
|
|
|
26
26
|
context: Detecting system prompt override attempts via translation requests provides continuous evidence for evaluating the AI system's security and resilience against prompt injection, which MS.2.7 requires to be measured and documented.
|
|
27
27
|
strength: secondary
|
|
28
28
|
- subcategory: MG.2.3
|
|
29
|
-
context: Matches on translation-borne override instructions trigger pre-defined risk treatment to disengage or quarantine the hijacked agent behavior before safety controls are bypassed,
|
|
29
|
+
context: Matches on translation-borne override instructions trigger pre-defined risk treatment to disengage or quarantine the hijacked agent behavior before safety controls are bypassed, supporting MG.2.3's requirement for mechanisms to supersede or deactivate compromised AI behavior.
|
|
30
30
|
strength: secondary
|
|
31
31
|
iso_42001:
|
|
32
32
|
- clause: '8.1'
|
|
@@ -26,7 +26,7 @@ compliance:
|
|
|
26
26
|
context: Cipher and transposition encoding jailbreaks (ROT13, Atbash, Caesar, leet) are adversarial inputs designed to bypass safety filters by obfuscating harmful instructions; MS.2.7 requires that AI system security and resilience against such evasion techniques are continuously evaluated and documented.
|
|
27
27
|
strength: primary
|
|
28
28
|
- subcategory: MS.2.6
|
|
29
|
-
context: Detecting cipher-based jailbreak probes (as catalogued by garak InjectROT13/InjectAtbash/InjectLeet) provides ongoing measurement of safety/security risk magnitude from prompt-injection attacks that classical content filters miss,
|
|
29
|
+
context: Detecting cipher-based jailbreak probes (as catalogued by garak InjectROT13/InjectAtbash/InjectLeet) provides ongoing measurement of safety/security risk magnitude from prompt-injection attacks that classical content filters miss, supporting MS.2.6's continuous evaluation requirement.
|
|
30
30
|
strength: secondary
|
|
31
31
|
- subcategory: MG.2.3
|
|
32
32
|
context: Identification of obfuscated jailbreak instructions triggers the deactivation or response mechanisms required by MG.2.3 to supersede unsafe agent execution before the decoded harmful instruction is acted upon.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
context: Invisible ASCII smuggling via variation selectors is an adversarial input technique that exploits the gap between human-visible text and tokenizer-decoded content; MP.5.1 requires identifying and characterizing the likelihood and impact of such hidden jailbreak payload vectors.
|
|
30
30
|
strength: secondary
|
|
31
31
|
- subcategory: MG.2.3
|
|
32
|
-
context: Matches on consecutive U+E0100-U+E017F sequences trigger risk treatment to strip or quarantine the smuggled payload before it reaches the model,
|
|
32
|
+
context: Matches on consecutive U+E0100-U+E017F sequences trigger risk treatment to strip or quarantine the smuggled payload before it reaches the model, supporting MG.2.3's requirement for mechanisms that disengage adversarial inputs from AI processing pipelines.
|
|
33
33
|
strength: secondary
|
|
34
34
|
iso_42001:
|
|
35
35
|
- clause: '8.1'
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|
package/rules/prompt-injection/ATR-2026-00466-garak-latentinjection-following-text-from.yaml
CHANGED
|
@@ -29,7 +29,7 @@ compliance:
|
|
|
29
29
|
strength: primary
|
|
30
30
|
eu_ai_act:
|
|
31
31
|
- article: '15'
|
|
32
|
-
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule
|
|
32
|
+
context: High-risk AI systems must be resilient against adversarial attempts to alter output or behavior. Deployment of this prompt injection detection rule provides detection evidence supporting the Article 15 requirement to implement technical measures ensuring robustness against manipulation.
|
|
33
33
|
strength: primary
|
|
34
34
|
- article: '9'
|
|
35
35
|
context: Prompt injection is a documented risk class; this rule implements the monitoring control required by Article 9 risk management obligations for high-risk AI systems.
|