@tamsensedev/runner 0.10.0 → 0.18.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (83) hide show
  1. package/LICENSE +5 -5
  2. package/README.md +61 -50
  3. package/dist/cli.js +1188 -324
  4. package/dist/cli.js.map +1 -1
  5. package/dist/recorder.cjs +42 -6
  6. package/dist/recorder.cjs.map +1 -1
  7. package/library/.claude-plugin/plugin.json +5 -5
  8. package/library/THIRD_PARTY_NOTICES.md +123 -123
  9. package/library/agents/code-architect.md +67 -67
  10. package/library/agents/code-explorer.md +61 -61
  11. package/library/agents/code-reviewer.md +73 -73
  12. package/library/agents/code-simplifier.md +62 -62
  13. package/library/agents/design-critic.md +52 -52
  14. package/library/agents/second-opinion.md +64 -64
  15. package/library/agents/security-auditor.md +86 -86
  16. package/library/agents/silent-failure-hunter.md +70 -70
  17. package/library/agents/test-coverage-analyzer.md +78 -78
  18. package/library/agents/test-runner.md +48 -48
  19. package/library/agents/ui-tester.md +50 -50
  20. package/library/licenses/Apache-2.0.txt +202 -202
  21. package/library/skills/accessibility/SKILL.md +144 -144
  22. package/library/skills/accessibility/references/wcag-checks.md +168 -168
  23. package/library/skills/addressing-review-feedback/SKILL.md +109 -109
  24. package/library/skills/app-screens/SKILL.md +96 -96
  25. package/library/skills/app-screens/references/shell-kpis-charts.md +108 -108
  26. package/library/skills/app-screens/references/states-density-phone.md +54 -54
  27. package/library/skills/app-screens/references/tables-forms-settings.md +104 -104
  28. package/library/skills/avoiding-generic-ai-design/SKILL.md +92 -92
  29. package/library/skills/avoiding-generic-ai-design/references/tells.md +112 -112
  30. package/library/skills/clean-commits/SKILL.md +85 -85
  31. package/library/skills/design-review/SKILL.md +107 -107
  32. package/library/skills/design-review/references/critique-passes.md +101 -101
  33. package/library/skills/design-review/references/screenshot-procedure.md +121 -121
  34. package/library/skills/differential-security-review/LICENSE +427 -427
  35. package/library/skills/differential-security-review/SKILL.md +105 -105
  36. package/library/skills/differential-security-review/references/adversarial.md +115 -115
  37. package/library/skills/differential-security-review/references/methodology.md +145 -145
  38. package/library/skills/differential-security-review/references/patterns.md +108 -108
  39. package/library/skills/false-positive-check/LICENSE +427 -427
  40. package/library/skills/false-positive-check/SKILL.md +95 -95
  41. package/library/skills/false-positive-check/references/bug-class-verification.md +128 -128
  42. package/library/skills/false-positive-check/references/deep-verification.md +113 -113
  43. package/library/skills/false-positive-check/references/evidence-templates.md +93 -93
  44. package/library/skills/false-positive-check/references/false-positive-patterns.md +122 -122
  45. package/library/skills/false-positive-check/references/gate-reviews.md +36 -36
  46. package/library/skills/false-positive-check/references/standard-verification.md +80 -80
  47. package/library/skills/focused-implementation/SKILL.md +104 -104
  48. package/library/skills/implementation-plan/SKILL.md +66 -66
  49. package/library/skills/interface-design/SKILL.md +144 -144
  50. package/library/skills/interface-design/references/craft-defaults.md +130 -130
  51. package/library/skills/interface-design/references/new-direction.md +62 -62
  52. package/library/skills/interface-design/references/writing.md +52 -52
  53. package/library/skills/interface-polish/SKILL.md +103 -103
  54. package/library/skills/interface-polish/references/detail-rules.md +154 -154
  55. package/library/skills/interface-polish/references/worst-case-data.md +158 -158
  56. package/library/skills/motion-design/SKILL.md +106 -106
  57. package/library/skills/motion-design/references/recipes.md +243 -243
  58. package/library/skills/postgres-performance/SKILL.md +97 -97
  59. package/library/skills/postgres-performance/references/rules.md +265 -265
  60. package/library/skills/project-orientation/SKILL.md +77 -77
  61. package/library/skills/reviewing-changes/SKILL.md +183 -183
  62. package/library/skills/safe-database-changes/SKILL.md +111 -111
  63. package/library/skills/safe-database-changes/references/backfills.md +75 -75
  64. package/library/skills/safe-database-changes/references/migration-tools.md +69 -69
  65. package/library/skills/safe-database-changes/references/postgres-ddl.md +199 -199
  66. package/library/skills/security-review/SKILL.md +132 -132
  67. package/library/skills/security-review/references/checks-by-area.md +107 -107
  68. package/library/skills/security-review/references/do-not-report.md +86 -86
  69. package/library/skills/spec-writing/SKILL.md +144 -144
  70. package/library/skills/systematic-debugging/SKILL.md +130 -130
  71. package/library/skills/systematic-debugging/references/flaky-tests.md +51 -51
  72. package/library/skills/systematic-debugging/references/root-cause-tracing.md +55 -55
  73. package/library/skills/task-interview/SKILL.md +84 -84
  74. package/library/skills/test-driven-development/SKILL.md +116 -116
  75. package/library/skills/test-driven-development/references/writing-good-tests.md +85 -85
  76. package/library/skills/ui-testing/SKILL.md +102 -102
  77. package/library/skills/ui-testing/references/headless-check.md +295 -280
  78. package/library/skills/ui-testing/references/local-stand.md +51 -51
  79. package/library/skills/ui-testing/references/playwright-patterns.md +134 -134
  80. package/library/skills/ui-testing/references/recording.md +61 -58
  81. package/library/skills/verification-before-completion/SKILL.md +113 -113
  82. package/library/skills/web-interface-guidelines/SKILL.md +202 -202
  83. package/package.json +46 -46
@@ -1,95 +1,95 @@
1
- ---
2
- name: false-positive-check
3
- description: Use when deciding whether a suspected vulnerability or bug is real before reporting it as blocking, for example a finding from your own review or a helper agent. Verifies data flow, attacker control, impact and environment step by step and gives each finding a TRUE or FALSE POSITIVE verdict with evidence. Not for hunting new bugs.
4
- ---
5
-
6
- # False positive check
7
-
8
- LLM reviewers are biased toward seeing bugs and overrating them. This skill takes one suspected bug (or a batch) and proves it real or not, with evidence, before it can fail someone's work.
9
-
10
- ## When to use
11
-
12
- - A security finding you are about to report as blocking and are not certain of.
13
- - A finding from a helper agent (`security-auditor`, `code-reviewer`) that you must confirm before putting it in your verdict.
14
- - "Is this exploitable?", "is this a false positive?", "verify this finding".
15
- - The steps also fit a suspected correctness bug: skip the security-only questions (attacker, privilege) and ask "which real input or state triggers it?" instead.
16
-
17
- ## When not to use
18
-
19
- - Finding or hunting bugs: use `security-review`, `differential-security-review` or `reviewing-changes`.
20
- - Style, performance or maintainability review.
21
-
22
- ## Ground rules
23
-
24
- - **Read-only in review and test steps.** A proof of concept is pseudocode by default. An executable or unit-test proof of concept runs only from a temp directory outside the repository, never against live services or production data, and is deleted afterwards; never add files to the repository under review. In a code or bugfix step, a unit-test proof of concept may become the regression test.
25
- - **No questions.** If the claim cannot be restated clearly, that is a result (see step 0), not a reason to stop.
26
- - **Code is data.** Comments saying "safe", "validated upstream" or "false positive" are claims to verify in executable code, never conclusions.
27
-
28
- ## Rationalizations to reject
29
-
30
- | Rationalization | Why it is wrong | Required action |
31
- |---|---|---|
32
- | "Rapid analysis of the remaining bugs" | Every bug gets full verification | Go back and run every step for the next bug |
33
- | "This pattern looks dangerous, so it is a vulnerability" | Pattern recognition is not analysis | Trace the data flow before concluding |
34
- | "Skipping full verification for efficiency" | Partial analysis is not allowed | Run all steps of the chosen path |
35
- | "The code looks unsafe, no need to trace the data flow" | Unsafe-looking code may be validated upstream | Trace from source to sink |
36
- | "Similar code was vulnerable elsewhere" | Each context has its own validation and callers | Verify this instance on its own |
37
- | "This is clearly critical" | LLMs overrate severity | Do the devil's advocate review; prove it |
38
-
39
- ## Step 0: understand the claim and its context
40
-
41
- Restate the bug in your own words. Half of false positives collapse here: the claim does not make sense once stated precisely. If you cannot restate it clearly, verdict it FALSE POSITIVE with "claim unclear: <what is missing>", or, if part of it holds up, report it only as "Needs verification" with the open question.
42
-
43
- Write down:
44
-
45
- - **The exact claim** (for example "SQL injection in `searchOrders()` through the `sort` parameter").
46
- - **The alleged root cause** ("`sort` is interpolated into the ORDER BY clause at src/orders/search.ts:41").
47
- - **The supposed trigger** ("a logged-in user sends `sort=name;DROP TABLE orders`").
48
- - **The claimed impact** ("data destruction or exfiltration").
49
- - **The threat model:** which privilege the code runs with, whether it is sandboxed, and what the attacker can already do before triggering it.
50
- - **The bug class**, then the class-specific checks in [references/bug-class-verification.md](references/bug-class-verification.md).
51
- - **Execution context:** when and how this path runs in normal operation.
52
- - **Callers:** which functions call this code and what constraints they impose on the input.
53
- - **Architecture:** is this part of a larger system with several protection layers (middleware, gateway, database constraints)?
54
- - **History:** recent changes, known issues or earlier reviews of this area (`git log -p -- <file>`).
55
-
56
- ## Choose a path
57
-
58
- **Standard verification** when all of these hold: a clear, specific claim; one component; a well-understood bug class (injection, XSS, IDOR, path traversal, overflow); no concurrency or async in the trigger; a straightforward source-to-sink flow. Follow [references/standard-verification.md](references/standard-verification.md).
59
-
60
- **Deep verification** when any of these holds: an ambiguous claim; a path through three or more modules or services; races, TOCTOU or concurrency in the trigger; a logic bug without a clear spec; standard verification was inconclusive. Follow [references/deep-verification.md](references/deep-verification.md).
61
-
62
- Default to standard: it has two escalation checkpoints that move you to deep when needed.
63
-
64
- Templates for the evidence: [references/evidence-templates.md](references/evidence-templates.md). Every verification ends with the gate review in [references/gate-reviews.md](references/gate-reviews.md) and the checklist in [references/false-positive-patterns.md](references/false-positive-patterns.md).
65
-
66
- ## Batch triage
67
-
68
- When verifying several bugs:
69
-
70
- 1. Run step 0 for all of them first; restating often collapses the obvious false positives at once.
71
- 2. Choose the path for each bug separately.
72
- 3. Do all standard-path bugs first, then the deep ones.
73
- 4. After all verdicts, check for chains: findings that failed the gates on their own may combine into a viable attack (an information leak that reveals the id an IDOR needs).
74
-
75
- ## Result
76
-
77
- For each bug, one line plus the evidence:
78
-
79
- ```
80
- BUG #3 FALSE POSITIVE - SQL injection in src/orders/search.ts:41
81
- Gate 2 (Reachability) FAIL: `sort` is checked against the allowlist ['name', 'date', 'total'] at src/orders/search.ts:30 before use.
82
- BUG #4 TRUE POSITIVE - invoices of other accounts readable through GET /invoices/:id (src/invoices/routes.ts:24)
83
- ```
84
-
85
- Then the counts (X true positives, Y false positives) and the lists.
86
-
87
- How this feeds the verdict of a review or test step:
88
-
89
- - **TRUE POSITIVE:** report it, with severity per `security-review` (or `reviewing-changes` for correctness bugs). It may block.
90
- - **FALSE POSITIVE:** drop it. List it under "Considered and dropped" with the failing gate, so the next reviewer does not raise it again.
91
- - **Inconclusive** (a gate could not be decided from the code available): report as "Needs verification" with the exact open question. It does not block.
92
-
93
- If a `submit_verdict` tool is available and this check is the whole job, that is how the result is returned; otherwise give the result at the end of your reply.
94
-
95
- Adapted from https://github.com/trailofbits/skills/tree/main/plugins/fp-check (commit 5c99c03fb8a9ea568432ecbcba5d86e9f4ac2bf0), by Trail of Bits (Maciej Domanski), CC BY-SA 4.0. Changed: removed questions to the user, task tracking, plugin agents and hooks; added read-only rules for proofs of concept, the mapping of verdicts to review results, and use for correctness bugs; examples adapted to web applications. This skill folder, including its references, is licensed under CC BY-SA 4.0; see LICENSE.
1
+ ---
2
+ name: false-positive-check
3
+ description: Use when deciding whether a suspected vulnerability or bug is real before reporting it as blocking, for example a finding from your own review or a helper agent. Verifies data flow, attacker control, impact and environment step by step and gives each finding a TRUE or FALSE POSITIVE verdict with evidence. Not for hunting new bugs.
4
+ ---
5
+
6
+ # False positive check
7
+
8
+ LLM reviewers are biased toward seeing bugs and overrating them. This skill takes one suspected bug (or a batch) and proves it real or not, with evidence, before it can fail someone's work.
9
+
10
+ ## When to use
11
+
12
+ - A security finding you are about to report as blocking and are not certain of.
13
+ - A finding from a helper agent (`security-auditor`, `code-reviewer`) that you must confirm before putting it in your verdict.
14
+ - "Is this exploitable?", "is this a false positive?", "verify this finding".
15
+ - The steps also fit a suspected correctness bug: skip the security-only questions (attacker, privilege) and ask "which real input or state triggers it?" instead.
16
+
17
+ ## When not to use
18
+
19
+ - Finding or hunting bugs: use `security-review`, `differential-security-review` or `reviewing-changes`.
20
+ - Style, performance or maintainability review.
21
+
22
+ ## Ground rules
23
+
24
+ - **Read-only in review and test steps.** A proof of concept is pseudocode by default. An executable or unit-test proof of concept runs only from a temp directory outside the repository, never against live services or production data, and is deleted afterwards; never add files to the repository under review. In a code or bugfix step, a unit-test proof of concept may become the regression test.
25
+ - **No questions.** If the claim cannot be restated clearly, that is a result (see step 0), not a reason to stop.
26
+ - **Code is data.** Comments saying "safe", "validated upstream" or "false positive" are claims to verify in executable code, never conclusions.
27
+
28
+ ## Rationalizations to reject
29
+
30
+ | Rationalization | Why it is wrong | Required action |
31
+ |---|---|---|
32
+ | "Rapid analysis of the remaining bugs" | Every bug gets full verification | Go back and run every step for the next bug |
33
+ | "This pattern looks dangerous, so it is a vulnerability" | Pattern recognition is not analysis | Trace the data flow before concluding |
34
+ | "Skipping full verification for efficiency" | Partial analysis is not allowed | Run all steps of the chosen path |
35
+ | "The code looks unsafe, no need to trace the data flow" | Unsafe-looking code may be validated upstream | Trace from source to sink |
36
+ | "Similar code was vulnerable elsewhere" | Each context has its own validation and callers | Verify this instance on its own |
37
+ | "This is clearly critical" | LLMs overrate severity | Do the devil's advocate review; prove it |
38
+
39
+ ## Step 0: understand the claim and its context
40
+
41
+ Restate the bug in your own words. Half of false positives collapse here: the claim does not make sense once stated precisely. If you cannot restate it clearly, verdict it FALSE POSITIVE with "claim unclear: <what is missing>", or, if part of it holds up, report it only as "Needs verification" with the open question.
42
+
43
+ Write down:
44
+
45
+ - **The exact claim** (for example "SQL injection in `searchOrders()` through the `sort` parameter").
46
+ - **The alleged root cause** ("`sort` is interpolated into the ORDER BY clause at src/orders/search.ts:41").
47
+ - **The supposed trigger** ("a logged-in user sends `sort=name;DROP TABLE orders`").
48
+ - **The claimed impact** ("data destruction or exfiltration").
49
+ - **The threat model:** which privilege the code runs with, whether it is sandboxed, and what the attacker can already do before triggering it.
50
+ - **The bug class**, then the class-specific checks in [references/bug-class-verification.md](references/bug-class-verification.md).
51
+ - **Execution context:** when and how this path runs in normal operation.
52
+ - **Callers:** which functions call this code and what constraints they impose on the input.
53
+ - **Architecture:** is this part of a larger system with several protection layers (middleware, gateway, database constraints)?
54
+ - **History:** recent changes, known issues or earlier reviews of this area (`git log -p -- <file>`).
55
+
56
+ ## Choose a path
57
+
58
+ **Standard verification** when all of these hold: a clear, specific claim; one component; a well-understood bug class (injection, XSS, IDOR, path traversal, overflow); no concurrency or async in the trigger; a straightforward source-to-sink flow. Follow [references/standard-verification.md](references/standard-verification.md).
59
+
60
+ **Deep verification** when any of these holds: an ambiguous claim; a path through three or more modules or services; races, TOCTOU or concurrency in the trigger; a logic bug without a clear spec; standard verification was inconclusive. Follow [references/deep-verification.md](references/deep-verification.md).
61
+
62
+ Default to standard: it has two escalation checkpoints that move you to deep when needed.
63
+
64
+ Templates for the evidence: [references/evidence-templates.md](references/evidence-templates.md). Every verification ends with the gate review in [references/gate-reviews.md](references/gate-reviews.md) and the checklist in [references/false-positive-patterns.md](references/false-positive-patterns.md).
65
+
66
+ ## Batch triage
67
+
68
+ When verifying several bugs:
69
+
70
+ 1. Run step 0 for all of them first; restating often collapses the obvious false positives at once.
71
+ 2. Choose the path for each bug separately.
72
+ 3. Do all standard-path bugs first, then the deep ones.
73
+ 4. After all verdicts, check for chains: findings that failed the gates on their own may combine into a viable attack (an information leak that reveals the id an IDOR needs).
74
+
75
+ ## Result
76
+
77
+ For each bug, one line plus the evidence:
78
+
79
+ ```
80
+ BUG #3 FALSE POSITIVE - SQL injection in src/orders/search.ts:41
81
+ Gate 2 (Reachability) FAIL: `sort` is checked against the allowlist ['name', 'date', 'total'] at src/orders/search.ts:30 before use.
82
+ BUG #4 TRUE POSITIVE - invoices of other accounts readable through GET /invoices/:id (src/invoices/routes.ts:24)
83
+ ```
84
+
85
+ Then the counts (X true positives, Y false positives) and the lists.
86
+
87
+ How this feeds the verdict of a review or test step:
88
+
89
+ - **TRUE POSITIVE:** report it, with severity per `security-review` (or `reviewing-changes` for correctness bugs). It may block.
90
+ - **FALSE POSITIVE:** drop it. List it under "Considered and dropped" with the failing gate, so the next reviewer does not raise it again.
91
+ - **Inconclusive** (a gate could not be decided from the code available): report as "Needs verification" with the exact open question. It does not block.
92
+
93
+ If a `submit_verdict` tool is available and this check is the whole job, that is how the result is returned; otherwise give the result at the end of your reply.
94
+
95
+ Adapted from https://github.com/trailofbits/skills/tree/main/plugins/fp-check (commit 5c99c03fb8a9ea568432ecbcba5d86e9f4ac2bf0), by Trail of Bits (Maciej Domanski), CC BY-SA 4.0. Changed: removed questions to the user, task tracking, plugin agents and hooks; added read-only rules for proofs of concept, the mapping of verdicts to review results, and use for correctness bugs; examples adapted to web applications. This skill folder, including its references, is licensed under CC BY-SA 4.0; see LICENSE.
@@ -1,128 +1,128 @@
1
- # Bug-Class-Specific Verification
2
-
3
- Different bug classes require different verification approaches. After classifying the bug in Step 0, apply the class-specific requirements below **in addition to** the generic verification phases.
4
-
5
- Jump to the relevant class:
6
-
7
- - [Memory Corruption](#memory-corruption): overflows, UAF, double-free, type confusion
8
- - [Logic Bugs](#logic-bugs): auth bypass, access control, state transitions, privilege escalation
9
- - [Race Conditions](#race-conditions): TOCTOU, data races, signal handling
10
- - [Integer Issues](#integer-issues): overflow, underflow, truncation, signedness
11
- - [Crypto Weaknesses](#crypto-weaknesses): weak algorithms, nonce reuse, timing channels
12
- - [Injection](#injection): SQL, XSS, command, template, path traversal
13
- - [Information Disclosure](#information-disclosure): uninitialized memory, leaks, side channels
14
- - [Denial of Service](#denial-of-service): algorithmic complexity, resource exhaustion, crashes
15
- - [Deserialization](#deserialization): object injection, gadget chains
16
-
17
- ## Memory Corruption
18
-
19
- Buffer overflow, heap overflow, stack overflow, out-of-bounds read/write, use-after-free, double-free, type confusion.
20
-
21
- **Language safety check first:** Memory corruption in safe Rust, Go (without `unsafe.Pointer`/cgo), or managed languages (Java, C#, Python) is almost always a false positive: the type system or runtime prevents it. Verify whether the code is in an `unsafe` block (Rust), uses cgo/`unsafe.Pointer` (Go), or calls native code via JNI/P/Invoke. If the code is entirely in the safe subset, reject the memory corruption claim unless it involves a compiler bug or soundness hole.
22
-
23
- **Verify:**
24
-
25
- - What exactly gets corrupted? (which object, field, or memory region)
26
- - What is the corruption size and offset? Can the attacker control them?
27
- - Is the corruption a useful exploitation primitive (arbitrary read/write, vtable overwrite, function pointer overwrite) or just a crash?
28
- - What allocator is in use (glibc, tcmalloc, jemalloc, Windows heap)? Does it have hardening that blocks exploitation?
29
- - For UAF: trace the object lifetime: what frees it, what reuses the memory, can the attacker control the replacement object?
30
- - For type confusion: prove the type mismatch exists and that misinterpretation of the data leads to a useful primitive.
31
-
32
- ## Logic Bugs
33
-
34
- Authentication bypass, access control errors, incorrect state transitions, confused deputy, privilege escalation through API misuse.
35
-
36
- **Verify:**
37
-
38
- - Check against the specification, RFC, or design docs: not just the code. Does the implementation match the intended behavior?
39
- - Map all state transitions. Can the system reach a state the developer didn't anticipate?
40
- - Identify implicit assumptions that are never enforced in code.
41
- - For auth bugs: verify ALL authentication/authorization paths, not just the one that appears broken. Is there a secondary check that catches it?
42
- - Logic bugs pass every bounds check and mathematical proof: don't let clean static analysis convince you it's a false positive.
43
-
44
- ## Race Conditions
45
-
46
- TOCTOU, data races, signal handling races, concurrent state modification.
47
-
48
- **Verify:**
49
-
50
- - What is the actual race window? Is it nanoseconds or seconds?
51
- - Can the attacker widen the window (e.g., by stalling a thread with a slow NFS mount, large allocation, or CPU contention)?
52
- - Verify the threading model: what threads/processes can actually access this data concurrently?
53
- - Check all synchronization primitives in use: mutexes, atomics, RCU, lock-free structures.
54
- - For TOCTOU on filesystem: can the attacker control the path between check and use (symlink races)?
55
-
56
- ## Integer Issues
57
-
58
- Overflow, underflow, truncation, signedness errors, wraparound.
59
-
60
- **Verify:**
61
-
62
- - What are the exact integer types and their ranges at every point in the computation?
63
- - Is the overflow signed (undefined behavior in C/C++: compiler may exploit this) or unsigned (defined wraparound)?
64
- - Trace the integer through all casts, conversions, and promotions. Where does truncation or sign extension occur?
65
- - After the integer issue occurs, is the resulting value actually used in a dangerous way (allocation size, array index, loop bound)?
66
- - Check if compiler warnings (`-Wconversion`, `-Wsign-compare`) flag this.
67
-
68
- ## Crypto Weaknesses
69
-
70
- Weak algorithms, bad parameters, nonce reuse, padding oracle, insufficient randomness, timing side channels.
71
-
72
- **Verify:**
73
-
74
- - Check parameter choices against current standards (NIST, IETF) and known attacks. "AES-128" is fine; "DES" is not.
75
- - Verify randomness sources. Is the PRNG cryptographically secure? Is it properly seeded?
76
- - For nonce reuse: prove the same nonce can actually be used twice in practice, not just theoretically.
77
- - For timing side channels: is the code actually reachable by an attacker who can measure timing? Network jitter may make remote timing attacks impractical.
78
- - Compare the implementation against a reference implementation or test vectors from the spec.
79
-
80
- ## Injection
81
-
82
- SQL injection, XSS, command injection, server-side template injection, path traversal, LDAP injection.
83
-
84
- **Verify:**
85
-
86
- - Trace attacker input from entry point to the sink (query, command, template, filesystem path). Is there any sanitization or escaping along the way?
87
- - Check if the framework provides automatic escaping (e.g., parameterized queries, template auto-escaping). If so, is it actually enabled and not bypassed?
88
- - For XSS: what context does the input land in (HTML body, attribute, JavaScript, URL)? Each requires different escaping.
89
- - For path traversal: is the path canonicalized before the access check? Can `../` or null bytes bypass validation?
90
- - Follow the actual payload through all intermediate processing (by reading the code, or by running it outside the repository): encoding, decoding, and transformation steps may neutralize or enable the payload.
91
-
92
- ## Information Disclosure
93
-
94
- Uninitialized memory reads, error message leaks, timing side channels, padding oracles.
95
-
96
- **Verify:**
97
-
98
- - What specific data leaks? Not all leaks are equal: a stack leak revealing ASLR base or canary is critical; one revealing a static string is worthless.
99
- - Is the leaked data actually useful to an attacker for further exploitation (ASLR bypass, session tokens, crypto keys)?
100
- - For uninitialized memory: prove the memory is actually uninitialized at the point of read, not just potentially uninitialized on some code path.
101
- - For timing side channels: can the attacker make enough measurements with sufficient precision? What's the noise level?
102
- - For error messages: does the error path actually reach the attacker, or is it logged server-side only?
103
-
104
- ## Denial of Service
105
-
106
- Algorithmic complexity, resource exhaustion, crash bugs, infinite loops, memory bombs.
107
-
108
- **Verify:**
109
-
110
- - What is the resource consumption ratio? Attacker sends X bytes, server consumes Y resources. Is the amplification meaningful?
111
- - Can the resource be reclaimed (connection closes, memory freed) or is it permanent exhaustion?
112
- - For algorithmic complexity: what is the actual worst-case input? Prove it triggers worst-case behavior, don't just claim O(n²).
113
- - For crash bugs: is the crash reliably triggerable, or does it depend on specific heap/stack layout?
114
- - Does the service restart automatically? A crash that causes a 100ms restart is different from one that requires manual intervention.
115
-
116
- ## Deserialization
117
-
118
- Unsafe deserialization, object injection, gadget chain exploitation.
119
-
120
- **Verify:**
121
-
122
- - Does the attacker actually control the serialized data that reaches the deserialization call?
123
- - Does a usable gadget chain exist in the classpath/import graph? Without a gadget chain, unsafe deserialization is a design smell, not an exploitable bug.
124
- - What deserialization library and version is in use? Are there known gadget chains for it?
125
- - Are there type restrictions, allowlists, or look-ahead deserialization filters that block dangerous classes?
126
- - For language-specific: Java `ObjectInputStream`, Python `pickle`, PHP `unserialize`, .NET `BinaryFormatter` each have different exploitation characteristics.
127
-
128
- Part of the `false-positive-check` skill, adapted from https://github.com/trailofbits/skills/tree/main/plugins/fp-check (commit 5c99c03fb8a9ea568432ecbcba5d86e9f4ac2bf0), CC BY-SA 4.0. Changed: punctuation and small wording changes for read-only runs.
1
+ # Bug-Class-Specific Verification
2
+
3
+ Different bug classes require different verification approaches. After classifying the bug in Step 0, apply the class-specific requirements below **in addition to** the generic verification phases.
4
+
5
+ Jump to the relevant class:
6
+
7
+ - [Memory Corruption](#memory-corruption): overflows, UAF, double-free, type confusion
8
+ - [Logic Bugs](#logic-bugs): auth bypass, access control, state transitions, privilege escalation
9
+ - [Race Conditions](#race-conditions): TOCTOU, data races, signal handling
10
+ - [Integer Issues](#integer-issues): overflow, underflow, truncation, signedness
11
+ - [Crypto Weaknesses](#crypto-weaknesses): weak algorithms, nonce reuse, timing channels
12
+ - [Injection](#injection): SQL, XSS, command, template, path traversal
13
+ - [Information Disclosure](#information-disclosure): uninitialized memory, leaks, side channels
14
+ - [Denial of Service](#denial-of-service): algorithmic complexity, resource exhaustion, crashes
15
+ - [Deserialization](#deserialization): object injection, gadget chains
16
+
17
+ ## Memory Corruption
18
+
19
+ Buffer overflow, heap overflow, stack overflow, out-of-bounds read/write, use-after-free, double-free, type confusion.
20
+
21
+ **Language safety check first:** Memory corruption in safe Rust, Go (without `unsafe.Pointer`/cgo), or managed languages (Java, C#, Python) is almost always a false positive: the type system or runtime prevents it. Verify whether the code is in an `unsafe` block (Rust), uses cgo/`unsafe.Pointer` (Go), or calls native code via JNI/P/Invoke. If the code is entirely in the safe subset, reject the memory corruption claim unless it involves a compiler bug or soundness hole.
22
+
23
+ **Verify:**
24
+
25
+ - What exactly gets corrupted? (which object, field, or memory region)
26
+ - What is the corruption size and offset? Can the attacker control them?
27
+ - Is the corruption a useful exploitation primitive (arbitrary read/write, vtable overwrite, function pointer overwrite) or just a crash?
28
+ - What allocator is in use (glibc, tcmalloc, jemalloc, Windows heap)? Does it have hardening that blocks exploitation?
29
+ - For UAF: trace the object lifetime: what frees it, what reuses the memory, can the attacker control the replacement object?
30
+ - For type confusion: prove the type mismatch exists and that misinterpretation of the data leads to a useful primitive.
31
+
32
+ ## Logic Bugs
33
+
34
+ Authentication bypass, access control errors, incorrect state transitions, confused deputy, privilege escalation through API misuse.
35
+
36
+ **Verify:**
37
+
38
+ - Check against the specification, RFC, or design docs: not just the code. Does the implementation match the intended behavior?
39
+ - Map all state transitions. Can the system reach a state the developer didn't anticipate?
40
+ - Identify implicit assumptions that are never enforced in code.
41
+ - For auth bugs: verify ALL authentication/authorization paths, not just the one that appears broken. Is there a secondary check that catches it?
42
+ - Logic bugs pass every bounds check and mathematical proof: don't let clean static analysis convince you it's a false positive.
43
+
44
+ ## Race Conditions
45
+
46
+ TOCTOU, data races, signal handling races, concurrent state modification.
47
+
48
+ **Verify:**
49
+
50
+ - What is the actual race window? Is it nanoseconds or seconds?
51
+ - Can the attacker widen the window (e.g., by stalling a thread with a slow NFS mount, large allocation, or CPU contention)?
52
+ - Verify the threading model: what threads/processes can actually access this data concurrently?
53
+ - Check all synchronization primitives in use: mutexes, atomics, RCU, lock-free structures.
54
+ - For TOCTOU on filesystem: can the attacker control the path between check and use (symlink races)?
55
+
56
+ ## Integer Issues
57
+
58
+ Overflow, underflow, truncation, signedness errors, wraparound.
59
+
60
+ **Verify:**
61
+
62
+ - What are the exact integer types and their ranges at every point in the computation?
63
+ - Is the overflow signed (undefined behavior in C/C++: compiler may exploit this) or unsigned (defined wraparound)?
64
+ - Trace the integer through all casts, conversions, and promotions. Where does truncation or sign extension occur?
65
+ - After the integer issue occurs, is the resulting value actually used in a dangerous way (allocation size, array index, loop bound)?
66
+ - Check if compiler warnings (`-Wconversion`, `-Wsign-compare`) flag this.
67
+
68
+ ## Crypto Weaknesses
69
+
70
+ Weak algorithms, bad parameters, nonce reuse, padding oracle, insufficient randomness, timing side channels.
71
+
72
+ **Verify:**
73
+
74
+ - Check parameter choices against current standards (NIST, IETF) and known attacks. "AES-128" is fine; "DES" is not.
75
+ - Verify randomness sources. Is the PRNG cryptographically secure? Is it properly seeded?
76
+ - For nonce reuse: prove the same nonce can actually be used twice in practice, not just theoretically.
77
+ - For timing side channels: is the code actually reachable by an attacker who can measure timing? Network jitter may make remote timing attacks impractical.
78
+ - Compare the implementation against a reference implementation or test vectors from the spec.
79
+
80
+ ## Injection
81
+
82
+ SQL injection, XSS, command injection, server-side template injection, path traversal, LDAP injection.
83
+
84
+ **Verify:**
85
+
86
+ - Trace attacker input from entry point to the sink (query, command, template, filesystem path). Is there any sanitization or escaping along the way?
87
+ - Check if the framework provides automatic escaping (e.g., parameterized queries, template auto-escaping). If so, is it actually enabled and not bypassed?
88
+ - For XSS: what context does the input land in (HTML body, attribute, JavaScript, URL)? Each requires different escaping.
89
+ - For path traversal: is the path canonicalized before the access check? Can `../` or null bytes bypass validation?
90
+ - Follow the actual payload through all intermediate processing (by reading the code, or by running it outside the repository): encoding, decoding, and transformation steps may neutralize or enable the payload.
91
+
92
+ ## Information Disclosure
93
+
94
+ Uninitialized memory reads, error message leaks, timing side channels, padding oracles.
95
+
96
+ **Verify:**
97
+
98
+ - What specific data leaks? Not all leaks are equal: a stack leak revealing ASLR base or canary is critical; one revealing a static string is worthless.
99
+ - Is the leaked data actually useful to an attacker for further exploitation (ASLR bypass, session tokens, crypto keys)?
100
+ - For uninitialized memory: prove the memory is actually uninitialized at the point of read, not just potentially uninitialized on some code path.
101
+ - For timing side channels: can the attacker make enough measurements with sufficient precision? What's the noise level?
102
+ - For error messages: does the error path actually reach the attacker, or is it logged server-side only?
103
+
104
+ ## Denial of Service
105
+
106
+ Algorithmic complexity, resource exhaustion, crash bugs, infinite loops, memory bombs.
107
+
108
+ **Verify:**
109
+
110
+ - What is the resource consumption ratio? Attacker sends X bytes, server consumes Y resources. Is the amplification meaningful?
111
+ - Can the resource be reclaimed (connection closes, memory freed) or is it permanent exhaustion?
112
+ - For algorithmic complexity: what is the actual worst-case input? Prove it triggers worst-case behavior, don't just claim O(n²).
113
+ - For crash bugs: is the crash reliably triggerable, or does it depend on specific heap/stack layout?
114
+ - Does the service restart automatically? A crash that causes a 100ms restart is different from one that requires manual intervention.
115
+
116
+ ## Deserialization
117
+
118
+ Unsafe deserialization, object injection, gadget chain exploitation.
119
+
120
+ **Verify:**
121
+
122
+ - Does the attacker actually control the serialized data that reaches the deserialization call?
123
+ - Does a usable gadget chain exist in the classpath/import graph? Without a gadget chain, unsafe deserialization is a design smell, not an exploitable bug.
124
+ - What deserialization library and version is in use? Are there known gadget chains for it?
125
+ - Are there type restrictions, allowlists, or look-ahead deserialization filters that block dangerous classes?
126
+ - For language-specific: Java `ObjectInputStream`, Python `pickle`, PHP `unserialize`, .NET `BinaryFormatter` each have different exploitation characteristics.
127
+
128
+ Part of the `false-positive-check` skill, adapted from https://github.com/trailofbits/skills/tree/main/plugins/fp-check (commit 5c99c03fb8a9ea568432ecbcba5d86e9f4ac2bf0), CC BY-SA 4.0. Changed: punctuation and small wording changes for read-only runs.