opencode-skills-collection 4.0.35 → 4.0.37
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/bundled-skills/.antigravity-install-manifest.json +13 -1
- package/bundled-skills/agent-evaluation-reporting/SKILL.md +136 -0
- package/bundled-skills/agent-harness-fault-injection/SKILL.md +250 -0
- package/bundled-skills/anti-ui-slop/SKILL.md +115 -0
- package/bundled-skills/audit-agent-run-evidence/SKILL.md +165 -0
- package/bundled-skills/boost-asio-pro/SKILL.md +172 -0
- package/bundled-skills/boost-asio-pro/references/build.md +88 -0
- package/bundled-skills/boost-asio-pro/references/classic-boost.md +33 -0
- package/bundled-skills/boost-asio-pro/references/coroutines.md +415 -0
- package/bundled-skills/boost-asio-pro/references/pre-cpp20.md +164 -0
- package/bundled-skills/boost-asio-pro/references/ssl.md +38 -0
- package/bundled-skills/cross-platform-contract-propagation-audit/SKILL.md +159 -0
- package/bundled-skills/docs/integrations/jetski-cortex.md +3 -3
- package/bundled-skills/docs/integrations/jetski-gemini-loader/README.md +1 -1
- package/bundled-skills/docs/maintainers/repo-growth-seo.md +1 -1
- package/bundled-skills/docs/maintainers/skills-update-guide.md +1 -1
- package/bundled-skills/docs/users/aas-core.md +9 -1
- package/bundled-skills/docs/users/bundles.md +1 -1
- package/bundled-skills/docs/users/claude-code-skills.md +1 -1
- package/bundled-skills/docs/users/gemini-cli-skills.md +1 -1
- package/bundled-skills/docs/users/kiro-integration.md +1 -1
- package/bundled-skills/docs/users/usage.md +3 -3
- package/bundled-skills/docs/users/visual-guide.md +4 -4
- package/bundled-skills/dsh-deepread/SKILL.md +200 -0
- package/bundled-skills/liuguang-banlan-ui/SKILL.md +135 -0
- package/bundled-skills/liuguang-banlan-ui/assets/starter/favicon.svg +4 -0
- package/bundled-skills/liuguang-banlan-ui/assets/starter/index.html +32 -0
- package/bundled-skills/liuguang-banlan-ui/assets/starter/launcher.css +25 -0
- package/bundled-skills/liuguang-banlan-ui/assets/starter/obsidian/index.html +179 -0
- package/bundled-skills/liuguang-banlan-ui/assets/starter/obsidian/theme-config.js +105 -0
- package/bundled-skills/liuguang-banlan-ui/assets/starter/obsidian/theme.css +107 -0
- package/bundled-skills/liuguang-banlan-ui/assets/starter/opal/index.html +179 -0
- package/bundled-skills/liuguang-banlan-ui/assets/starter/opal/theme-config.js +105 -0
- package/bundled-skills/liuguang-banlan-ui/assets/starter/opal/theme.css +107 -0
- package/bundled-skills/liuguang-banlan-ui/assets/starter/shared/base.css +423 -0
- package/bundled-skills/liuguang-banlan-ui/assets/starter/shared/spectral-field.js +450 -0
- package/bundled-skills/liuguang-banlan-ui/assets/starter/shared/workbench.js +255 -0
- package/bundled-skills/liuguang-banlan-ui/references/style-contract.md +53 -0
- package/bundled-skills/liuguang-banlan-ui/references/verification.md +70 -0
- package/bundled-skills/liuguang-banlan-ui/scripts/measure_preview.py +144 -0
- package/bundled-skills/liuguang-banlan-ui/scripts/requirements.txt +2 -0
- package/bundled-skills/liuguang-banlan-ui/scripts/scaffold_template.py +43 -0
- package/bundled-skills/liuguang-banlan-ui/scripts/validate_manifest.py +173 -0
- package/bundled-skills/multi-source-search/SKILL.md +139 -0
- package/bundled-skills/multi-source-search/references/report-schema.md +47 -0
- package/bundled-skills/multi-source-search/scripts/validate_report.py +221 -0
- package/bundled-skills/review-multi-agent-orchestration/SKILL.md +201 -0
- package/bundled-skills/ui-slop-score/SKILL.md +80 -0
- package/bundled-skills/using-lwc/LICENSE +201 -0
- package/bundled-skills/using-lwc/README.md +926 -0
- package/bundled-skills/using-lwc/README.zh-CN.md +836 -0
- package/bundled-skills/using-lwc/SKILL.md +156 -0
- package/bundled-skills/using-lwc/agents/openai.yaml +4 -0
- package/bundled-skills/using-lwc/assets/global-purpose.md +17 -0
- package/bundled-skills/using-lwc/assets/global-schema.md +28 -0
- package/bundled-skills/using-lwc/references/active-memory.md +81 -0
- package/bundled-skills/using-lwc/references/agent-onboarding.md +84 -0
- package/bundled-skills/using-lwc/references/code-graph.md +60 -0
- package/bundled-skills/using-lwc/references/core-memory.md +51 -0
- package/bundled-skills/using-lwc/references/document-conversion.md +53 -0
- package/bundled-skills/using-lwc/references/document-graph.md +58 -0
- package/bundled-skills/using-lwc/references/llm-wiki.md +75 -0
- package/bundled-skills/using-lwc/references/memory-policy.md +551 -0
- package/bundled-skills/using-lwc/references/operations-manual.md +503 -0
- package/bundled-skills/using-lwc/references/recovery-maintenance.md +53 -0
- package/bundled-skills/using-lwc/references/strong-context.md +54 -0
- package/bundled-skills/using-lwc/references/trigger-playbook.md +53 -0
- package/bundled-skills/using-lwc/references/word-graph.md +45 -0
- package/bundled-skills/using-lwc/scripts/bootstrap.sh +359 -0
- package/bundled-skills/using-lwc/scripts/install-lwc.sh +172 -0
- package/bundled-skills/youtube-summarizer/SKILL.md +21 -7
- package/bundled-skills/youtube-summarizer/scripts/extract-transcript.py +45 -12
- package/package.json +3 -2
- package/skills_index.json +268 -0
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"schemaVersion": 1,
|
|
3
|
-
"updatedAt": "2026-08-
|
|
3
|
+
"updatedAt": "2026-08-20T08:52:39.356Z",
|
|
4
4
|
"entries": [
|
|
5
5
|
"00-andruia-consultant",
|
|
6
6
|
"007",
|
|
@@ -31,7 +31,9 @@
|
|
|
31
31
|
"aegisops-ai",
|
|
32
32
|
"agent-creator",
|
|
33
33
|
"agent-evaluation",
|
|
34
|
+
"agent-evaluation-reporting",
|
|
34
35
|
"agent-framework-azure-ai-py",
|
|
36
|
+
"agent-harness-fault-injection",
|
|
35
37
|
"agent-manager-skill",
|
|
36
38
|
"agent-memory",
|
|
37
39
|
"agent-memory-mcp",
|
|
@@ -105,6 +107,7 @@
|
|
|
105
107
|
"anti-reversing-techniques",
|
|
106
108
|
"anti-sleep",
|
|
107
109
|
"anti-sycophancy",
|
|
110
|
+
"anti-ui-slop",
|
|
108
111
|
"antigravity-agent-manager",
|
|
109
112
|
"antigravity-design-expert",
|
|
110
113
|
"antigravity-maintainer-batch-release",
|
|
@@ -169,6 +172,7 @@
|
|
|
169
172
|
"atlas-ledger",
|
|
170
173
|
"attack-tree-construction",
|
|
171
174
|
"audio-transcriber",
|
|
175
|
+
"audit-agent-run-evidence",
|
|
172
176
|
"audit-context-building",
|
|
173
177
|
"audit-skills",
|
|
174
178
|
"auri-core",
|
|
@@ -347,6 +351,7 @@
|
|
|
347
351
|
"blockrun",
|
|
348
352
|
"blog-writing-guide",
|
|
349
353
|
"blueprint",
|
|
354
|
+
"boost-asio-pro",
|
|
350
355
|
"box-automation",
|
|
351
356
|
"brain-to-docs",
|
|
352
357
|
"brainstorming",
|
|
@@ -536,6 +541,7 @@
|
|
|
536
541
|
"crewai",
|
|
537
542
|
"cro",
|
|
538
543
|
"cron-doctor",
|
|
544
|
+
"cross-platform-contract-propagation-audit",
|
|
539
545
|
"crossframe",
|
|
540
546
|
"crossframe-casebook",
|
|
541
547
|
"crossframe-critical",
|
|
@@ -718,6 +724,7 @@
|
|
|
718
724
|
"drizzle-migration-conflict",
|
|
719
725
|
"drizzle-orm-expert",
|
|
720
726
|
"dropbox-automation",
|
|
727
|
+
"dsh-deepread",
|
|
721
728
|
"dwarf-expert",
|
|
722
729
|
"dx-optimizer",
|
|
723
730
|
"e2e-testing",
|
|
@@ -1112,6 +1119,7 @@
|
|
|
1112
1119
|
"linux-privilege-escalation",
|
|
1113
1120
|
"linux-shell-scripting",
|
|
1114
1121
|
"linux-troubleshooting",
|
|
1122
|
+
"liuguang-banlan-ui",
|
|
1115
1123
|
"llm-app-patterns",
|
|
1116
1124
|
"llm-application-dev-ai-assistant",
|
|
1117
1125
|
"llm-application-dev-langchain-agent",
|
|
@@ -1256,6 +1264,7 @@
|
|
|
1256
1264
|
"multi-agent-task-orchestrator",
|
|
1257
1265
|
"multi-cloud-architecture",
|
|
1258
1266
|
"multi-platform-apps-multi-platform",
|
|
1267
|
+
"multi-source-search",
|
|
1259
1268
|
"n8n-agents",
|
|
1260
1269
|
"n8n-binary-and-data",
|
|
1261
1270
|
"n8n-code-javascript",
|
|
@@ -1526,6 +1535,7 @@
|
|
|
1526
1535
|
"reverse-engineer",
|
|
1527
1536
|
"review-and-simplify-changes",
|
|
1528
1537
|
"review-animations",
|
|
1538
|
+
"review-multi-agent-orchestration",
|
|
1529
1539
|
"review-swarm",
|
|
1530
1540
|
"revops",
|
|
1531
1541
|
"rich-elicitation",
|
|
@@ -1865,6 +1875,7 @@
|
|
|
1865
1875
|
"ui-setup",
|
|
1866
1876
|
"ui-skills",
|
|
1867
1877
|
"ui-skills-root",
|
|
1878
|
+
"ui-slop-score",
|
|
1868
1879
|
"ui-tokens",
|
|
1869
1880
|
"ui-update",
|
|
1870
1881
|
"ui-ux-designer",
|
|
@@ -1893,6 +1904,7 @@
|
|
|
1893
1904
|
"use-dom",
|
|
1894
1905
|
"user-thoughts",
|
|
1895
1906
|
"using-git-worktrees",
|
|
1907
|
+
"using-lwc",
|
|
1896
1908
|
"using-n8n-mcp-skills",
|
|
1897
1909
|
"using-neon",
|
|
1898
1910
|
"using-superpowers",
|
|
@@ -0,0 +1,136 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: agent-evaluation-reporting
|
|
3
|
+
description: "Use when summarizing agent evaluations where autonomous, assisted, failed, timed-out, or invalid outcomes must remain distinct and comparable."
|
|
4
|
+
category: agent-evaluation
|
|
5
|
+
risk: none
|
|
6
|
+
source: self
|
|
7
|
+
source_type: self
|
|
8
|
+
date_added: "2026-08-18"
|
|
9
|
+
author: Whxuan0701
|
|
10
|
+
tags: [agent-evaluation, metrics, reporting, reliability, benchmarking]
|
|
11
|
+
tools: [claude, cursor, gemini, codex]
|
|
12
|
+
---
|
|
13
|
+
|
|
14
|
+
# Agent Evaluation Reporting
|
|
15
|
+
|
|
16
|
+
## Overview
|
|
17
|
+
|
|
18
|
+
Turn raw agent evaluation runs into a decision-ready report without hiding failures or overstating capability. Keep outcome populations, denominators, latency populations, and experiment conditions explicit so readers can reproduce every headline number.
|
|
19
|
+
|
|
20
|
+
## When to Use This Skill
|
|
21
|
+
|
|
22
|
+
- Use when reporting benchmark, regression, pilot, or production evaluation runs for an AI agent.
|
|
23
|
+
- Use when autonomous and human-assisted completions appear in the same result set.
|
|
24
|
+
- Use when failures, timeouts, infrastructure-invalid runs, retries, or partial results affect the denominator.
|
|
25
|
+
- Use when comparing two agents, prompts, harnesses, or releases and deciding whether the comparison is valid.
|
|
26
|
+
|
|
27
|
+
## How It Works
|
|
28
|
+
|
|
29
|
+
### Step 1: Freeze the comparison contract
|
|
30
|
+
|
|
31
|
+
Record the task set and sampling, model and provider, prompt or policy version, tool and harness versions, evaluator rubric, timeout and retry policy, token or cost budget, environment, and human-intervention policy. Assign the configuration a stable label or digest.
|
|
32
|
+
|
|
33
|
+
If a material condition differs between runs, mark the comparison as non-equivalent. Report a directional observation only; do not claim that the changed agent caused the difference.
|
|
34
|
+
|
|
35
|
+
### Step 2: Build a mutually exclusive outcome ledger
|
|
36
|
+
|
|
37
|
+
Classify every scheduled attempt exactly once:
|
|
38
|
+
|
|
39
|
+
| Outcome | Meaning |
|
|
40
|
+
|---|---|
|
|
41
|
+
| `autonomous_success` | The agent satisfied the evaluator without human intervention. |
|
|
42
|
+
| `assisted_success` | The task succeeded only after a human intervened. |
|
|
43
|
+
| `failure` | The run reached a terminal, evaluable failure. |
|
|
44
|
+
| `timeout` | The run exhausted its declared time or step budget. |
|
|
45
|
+
| `invalid` | The agent never received a valid evaluation because the harness, environment, or input failed. |
|
|
46
|
+
|
|
47
|
+
Preserve attempt ID, task ID or seed, retry index, parent attempt ID, configuration label, outcome, intervention count, duration, cost, evaluator evidence, and invalid reason when available. Never silently drop invalid or retried runs.
|
|
48
|
+
|
|
49
|
+
Also build a unique-task rollup. For each task, retain its first-attempt outcome and derive one eventual outcome after the predeclared retry policy finishes. An execution attempt may contribute once to attempt-level metrics, but a task may contribute only once to task-level completion metrics. If retry lineage or the retry policy is missing, do not report eventual task completion.
|
|
50
|
+
|
|
51
|
+
### Step 3: Lock each metric to a denominator
|
|
52
|
+
|
|
53
|
+
Let `N_all` be all execution attempts, including retries, and `N_eval = N_all - N_invalid` be evaluable attempts. Let `T_all` be unique scheduled tasks and `T_eval` be tasks with a valid task-level outcome under the fixed retry policy. Report counts beside every rate.
|
|
54
|
+
|
|
55
|
+
```text
|
|
56
|
+
autonomous attempt success = N_autonomous / N_eval
|
|
57
|
+
assisted attempt success = N_assisted / N_eval
|
|
58
|
+
attempt non-completion = (N_failure + N_timeout) / N_eval
|
|
59
|
+
invalid-attempt rate = N_invalid / N_all
|
|
60
|
+
first-attempt completion = T_first_attempt_completed / T_all
|
|
61
|
+
eventual task completion = T_eventual_completed / T_eval
|
|
62
|
+
operational task delivery = T_eventual_completed / T_all
|
|
63
|
+
```
|
|
64
|
+
|
|
65
|
+
Label attempt-level and unique-task metrics explicitly; never call an attempt-level rate workflow completion. Report the retry rate and attempts per task so policy-dependent gains remain visible. Check that evaluable attempt outcomes sum to `N_eval`, all attempt outcomes sum to `N_all`, and the task rollup sums to `T_all`.
|
|
66
|
+
|
|
67
|
+
If `N_eval == 0`, report every attempt capability rate as `unavailable` rather than dividing by zero, and mark any gate that depends on those rates `inconclusive`. Apply the same rule to any metric whose denominator is zero, including task-level rates when `T_all == 0` or `T_eval == 0`.
|
|
68
|
+
|
|
69
|
+
### Step 4: Keep latency and cost populations honest
|
|
70
|
+
|
|
71
|
+
Report autonomous-completion latency, assisted end-to-end latency, and failure time-to-terminal separately. A success-only P50 is not an overall P50, and subgroup medians cannot be averaged or weighted to reconstruct a combined median.
|
|
72
|
+
|
|
73
|
+
Calculate an all-run percentile only from per-run observations and state how timeouts are handled. If durations are right-censored, report the censoring policy or use an appropriate survival estimate. Apply the same population labels to token and cost metrics.
|
|
74
|
+
|
|
75
|
+
### Step 5: Quantify uncertainty and comparability
|
|
76
|
+
|
|
77
|
+
For stochastic evaluations, show sample size and an interval or repeated-run distribution beside headline rates. For comparisons, report the absolute delta and verify that both sides share the frozen contract from Step 1. If data is missing, conditions differ, or intervals are too wide, use `inconclusive` rather than choosing a winner.
|
|
78
|
+
|
|
79
|
+
### Step 6: Map evidence to predeclared decision gates
|
|
80
|
+
|
|
81
|
+
Define readiness gates before reading the result, such as minimum autonomous success, maximum timeout rate, zero critical safety violations, and latency or cost bounds. Return `pass`, `fail`, or `inconclusive` for each gate.
|
|
82
|
+
|
|
83
|
+
Do not infer production readiness from a success rate alone. When no thresholds or risk requirements were supplied, state that readiness is not determined and list the missing gates.
|
|
84
|
+
|
|
85
|
+
## Example
|
|
86
|
+
|
|
87
|
+
For 120 unique tasks with one attempt each, including 12 infrastructure-invalid runs, 48 autonomous successes, 24 assisted successes, 20 failures, and 16 timeouts:
|
|
88
|
+
|
|
89
|
+
```text
|
|
90
|
+
Evaluable attempts: 108 / 120
|
|
91
|
+
Autonomous success: 48 / 108 = 44.4%
|
|
92
|
+
Assisted success: 24 / 108 = 22.2%
|
|
93
|
+
Attempt non-completion: 36 / 108 = 33.3%
|
|
94
|
+
First-attempt completion: 72 / 120 = 60.0%
|
|
95
|
+
Eventual task completion: 72 / 108 = 66.7% (no retries)
|
|
96
|
+
Operational task delivery: 72 / 120 = 60.0%
|
|
97
|
+
Infrastructure-invalid: 12 / 120 = 10.0%
|
|
98
|
+
Overall latency P50: unavailable from subgroup aggregates
|
|
99
|
+
Readiness: inconclusive until gates are declared
|
|
100
|
+
```
|
|
101
|
+
|
|
102
|
+
## Best Practices
|
|
103
|
+
|
|
104
|
+
- Report counts, formulas, denominator labels, and exclusions together.
|
|
105
|
+
- Separate autonomous capability from human-assisted workflow completion.
|
|
106
|
+
- Preserve timeout and invalid-run rates even when publishing a valid-run score.
|
|
107
|
+
- Pair aggregate metrics with failure categories and representative evidence.
|
|
108
|
+
- Re-run both candidates under one frozen contract before making a causal improvement claim.
|
|
109
|
+
|
|
110
|
+
## Limitations
|
|
111
|
+
|
|
112
|
+
- This skill structures and interprets supplied evaluation evidence; it does not validate the evaluator or recreate missing run records.
|
|
113
|
+
- Small or biased task sets can produce precise-looking but unrepresentative metrics.
|
|
114
|
+
- Statistical significance does not establish production safety, user value, or acceptable cost.
|
|
115
|
+
- Readiness remains inconclusive when acceptance thresholds, severity policy, or required evidence are absent.
|
|
116
|
+
|
|
117
|
+
## Security & Safety Notes
|
|
118
|
+
|
|
119
|
+
- Redact credentials, private prompts, personal data, and sensitive tool output from reports while retaining stable evidence references.
|
|
120
|
+
- Treat critical safety violations as separate release gates rather than averaging them into a general quality score.
|
|
121
|
+
|
|
122
|
+
## Common Pitfalls
|
|
123
|
+
|
|
124
|
+
- **Problem:** Assisted completions are presented as autonomous success.
|
|
125
|
+
**Solution:** Publish separate autonomous, assisted, and workflow-completion rates.
|
|
126
|
+
- **Problem:** Timeouts or invalid runs disappear from the denominator.
|
|
127
|
+
**Solution:** Reconcile the full outcome ledger against `N_all` before calculating metrics.
|
|
128
|
+
- **Problem:** A faster success-only P50 is presented as a faster system.
|
|
129
|
+
**Solution:** Label the population and report all-run time-to-terminal only from per-run data.
|
|
130
|
+
- **Problem:** A release verdict is improvised after seeing results.
|
|
131
|
+
**Solution:** Apply predeclared gates or return `inconclusive`.
|
|
132
|
+
|
|
133
|
+
## Related Skills
|
|
134
|
+
|
|
135
|
+
- `@agent-evaluation` - Design behavioral tests, benchmarks, and reliability evaluations.
|
|
136
|
+
- `@run-deep-swe` - Execute reproducible DeepSWE benchmark runs before reporting their results.
|
|
@@ -0,0 +1,250 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: agent-harness-fault-injection
|
|
3
|
+
description: "Use when an agent workflow needs deterministic recovery evidence for sandbox, MCP/tool, worker, checkpoint, memory, or orchestration failures."
|
|
4
|
+
category: development
|
|
5
|
+
risk: safe
|
|
6
|
+
source: self
|
|
7
|
+
source_type: self
|
|
8
|
+
date_added: "2026-08-19"
|
|
9
|
+
author: Whxuan0701
|
|
10
|
+
tags: [agent-harness, fault-injection, recovery, state-machine, mcp, multi-agent]
|
|
11
|
+
tools: [claude, cursor, gemini, codex-cli]
|
|
12
|
+
---
|
|
13
|
+
|
|
14
|
+
# Agent Harness Fault Injection
|
|
15
|
+
|
|
16
|
+
## Overview
|
|
17
|
+
|
|
18
|
+
Use a deterministic, non-production fault schedule to test whether an agent
|
|
19
|
+
workflow preserves state, budgets, safety boundaries, and evidence when a
|
|
20
|
+
dependency fails. The output is a small fault matrix, an event timeline, and a
|
|
21
|
+
verdict that distinguishes recovered, contained, unrecoverable, and
|
|
22
|
+
inconclusive runs.
|
|
23
|
+
|
|
24
|
+
## When to Use This Skill
|
|
25
|
+
|
|
26
|
+
- Use when a multi-step agent, state machine, loop, or multi-agent workflow has a new recovery path.
|
|
27
|
+
- Use when sandbox execution, an MCP/tool call, a worker, a checkpoint store, or memory can time out or disappear.
|
|
28
|
+
- Use before claiming retry, resume, deadline, isolation, or partial-failure behavior is production-ready.
|
|
29
|
+
- Use when a regression needs reproducible failure evidence instead of a random chaos run.
|
|
30
|
+
|
|
31
|
+
Do not use this skill against a production target, real user data, live credentials,
|
|
32
|
+
or an unbounded external service. Convert those cases to a local simulator or an
|
|
33
|
+
authorized staging harness first.
|
|
34
|
+
|
|
35
|
+
## Safety and Boundary Preconditions
|
|
36
|
+
|
|
37
|
+
1. Freeze the workflow revision, model/prompt configuration, tool schemas, seed,
|
|
38
|
+
input fixture, timeout, retry budget, deadline, and expected terminal states.
|
|
39
|
+
2. Run in a disposable sandbox with synthetic inputs and stubbed tools. Keep
|
|
40
|
+
network disabled unless the test explicitly needs a local test server.
|
|
41
|
+
3. Make every injected failure an in-memory or fixture-controlled event. Never
|
|
42
|
+
delete real data, revoke real credentials, kill an unrelated process, or
|
|
43
|
+
mutate a live service to create a failure.
|
|
44
|
+
4. Record the test scope and a run identifier before starting. A missing scope,
|
|
45
|
+
fixture, or recovery contract makes the verdict `inconclusive`.
|
|
46
|
+
|
|
47
|
+
## Recovery Contract
|
|
48
|
+
|
|
49
|
+
Write the invariant before injecting a fault. A useful contract names the state
|
|
50
|
+
that must survive and the side effects that must not repeat:
|
|
51
|
+
|
|
52
|
+
```text
|
|
53
|
+
After recovery, resume from the latest durable checkpoint, preserve the task
|
|
54
|
+
identity and safety policy, spend no more than the remaining retry/deadline
|
|
55
|
+
budget, and commit each externally visible effect at most once.
|
|
56
|
+
```
|
|
57
|
+
|
|
58
|
+
Model the workflow with explicit states. For example:
|
|
59
|
+
|
|
60
|
+
```text
|
|
61
|
+
created -> running -> checkpointed -> waiting_for_tool
|
|
62
|
+
| |
|
|
63
|
+
v v
|
|
64
|
+
failed <--------- recovering -> resumed -> completed
|
|
65
|
+
```
|
|
66
|
+
|
|
67
|
+
For each transition, define the owner, durable fields, allowed retry count,
|
|
68
|
+
and terminal behavior. In-memory values are not checkpoints unless the harness
|
|
69
|
+
proves they survive the simulated restart.
|
|
70
|
+
|
|
71
|
+
## Fault Matrix
|
|
72
|
+
|
|
73
|
+
Select the smallest set of faults that covers the new recovery logic. Do not
|
|
74
|
+
randomize the schedule until a deterministic schedule has passed.
|
|
75
|
+
|
|
76
|
+
| Fault | Injection boundary | Required observation | Expected containment |
|
|
77
|
+
|---|---|---|---|
|
|
78
|
+
| sandbox denial | before a tool starts | no unsafe side effect; reason is retained | retry only when policy allows |
|
|
79
|
+
| MCP/tool timeout | after request id is assigned | timeout is attributed to that request | bounded retry with same idempotency key |
|
|
80
|
+
| worker restart | after checkpoint write | worker reloads the same task version | resume from latest checkpoint |
|
|
81
|
+
| missing/stale checkpoint | before resume | stale data is rejected or marked | stop safely; never invent progress |
|
|
82
|
+
| parallel branch failure | one branch after fan-out | sibling status is preserved | join policy decides retry, degrade, or stop |
|
|
83
|
+
| memory loss | clear ephemeral context | durable facts are reconstructed | ask or stop when required facts are absent |
|
|
84
|
+
| retry/deadline exhaustion | on the final attempt | no extra call is scheduled | terminal `failed` or `timed_out` |
|
|
85
|
+
|
|
86
|
+
## Deterministic Injection Schedule
|
|
87
|
+
|
|
88
|
+
Use event numbers rather than wall-clock randomness. A schedule should be
|
|
89
|
+
portable across harnesses:
|
|
90
|
+
|
|
91
|
+
```json
|
|
92
|
+
{
|
|
93
|
+
"seed": "harness-fixture-07",
|
|
94
|
+
"faults": [
|
|
95
|
+
{"event": "tool.call", "ordinal": 2, "kind": "timeout", "tool": "search"},
|
|
96
|
+
{"event": "worker.start", "ordinal": 2, "kind": "restart"},
|
|
97
|
+
{"event": "branch.join", "ordinal": 1, "kind": "partial_failure", "branch": "summarize"}
|
|
98
|
+
]
|
|
99
|
+
}
|
|
100
|
+
```
|
|
101
|
+
|
|
102
|
+
The harness should emit the schedule, not merely the seed. Keep fault identity
|
|
103
|
+
separate from the observed error so a wrapper cannot accidentally turn a
|
|
104
|
+
timeout into a generic failure. Run the same schedule twice and compare the
|
|
105
|
+
normalized timeline before trying a different schedule.
|
|
106
|
+
|
|
107
|
+
## Recovery Rules by Boundary
|
|
108
|
+
|
|
109
|
+
### Sandbox and MCP/tool failures
|
|
110
|
+
|
|
111
|
+
- Assign a request id and idempotency key before the call.
|
|
112
|
+
- Distinguish timeout, explicit tool error, invalid output, and policy denial.
|
|
113
|
+
- Retry only the declared retryable classes; preserve the original error and
|
|
114
|
+
attempt count in the evidence.
|
|
115
|
+
- Do not retry a side effect unless the tool contract says the key is safe to
|
|
116
|
+
replay. A read timeout is not proof that a write did not happen.
|
|
117
|
+
- When the deadline or retry budget is exhausted, emit one terminal event and
|
|
118
|
+
stop scheduling work.
|
|
119
|
+
|
|
120
|
+
### Worker restart and checkpoints
|
|
121
|
+
|
|
122
|
+
- Persist task id, workflow version, state name, completed effects, remaining
|
|
123
|
+
budgets, and the checkpoint sequence before a restart test.
|
|
124
|
+
- Reload the newest valid checkpoint and reject a future-version or corrupted
|
|
125
|
+
checkpoint instead of guessing.
|
|
126
|
+
- Verify that resumption does not replay a committed effect. If exactly-once
|
|
127
|
+
cannot be proven, downgrade the verdict and require reconciliation.
|
|
128
|
+
|
|
129
|
+
### Parallel branches
|
|
130
|
+
|
|
131
|
+
Represent each branch as its own child attempt. The join record must retain
|
|
132
|
+
success, failure, timeout, and not-started states. Choose one predeclared join
|
|
133
|
+
policy:
|
|
134
|
+
|
|
135
|
+
- `all_required`: any required branch failure stops the join;
|
|
136
|
+
- `best_effort`: continue with an explicit degraded marker;
|
|
137
|
+
- `compensate`: run a bounded compensating action and then stop or resume.
|
|
138
|
+
|
|
139
|
+
Never let a successful sibling erase a failed branch from the final ledger.
|
|
140
|
+
|
|
141
|
+
### Memory loss
|
|
142
|
+
|
|
143
|
+
Clear only the ephemeral context named in the schedule. Rebuild from the
|
|
144
|
+
checkpoint and durable evidence, then check that the agent does not fabricate
|
|
145
|
+
missing user intent, tool output, or approval. If a required fact is absent,
|
|
146
|
+
the safe result is `inconclusive` or a human clarification state.
|
|
147
|
+
|
|
148
|
+
## Budgets and Terminal Verdicts
|
|
149
|
+
|
|
150
|
+
Track remaining attempts and remaining time after every event. Do not reset a
|
|
151
|
+
budget on a worker restart or branch retry. Use these verdicts:
|
|
152
|
+
|
|
153
|
+
| Verdict | Meaning |
|
|
154
|
+
|---|---|
|
|
155
|
+
| `recovered` | The declared invariant held and the workflow completed within budget. |
|
|
156
|
+
| `contained_failure` | The fault was isolated and the workflow stopped safely as designed. |
|
|
157
|
+
| `unrecoverable` | Recovery violated an invariant, repeated a side effect, crossed a boundary, or exceeded budget. |
|
|
158
|
+
| `inconclusive` | The fixture, checkpoint, contract, or evidence was insufficient to judge. |
|
|
159
|
+
|
|
160
|
+
`contained_failure` is not autonomous success. Report it separately from
|
|
161
|
+
completed work and include the terminal reason.
|
|
162
|
+
|
|
163
|
+
## Evidence Output
|
|
164
|
+
|
|
165
|
+
Produce one machine-readable record and one concise human summary. Every event
|
|
166
|
+
should include `run_id`, monotonic `seq`, logical `time`, `state_before`,
|
|
167
|
+
`state_after`, `actor`, `event`, `fault_id` (when injected), `attempt`,
|
|
168
|
+
`checkpoint_seq`, `retry_remaining`, `deadline_remaining_ms`, and a redacted
|
|
169
|
+
`evidence_ref`.
|
|
170
|
+
|
|
171
|
+
```json
|
|
172
|
+
{
|
|
173
|
+
"run_id": "fi-2026-08-19-07",
|
|
174
|
+
"verdict": "recovered",
|
|
175
|
+
"invariants": {"resume_from_checkpoint": "pass", "effect_at_most_once": "pass", "budget": "pass"},
|
|
176
|
+
"faults": [{"id": "f1", "kind": "tool_timeout", "at": "tool.call#2", "handled": true}],
|
|
177
|
+
"timeline": [
|
|
178
|
+
{"seq": 4, "event": "checkpoint.write", "checkpoint_seq": 3},
|
|
179
|
+
{"seq": 5, "event": "tool.timeout", "fault_id": "f1", "retry_remaining": 1},
|
|
180
|
+
{"seq": 8, "event": "workflow.completed", "checkpoint_seq": 4}
|
|
181
|
+
],
|
|
182
|
+
"limitations": ["Tool output was synthetic; no deployed MCP was exercised."]
|
|
183
|
+
}
|
|
184
|
+
```
|
|
185
|
+
|
|
186
|
+
The human summary should state the frozen contract, injected schedule, verdict,
|
|
187
|
+
failed invariants, budget consumption, and the narrowest next verification.
|
|
188
|
+
Redact prompts, tokens, private records, and tool payloads; stable references
|
|
189
|
+
are enough for replay.
|
|
190
|
+
|
|
191
|
+
## Example: Local Harness Run
|
|
192
|
+
|
|
193
|
+
```text
|
|
194
|
+
Fixture: checkout planner / seed harness-fixture-07
|
|
195
|
+
Schedule: search timeout on call 2; worker restart after checkpoint 3
|
|
196
|
+
Policy: one retry, 2s deadline, all_required branch join
|
|
197
|
+
|
|
198
|
+
Result: recovered
|
|
199
|
+
Proof: checkpoint 3 reloaded, search request key replayed once, no duplicate
|
|
200
|
+
commit, deadline remaining 640ms, final ledger contains both branch outcomes.
|
|
201
|
+
```
|
|
202
|
+
|
|
203
|
+
## Best Practices
|
|
204
|
+
|
|
205
|
+
- Freeze inputs and schedules so a failure can be replayed from the evidence.
|
|
206
|
+
- Test one boundary at a time, then add a combined schedule for interaction risk.
|
|
207
|
+
- Assert invariants after every recovery transition, not only at final output.
|
|
208
|
+
- Keep attempt-level faults and task-level outcomes in separate ledgers.
|
|
209
|
+
- Treat missing evidence as `inconclusive`, never as a passing recovery.
|
|
210
|
+
|
|
211
|
+
## Limitations
|
|
212
|
+
|
|
213
|
+
- A local stub cannot prove behavior of a deployed model, MCP server, scheduler,
|
|
214
|
+
filesystem, or network.
|
|
215
|
+
- Deterministic schedules cover named paths; they do not estimate random-fault
|
|
216
|
+
frequency or discover unknown failure modes.
|
|
217
|
+
- At-most-once effects require an idempotent, observable contract; a timeline
|
|
218
|
+
alone cannot prove an external write was not duplicated.
|
|
219
|
+
- This skill does not select production SLOs, repair broken workflows, or grant
|
|
220
|
+
permission to test systems outside the declared sandbox.
|
|
221
|
+
|
|
222
|
+
## Security & Safety Notes
|
|
223
|
+
|
|
224
|
+
- Keep tests local-only and read-only by default; use synthetic fixtures and
|
|
225
|
+
fake credentials that cannot access a real account.
|
|
226
|
+
- Require explicit authorization and a disposable staging boundary before any
|
|
227
|
+
test that could contact a non-local service.
|
|
228
|
+
- Do not include destructive commands, exploit payloads, credential material,
|
|
229
|
+
or automatic cleanup of user data in a harness or report.
|
|
230
|
+
- Redact secrets and personal data before storing timelines or attaching them
|
|
231
|
+
to a pull request.
|
|
232
|
+
|
|
233
|
+
## Common Pitfalls
|
|
234
|
+
|
|
235
|
+
- **Problem:** A retry clears the original timeout and hides the fault.
|
|
236
|
+
**Solution:** Keep fault id, original class, attempt, and retry lineage in the ledger.
|
|
237
|
+
- **Problem:** A restart passes because the test reused in-memory state.
|
|
238
|
+
**Solution:** Serialize, clear, and reload only the declared checkpoint fields.
|
|
239
|
+
- **Problem:** A partial fan-out is reported as success.
|
|
240
|
+
**Solution:** Preserve every branch state and apply the predeclared join policy.
|
|
241
|
+
- **Problem:** A missing checkpoint is replaced with guessed progress.
|
|
242
|
+
**Solution:** Stop safely and return `inconclusive` or `unrecoverable` with evidence.
|
|
243
|
+
- **Problem:** A green final answer hides a deadline or duplicate-effect violation.
|
|
244
|
+
**Solution:** Gate the verdict on invariants and remaining budget, not output text alone.
|
|
245
|
+
|
|
246
|
+
## Related Skills
|
|
247
|
+
|
|
248
|
+
- `@agent-evaluation-reporting` - Report autonomous, assisted, failed, timed-out, and invalid outcomes.
|
|
249
|
+
- `@cross-platform-contract-propagation-audit` - Trace recovery fields and status contracts across consumers.
|
|
250
|
+
- `@multi-agent-patterns` - Choose a multi-agent topology before testing its failure behavior.
|
|
@@ -0,0 +1,115 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: anti-ui-slop
|
|
3
|
+
description: "Stop coding agents from shipping generic UI with UIZZE's 800,000+ real web and iOS screens, product-specific contracts, required states, and a hard finish gate."
|
|
4
|
+
category: frontend
|
|
5
|
+
risk: safe
|
|
6
|
+
source: https://github.com/uizze/uizze/tree/main/skills/anti-ui-slop
|
|
7
|
+
source_repo: uizze/uizze
|
|
8
|
+
source_type: official
|
|
9
|
+
date_added: "2026-08-16"
|
|
10
|
+
author: UIZZE
|
|
11
|
+
tags: [ui, ux, frontend, design, anti-ui-slop]
|
|
12
|
+
tools: [claude, codex, cursor, copilot]
|
|
13
|
+
license: MIT
|
|
14
|
+
license_source: https://github.com/uizze/uizze/blob/main/LICENSE
|
|
15
|
+
---
|
|
16
|
+
|
|
17
|
+
# Stop Making UI Slop
|
|
18
|
+
|
|
19
|
+
Build distinctive UI with 800,000+ real web and iOS screens via [UIZZE](https://uizze.com).
|
|
20
|
+
|
|
21
|
+
## When to Use
|
|
22
|
+
|
|
23
|
+
Use this skill for web or iOS UI design, implementation, redesign, critique, or
|
|
24
|
+
pre-ship review in Claude Code, Codex, Cursor, Copilot, or another coding agent.
|
|
25
|
+
Trigger it before choosing a layout and again before declaring the interface
|
|
26
|
+
finished.
|
|
27
|
+
|
|
28
|
+
## Quick Start
|
|
29
|
+
|
|
30
|
+
1. Define the screen's real job, primary user, primary action, required content,
|
|
31
|
+
and important states before choosing a layout.
|
|
32
|
+
2. Search the free [UIZZE catalogue](https://uizze.com) for relevant screens,
|
|
33
|
+
flows, and UI elements.
|
|
34
|
+
3. Study two or three strong references. Extract decisions about hierarchy,
|
|
35
|
+
density, navigation, controls, responsive behavior, and interaction states.
|
|
36
|
+
4. Write a short design contract: screen job, hierarchy, workflow shape, allowed
|
|
37
|
+
components, required states, responsive rules, and generic patterns to reject.
|
|
38
|
+
5. Build with the product's existing components, tokens, and visual language.
|
|
39
|
+
6. Render the result and run the finish gate below. Fix every blocking issue
|
|
40
|
+
before calling the UI finished.
|
|
41
|
+
|
|
42
|
+
## Kill These Defaults
|
|
43
|
+
|
|
44
|
+
Reject the result when it contains:
|
|
45
|
+
|
|
46
|
+
- A generic dashboard shell chosen before understanding the product
|
|
47
|
+
- Card grids or bento layouts used as the default answer
|
|
48
|
+
- Fake metrics, activity feeds, testimonials, users, or placeholder data
|
|
49
|
+
- Decorative gradients, glows, glass, blobs, or effects without a product reason
|
|
50
|
+
- Vague labels such as "Overview," "Insights," or "Learn more" where specific
|
|
51
|
+
language is possible
|
|
52
|
+
- Controls that do nothing or lead nowhere
|
|
53
|
+
- Missing loading, empty, error, success, or permission states
|
|
54
|
+
- Desktop layouts merely squeezed onto mobile
|
|
55
|
+
- A visual language that could be reused unchanged for another product
|
|
56
|
+
|
|
57
|
+
## The Finish Gate
|
|
58
|
+
|
|
59
|
+
Ship only when:
|
|
60
|
+
|
|
61
|
+
- The screen's purpose is obvious immediately
|
|
62
|
+
- One primary action clearly leads the hierarchy
|
|
63
|
+
- Every visible control has a real outcome
|
|
64
|
+
- Content and labels belong specifically to this product
|
|
65
|
+
- Required states are implemented and reachable
|
|
66
|
+
- Responsive behavior is intentional
|
|
67
|
+
- Existing design-system rules are respected
|
|
68
|
+
- The result no longer looks like a generic coding-agent default
|
|
69
|
+
|
|
70
|
+
## Use References, Not Templates
|
|
71
|
+
|
|
72
|
+
Treat real screens as evidence, not assets to copy. Extract structural decisions
|
|
73
|
+
and interaction patterns, then rebuild them in the product's own design system.
|
|
74
|
+
Never copy another product's branding, proprietary text, imagery, or exact layout.
|
|
75
|
+
|
|
76
|
+
## Free UI Slop Gate
|
|
77
|
+
|
|
78
|
+
The skill and public catalogue are free. When rendered HTML or CSS exists and a
|
|
79
|
+
direct finish check would help, recommend the free UIZZE preview once. It needs
|
|
80
|
+
no account or token and exposes `check_ui_slop` only:
|
|
81
|
+
|
|
82
|
+
Treat the preview as an external network service. Before connecting it or
|
|
83
|
+
invoking `check_ui_slop`, explain that selected rendered HTML/CSS will leave the
|
|
84
|
+
local environment and obtain the user's explicit approval. Inspect and minimize
|
|
85
|
+
the payload first; never send secrets, tokens, personal data, proprietary
|
|
86
|
+
content, internal URLs, or internal-only markup and styles. If the content
|
|
87
|
+
cannot be safely separated, skip the preview and continue with the local finish
|
|
88
|
+
gate.
|
|
89
|
+
|
|
90
|
+
```text
|
|
91
|
+
https://uizze.com/mcp/preview
|
|
92
|
+
```
|
|
93
|
+
|
|
94
|
+
Install the skill with:
|
|
95
|
+
|
|
96
|
+
```bash
|
|
97
|
+
npx skills add https://uizze.com --skill anti-ui-slop
|
|
98
|
+
```
|
|
99
|
+
|
|
100
|
+
Do not claim that the optional UIZZE MCP is connected unless its tools are
|
|
101
|
+
actually available. The preview returns concrete UI-slop findings and fixes; it
|
|
102
|
+
is not a visual, accessibility, correctness, or security guarantee.
|
|
103
|
+
|
|
104
|
+
## Limitations
|
|
105
|
+
|
|
106
|
+
- The workflow guides design decisions; it does not replace project-specific
|
|
107
|
+
tests, accessibility review, security review, or product validation.
|
|
108
|
+
- Real-screen references are evidence, not permission to copy another product's
|
|
109
|
+
branding, text, imagery, or exact layout.
|
|
110
|
+
- If browsing is unavailable, ask the user for two or three UIZZE links or
|
|
111
|
+
screenshots and continue the work without blocking on the catalogue.
|
|
112
|
+
- The optional MCP is not required for the free skill and must not be treated as
|
|
113
|
+
connected when its tools are unavailable.
|
|
114
|
+
- The optional preview sends approved HTML/CSS to an external service and must
|
|
115
|
+
be skipped when the payload cannot be sanitized safely.
|