dsh-plugin-t-expert 0.4.51 → 0.4.53

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (64) hide show
  1. package/CHANGELOG.md +56 -0
  2. package/data/roster.json +2220 -743
  3. package/lib/client.js +29 -3
  4. package/lib/fetch-assets.js +3 -0
  5. package/lib/index.js +20 -1
  6. package/lib/remote.js +13 -0
  7. package/package.json +1 -1
  8. package/data/experts/engineering/data-analytics-reporter/agents/data-analytics-reporter.md +0 -174
  9. package/data/experts/engineering/data-analytics-reporter/skills/analytics-reporting/SKILL.md +0 -213
  10. package/data/experts/engineering/data-analytics-reporter/skills/data-quality-assessment/SKILL.md +0 -167
  11. package/data/experts/engineering/data-analytics-reporter/skills/data-visualization/SKILL.md +0 -94
  12. package/data/experts/engineering/data-analytics-reporter/skills/kpi-design/SKILL.md +0 -134
  13. package/data/experts/engineering/data-analytics-reporter/skills/metric-diagnostics/SKILL.md +0 -143
  14. package/data/experts/hr/fbsir-beike-yi/agents/fbsir-beike-yi.md +0 -225
  15. package/data/experts/hr/fbsir-beike-yi/contracts/first-value-contract.json +0 -33
  16. package/data/experts/hr/fbsir-beike-yi/contracts/high-value-delivery.schema.json +0 -36
  17. package/data/experts/hr/fbsir-beike-yi/contracts/material-scope.schema.json +0 -46
  18. package/data/experts/hr/fbsir-beike-yi/contracts/option-decision-contract.json +0 -34
  19. package/data/experts/hr/fbsir-beike-yi/contracts/reuse-capsule.schema.json +0 -28
  20. package/data/experts/hr/fbsir-beike-yi/contracts/teaching-quality-review-contract.json +0 -38
  21. package/data/experts/hr/fbsir-beike-yi/contracts/writeback-contract.json +0 -34
  22. package/data/experts/hr/fbsir-beike-yi/examples/acceptance-cases.json +0 -104
  23. package/data/experts/hr/fbsir-beike-yi/examples/local-workspace-scenarios.json +0 -43
  24. package/data/experts/hr/fbsir-beike-yi/examples/output-structures.md +0 -111
  25. package/data/experts/hr/fbsir-beike-yi/references/evidence-and-source-ledger.md +0 -56
  26. package/data/experts/hr/fbsir-beike-yi/references/user-visible-copy.md +0 -60
  27. package/data/experts/hr/fbsir-beike-yi/references/workbuddy-local-mode-boundary.md +0 -41
  28. package/data/experts/hr/fbsir-beike-yi/skills/lesson-planning-core/SKILL.md +0 -152
  29. package/data/experts/hr/fbsir-beike-yi/skills/lesson-planning-core/references/bounded-revision.md +0 -30
  30. package/data/experts/hr/fbsir-beike-yi/skills/lesson-planning-core/references/high-value-delivery.md +0 -33
  31. package/data/experts/hr/fbsir-beike-yi/skills/lesson-planning-core/references/local-writeback.md +0 -35
  32. package/data/experts/hr/fbsir-beike-yi/skills/lesson-planning-core/references/material-sensemaking.md +0 -43
  33. package/data/experts/hr/fbsir-beike-yi/skills/lesson-planning-core/references/option-decision.md +0 -40
  34. package/data/experts/hr/fbsir-beike-yi/skills/lesson-planning-core/references/reuse-capsule.md +0 -34
  35. package/data/experts/hr/fbsir-beike-yi/skills/lesson-planning-core/references/teaching-quality-review.md +0 -28
  36. package/data/experts/hr/fbsir-beike-yi/skills/lesson-planning-core/templates/high-value-delivery-card.md +0 -35
  37. package/data/experts/hr/fbsir-beike-yi/skills/lesson-planning-core/templates/material-understanding-card.md +0 -47
  38. package/data/experts/hr/fbsir-beike-yi/skills/lesson-planning-core/templates/teaching-option-card.md +0 -38
  39. package/data/experts/marketing/kdocs-ppt-creator/agents/kdocs-ppt-creator.md +0 -42
  40. package/data/experts/marketing/kdocs-ppt-creator/skills/ppt-gen/SKILL.md +0 -164
  41. package/data/experts/marketing/kdocs-ppt-creator/skills/ppt-gen/references/auth.md +0 -32
  42. package/data/experts/marketing/kdocs-ppt-creator/skills/ppt-gen/references/file-locating-guide.md +0 -34
  43. package/data/experts/marketing/kdocs-ppt-creator/skills/ppt-gen/references/wpp/doc_master.md +0 -83
  44. package/data/experts/marketing/kdocs-ppt-creator/skills/ppt-gen/references/wpp/doc_presentation.md +0 -85
  45. package/data/experts/marketing/kdocs-ppt-creator/skills/ppt-gen/references/wpp/doc_shape.md +0 -118
  46. package/data/experts/marketing/kdocs-ppt-creator/skills/ppt-gen/references/wpp/doc_slide.md +0 -94
  47. package/data/experts/marketing/kdocs-ppt-creator/skills/ppt-gen/references/wpp/export.md +0 -178
  48. package/data/experts/marketing/kdocs-ppt-creator/skills/ppt-gen/references/wpp/jsapi_shape.md +0 -131
  49. package/data/experts/marketing/kdocs-ppt-creator/skills/ppt-gen/references/wpp/jsapi_slide.md +0 -126
  50. package/data/experts/marketing/kdocs-ppt-creator/skills/ppt-gen/references/wpp/slide.md +0 -139
  51. package/data/experts/marketing/kdocs-ppt-creator/skills/ppt-gen/references/wpp/theme.md +0 -204
  52. package/data/experts/marketing/kdocs-ppt-creator/skills/ppt-gen/references/wpp.md +0 -164
  53. package/data/experts/specialized/job-companion-team/agents/job-companion-interview.md +0 -74
  54. package/data/experts/specialized/job-companion-team/agents/job-companion-negotiation.md +0 -82
  55. package/data/experts/specialized/job-companion-team/agents/job-companion-reflection.md +0 -87
  56. package/data/experts/specialized/job-companion-team/agents/job-companion-resume.md +0 -82
  57. package/data/experts/specialized/job-companion-team/agents/job-companion-team-lead.md +0 -162
  58. package/data/experts/specialized/job-companion-team/skills/interview-prep/SKILL.md +0 -73
  59. package/data/experts/specialized/job-companion-team/skills/mock-interview/SKILL.md +0 -65
  60. package/data/experts/specialized/job-companion-team/skills/onboarding-reflection/SKILL.md +0 -142
  61. package/data/experts/specialized/job-companion-team/skills/resume-polish/SKILL.md +0 -82
  62. package/data/experts/specialized/job-companion-team/skills/salary-negotiation/SKILL.md +0 -105
  63. package/data/experts/specialized/job-companion-team/skills/self-inventory/SKILL.md +0 -67
  64. package/data/experts/specialized/job-companion-team/skills/target-positioning/SKILL.md +0 -64
@@ -1,167 +0,0 @@
1
- ---
2
- name: data-quality-assessment
3
- description: "Assess whether datasets are trustworthy for analysis, modeling, dashboards, or pipelines; and validate finished analyses before sharing. Use for data quality checks (grain, freshness, nulls, duplicates, schema drift, joins, integrity, distributions) and analysis QA (methodology review, calculation verification, visualization checks, confidence assessment)."
4
- ---
5
-
6
- # Data Quality Assessment & Analysis Validation
7
-
8
- Two complementary capabilities: (1) assess whether a dataset is trustworthy enough for its intended use, and (2) validate a finished analysis before it is shared with stakeholders.
9
-
10
- ## Part A: Data Quality Assessment
11
-
12
- Assess whether a dataset is trustworthy enough for analysis, modeling, dashboards, experiments, or downstream pipelines. Start with the intended use and grain, run the highest-value checks for the data shape, and report concrete evidence, analytical risk, likely causes, and the smallest useful remediation or automated test.
13
-
14
- ### Workflow
15
-
16
- 1. **Clarify the quality question and operating context.**
17
-
18
- Establish what the dataset represents, the intended unit of analysis, the downstream use, whether the user cares about raw ingestion quality, transformed-model quality, or both, and the comparison baseline. Identify expected grain, primary keys, important date columns, timezone assumptions, domain rules, allowed values, and business thresholds. If context is missing, infer cautiously and label assumptions.
19
-
20
- 2. **Choose an inspectable analysis path.**
21
-
22
- When checks require SQL or Python, default to a companion notebook or script so the user can inspect the exact code behind the findings. For queryable tables, confirm schema, grain, sample rows, and query rules before heavier checks.
23
-
24
- 3. **Build a compact profile.**
25
-
26
- Start with row count, column count, column names and types, candidate keys, duplicate rates on likely identifiers, min/max timestamps, null rates, distinct counts for categorical columns, and basic numeric summaries. Confirm grain before interpreting anomalies; many apparent quality problems are mixed-grain data, partial backfills, late-arriving data, or duplicated joins.
27
-
28
- 4. **Run core quality checks.**
29
-
30
- Select checks that match the dataset and task across completeness, uniqueness, validity, consistency, integrity, timeliness, volume, and shape. Compare rates, not just counts, and segment by time, source, country, platform, or other key dimensions when that helps distinguish real issues from expected variation.
31
-
32
- 5. **Run shape-specific checks.**
33
-
34
- Adapt the checks to the data shape:
35
- - **Event data**: duplicate event IDs, future timestamps, coverage gaps, abrupt event-mix changes after releases.
36
- - **Dimension tables**: non-unique business keys, orphan surrogate keys, status changes without timestamps, unexpected churn in reference values.
37
- - **Fact tables**: mixed grain, impossible measures (negative revenue/quantity), join blowups, late-arriving partitions.
38
- - **ML feature tables**: leakage from post-outcome fields, feature sparsity spikes, range shifts, class-label drift.
39
- - **Experiment data**: duplicate assignments, variant imbalance, exposure without assignment, events before assignment.
40
-
41
- 6. **Run temporal and distribution checks when history exists.**
42
-
43
- Prioritize temporal diagnostics when the user mentions "after X date", "suddenly", "recently". Check first-seen/last-seen dates, daily null-rate trends, duplicate-rate trends, row count trends, category-share shifts, distribution drift, and change points around launches, migrations, or incidents.
44
-
45
- 7. **Investigate analytical risks and likely causes.**
46
-
47
- Tie each issue to downstream risk: broken analysis, biased decisions, broken joins, stale dashboards, incorrect experiments, leakage, or misleading segments. Identify whether the issue is isolated to a source, segment, partition, time window, or pipeline change.
48
-
49
- 8. **Recommend fixes or automated tests.**
50
-
51
- Recommend the smallest set of fixes, monitoring, or automated tests that would materially reduce risk. Suggest automation only when the rule is stable and worth maintaining.
52
-
53
- ### Core Check Categories
54
-
55
- - **Completeness**: null rate by column/partition/segment; unexpected empty strings or sentinel values; required-column population rate.
56
- - **Uniqueness**: exact duplicate rows, duplicate primary keys, duplicate composite keys, proportion unique for semi-unique fields.
57
- - **Validity**: type conformance; format checks for IDs, emails, URLs, enums, timestamps; range checks for measures and dates; allowed-values checks.
58
- - **Consistency**: cross-field rule checks, units/currency consistency, status-timestamp alignment, agreement between duplicated fields.
59
- - **Integrity**: parent-child key coverage, orphan records, unexpected many-to-many joins, broken SCD joins.
60
- - **Timeliness**: freshness lag, missing recent partitions, unexplained historical rewrites or backfills.
61
- - **Volume and shape**: row-count drift, distinct-count drift, distribution drift, share-of-total drift, new/disappeared categories.
62
-
63
- ### Severity Classification
64
-
65
- - **Critical**: breaks trusted analysis, core joins, production dashboards, or key decisions.
66
- - **High**: materially biases downstream decisions (large null spikes, category drift, leakage).
67
- - **Medium**: localized or explainable issues needing documentation or monitoring.
68
- - **Low**: cosmetic inconsistencies, expected sparsity, or known edge cases.
69
-
70
- ### Automated Test Guidance
71
-
72
- Good candidates: primary key uniqueness, not-null checks on required columns, accepted values for stable enums, referential integrity, freshness thresholds, seasonality-aware row-count bounds.
73
-
74
- Use caution with: hard-coded distribution thresholds on volatile metrics, strict uniqueness in messy entity-resolution cases, recent partitions when late-arriving data is normal.
75
-
76
- ### Output Structure
77
-
78
- 1. Dataset and grain summary
79
- 2. Checks performed
80
- 3. Findings (with evidence: counts, rates, segments, dates)
81
- 4. Temporal or trend anomalies
82
- 5. Likely causes and impacted use cases
83
- 6. Recommended fixes or automated tests
84
- 7. Assumptions and open questions
85
-
86
- ---
87
-
88
- ## Part B: Analysis Validation (QA)
89
-
90
- Validate an analysis before sharing with stakeholders. Focus on whether the question, data, methodology, calculations, visuals, claims, caveats, and recommendations are trustworthy enough for the stated audience and decision.
91
-
92
- ### Workflow
93
-
94
- 1. **Inventory the artifact and claims.**
95
-
96
- Identify the report, notebook, spreadsheet, SQL, dashboard, or recommendation being validated. Extract the main question, audience, decision, key claims, headline numbers, data sources, time windows, populations, filters, and stated caveats.
97
-
98
- 2. **Validate question, methodology, and assumptions.**
99
-
100
- Confirm the analysis answers the stated question (not a nearby easier one). Check population, eligibility rules, exclusions, sampling, metric definitions, formulas, units, denominators, timezones, cohorts, comparison periods, and baselines.
101
-
102
- 3. **Validate data selection and quality risks.**
103
-
104
- Confirm that chosen tables/files are appropriate and current. Check freshness, partitions, segment coverage, completeness, null handling, deduplication, filter logic, and join coverage.
105
-
106
- 4. **Verify calculations and aggregations.**
107
-
108
- Recompute highest-impact numbers independently. Check grain, subtotals, denominators, rate bases, period-over-period bases, weighted averages, units, and whether categories add to totals. For SQL, inspect join types, group-by grain, filters, distinct counts.
109
-
110
- 5. **Test reasonableness and common traps.**
111
-
112
- Compare magnitudes against known baselines. Investigate trend jumps, flatlines, exact round numbers, 0%/100% rates. Check edge cases.
113
-
114
- 6. **Review visuals and presentation integrity.**
115
-
116
- Confirm charts use appropriate types, scales, axes, titles, labels, ordering, and color. Check whether a quick reader could get a misleading interpretation.
117
-
118
- 7. **Evaluate narrative, conclusions, and recommendations.**
119
-
120
- Confirm conclusions are supported by evidence. Separate findings from interpretation. Identify alternative explanations and unsupported causal language.
121
-
122
- 8. **Produce confidence assessment and required fixes.**
123
-
124
- Prioritize issues by decision impact.
125
-
126
- ### Common Pitfalls
127
-
128
- - **Join explosion**: many-to-many joins silently multiply rows.
129
- - **Survivorship bias**: only includes entities that exist today.
130
- - **Incomplete period comparison**: partial vs. complete period.
131
- - **Denominator shifting**: eligible population changes between compared groups.
132
- - **Average of averages**: pre-computed averages averaged without weighting.
133
- - **Timezone mismatch**: different timestamp conventions or cutoffs.
134
- - **Selection bias**: segments defined by the outcome being measured.
135
- - **Simpson's paradox**: aggregate and segment-level trends conflict.
136
-
137
- ### Confidence Ratings
138
-
139
- - **Ready to share**: Methodologically sound, key calculations verified, caveats clear.
140
- - **Share with caveats**: Directionally usable but specific limitations must be communicated.
141
- - **Needs revision**: Material errors, unsupported claims, or methodological issues.
142
-
143
- ### Validation Report Template
144
-
145
- ```markdown
146
- ## Validation Report
147
-
148
- ### Overall Assessment: [Ready to share | Share with caveats | Needs revision]
149
-
150
- ### Methodology Review
151
- [Findings about question framing, data selection, population, definitions, comparisons.]
152
-
153
- ### Issues Found
154
- 1. [Severity: High/Medium/Low] [Issue, evidence, and impact]
155
-
156
- ### Calculation Spot-Checks
157
- - [Metric]: [Verified / Discrepancy found / Not verified] - [evidence]
158
-
159
- ### Visualization Review
160
- [Chart or presentation issues, if applicable.]
161
-
162
- ### Suggested Improvements
163
- 1. [Improvement and why it matters]
164
-
165
- ### Required Caveats for Stakeholders
166
- - [Caveat that must be communicated]
167
- ```
@@ -1,94 +0,0 @@
1
- ---
2
- name: data-visualization
3
- description: "Design, specify, implement, revise, and QA quantitative visuals and chart choices. Use when an analytical answer needs visual judgment—comparing values, showing composition, reading concentration, understanding movement over time, or building chart specifications for reports and dashboards."
4
- ---
5
-
6
- # Data Visualization
7
-
8
- Create quantitative visuals that are analytically sound, immediately readable, and polished enough to ship in a report, memo, slide, dashboard, notebook, or HTML artifact. Treat charts as evidence for a takeaway. Redesign charts that are visually attractive but analytically weak, and revise charts that are technically correct but hard to interpret.
9
-
10
- ## Chart Selection Guide
11
-
12
- | Data relationship | Best chart | Use it well |
13
- |---|---|---|
14
- | Trend over time | `line` | Show enough points to reveal shape; use `area` only when filled magnitude helps; `sparkline` for dense KPI cards |
15
- | Composition over time | `stackedArea` | Use when parts should read as one total; switch to `line` when comparing trajectories matters more |
16
- | Comparison across categories | `bar` | Sort when order is not semantic; horizontal bars for long labels; avoid redundant legends |
17
- | Ranking or top-N | `leaderboard` | Compact, single-measure; switch to ranked `bar` for more context |
18
- | Part-to-whole composition | stacked `bar` | Keep denominator explicit; use `pie` only for rough read with few slices |
19
- | Distribution or spread | `histogram` | Numeric bins that reveal shape; `boxPlot` when comparing groups is the point |
20
- | Distribution across groups | `boxPlot` | Median and spread over full shape; switch to `histogram` when shape needs space |
21
- | Relationship between variables | `scatter` | Numeric x and y, enough distinct points to show pattern; retain labels and one grouping candidate |
22
- | Dense 2D pattern or cohort matrix | `heatmap` | Matrix shape or intensity; switch to `scatter` for point-level variation |
23
- | Additive bridge start to end | `waterfall` | Only when drivers sum cleanly to end value; otherwise ranked `bar` |
24
- | Ordered stage progression | `funnel` | Only for ordered single-series stages; prefer stage `bar` when geometry distorts |
25
-
26
- ## Workflow
27
-
28
- 1. **Define the analytical question and takeaway** before choosing a chart. Identify the intended comparison and context needed to make the visual honest.
29
-
30
- 2. **Choose the simplest defensible chart family** from the Chart Selection Guide. Keep the top-level families small: Tables & Scorecards, Trend, Comparison & Ranking, Composition, Distribution, Relationship, Uncertainty & Benchmark, Matrix & Cohort, Decomposition & Progression.
31
-
32
- 3. **Write a compact chart contract** before implementation:
33
- - Analytical question and takeaway
34
- - Chart family and concrete variant
35
- - Data sufficiency for the chosen visual
36
- - Palette policy and non-color distinction plan
37
- - Output footprint and delivery target
38
-
39
- 4. **Select the delivery path** matching the final surface:
40
- - Static HTML/PNG for reports and portable files
41
- - Python (Matplotlib/Seaborn) for notebooks and static exports
42
- - JavaScript (ECharts, Chart.js, D3) for interactive web dashboards
43
- - BI-native widgets when a governed BI tool owns rendering
44
-
45
- 5. **Build in order**: format → structure → color → QA.
46
-
47
- 6. **Render or export** the chart in its real context. Save the image format the delivery surface expects.
48
-
49
- 7. **Inspect in final context**. Revise before delivery when the chart, labels, color, or container fails QA.
50
-
51
- ## Selection Rules
52
-
53
- - Start from the analytical question, not a favorite chart type.
54
- - Use charts for shape and comparison; tables for exact lookup.
55
- - Do not choose `line` merely because "trend" appears—decide whether the reader needs status, movement, variance, mix, or distribution.
56
- - Do not ship underpowered trend charts. Aim for at least 8-12 temporal points. Use KPI cards, grouped bars, or narrative for fewer points.
57
- - Do not ship underpowered scatter charts. Aim for at least 12-20 meaningful points.
58
- - Use horizontal bars for long labels; sorted bars when order has no semantic meaning.
59
- - Prefer variant escalation within a family before inventing new chart types.
60
- - Keep pie, Pareto, waterfall, Likert as variants, not defaults.
61
- - Include volume/denominator/sample-size context when omission could mislead.
62
-
63
- ## Visual Design Standards
64
-
65
- ### Typography & Color
66
- - Single font family across charts. Prefer white/near-white backgrounds, quiet grey grid lines, deep charcoal text, restrained palette.
67
- - Do not rely on color alone. Use tone, open fill, marker fill, line style, direct labels, ordering, or faceting.
68
- - Choose one palette policy before plotting:
69
- - **Single-root preferred**: one non-neutral root plus shades for simple charts.
70
- - **Hard two-root cap**: at most two non-neutral roots for binary, signed, or comparison charts.
71
- - **Relaxed multi-category**: up to five approved roots when category identity is the point.
72
-
73
- ### Layout & Labels
74
- - Chart titles: neutral and descriptive for reports/dashboards; takeaway-led for standalone charts.
75
- - Put metric details (units, denominator, date range, cohort, filters) in the subtitle.
76
- - Prefer direct labels when they reduce legend lookups; use compact legend when direct labels create clutter.
77
- - Reserve space for horizontal bars with long labels or negative values.
78
- - Do not use gradients inside marks, colored backgrounds, or inconsistent corner radii.
79
-
80
- ### Signed Values
81
- - Avoid green/red by default. Use dark vs. open/light fills, direct signed labels, and clear zero-line context.
82
- - Waterfall: matched neutral anchors + exactly two non-neutral delta colors.
83
-
84
- ## Quality Bar
85
-
86
- Before delivery, confirm:
87
- - Chart choice follows the analytical question, not visual preference.
88
- - Form matches the comparison; scales stay honest and consistent.
89
- - Data grain, filters, date range, denominator, and units match the supported claim.
90
- - Every shipped chart has a visible title and subtitle with needed context.
91
- - Labels, ticks, legends, annotations must not collide or clip.
92
- - Multi-series marks have distinct tones/fills/styles legible in grayscale.
93
- - Positive/negative states use tone + signed labels, not just color.
94
- - Inspect the visual in the final layout before handoff.
@@ -1,134 +0,0 @@
1
- ---
2
- name: kpi-design
3
- description: "Design KPI frameworks, set targets, develop measurement plans, and estimate market/opportunity sizes (TAM/SAM/SOM). Use when success metrics, drivers, guardrails, targets, or measurement approach need to be defined or improved, or when a market or opportunity size estimate is needed."
4
- ---
5
-
6
- # KPI Design & Market Sizing
7
-
8
- Two complementary capabilities: (1) design KPI frameworks, set targets, and develop measurement plans; (2) estimate market or opportunity sizes with transparent assumptions and sensitivity analysis.
9
-
10
- ## Part A: KPI Framework Design
11
-
12
- Design KPI frameworks, set targets, and develop measurement plans that help teams make product or business decisions.
13
-
14
- ### Workflow
15
-
16
- #### 1. Clarify The Decision And Operating Context
17
-
18
- Understand the decision the metrics need to support, the context in which they will be reviewed, and who will act on the result. Ask the user to clarify the goal, operating cadence, or measurement constraints when missing input would change the recommendation.
19
-
20
- #### 2. Gather Evidence Before Recommending Metrics
21
-
22
- When the prompt does not already provide enough context to know what success means, gather that context before recommending metrics or targets. Understand the goal, current state, audience, constraints, risks, existing definitions, prior decisions, and any baseline or target context.
23
-
24
- #### 3. Generate A Wider Candidate Set
25
-
26
- Create candidate outcome, driver, and guardrail metrics before narrowing. Each candidate should have a clear definition and a plausible link to the decision.
27
-
28
- #### 4. Compare And Select Metrics
29
-
30
- Compare candidate metrics by whether they:
31
- - **Reflect the goal**: the metric represents the intended outcome. When using a proxy, explain why and where it could mislead.
32
- - **Inform a real decision**: movement should change what the team does.
33
- - **Show useful signal at the decision cadence**: not too slow-moving or noisy for the decision it supports.
34
- - **Can be influenced by the team**: plausible levers exist, or paired with drivers.
35
- - **Can be measured operationally**: instrument, calculate, and track consistently.
36
- - **Are hard to game**: improving the metric should not hide harm to quality, trust, or retention.
37
-
38
- Recommend 1-3 primary KPIs, 1-2 driver metrics for each KPI, and 1-2 guardrails when tradeoffs are likely.
39
-
40
- For each recommended metric: what it measures, why it matters, how it is calculated, where it comes from, main pros and cons, and what caveats matter.
41
-
42
- #### 5. Set Targets When Needed
43
-
44
- Treat target setting as separate from metric selection.
45
-
46
- Use the target-setting approach that fits the evidence:
47
- - **Top-down**: benchmarks, historical performance, comparable products, competitor context.
48
- - **Bottom-up**: what the team can realistically do—what is shipping, expected adoption, available levers.
49
-
50
- Compare aspirational targets with realistic influence. A good target should be meaningful for the decision and plausible enough to guide action.
51
-
52
- #### 6. Deliver The Recommendation
53
-
54
- Compact metric-design brief:
55
- 1. Initiative summary
56
- 2. Recommended metric candidates with definition and rationale
57
- 3. Target recommendation with anchor, assumptions, and methodology
58
- 4. Evidence reviewed
59
- 5. Assumptions and missing context
60
- 6. Risks and guardrails
61
- 7. Open questions
62
-
63
- ### Example Metric Shapes
64
-
65
- - **Product launch/adoption**: outcome metric for adoption + drivers for activation/engagement + guardrails for experience quality.
66
- - **Growth work**: business outcome (activation/retention/monetization) + drivers + guardrails.
67
- - **Funnel work**: progression/completion outcome + stage drivers + downstream quality guardrails.
68
- - **Operating review**: health, pacing, action-oriented metrics.
69
- - **Experiment**: one primary success metric + diagnostics + guardrails for unintended effects.
70
- - **Platform/reliability**: service health, throughput, quality, cost efficiency, customer impact.
71
-
72
- ---
73
-
74
- ## Part B: Market Sizing
75
-
76
- Produce defensible estimates of a market or opportunity from available context, public sources, transparent assumptions, and auditable calculations.
77
-
78
- ### Workflow
79
-
80
- #### 1. Frame The Market Or Opportunity
81
-
82
- Define the boundary:
83
- - What is being sized (product category, workflow, problem, use case)
84
- - Where and when (geography, segment, time horizon, maturity)
85
- - Who counts (relevant population, unit of demand, transaction type)
86
- - How measured (spend, revenue, volume, value created)
87
- - What answer needed (TAM/SAM/SOM, market entry, expansion upside, spend pool)
88
-
89
- #### 2. Choose A Sizing Approach And Inputs
90
-
91
- Pick the simplest sound approach:
92
- - **Top-down**: reliable aggregate market data exists.
93
- - **Bottom-up**: market can be built from observable units and assumptions.
94
- - **Value-based**: estimate from value created rather than published market total.
95
-
96
- Use mixed approach only when cross-checking would materially improve confidence.
97
-
98
- #### 3. Gather Sources For The Inputs
99
-
100
- Start with user-named sources. Then use strongest available evidence for each major input. When an input depends on the outside market, use public sources for benchmarks, population estimates, comparable markets, or proxy assumptions.
101
-
102
- If the strongest source is unavailable, continue with a transparent proxy assumption only when the estimate is still useful. Label the gap.
103
-
104
- #### 4. Separate Facts From Assumptions
105
-
106
- Keep sourced facts, inferred estimates, and judgment calls distinct. When exact data is unavailable, use a defensible proxy, explain why it is reasonable, and note confidence level.
107
-
108
- #### 5. Build The Model
109
-
110
- Make the model easy to inspect and adjust:
111
- - Market definition and measurement unit
112
- - Assumptions and source context
113
- - Calculation chain and derived values
114
- - Base case, material ranges, and sensitivity logic
115
- - Validation priorities
116
-
117
- Keep derived values traceable to formulas rather than hardcoded outputs.
118
-
119
- #### 6. Test Sensitivity
120
-
121
- Identify assumptions that move the estimate most. Show how the estimate changes when those assumptions vary. Prefer simple, decision-useful sensitivity over exhaustive scenario sprawl.
122
-
123
- Use ranges when uncertainty is material. Do not hide uncertainty behind a single point estimate.
124
-
125
- #### 7. State The Estimate And Validation Priorities
126
-
127
- Close with:
128
- - Market definition
129
- - Estimate or range
130
- - Method
131
- - Main uncertainty drivers
132
- - Sensitivity takeaways
133
- - Validation priorities
134
- - Practical interpretation for the user's decision
@@ -1,143 +0,0 @@
1
- ---
2
- name: metric-diagnostics
3
- description: "Diagnose why a metric changed or differs from expectation, and produce leadership-ready KPI updates. Use when the user needs to understand what drove a metric movement, anomaly, or discrepancy, or when producing WBR/MBR/QBR summaries, scorecards, target pacing readouts, or performance updates."
4
- ---
5
-
6
- # Metric Diagnostics & KPI Reporting
7
-
8
- Two complementary capabilities: (1) diagnose why a metric changed or differs from expectation, and (2) produce leadership-ready KPI updates and scorecards.
9
-
10
- ## Part A: Metric Diagnostics
11
-
12
- Diagnose why a metric changed or differs from expectation. Reproduce the metric, define the comparison, quantify the movement, validate likely drivers, and state what is verified, likely, unresolved, and useful to do next.
13
-
14
- ### Workflow
15
-
16
- #### 1. Define The Diagnostic Question
17
-
18
- Frame the diagnostic so it is clear what changed and what comparison would prove it.
19
-
20
- Define:
21
- - What the metric means in business terms
22
- - The time window and comparison that make the change measurable
23
- - The population and grain that determine what counts
24
- - The source that owns the metric definition
25
- - The diagnostic question (movement, concentration, or reconciliation)
26
-
27
- #### 2. Validate The Metric Definition And Source
28
-
29
- Before explaining the movement, confirm that the metric is defined correctly and that the source data can measure it reliably. Confirm definition, grain, aggregation logic, filters, joins, exclusions, freshness, and lineage.
30
-
31
- Treat saved context and familiar table names as source candidates, not source selection. Inspect at least one business-facing surface and one lower-level source, then state why the selected source owns the answer.
32
-
33
- #### 3. Establish The Metric Pattern
34
-
35
- Before looking for drivers, establish the metric pattern the diagnostic needs to explain. Quantify the metric over the relevant period and scope. If the question includes a comparison, reproduce that comparison.
36
-
37
- Do not search for causes until the size, timing, and scope of the pattern are verified.
38
-
39
- #### 4. Choose The Diagnostic Plan
40
-
41
- Choose the smallest set of cuts and checks likely to explain the pattern. Choose driver dimensions from the metric's operating logic, business context, and source shape. Prioritize drivers the business usually monitors or can act on.
42
-
43
- Use the explanation mode that fits the question:
44
- - **Metric change**: compare focal window with baseline, rank segment contributions, check mix shift vs. within-segment movement.
45
- - **Spike/regression/incident**: pin down onset, peak, recovery, distribution shape, affected slices, broad vs. localized degradation.
46
- - **Largest contributors**: define "largest", rank entities, compare total share and change, look for major movers, entrants, and exits.
47
- - **Reconciliation**: align definitions, filters, grain, numerator, denominator; quantify components explaining the gap.
48
-
49
- #### 5. Decompose And Validate Drivers
50
-
51
- Quantify the main drivers and validate whether they explain the pattern.
52
-
53
- - Size each major driver with the strongest available evidence.
54
- - Show whether it explains the pattern, how large it is relative to the base.
55
- - For rates, check whether the numerator, denominator, or both explain the change.
56
- - For additive metrics, calculate contribution share when it sharpens the story.
57
- - Separate composition effects from within-segment performance effects.
58
- - Treat measurement issues as possible explanations (logging changes, incomplete data, duplicated rows, shifted denominator).
59
- - Calibrate the explanation to the evidence; make important uncertainty visible.
60
-
61
- #### 6. State Implications And Follow-Up
62
-
63
- Lead with the answer to the diagnostic question, then state practical implications:
64
- - The pattern being explained
65
- - The strongest driver explanation and supporting evidence
66
- - Why it matters for the business
67
- - How much confidence to place in the explanation
68
- - The implication, next action, or follow-up that matters most
69
-
70
- ---
71
-
72
- ## Part B: KPI Reporting
73
-
74
- Turn business or product metrics into decision-ready operating readouts for leaders and teams. Define the KPI contract, report status against the right comparison and target, include validated driver context, and state the operating implication clearly.
75
-
76
- ### Workflow
77
-
78
- #### 1. Clarify The Readout Purpose
79
-
80
- Understand who the readout is for, what conversation it supports, and what is being reported. Anchor the update in the period being evaluated, the comparison or target, and the freshness cutoff.
81
-
82
- #### 2. Define The Metric Framework
83
-
84
- Decide which metrics belong in the readout and what role each plays. Start with the primary KPI, then add the smallest set of supporting metrics to explain status.
85
-
86
- Lead with the metric that matters most to the audience. Include the metrics and slices decision-makers actually use, plus any that materially explain this update.
87
-
88
- #### 3. Lock Metric Definitions And Sources
89
-
90
- Confirm the KPI definition, source, time window, reporting cutoff, comparison period, and target or pacing expectation before interpreting performance.
91
-
92
- If a definition changed, show comparable restated history or call out the break clearly.
93
-
94
- #### 4. Pull The Topline Actuals
95
-
96
- Query or inspect data sources for core actuals. Reproduce the topline actual before explaining movement.
97
-
98
- For each headline KPI, include the current value, absolute and relative change vs. the comparison period, and short interpretation. Call out anything that makes the current value hard to compare.
99
-
100
- #### 5. Put The Numbers In Context
101
-
102
- Compare actuals against the context that makes performance interpretable: target, plan, pacing model, benchmark, historical range, or relevant peer group.
103
-
104
- If the goal has a deadline, show whether it is on pace. Include absolute and percent variance to target and a status indicator.
105
-
106
- #### 6. Explain Validated Drivers
107
-
108
- Driver claims must be validated before presented as explanations. Use Part A (Metric Diagnostics) to identify and validate drivers when fresh investigation is needed.
109
-
110
- #### 7. Add Business Context And Operating Implications
111
-
112
- Translate evidence, driver analysis, and business context into the operating implication. State whether the movement is concerning, what next step is warranted, and whether the KPI is on track, at risk, or ahead of plan.
113
-
114
- #### 8. Shape The Readout
115
-
116
- Common shapes: inline written update, document/report, slide, or deck. Adapt to the audience, evidence, and artifact.
117
-
118
- ### KPI Reporting Standards
119
-
120
- #### Metric Standards
121
- - Never present a KPI as precise when its definition, source, or comparison basis is unclear.
122
- - Make calculation logic, inclusion rules, grain, and time treatment explicit.
123
- - Reconcile totals and compare against prior reporting when possible.
124
- - Do not compare periods that are not definitionally compatible.
125
-
126
- #### Status And Pacing Standards
127
- - Include headline takeaway, current actual, comparison, target/pacing context, driver summary, and implication.
128
- - Put actuals next to target so the reader can judge performance immediately.
129
- - If a target is time-bound, show whether current performance is on pace.
130
- - Use traffic-signal status only when it helps prioritize action.
131
-
132
- #### Driver Standards
133
- - Quantify drivers whenever evidence supports it.
134
- - Report the few drivers that matter for interpreting the movement.
135
- - Separate validated drivers from business context or hypotheses.
136
- - Do not elevate business events into causes unless timing and measured change support the link.
137
- - State whether movement is broad-based or concentrated.
138
-
139
- #### Presentation Standards
140
- - Write for executives who skim: lead with the answer, then evidence.
141
- - Use business-readable numbers: `123k (+8% w/w, +19% m/m)`.
142
- - Replace generic adjectives ("strong", "healthy") with metric evidence.
143
- - Keep caveats close to the claim they affect.