dew-method 0.1.0

package/src/dew-skills/3-solutioning/dew-serving-design/assets/trust-limitations-statement-template.md

@@ -0,0 +1,65 @@
+# Trust and Limitations Statement Template
+
+```markdown
+---
+title: "{Project Name} Trust and Limitations Statement"
+status: draft
+created: {YYYY-MM-DD}
+updated: {YYYY-MM-DD}
+workflow: dew
+phase: "3-solutioning"
+---
+
+# Trust and Limitations Statement
+
+## Intended Use
+
+This data product is intended for:
+
+## Not Intended For
+
+This data product should not be used for:
+
+## Trust Expectation
+
+A. Exploratory only  
+B. Internal decision-support with documented limitations  
+C. Trusted shared product with quality checks  
+D. Production-grade with contracts and monitoring  
+
+Selected:
+
+## Data Sources
+
+| Source | Validation Status | Caveat |
+|---|---|---|
+
+## KPI / Metric Caveats
+
+| KPI | Caveat | Impact |
+|---|---|---|
+
+## Freshness Caveats
+
+## Grain Caveats
+
+## Data Quality Caveats
+
+## Known Missing Coverage
+
+## User Responsibilities
+
+Users should:
+- check freshness
+- read caveats
+- avoid unsupported conclusions
+- report suspected errors
+
+## Feedback / Issue Reporting
+
+## Approval
+
+Approved by:
+
+Date:
+```

package/src/dew-skills/3-solutioning/dew-serving-design/checklist.md

@@ -0,0 +1,17 @@
+# Serving Design Checklist
+
+- [ ] Data Product PRD loaded.
+- [ ] Data Model Spec loaded.
+- [ ] KPI-to-model mapping loaded.
+- [ ] DQ rules loaded.
+- [ ] Consumer identified.
+- [ ] Serving mode selected by user.
+- [ ] Served assets listed.
+- [ ] Metric serving contract created.
+- [ ] Freshness and availability documented.
+- [ ] Trust and limitations statement created.
+- [ ] Self-service policy selected.
+- [ ] Feedback loop defined.
+- [ ] Caveats preserved.
+- [ ] Decision log updated.
+- [ ] Learning log updated if enabled.

package/src/dew-skills/3-solutioning/dew-serving-design/customize.toml

@@ -0,0 +1,39 @@
+# DO NOT EDIT -- overwritten on every update.
+#
+# Workflow customization surface for dew-serving-design.
+
+[workflow]
+
+activation_steps_prepend = []
+activation_steps_append = []
+
+persistent_facts = [
+  "file:{project-root}/**/data-product-prd.md",
+  "file:{project-root}/**/requirement-gate-report.md",
+  "file:{project-root}/**/data-architecture.md",
+  "file:{project-root}/**/data-model-spec.md",
+  "file:{project-root}/**/kpi-to-model-mapping.md",
+  "file:{project-root}/**/data-quality-rules.md",
+  "file:{project-root}/**/dq-rule-catalog.md",
+  "file:{project-root}/**/transformation-design.md",
+  "file:{project-root}/**/business-rule-catalog.md",
+  "file:{project-root}/**/validation-evidence-index.md",
+  "file:{project-root}/**/.decision-log.md",
+  "file:{project-root}/**/.learning-log.md",
+]
+
+on_complete = ""
+
+serving_spec_template = "assets/serving-data-product-spec-template.md"
+metric_contract_template = "assets/metric-serving-contract-template.md"
+trust_limitations_template = "assets/trust-limitations-statement-template.md"
+serving_mode_rubric = "assets/serving-mode-rubric.md"
+self_service_rubric = "assets/self-service-rubric.md"
+checklist = "checklist.md"
+
+serving_output_path = "{planning_artifacts}/serving-design"
+run_folder_pattern = "serving-design-{project_name}-{date}"
+
+decision_log_path = "{planning_artifacts}/.decision-log.md"
+learning_log_path = "{learning_artifacts}/.learning-log.md"
+evidence_index_path = "{evidence_artifacts}/validation-evidence-index.md"

package/src/dew-skills/3-solutioning/dew-serving-design/steps/step-01-init.md

@@ -0,0 +1,67 @@
+# Step 01 — Serving Design Initialization
+
+## Mandatory Rules
+
+- Do not design serving before data model and DQ design exist.
+- Do not proceed if consumer is unclear.
+- Read the complete step before acting.
+
+## Task
+
+Initialize Serving Design workflow.
+
+## Sequence
+
+### 1. Detect existing workflow
+
+Look for:
+- `{workflow.serving_output_path}/**/serving-data-product-spec.md`
+- `{planning_artifacts}/**/*serving*.md`
+
+If unfinished serving design exists, offer to resume.
+
+### 2. Validate prerequisites
+
+Look for:
+- `data-model-spec.md`
+- `kpi-to-model-mapping.md`
+- `data-quality-rules.md`
+- `dq-rule-catalog.md`
+
+If missing:
+- missing model → return to `dew-data-model-design`
+- missing DQ → `HALT-14`
+
+### 3. Create workspace
+
+Bind `{doc_workspace}` to:
+
+`{workflow.serving_output_path}/{workflow.run_folder_pattern}/`
+
+Create:
+- `serving-data-product-spec.md`
+- `metric-serving-contract.md`
+- `trust-and-limitations-statement.md`
+
+Use templates.
+
+### 4. Initialize frontmatter
+
+Set:
+
+```yaml
+status: draft
+stepsCompleted:
+  - step-01-init
+decisionGates:
+  GATE-20-serving-mode:
+    status: pending
+  GATE-serving-trust-limitations:
+    status: pending
+```
+
+### 5. Continue checkpoint
+
+Ask:
+
+`[C] Continue to load model and DQ context`

package/src/dew-skills/3-solutioning/dew-serving-design/steps/step-02-load-model-dq-context.md

@@ -0,0 +1,47 @@
+# Step 02 — Load Model and DQ Context
+
+## Mandatory Rules
+
+- Load Gold models, KPI mapping, DQ rules, and caveats before serving mode.
+- Do not expose metrics without contract context.
+
+## Task
+
+Extract serving context.
+
+## Extract
+
+From PRD:
+- consumers
+- decisions supported
+- product type
+- trust expectation
+
+From model spec:
+- Gold models
+- dimensions
+- facts
+- grain
+- KPI mapping
+
+From DQ design:
+- DQ rules
+- DQ gate policy
+- critical caveats
+
+From transformation:
+- business rules
+- metric calculation caveats
+
+## Update
+
+Update:
+- serving-data-product-spec.md
+- metric-serving-contract.md
+- trust-and-limitations-statement.md
+
+## Continue checkpoint
+
+Ask:
+
+`[C] Continue to serving mode gate`

package/src/dew-skills/3-solutioning/dew-serving-design/steps/step-03-serving-mode-gate.md

@@ -0,0 +1,54 @@
+# Step 03 — Serving Mode Gate
+
+## Mandatory Rules
+
+- Stop at this gate.
+- User must approve serving mode.
+- Do not choose dashboard/API/mart silently.
+- Serving mode must match consumer and trust expectation.
+
+## Options
+
+A. Dashboard  
+B. Gold data mart  
+C. API  
+D. Notebook/report  
+E. Web app feature  
+F. ML feature table  
+G. Reverse ETL output  
+
+## Required comparison table
+
+| Option | Fit | Pros | Cons | Risk | Required Governance |
+|---|---|---|---|---|---|
+
+## Recommendation
+
+Recommend one or more modes.
+
+## User decision
+
+Ask user to choose.
+
+Do not continue until user chooses.
+
+## Record
+
+Update:
+- serving-data-product-spec.md
+- .decision-log.md
+- .learning-log.md if enabled
+
+Update frontmatter:
+
+```yaml
+decisionGates:
+  GATE-20-serving-mode:
+    status: approved / approved-with-caveats
+```
+
+## Continue checkpoint
+
+Ask:
+
+`[C] Continue to metric contract and consumer experience`

package/src/dew-skills/3-solutioning/dew-serving-design/steps/step-04-metric-contract-and-consumer-experience.md

@@ -0,0 +1,48 @@
+# Step 04 — Metric Contract and Consumer Experience
+
+## Mandatory Rules
+
+- Every served KPI must have formula, grain, Gold model, caveat, and owner/change process.
+- Do not expose unresolved KPI without caveat.
+
+## Task
+
+Create metric serving contract and consumer experience spec.
+
+## For each served metric
+
+Record:
+- KPI ID
+- formula
+- grain
+- Gold model/field
+- dimensions
+- filters
+- freshness
+- DQ rules
+- caveats
+- owner
+- change process
+
+## Consumer experience
+
+Define:
+- user journey
+- dashboard/report/API endpoint/app feature
+- filters
+- drill-downs
+- exports
+- documentation shown to user
+- feedback route
+
+## Update
+
+Update:
+- serving-data-product-spec.md
+- metric-serving-contract.md
+
+## Continue checkpoint
+
+Ask:
+
+`[C] Continue to trust limitations and feedback`

package/src/dew-skills/3-solutioning/dew-serving-design/steps/step-05-trust-limitations-and-feedback.md

@@ -0,0 +1,59 @@
+# Step 05 — Trust, Limitations, and Feedback
+
+## Mandatory Rules
+
+- Stop if trust statement is missing.
+- Limitations must be shown to consumers.
+- Accepted caveats are not evidence.
+- Feedback loop must exist.
+
+## Task
+
+Create trust and limitations statement.
+
+## Required sections
+
+- intended use
+- not intended for
+- trust expectation
+- source caveats
+- KPI caveats
+- freshness caveats
+- grain caveats
+- DQ caveats
+- known missing coverage
+- user responsibilities
+- issue reporting
+
+## Gate
+
+Ask user to approve trust/limitations statement:
+
+A. Approve  
+B. Approve with caveats  
+C. Revise limitations  
+D. Return to DQ/model design  
+
+Do not continue until user chooses.
+
+## Record
+
+Update:
+- trust-and-limitations-statement.md
+- serving-data-product-spec.md
+- .decision-log.md
+- .learning-log.md if enabled
+
+Update frontmatter:
+
+```yaml
+decisionGates:
+  GATE-serving-trust-limitations:
+    status: approved / approved-with-caveats / blocked
+```
+
+## Continue checkpoint
+
+Ask:
+
+`[C] Continue to finalize serving design`

package/src/dew-skills/3-solutioning/dew-serving-design/steps/step-06-finalize.md

@@ -0,0 +1,36 @@
+# Step 06 — Finalize Serving Design
+
+## Mandatory Rules
+
+- Do not finalize if serving mode gate is unresolved.
+- Do not finalize if trust/limitations statement is unresolved.
+- Run checklist.
+
+## Required outputs
+
+- serving-data-product-spec.md
+- metric-serving-contract.md
+- trust-and-limitations-statement.md
+- decision log entries
+- learning log entries if enabled
+
+## Final status
+
+Set:
+
+```yaml
+status: final
+stepsCompleted:
+  - step-01-init
+  - step-02-load-model-dq-context
+  - step-03-serving-mode-gate
+  - step-04-metric-contract-and-consumer-experience
+  - step-05-trust-limitations-and-feedback
+  - step-06-finalize
+```
+
+## Next workflow
+
+Recommend:
+
+`dew-governance-security-design`

package/src/dew-skills/3-solutioning/dew-storage-design/SKILL.md

@@ -0,0 +1,77 @@
+---
+name: dew-storage-design
+description: Design storage layers, raw/bronze/silver/gold responsibilities, metadata, retention, schema snapshots, and source-to-storage mapping from approved architecture.
+---
+
+# DEW Storage Design
+
+**Goal:** Create a detailed storage design grounded in approved data architecture, validated sources, KPI feasibility, and accepted caveats.
+
+**Your Role:** You are a storage design facilitator.
+
+You translate architecture-level storage intent into concrete storage layer design.
+
+You may recommend, but you must not decide.
+
+## Workflow Architecture
+
+This workflow uses step-file architecture.
+
+Rules:
+- Read one step file at a time.
+- Read the complete step file before acting.
+- Do not skip steps.
+- Do not load future steps early.
+- Stop at decision gates.
+- Update frontmatter after each completed step.
+- Preserve architecture caveats.
+
+## Mandatory Rules
+
+- Do not design storage without approved `data-architecture.md`.
+- Do not silently change architecture pattern.
+- Do not drop caveats from `architecture-caveat-carryover.md`.
+- Do not choose storage layer strategy without user approval.
+- Do not mark source-to-storage mapping complete without validated source context.
+- If architecture is missing, trigger `HALT-10 — Architecture Before Validation`.
+- If storage layer is unclear, trigger `HALT-11 — Storage Layer Unclear`.
+- If schema evolution direction is missing, trigger `HALT-13 — Schema Evolution Undefined`.
+- If evidence is missing, trigger `HALT-18 — No Validation Evidence`.
+
+## Conventions
+
+- Bare paths resolve from the skill root.
+- `{skill-root}` resolves to this skill's installed directory.
+- `{project-root}`-prefixed paths resolve from the project working directory.
+- `{workflow.<name>}` resolves to fields in `customize.toml`'s `[workflow]` table.
+- `{doc_workspace}` is the run folder for this workflow.
+
+## On Activation
+
+1. Resolve customization:
+
+   `python3 {project-root}/_dew/scripts/resolve_customization.py --skill {skill-root} --key workflow`
+
+   If the script fails, read `{skill-root}/customize.toml` directly and use defaults.
+
+2. Execute `{workflow.activation_steps_prepend}`.
+
+3. Load persistent facts from `{workflow.persistent_facts}`.
+
+4. Load `{project-root}/_dew/dew/config.yaml` if present.
+
+5. Load:
+   - `{workflow.storage_design_template}`
+   - `{workflow.storage_decision_record_template}`
+   - `{workflow.source_to_storage_mapping_template}`
+   - `{workflow.storage_layer_rubric}`
+   - `{workflow.metadata_standard_rubric}`
+   - `{workflow.raw_retention_rubric}`
+
+6. Greet user in configured language.
+
+## Execution
+
+Read fully and follow:
+
+`steps/step-01-init.md`

package/src/dew-skills/3-solutioning/dew-storage-design/assets/metadata-standard-rubric.md

@@ -0,0 +1,60 @@
+# Metadata Standard Rubric
+
+## Minimal metadata
+
+Use when:
+- project is learning/portfolio
+- source count is low
+- traceability needs are simple
+
+Typical fields:
+- dew_source_system
+- dew_source_file_path
+- dew_processing_timestamp
+- dew_dq_status
+
+## Operational metadata
+
+Use when:
+- ingestion and transformation runs must be traced
+- reruns/backfills are expected
+
+Typical fields:
+- dew_source_system
+- dew_source_file_path
+- dew_ingestion_timestamp
+- dew_ingestion_run_id
+- dew_silver_timestamp
+- dew_silver_run_id
+- dew_dq_status
+
+## Full lineage metadata
+
+Use when:
+- multiple sources
+- multiple consumers
+- auditability matters
+- production-like workflow
+
+Typical fields:
+- source system
+- source object
+- source file path
+- source extraction timestamp
+- ingestion run ID
+- transform run ID
+- batch ID
+- schema version
+- DQ status
+- record hash
+- lineage ID
+
+## Rule
+
+Metadata choice must match trust expectation.
+
+Exploratory projects can use minimal metadata.
+
+Internal decision-support should use at least operational metadata for key tables.
+
+Trusted shared products need stronger lineage and DQ metadata.

package/src/dew-skills/3-solutioning/dew-storage-design/assets/raw-retention-rubric.md

@@ -0,0 +1,39 @@
+# Raw Retention Rubric
+
+## Keep all raw inputs
+
+Use when:
+- reproducibility matters
+- source may change
+- auditability matters
+- storage cost is acceptable
+
+## Keep raw inputs for MVP period only
+
+Use when:
+- storage cost matters
+- project is still experimental
+- reproducibility is needed only during build phase
+
+## Keep raw samples and schema snapshots only
+
+Use when:
+- source is large
+- raw data is externally available
+- source can be re-pulled
+- project is learning-focused
+
+## Keep raw externally and store references
+
+Use when:
+- source has stable URLs/object references
+- copying data is unnecessary or restricted
+
+## No raw retention
+
+Use only with explicit caveat.
+
+Risk:
+- weak reproducibility
+- harder debugging
+- harder backfill

package/src/dew-skills/3-solutioning/dew-storage-design/assets/source-to-storage-mapping-template.md

@@ -0,0 +1,36 @@
+# Source to Storage Mapping Template
+
+```markdown
+# Source to Storage Mapping
+
+## Purpose
+
+Map validated/caveated sources to storage targets.
+
+## Mapping Table
+
+| Source ID | Source Name | Validation Status | Access Pattern | Raw/Bronze Target | Silver Target | Schema Snapshot Target | Quarantine Target | Metadata Required | Caveat |
+|---|---|---|---|---|---|---|---|---|---|
+| SRC-001 | | P1/P2/Caveated | API/File/DB | | | | | | |
+
+## Source Detail
+
+## SRC-001 — {Source Name}
+
+### Validation Status
+
+### Source Grain
+
+### Source Freshness
+
+### Raw/Bronze Target
+
+### Schema Snapshot Target
+
+### Metadata Required
+
+### Quarantine / Error Target
+
+### Retention Rule
+
+### Notes for Ingestion Design