dew-method 0.1.0

package/src/dew-skills/2-plan-workflows/dew-source-validation/assets/source-profile-template.md

@@ -0,0 +1,59 @@
+# Source Profile Template
+
+```markdown
+# Source Profile
+
+## Source
+
+Source ID:
+
+Source Name:
+
+## Profile Scope
+
+Sample path:
+
+Profile date:
+
+Rows profiled:
+
+Columns profiled:
+
+## Field Completeness
+
+| Field | Null Count | Null % | Notes |
+|---|---:|---:|---|
+| | | | |
+
+## Uniqueness / Duplicate Checks
+
+| Field / Key | Duplicate Count | Notes |
+|---|---:|---|
+| | | |
+
+## Valid Ranges
+
+| Field | Expected Range | Observed Range | Status |
+|---|---|---|---|
+| | | | |
+
+## Time Coverage
+
+Start:
+
+End:
+
+Gaps:
+
+## Entity / Geography Coverage
+
+## Unexpected Values
+
+## Quality Summary
+
+- Low risk
+- Medium risk
+- High risk
+- Unknown
+
+## Caveats

package/src/dew-skills/2-plan-workflows/dew-source-validation/assets/source-sample-template.md

@@ -0,0 +1,55 @@
+# Source Sample Template
+
+```markdown
+# Source Sample Notes
+
+## Source
+
+Source ID:
+
+Source Name:
+
+## Sample Location
+
+Path:
+
+URL:
+
+Date captured:
+
+Captured by:
+
+## Sample Method
+
+- API call
+- File download
+- Database query
+- Manual upload
+- Web extraction
+- Other:
+
+## Sample Summary
+
+| Property | Value |
+|---|---|
+| File format | |
+| Row count | |
+| Column count | |
+| Time range | |
+| Entity/geography coverage | |
+| Sample size | |
+
+## Sample Rows Preview
+
+| Column | Example Value | Notes |
+|---|---|---|
+| | | |
+
+## Caveats
+
+## Evidence Status
+
+- valid-sample
+- valid-with-caveats
+- invalid
+- blocked

package/src/dew-skills/2-plan-workflows/dew-source-validation/assets/source-validation-report-template.md

@@ -0,0 +1,213 @@
+# Source Validation Report Template
+
+```markdown
+---
+title: "{Project Name} Source Validation Report"
+status: draft
+created: {YYYY-MM-DD}
+updated: {YYYY-MM-DD}
+workflow: dew
+phase: "2-plan-workflows"
+stepsCompleted: []
+decisionGates:
+  GATE-07-source-access:
+    status: pending
+  GATE-08-source-trust:
+    status: pending
+  GATE-09-source-grain:
+    status: pending
+  GATE-10-source-freshness:
+    status: pending
+  GATE-11-schema-evolution:
+    status: pending
+evidence: []
+assumptions: []
+caveats:
+  - "A source is not accepted as P1 unless access, sample, schema, grain/freshness, and trust evidence are documented."
+---
+
+# Source Validation Report: {Project Name}
+
+## 0. Document Purpose
+
+This report validates whether candidate sources can be used for the data product.
+
+It must be completed before final architecture.
+
+## 1. Input Artifacts
+
+| Artifact | Path | Loaded? | Notes |
+|---|---|---|---|
+| Source Inventory | | Yes/No | |
+| Source Scorecard | | Yes/No | |
+| KPI Catalog | | Yes/No | |
+| KPI Source Matrix | | Yes/No | |
+| KPI Feasibility Report | | Yes/No | |
+| Data Product PRD | | Yes/No | |
+| Decision Log | | Yes/No | |
+| Evidence Index | | Yes/No | |
+
+## 2. Source Validation Summary
+
+| Source ID | Source Name | Access | Sample | Schema | Grain | Freshness | DQ Profile | Recommended Status |
+|---|---|---|---|---|---|---|---|---|
+| SRC-001 | | Unknown | Missing | Missing | Unknown | Unknown | Missing | Candidate |
+
+## 3. Source Detail
+
+## SRC-001 — {Source Name}
+
+### Source Role
+
+### Related KPI(s)
+
+| KPI ID | Dependency Type | Required Fields |
+|---|---|---|
+| KPI-001 | Required/Optional | |
+
+### Access Validation
+
+Status:
+- Verified
+- Blocked
+- Manual only
+- Unknown
+- Failed
+
+Evidence:
+- access log:
+- notes:
+
+### Sample Validation
+
+Status:
+- Sample available
+- Sample missing
+- Sample invalid
+- Sample stale
+
+Evidence:
+- sample path:
+- row count:
+- file size:
+- sample date:
+
+### Schema Snapshot
+
+Status:
+- Captured
+- Missing
+- Unstable
+- Unknown
+
+Evidence:
+- schema path:
+- field count:
+- schema date:
+
+### Field Coverage
+
+| Required Field | Candidate Source Field | Available? | Notes |
+|---|---|---|---|
+| | | Yes/No/Unknown | |
+
+### Grain Validation
+
+Expected grain:
+
+Observed grain:
+
+Status:
+- Confirmed
+- Requires aggregation
+- Requires bridge/mapping
+- Incompatible
+- Unknown
+
+### Freshness Validation
+
+Required freshness:
+
+Observed freshness:
+
+Status:
+- Meets requirement
+- Acceptable with caveat
+- Does not meet requirement
+- Unknown
+
+### Profiling / Data Quality Notes
+
+- nulls:
+- duplicates:
+- invalid ranges:
+- unexpected values:
+- row count:
+- time coverage:
+- geography/entity coverage:
+
+### Schema Evolution Behavior
+
+Choose one:
+
+A. Strict schema contract  
+B. Schema snapshot + drift detection  
+C. Flexible rescued fields  
+D. Manual review on change  
+
+Selected:
+
+### Privacy / Security Notes
+
+### Source Validation Status
+
+Choose one:
+
+- P1 — Use in MVP
+- P2 — Use later
+- Exploration only
+- Rejected
+- Blocked
+
+### Caveats
+
+### Decision Required
+
+A. Promote to P1  
+B. Keep as P2  
+C. Exploration only  
+D. Reject  
+E. Block pending access/evidence  
+
+### User Decision
+
+## 4. KPI-Source Coverage After Validation
+
+| KPI ID | Required Source | Validated Source? | Coverage | Caveat |
+|---|---|---|---|---|
+| KPI-001 | SRC-001 | Yes/No | Full/Partial/None | |
+
+## 5. Architecture Readiness Impact
+
+Can architecture proceed?
+
+A. Yes  
+B. Yes, with caveats  
+C. No, source validation unresolved  
+D. Reduce MVP scope  
+
+Decision:
+
+## 6. Evidence Links
+
+| Evidence ID | Type | Path | Related Source | Status |
+|---|---|---|---|---|
+| EVD-001 | source-sample | | SRC-001 | |
+
+## 7. Open Issues
+
+## 8. Next Workflow
+
+Recommended next:
+
+`dew-requirement-gate`

package/src/dew-skills/2-plan-workflows/dew-source-validation/assets/source-validation-status-rubric.md

@@ -0,0 +1,41 @@
+# Source Validation Status Rubric
+
+## P1 — Use in MVP
+
+Use only when:
+- access is verified
+- sample exists
+- schema snapshot exists
+- grain is confirmed or bridge/mapping is approved
+- freshness is known or caveated
+- field coverage supports primary KPI or product requirement
+- major DQ risks are known
+- user approves promotion to P1
+
+## P2 — Use later
+
+Use when:
+- source is valuable
+- not required for MVP
+- or evidence is partial but promising
+
+## Exploration only
+
+Use when:
+- source is useful for learning or research
+- not reliable enough for product use
+- field coverage or trust is weak
+
+## Rejected
+
+Use when:
+- source does not support product/KPI needs
+- source is inaccessible
+- schema/quality/grain is unusable
+- legal/privacy risk is unacceptable
+
+## Blocked
+
+Use when:
+- source is important
+- but access, owner, legal, or technical issue blocks validation

package/src/dew-skills/2-plan-workflows/dew-source-validation/checklist.md

@@ -0,0 +1,52 @@
+# Source Validation Checklist
+
+## Required inputs
+
+- [ ] Source inventory loaded.
+- [ ] Source scorecard loaded.
+- [ ] KPI catalog loaded or context provided.
+- [ ] KPI-source matrix loaded or reconstructed.
+- [ ] Data product PRD loaded or context provided.
+
+## Access evidence
+
+- [ ] Access method documented.
+- [ ] Access check completed or blocked reason documented.
+- [ ] Access evidence path recorded.
+- [ ] HALT-05 triggered if access unverified for P1 candidate.
+
+## Sample evidence
+
+- [ ] Source sample exists or missing reason documented.
+- [ ] Sample path recorded.
+- [ ] Sample metadata recorded.
+- [ ] Sample caveats documented.
+
+## Schema evidence
+
+- [ ] Schema snapshot exists or missing reason documented.
+- [ ] Fields listed.
+- [ ] Required KPI fields mapped.
+- [ ] Schema evolution recommendation documented.
+
+## Grain and freshness
+
+- [ ] Source grain assessed.
+- [ ] Target KPI/product grain compared.
+- [ ] Freshness requirement compared with observed freshness.
+- [ ] Grain/freshness caveats documented.
+
+## Quality/profile
+
+- [ ] Basic profile completed or missing reason documented.
+- [ ] Nulls/duplicates/ranges reviewed where applicable.
+- [ ] Quality risk assigned.
+
+## Decision
+
+- [ ] Recommended source status assigned.
+- [ ] User approves final status.
+- [ ] Decision log updated.
+- [ ] Learning log updated if learning mode is enabled.
+- [ ] Evidence index updated.
+- [ ] No source promoted to P1 without access/sample/schema evidence.

package/src/dew-skills/2-plan-workflows/dew-source-validation/customize.toml

@@ -0,0 +1,42 @@
+# DO NOT EDIT -- overwritten on every update.
+#
+# Workflow customization surface for dew-source-validation.
+
+[workflow]
+
+activation_steps_prepend = []
+activation_steps_append = []
+
+persistent_facts = [
+  "file:{project-root}/**/source-inventory.md",
+  "file:{project-root}/**/source-scorecard.md",
+  "file:{project-root}/**/kpi-catalog.md",
+  "file:{project-root}/**/kpi-source-matrix.md",
+  "file:{project-root}/**/kpi-feasibility-report.md",
+  "file:{project-root}/**/data-product-prd.md",
+  "file:{project-root}/**/.decision-log.md",
+  "file:{project-root}/**/.learning-log.md",
+  "file:{project-root}/**/validation-evidence-index.md",
+]
+
+on_complete = ""
+
+validation_report_template = "assets/source-validation-report-template.md"
+source_sample_template = "assets/source-sample-template.md"
+schema_snapshot_template = "assets/schema-snapshot-template.md"
+source_profile_template = "assets/source-profile-template.md"
+status_rubric = "assets/source-validation-status-rubric.md"
+checklist = "checklist.md"
+
+validation_output_path = "{planning_artifacts}/source-validation"
+run_folder_pattern = "source-validation-{project_name}-{date}"
+
+source_sample_output_path = "{evidence_artifacts}/source-samples"
+schema_snapshot_output_path = "{evidence_artifacts}/schema-snapshots"
+profile_output_path = "{evidence_artifacts}/profiling-reports"
+api_log_output_path = "{evidence_artifacts}/api-call-logs"
+contract_test_output_path = "{evidence_artifacts}/source-contract-tests"
+
+decision_log_path = "{planning_artifacts}/.decision-log.md"
+learning_log_path = "{learning_artifacts}/.learning-log.md"
+evidence_index_path = "{evidence_artifacts}/validation-evidence-index.md"

package/src/dew-skills/2-plan-workflows/dew-source-validation/steps/step-01-init.md

@@ -0,0 +1,51 @@
+# Step 01 — Source Validation Initialization
+
+## Mandatory Rules
+
+- Do not promote any source to P1 in this step.
+- Do not proceed if source inventory is missing unless user explicitly provides source context.
+- Read the complete step before acting.
+- Initialize document state before moving to next step.
+
+## Task
+
+Initialize source validation workflow.
+
+## Sequence
+
+### 1. Detect existing workflow
+
+Look for existing source validation report in:
+
+- `{workflow.validation_output_path}/**/source-validation-report.md`
+- `{planning_artifacts}/**/*source*validation*.md`
+
+If an unfinished report exists, offer to resume.
+
+### 2. Create workspace
+
+If fresh workflow, bind `{doc_workspace}` to:
+
+`{workflow.validation_output_path}/{workflow.run_folder_pattern}/`
+
+Create:
+
+- `source-validation-report.md`
+
+Use:
+
+- `{workflow.validation_report_template}`
+
+### 3. Initialize frontmatter
+
+Set:
+
+```yaml
+status: draft
+stepsCompleted:
+  - step-01-init
+decisionGates:
+  GATE-07-source-access:
+    status: pending
+  GATE-08-source-trust:
+    status: pending

package/src/dew-skills/2-plan-workflows/dew-source-validation/steps/step-02-load-source-context.md

@@ -0,0 +1,59 @@
+# Step 02 — Load Source Context
+
+## Mandatory Rules
+
+- Load candidate source context before validation.
+- Do not infer source access, grain, freshness, or field coverage silently.
+- If source inventory is missing, trigger `HALT-04 — Source Not Identified`.
+
+## Task
+
+Load source context from prior artifacts.
+
+## Input discovery
+
+Search for:
+- `{planning_artifacts}/**/source-inventory.md`
+- `{planning_artifacts}/**/source-scorecard.md`
+- `{planning_artifacts}/**/kpi-catalog.md`
+- `{planning_artifacts}/**/kpi-source-matrix.md`
+- `{planning_artifacts}/**/data-product-prd.md`
+- `{planning_artifacts}/**/kpi-feasibility-report.md`
+- `{planning_artifacts}/**/.decision-log.md`
+- `{learning_artifacts}/**/.learning-log.md`
+
+## Extract for each source
+
+- source ID
+- source name
+- source type
+- access method
+- related KPI(s)
+- required fields
+- expected grain
+- expected freshness
+- validation priority
+- known risks
+
+## Validate minimum source definition
+
+A source is minimally defined only if it has:
+- source ID
+- source name
+- source type
+- expected role
+- access method hypothesis
+- related KPI or product requirement
+
+If missing, stop and trigger `HALT-04`.
+
+## Update report
+
+Append source context summary to `source-validation-report.md`.
+
+Update frontmatter:
+
+```yaml
+stepsCompleted:
+  - step-01-init
+  - step-02-load-source-context

package/src/dew-skills/2-plan-workflows/dew-source-validation/steps/step-03-access-check.md

@@ -0,0 +1,60 @@
+# Step 03 — Source Access Check
+
+## Mandatory Rules
+
+- Do not assume access works.
+- If access cannot be tested, mark as Unknown or Blocked.
+- A source cannot become P1 without access evidence or explicit caveated user approval.
+
+## Task
+
+Validate or document access for each validation-first source.
+
+## Access evidence types
+
+Allowed evidence:
+- successful API call log
+- downloaded file path
+- database query log
+- manual file sample
+- web page capture/extraction notes
+- owner confirmation
+- documented access limitation
+
+## For each source
+
+Record:
+
+| Source ID | Access Method | Access Status | Evidence | Notes |
+|---|---|---|---|---|
+
+Access status:
+- Verified
+- Failed
+- Blocked
+- Manual only
+- Unknown
+
+## If access is missing
+
+Trigger:
+
+`HALT-05 — Source Access Not Verified`
+
+Options:
+A. Run access check now  
+B. Continue with caveat  
+C. Mark source as blocked  
+D. Reject source  
+
+## Update report
+
+Update `source-validation-report.md`.
+
+Update frontmatter:
+
+```yaml
+stepsCompleted:
+  - step-01-init
+  - step-02-load-source-context
+  - step-03-access-check

package/src/dew-skills/2-plan-workflows/dew-source-validation/steps/step-04-sample-and-schema.md

@@ -0,0 +1,71 @@
+# Step 04 — Source Sample and Schema Snapshot
+
+## Mandatory Rules
+
+- Do not assume schema.
+- Do not assume required fields exist.
+- Do not promote to P1 if sample or schema is missing.
+- If evidence is missing, trigger `HALT-18 — No Validation Evidence`.
+
+## Task
+
+Capture or document source sample and schema snapshot.
+
+## Required evidence
+
+For each validation-first source:
+
+- source sample
+- schema snapshot or field list
+- required KPI field mapping
+
+## Sample evidence
+
+Record:
+- sample path
+- captured date
+- row count if applicable
+- format
+- time range if applicable
+- coverage notes
+
+## Schema evidence
+
+Record:
+- schema path
+- field names
+- field types if available
+- nullable/required if known
+- example values
+- related KPI fields
+
+## Field mapping
+
+| KPI Required Field | Source Field | Available? | Evidence | Notes |
+|---|---|---|---|---|
+
+## Missing field handling
+
+If required field is missing:
+
+A. Find substitute field  
+B. Modify KPI formula  
+C. Defer KPI  
+D. Reject source for this KPI  
+
+Ask user if the missing field affects primary KPI.
+
+## Update report
+
+Update:
+- source-validation-report.md
+- evidence index if evidence exists
+
+Update frontmatter:
+
+```yaml
+stepsCompleted:
+  - step-01-init
+  - step-02-load-source-context
+  - step-03-access-check
+  - step-04-sample-and-schema