dew-method 0.1.0

package/src/dew-skills/4-implementation/dew-source-access-check/SKILL.md

@@ -0,0 +1,84 @@
+---
+name: dew-source-access-check
+description: Run or document source access checks such as API call, file download, database query, or manual acquisition.
+---
+
+# DEW Source Access Check
+
+**Goal:** Produce access evidence for a candidate source.
+
+**Your Role:** You are a source access validation engineer.
+
+You verify whether the source can actually be reached or obtained.
+
+## Mandatory Rules
+
+- Do not claim access is verified without evidence.
+- Do not invent API responses or files.
+- Do not bypass authentication/legal/access constraints.
+- If access is blocked, document the blocker.
+- If access cannot be verified, source cannot be P1 unless user approves caveat.
+
+## On Activation
+
+1. Resolve customization.
+2. Execute `{workflow.activation_steps_prepend}`.
+3. Load persistent facts.
+4. Load config if present.
+5. Load:
+   - `{workflow.access_log_template}`
+   - `{workflow.connection_notes_template}`
+6. Greet user in configured language.
+
+## Execution
+
+### Step 1 — Load source validation context
+
+Load:
+- source inventory
+- source scorecard
+- source validation report
+- source access requirements
+
+### Step 2 — Select source
+
+If multiple sources need access check, ask user which source to validate first.
+
+### Step 3 — Determine access method
+
+Access methods:
+- API call
+- file download
+- database query
+- manual upload
+- web extraction
+- owner confirmation
+
+### Step 4 — Produce access evidence
+
+Create:
+
+`{workflow.access_log_output_path}/{source_id}-access-check.md`
+
+Record:
+- method
+- endpoint/path/query
+- timestamp
+- result
+- status
+- error if any
+- caveats
+
+### Step 5 — Update evidence index
+
+Update validation evidence index.
+
+### Step 6 — Recommend next
+
+If access verified:
+
+`dew-source-sampler`
+
+If blocked:
+
+`dew-halt-resolver` for `HALT-05`

package/src/dew-skills/4-implementation/dew-source-access-check/assets/access-check-log-template.md

@@ -0,0 +1,54 @@
+# Source Access Check Log
+
+```markdown
+---
+title: "Source Access Check — {Source ID}"
+status: draft
+created: {YYYY-MM-DD}
+updated: {YYYY-MM-DD}
+workflow: dew
+relatedSource: "{Source ID}"
+evidenceType: "access-check"
+---
+
+# Source Access Check: {Source ID} — {Source Name}
+
+## Access Method
+
+- API call
+- File download
+- Database query
+- Manual upload
+- Web extraction
+- Owner confirmation
+
+## Access Target
+
+Endpoint/path/query/location:
+
+## Authentication / Permission Notes
+
+## Execution Timestamp
+
+## Result
+
+- Verified
+- Failed
+- Blocked
+- Manual only
+- Unknown
+
+## Evidence
+
+- response sample:
+- downloaded file:
+- query output:
+- screenshot/note:
+- error message:
+
+## Caveats
+
+## Next Step
+
+- dew-source-sampler
+- dew-halt-resolver

package/src/dew-skills/4-implementation/dew-source-access-check/assets/source-connection-notes-template.md

@@ -0,0 +1,24 @@
+# Source Connection Notes
+
+```markdown
+# Source Connection Notes: {Source ID}
+
+## Source
+
+## Access Pattern
+
+## Required Credentials
+
+## Rate Limits / Quotas
+
+## Terms / License Notes
+
+## Operational Caveats
+
+## Failure Modes
+
+## Retry / Backoff Notes
+
+## Owner / Contact
+
+## Status

package/src/dew-skills/4-implementation/dew-source-access-check/checklist.md

@@ -0,0 +1,12 @@
+# Source Access Check Checklist
+
+- [ ] Source selected.
+- [ ] Access method identified.
+- [ ] Access target documented.
+- [ ] Authentication/permission notes documented.
+- [ ] Access attempt result recorded.
+- [ ] Evidence path recorded.
+- [ ] Failure/blocker documented if any.
+- [ ] Evidence index updated.
+- [ ] Source validation report update recommended.
+- [ ] HALT-05 triggered if access remains unverified.

package/src/dew-skills/4-implementation/dew-source-access-check/customize.toml

@@ -0,0 +1,26 @@
+# DO NOT EDIT -- overwritten on every update.
+#
+# Workflow customization surface for dew-source-access-check.
+
+[workflow]
+
+activation_steps_prepend = []
+activation_steps_append = []
+
+persistent_facts = [
+  "file:{project-root}/**/source-inventory.md",
+  "file:{project-root}/**/source-scorecard.md",
+  "file:{project-root}/**/source-validation-report.md",
+  "file:{project-root}/**/validation-evidence-index.md",
+]
+
+on_complete = ""
+
+access_log_template = "assets/access-check-log-template.md"
+connection_notes_template = "assets/source-connection-notes-template.md"
+checklist = "checklist.md"
+
+access_log_output_path = "{evidence_artifacts}/api-call-logs"
+decision_log_path = "{planning_artifacts}/.decision-log.md"
+learning_log_path = "{learning_artifacts}/.learning-log.md"
+evidence_index_path = "{evidence_artifacts}/validation-evidence-index.md"

package/src/dew-skills/4-implementation/dew-source-contract-test/SKILL.md

@@ -0,0 +1,85 @@
+---
+name: dew-source-contract-test
+description: Define and run minimal source contract tests for schema, required fields, freshness, and grain expectations.
+---
+
+# DEW Source Contract Test
+
+**Goal:** Define and run minimal tests that protect against source drift and false assumptions.
+
+**Your Role:** You are a source contract and data quality validation engineer.
+
+## Mandatory Rules
+
+- Do not design full production DQ suite here.
+- Focus on minimum contract needed before architecture/ingestion.
+- Do not pass a contract test without evidence.
+- If required field test fails, source cannot support related KPI without caveat.
+
+## On Activation
+
+1. Resolve customization.
+2. Execute `{workflow.activation_steps_prepend}`.
+3. Load persistent facts.
+4. Load config if present.
+5. Load:
+   - `{workflow.contract_test_template}`
+   - `{workflow.contract_test_result_template}`
+6. Greet user in configured language.
+
+## Execution
+
+### Step 1 — Load source evidence
+
+Load:
+- source validation report
+- source sample notes
+- schema snapshot
+- KPI-source matrix
+- validation evidence index
+
+### Step 2 — Define minimum source contract
+
+For each source, define tests:
+
+- required fields exist
+- field type expectations
+- critical field not null
+- valid time field exists
+- expected grain keys exist
+- freshness field exists if required
+- row count non-zero
+- schema drift detection rule
+
+### Step 3 — Create test spec
+
+Create:
+
+`{workflow.contract_test_output_path}/{source_id}-contract-test.md`
+
+### Step 4 — Record test result
+
+Create:
+
+`{workflow.contract_test_output_path}/{source_id}-contract-test-result.md`
+
+Status:
+- pass
+- pass-with-caveats
+- fail
+- blocked
+- not-run
+
+### Step 5 — Update evidence index
+
+Update validation evidence index.
+
+### Step 6 — Recommend next
+
+If pass or pass-with-caveats:
+
+Return to `dew-source-validation` finalize.
+
+If fail:
+
+Trigger `HALT-06` or `HALT-18`.

package/src/dew-skills/4-implementation/dew-source-contract-test/assets/contract-test-result-template.md

@@ -0,0 +1,55 @@
+# Contract Test Result Template
+
+```markdown
+---
+title: "Source Contract Test Result — {Source ID}"
+status: draft
+created: {YYYY-MM-DD}
+updated: {YYYY-MM-DD}
+workflow: dew
+relatedSource: "{Source ID}"
+evidenceType: "source-contract-test-result"
+---
+
+# Source Contract Test Result: {Source ID} — {Source Name}
+
+## Result Summary
+
+Overall status:
+
+- pass
+- pass-with-caveats
+- fail
+- blocked
+- not-run
+
+## Test Results
+
+| Test ID | Test Name | Expected | Observed | Status | Notes |
+|---|---|---|---|---|---|
+| SCT-001 | Required fields exist | | | pass/fail | |
+
+## Findings
+
+| Severity | Finding | Impact | Required Action |
+|---|---|---|---|
+| High/Medium/Low | | | |
+
+## Caveats
+
+## Downstream Impact
+
+- KPI feasibility:
+- Architecture:
+- Ingestion:
+- Transformation:
+- Serving:
+
+## Recommendation
+
+A. Accept contract result  
+B. Accept with caveats  
+C. Rerun after fixing source/sample  
+D. Reject/block source  
+
+## User Decision

package/src/dew-skills/4-implementation/dew-source-contract-test/assets/source-contract-test-template.md

@@ -0,0 +1,47 @@
+# Source Contract Test Template
+
+```markdown
+---
+title: "Source Contract Test — {Source ID}"
+status: draft
+created: {YYYY-MM-DD}
+updated: {YYYY-MM-DD}
+workflow: dew
+relatedSource: "{Source ID}"
+evidenceType: "source-contract-test"
+---
+
+# Source Contract Test: {Source ID} — {Source Name}
+
+## Purpose
+
+Define minimal expectations this source must satisfy before it can support architecture and ingestion design.
+
+## Test Scope
+
+- sample-level
+- schema-level
+- field-level
+- freshness-level
+- grain-level
+
+## Tests
+
+| Test ID | Test Name | Expectation | Required? | Related KPI |
+|---|---|---|---|---|
+| SCT-001 | Required fields exist | Fields X, Y, Z exist | Yes | KPI-001 |
+| SCT-002 | Row count non-zero | Row count > 0 | Yes | |
+| SCT-003 | Time field exists | Time/date column exists | Yes/No | |
+| SCT-004 | Grain keys exist | Grain keys present | Yes/No | |
+| SCT-005 | Critical fields not null | Null rate below threshold | Yes/No | |
+| SCT-006 | Schema drift check | Current schema compared to snapshot | Yes | |
+
+## Caveats
+
+## Expected Result Status
+
+- pass
+- pass-with-caveats
+- fail
+- blocked
+- not-run

package/src/dew-skills/4-implementation/dew-source-contract-test/checklist.md

@@ -0,0 +1,55 @@
+# Contract Test Result Template
+
+```markdown
+---
+title: "Source Contract Test Result — {Source ID}"
+status: draft
+created: {YYYY-MM-DD}
+updated: {YYYY-MM-DD}
+workflow: dew
+relatedSource: "{Source ID}"
+evidenceType: "source-contract-test-result"
+---
+
+# Source Contract Test Result: {Source ID} — {Source Name}
+
+## Result Summary
+
+Overall status:
+
+- pass
+- pass-with-caveats
+- fail
+- blocked
+- not-run
+
+## Test Results
+
+| Test ID | Test Name | Expected | Observed | Status | Notes |
+|---|---|---|---|---|---|
+| SCT-001 | Required fields exist | | | pass/fail | |
+
+## Findings
+
+| Severity | Finding | Impact | Required Action |
+|---|---|---|---|
+| High/Medium/Low | | | |
+
+## Caveats
+
+## Downstream Impact
+
+- KPI feasibility:
+- Architecture:
+- Ingestion:
+- Transformation:
+- Serving:
+
+## Recommendation
+
+A. Accept contract result  
+B. Accept with caveats  
+C. Rerun after fixing source/sample  
+D. Reject/block source  
+
+## User Decision

package/src/dew-skills/4-implementation/dew-source-contract-test/customize.toml

@@ -0,0 +1,28 @@
+# DO NOT EDIT -- overwritten on every update.
+#
+# Workflow customization surface for dew-source-contract-test.
+
+[workflow]
+
+activation_steps_prepend = []
+activation_steps_append = []
+
+persistent_facts = [
+  "file:{project-root}/**/source-validation-report.md",
+  "file:{project-root}/**/*sample*.md",
+  "file:{project-root}/**/*schema*.md",
+  "file:{project-root}/**/kpi-source-matrix.md",
+  "file:{project-root}/**/validation-evidence-index.md",
+]
+
+on_complete = ""
+
+contract_test_template = "assets/source-contract-test-template.md"
+contract_test_result_template = "assets/contract-test-result-template.md"
+checklist = "checklist.md"
+
+contract_test_output_path = "{evidence_artifacts}/source-contract-tests"
+
+decision_log_path = "{planning_artifacts}/.decision-log.md"
+learning_log_path = "{learning_artifacts}/.learning-log.md"
+evidence_index_path = "{evidence_artifacts}/validation-evidence-index.md"

package/src/dew-skills/4-implementation/dew-source-sampler/SKILL.md

@@ -0,0 +1,80 @@
+---
+name: dew-source-sampler
+description: Extract or document source samples and schema snapshots as evidence for source validation.
+---
+
+# DEW Source Sampler
+
+**Goal:** Produce source sample and schema snapshot evidence.
+
+**Your Role:** You are a data sampling and schema inspection engineer.
+
+## Mandatory Rules
+
+- Do not invent sample data.
+- Do not invent schema.
+- Do not claim fields exist without sample/schema evidence.
+- Do not modify source data.
+- If sample cannot be captured, document why and trigger HALT-18 if needed.
+
+## On Activation
+
+1. Resolve customization.
+2. Execute `{workflow.activation_steps_prepend}`.
+3. Load persistent facts.
+4. Load config if present.
+5. Load:
+   - `{workflow.sample_notes_template}`
+   - `{workflow.schema_notes_template}`
+6. Greet user in configured language.
+
+## Execution
+
+### Step 1 — Load source context
+
+Load:
+- source validation report
+- access check log
+- source inventory
+- KPI-source matrix
+
+### Step 2 — Select source
+
+If multiple sources need samples, ask which source to sample first.
+
+### Step 3 — Capture or document sample
+
+Create:
+
+`{workflow.sample_output_path}/{source_id}-sample-notes.md`
+
+Record:
+- sample location
+- row count
+- column count
+- time coverage
+- entity/geography coverage
+- caveats
+
+### Step 4 — Capture schema snapshot
+
+Create:
+
+`{workflow.schema_output_path}/{source_id}-schema-snapshot.md`
+
+Record:
+- field names
+- data types if available
+- example values
+- required KPI field mapping
+- schema drift risk
+
+### Step 5 — Update evidence index
+
+Update validation evidence index.
+
+### Step 6 — Recommend next
+
+Recommend:
+
+`dew-source-contract-test`

package/src/dew-skills/4-implementation/dew-source-sampler/assets/schema-snapshot-notes-template.md

@@ -0,0 +1,45 @@
+# Schema Snapshot Notes
+
+```markdown
+---
+title: "Schema Snapshot — {Source ID}"
+status: draft
+created: {YYYY-MM-DD}
+updated: {YYYY-MM-DD}
+workflow: dew
+relatedSource: "{Source ID}"
+evidenceType: "schema-snapshot"
+---
+
+# Schema Snapshot: {Source ID} — {Source Name}
+
+## Snapshot Source
+
+Path/API/query:
+
+## Snapshot Timestamp
+
+## Fields
+
+| Field Name | Data Type | Nullable? | Example Value | Meaning | Related KPI Field |
+|---|---|---|---|---|---|
+| | | Unknown | | | |
+
+## Required Field Coverage
+
+| Required KPI Field | Source Field | Present? | Notes |
+|---|---|---|---|
+| | | Yes/No/Unknown | |
+
+## Schema Stability Notes
+
+## Schema Evolution Recommendation
+
+A. Strict schema contract  
+B. Schema snapshot + drift detection  
+C. Flexible rescued fields  
+D. Manual review on change  
+
+Recommended:
+
+## Caveats

package/src/dew-skills/4-implementation/dew-source-sampler/assets/source-sample-notes-template.md

@@ -0,0 +1,56 @@
+# Source Sample Notes
+
+```markdown
+---
+title: "Source Sample — {Source ID}"
+status: draft
+created: {YYYY-MM-DD}
+updated: {YYYY-MM-DD}
+workflow: dew
+relatedSource: "{Source ID}"
+evidenceType: "source-sample"
+---
+
+# Source Sample: {Source ID} — {Source Name}
+
+## Sample Location
+
+Path:
+
+URL if applicable:
+
+## Capture Method
+
+## Capture Timestamp
+
+## Sample Summary
+
+| Property | Value |
+|---|---|
+| Format | |
+| Row count | |
+| Column count | |
+| Time range | |
+| Entity/geography coverage | |
+| Size | |
+
+## Columns
+
+| Column | Example Value | Notes |
+|---|---|---|
+| | | |
+
+## Related KPI Fields
+
+| KPI Required Field | Source Column | Present? |
+|---|---|---|
+| | | Yes/No |
+
+## Caveats
+
+## Evidence Status
+
+- valid-sample
+- valid-with-caveats
+- invalid
+- blocked

package/src/dew-skills/4-implementation/dew-source-sampler/checklist.md

@@ -0,0 +1,13 @@
+# Source Sampler Checklist
+
+- [ ] Source selected.
+- [ ] Access evidence loaded or caveat recorded.
+- [ ] Sample captured or missing reason documented.
+- [ ] Sample notes created.
+- [ ] Schema snapshot created.
+- [ ] Required KPI fields mapped.
+- [ ] Row/column summary documented.
+- [ ] Time/entity/geography coverage documented where applicable.
+- [ ] Caveats documented.
+- [ ] Evidence index updated.
+- [ ] HALT-18 triggered if required evidence is missing.