dew-method 0.1.0

package/src/dew-skills/4-implementation/dew-learning-capture/assets/fde-concept-map.md

@@ -0,0 +1,77 @@
+# FDE Concept Map
+
+Use this map when creating learning notes.
+
+## Data Engineering Lifecycle
+
+- Generation / Source Systems
+- Storage
+- Ingestion
+- Transformation
+- Serving
+
+## Undercurrents
+
+- Security
+- Data Management
+- DataOps
+- Data Architecture
+- Orchestration
+- Software Engineering
+
+## Architecture Principles
+
+- architecture first, technology second
+- reversible decisions
+- loose coupling
+- plan for failure
+- cost awareness
+- security by design
+
+## Source Concepts
+
+- source ownership
+- source access
+- schema
+- grain
+- freshness
+- field coverage
+- source reliability
+
+## Ingestion Concepts
+
+- batch vs streaming
+- push vs pull
+- snapshot vs incremental
+- schema evolution
+- idempotency
+- replay/backfill
+- failure handling
+
+## Transformation Concepts
+
+- cleaning
+- conformance
+- business rules
+- grain transformation
+- aggregation
+- bridge/mapping
+- KPI computation
+
+## Serving Concepts
+
+- consumer
+- metric contract
+- semantic definition
+- trust statement
+- limitations
+- self-service
+
+## DataOps Concepts
+
+- observability
+- testing
+- CI/CD
+- runbook
+- incident handling
+- evidence

package/src/dew-skills/4-implementation/dew-learning-capture/assets/fde-learning-map-template.md

@@ -0,0 +1,29 @@
+# FDE Learning Map Template
+
+```markdown
+# FDE Learning Map
+
+## Purpose
+
+Map project work to Fundamentals of Data Engineering concepts.
+
+## Concept Map
+
+| FDE Area | Project Artifact | What Was Practiced | Confidence |
+|---|---|---|---|
+| Source Systems | source-validation-report.md | source grain/access/schema validation | Low/Medium/High |
+| Storage | storage-design.md | raw/silver/gold and metadata | |
+| Ingestion | ingestion-design.md | batch/snapshot/schema evolution | |
+| Transformation | transformation-design.md | Bronze→Silver→Gold rules | |
+| Serving | serving-data-product-spec.md | metric contract/trust statement | |
+| Data Management | governance-security-review.md | lineage/metadata/ownership | |
+| DataOps | dataops-runbook.md | monitoring/evidence/runbook | |
+| Security | governance-security-review.md | access/privacy posture | |
+| Software Engineering | stories/dev/review | testing/review/versioning | |
+
+## Weak Areas
+
+## Next Study Topics
+
+## Recommended Practice
+```

package/src/dew-skills/4-implementation/dew-learning-capture/assets/learning-depth-rubric.md

@@ -0,0 +1,22 @@
+# Learning Depth Rubric
+
+## Shallow
+
+The lesson only says what was done.
+
+Example:
+- I created ingestion.
+
+## Medium
+
+The lesson explains why it was done.
+
+Example:
+- I used batch ingestion because the source freshness requirement did not require streaming.
+
+## Deep
+
+The lesson connects decision, trade-off, evidence, and future reuse.
+
+Example:
+- I chose snapshot ingestion because the source did not provide reliable incremental cursor. This increased storage/reprocessing cost but made replay simpler. Next time I should validate whether the source has update timestamps before committing to snapshot.

package/src/dew-skills/4-implementation/dew-learning-capture/assets/learning-retrospective-template.md

@@ -0,0 +1,67 @@
+# Learning Retrospective Template
+
+```markdown
+---
+title: "{Project Name} Learning Retrospective"
+status: draft
+created: {YYYY-MM-DD}
+updated: {YYYY-MM-DD}
+workflow: dew
+phase: "4-implementation"
+stepsCompleted: []
+decisionGates:
+  GATE-29-learning-capture:
+    status: pending
+---
+
+# Learning Retrospective: {Project Name}
+
+## 0. Purpose
+
+This retrospective captures what was learned from the project.
+
+## 1. Project Summary
+
+## 2. What I Built
+
+## 3. What I Learned by Lifecycle Stage
+
+### Business / Requirements
+
+### Source Systems
+
+### Storage
+
+### Ingestion
+
+### Transformation
+
+### Modeling
+
+### Data Quality
+
+### Serving
+
+### Governance / Security
+
+### DataOps
+
+### Software Engineering
+
+## 4. Key Decisions and Why They Mattered
+
+| Decision | Artifact | Concept Learned | Lesson |
+|---|---|---|---|
+
+## 5. Mistakes Avoided
+
+## 6. Mistakes Made
+
+## 7. Concepts I Understand Better Now
+
+## 8. Concepts Still Weak
+
+## 9. What I Would Do Differently Next Time
+
+## 10. Reusable Lessons
+```

package/src/dew-skills/4-implementation/dew-learning-capture/assets/mistake-pattern-template.md

@@ -0,0 +1,25 @@
+# Mistake Pattern Template
+
+```markdown
+# Mistake Pattern Log
+
+## Mistake / Risk Pattern
+
+### What happened or almost happened?
+
+### Where did it appear?
+
+### Why it matters?
+
+### Data engineering concept
+
+### How DEW prevented or fixed it
+
+### How to avoid next time
+
+## Table
+
+| Pattern ID | Mistake/Risk | Phase | Prevention | Reusable Lesson |
+|---|---|---|---|---|
+| MP-001 | Architecture before source validation | Requirement/Architecture | Requirement Gate | Validate before designing |
+```

package/src/dew-skills/4-implementation/dew-learning-capture/checklist.md

@@ -0,0 +1,15 @@
+# Learning Capture Checklist
+
+- [ ] Project documentation loaded.
+- [ ] Release readiness loaded.
+- [ ] Decision log loaded.
+- [ ] Learning log loaded.
+- [ ] Completion notes loaded.
+- [ ] FDE learning map created.
+- [ ] Learning retrospective created.
+- [ ] Mistake pattern log created.
+- [ ] Lessons connected to artifacts.
+- [ ] Lessons connected to data engineering concepts.
+- [ ] Weak areas identified.
+- [ ] Next study topics identified.
+- [ ] Learning review gate completed.

package/src/dew-skills/4-implementation/dew-learning-capture/customize.toml

@@ -0,0 +1,41 @@
+# DO NOT EDIT -- overwritten on every update.
+#
+# Workflow customization surface for dew-learning-capture.
+
+[workflow]
+
+activation_steps_prepend = []
+activation_steps_append = []
+
+persistent_facts = [
+  "file:{project-root}/**/project-documentation.md",
+  "file:{project-root}/**/data-product-readme.md",
+  "file:{project-root}/**/release-readiness-report.md",
+  "file:{project-root}/**/e2e-validation-report.md",
+  "file:{project-root}/**/completion-notes/**/*.md",
+  "file:{project-root}/**/.decision-log.md",
+  "file:{project-root}/**/.learning-log.md",
+  "file:{project-root}/**/data-architecture.md",
+  "file:{project-root}/**/storage-design.md",
+  "file:{project-root}/**/ingestion-design.md",
+  "file:{project-root}/**/transformation-design.md",
+  "file:{project-root}/**/data-model-spec.md",
+  "file:{project-root}/**/data-quality-rules.md",
+  "file:{project-root}/**/serving-data-product-spec.md",
+  "file:{project-root}/**/dataops-runbook.md",
+]
+
+on_complete = ""
+
+learning_retrospective_template = "assets/learning-retrospective-template.md"
+fde_learning_map_template = "assets/fde-learning-map-template.md"
+mistake_pattern_template = "assets/mistake-pattern-template.md"
+learning_depth_rubric = "assets/learning-depth-rubric.md"
+fde_concept_map = "assets/fde-concept-map.md"
+checklist = "checklist.md"
+
+learning_output_path = "{learning_artifacts}/learning-capture"
+run_folder_pattern = "learning-capture-{project_name}-{date}"
+
+learning_log_path = "{learning_artifacts}/.learning-log.md"
+decision_log_path = "{planning_artifacts}/.decision-log.md"

package/src/dew-skills/4-implementation/dew-learning-capture/steps/step-01-init.md

@@ -0,0 +1,36 @@
+# Step 01 — Learning Capture Initialization
+
+## Mandatory Rules
+
+- Do not skip learning capture.
+- Do not produce shallow learning summary only.
+
+## Task
+
+Initialize learning capture.
+
+## Sequence
+
+1. Detect existing learning capture.
+
+Look for:
+- `{workflow.learning_output_path}/**/learning-retrospective.md`
+- `{learning_artifacts}/**/*learning*.md`
+
+2. Validate prerequisite:
+- project documentation or release readiness
+- decision log
+- learning log
+
+3. Create workspace:
+
+`{workflow.learning_output_path}/{workflow.run_folder_pattern}/`
+
+Create:
+- `learning-retrospective.md`
+- `fde-learning-map.md`
+- `mistake-pattern-log.md`
+
+4. Continue checkpoint:
+
+`[C] Continue to load learning context`

package/src/dew-skills/4-implementation/dew-learning-capture/steps/step-02-load-learning-context.md

@@ -0,0 +1,44 @@
+# Step 02 — Load Learning Context
+
+## Mandatory Rules
+
+- Learning must be grounded in artifacts.
+- Do not invent what the user learned.
+
+## Task
+
+Load learning context.
+
+## Extract
+
+From decision log:
+- major decisions
+- trade-offs
+- gate choices
+
+From learning log:
+- previous learning notes
+- difficulties
+- repeated weak areas
+
+From completion notes:
+- what was implemented
+- what was hard
+- what evidence was produced
+
+From project docs:
+- final product shape
+- caveats
+- run/ops behavior
+
+## Update
+
+Update:
+- learning-retrospective.md
+- fde-learning-map.md
+
+## Continue checkpoint
+
+Ask:
+
+`[C] Continue to map to FDE concepts`

package/src/dew-skills/4-implementation/dew-learning-capture/steps/step-03-map-to-fde-concepts.md

@@ -0,0 +1,46 @@
+# Step 03 — Map to FDE Concepts
+
+## Mandatory Rules
+
+- Every mapped concept must reference project artifact or decision.
+- Do not list concepts without project connection.
+
+## Task
+
+Map project work to FDE concepts.
+
+## Required areas
+
+- Source Systems
+- Storage
+- Ingestion
+- Transformation
+- Serving
+- Security
+- Data Management
+- DataOps
+- Data Architecture
+- Orchestration
+- Software Engineering
+
+## For each area
+
+Record:
+- artifact
+- what was practiced
+- lesson
+- confidence
+- weak area
+- next study topic
+
+## Update
+
+Update:
+- fde-learning-map.md
+- learning-retrospective.md
+
+## Continue checkpoint
+
+Ask:
+
+`[C] Continue to capture mistakes and decisions`

package/src/dew-skills/4-implementation/dew-learning-capture/steps/step-04-capture-mistakes-and-decisions.md

@@ -0,0 +1,34 @@
+# Step 04 — Capture Mistakes and Decisions
+
+## Mandatory Rules
+
+- Mistakes must be concrete.
+- Decisions must include trade-off and consequence.
+- Avoid generic reflection.
+
+## Task
+
+Capture:
+
+1. Mistakes avoided
+2. Mistakes made
+3. Decisions that shaped the project
+4. Anti-patterns detected
+5. Future improvements
+
+## Required table
+
+| Decision / Mistake | Artifact | Why It Mattered | Lesson |
+|---|---|---|---|
+
+## Update
+
+Update:
+- learning-retrospective.md
+- mistake-pattern-log.md
+
+## Continue checkpoint
+
+Ask:
+
+`[C] Continue to learning review gate`

package/src/dew-skills/4-implementation/dew-learning-capture/steps/step-05-learning-review-gate.md

@@ -0,0 +1,44 @@
+# Step 05 — Learning Review Gate
+
+## Mandatory Rules
+
+- Stop at this gate.
+- User must approve whether learning capture is deep enough.
+- Shallow learning capture should be revised.
+
+## Decision options
+
+A. Learning capture approved  
+B. Approved with caveats  
+C. Needs deeper explanation  
+D. Missing important learning area  
+
+## Review table
+
+| Area | Depth | Missing? | Notes |
+|---|---|---|---|
+| Source | shallow/medium/deep | | |
+| Storage | | | |
+| Ingestion | | | |
+| Transformation | | | |
+| Serving | | | |
+| DataOps | | | |
+| Security/Governance | | | |
+
+## User decision
+
+Ask user to choose A/B/C/D.
+
+Do not continue until user chooses.
+
+## Record
+
+Update:
+- learning-retrospective.md
+- .learning-log.md
+
+## Continue checkpoint
+
+Ask:
+
+`[C] Continue to finalize learning capture`

package/src/dew-skills/4-implementation/dew-learning-capture/steps/step-06-finalize.md

@@ -0,0 +1,19 @@
+# Step 06 — Finalize Learning Capture
+
+## Mandatory Rules
+
+- Do not finalize if learning gate is blocked.
+- Run checklist.
+
+## Required outputs
+
+- learning-retrospective.md
+- fde-learning-map.md
+- mistake-pattern-log.md
+- updated .learning-log.md
+
+## Next workflow
+
+Recommend:
+
+`dew-pattern-extraction`

package/src/dew-skills/4-implementation/dew-package-release/SKILL.md

@@ -0,0 +1,42 @@
+---
+name: dew-package-release
+description: Package the DEW skill module for release with versioning, release notes, checklist, and package readiness gate.
+---
+
+# DEW Package Release
+
+**Goal:** Prepare the DEW skill module for release.
+
+**Your Role:** You are a module release facilitator.
+
+You package the skill pack only after QA is passed or caveated.
+
+## Mandatory Rules
+
+- Do not package if Skill QA is blocked.
+- Do not release package without version.
+- Do not release package without release notes.
+- Do not hide unresolved QA caveats.
+- Do not mark optional example project as required unless user decides.
+- User must approve Package Release Gate.
+- If QA failed, trigger `HALT-22 — Skill Pack QA Failed`.
+- If package readiness fails, trigger `HALT-23 — Package Release Not Ready`.
+
+## On Activation
+
+1. Resolve customization.
+2. Load persistent facts.
+3. Load config if present.
+4. Load:
+   - `{workflow.packaging_report_template}`
+   - `{workflow.final_release_notes_template}`
+   - `{workflow.release_package_checklist_template}`
+   - `{workflow.versioning_rubric}`
+   - `{workflow.release_risk_rubric}`
+5. Greet user in configured language.
+
+## Execution
+
+Read fully and follow:
+
+`steps/step-01-init.md`

package/src/dew-skills/4-implementation/dew-package-release/assets/final-release-notes-template.md

@@ -0,0 +1,46 @@
+# Final Release Notes Template
+
+```markdown
+# DEW Final Release Notes
+
+## Version
+
+## Release Date
+
+## Release Type
+
+- initial
+- patch
+- minor
+- major
+- pre-release
+
+## Summary
+
+## Included Skills
+
+## Workflow Chain
+
+1. Foundation Gates / HALT / Evidence
+2. Project Brief / Business / KPI / PRD
+3. KPI Feasibility Validation
+4. Source Discovery & Validation
+5. Requirement Gate
+6. Data Architecture
+7. Storage & Ingestion Design
+8. Transformation / Modeling / DQ Design
+9. Serving / Governance / DataOps Design
+10. Epics / Stories / Implementation Readiness
+11. Dev / Code Review / Story Validation
+12. E2E Validation & Release Readiness
+13. Documentation / Learning / Pattern Extraction
+14. Packaging / Installation / Final QA
+
+## Known Caveats
+
+## Installation Notes
+
+## Upgrade Notes
+
+## Next Improvements
+```

package/src/dew-skills/4-implementation/dew-package-release/assets/packaging-report-template.md

@@ -0,0 +1,94 @@
+# Packaging Report Template
+
+```markdown
+---
+title: "DEW Package Release Report"
+status: draft
+created: {YYYY-MM-DD}
+updated: {YYYY-MM-DD}
+workflow: dew
+phase: "4-implementation"
+stepsCompleted: []
+decisionGates:
+  GATE-32-package-release:
+    status: pending
+packageVersion:
+  status: pending
+---
+
+# DEW Package Release Report
+
+## 0. Purpose
+
+This report prepares the DEW skill module for release.
+
+## 1. QA Input
+
+| QA Artifact | Path | Status | Notes |
+|---|---|---|---|
+| Skill QA Report | | | |
+| Module Catalog Audit | | | |
+
+## 2. Package Scope
+
+### Included
+
+### Excluded
+
+### Optional
+
+## 3. Package Version
+
+Version:
+
+Version type:
+- initial
+- patch
+- minor
+- major
+- pre-release
+
+## 4. Release Caveats
+
+| Caveat | Severity | Accepted? | Notes |
+|---|---|---|---|
+
+## 5. Package Contents
+
+| Path | Included? | Notes |
+|---|---|---|
+| src/dew-skills/module.yaml | | |
+| src/dew-skills/module-help.csv | | |
+| src/dew-skills/1-analysis | | |
+| src/dew-skills/2-plan-workflows | | |
+| src/dew-skills/3-solutioning | | |
+| src/dew-skills/4-implementation | | |
+
+## 6. Release Risks
+
+| Risk | Severity | Mitigation |
+|---|---|---|
+
+## 7. Release Package Checklist
+
+See:
+
+`release-package-checklist.md`
+
+## 8. Final Release Notes
+
+See:
+
+`final-release-notes.md`
+
+## 9. Package Release Gate
+
+A. Package release approved  
+B. Package release approved with caveats  
+C. Fix required before package release  
+D. Block package release  
+
+User decision:
+
+## 10. Handoff to Installation Guide
+```