fraim-framework 2.0.56 → 2.0.58
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +10 -0
- package/bin/fraim-mcp.js +14 -0
- package/bin/fraim.js +23 -0
- package/dist/src/cli/commands/init-project.js +10 -4
- package/dist/src/cli/commands/mcp.js +65 -0
- package/dist/src/cli/setup/mcp-config-generator.js +19 -16
- package/dist/src/fraim/issue-tracking/ado-provider.js +304 -0
- package/dist/src/fraim/issue-tracking/factory.js +63 -0
- package/dist/src/fraim/issue-tracking/github-provider.js +200 -0
- package/dist/src/fraim/issue-tracking/types.js +7 -0
- package/dist/src/fraim/issue-tracking-config.js +83 -0
- package/dist/src/local-mcp-server/stdio-server.js +207 -0
- package/dist/src/utils/workflow-parser.js +81 -0
- package/package.json +17 -12
- package/registry/scripts/pdf-styles.css +172 -0
- package/registry/scripts/prep-issue.sh +46 -4
- package/registry/scripts/profile-server.ts +131 -130
- package/registry/stubs/workflows/customer-development/user-survey-dispatch.md +1 -1
- package/registry/stubs/workflows/customer-development/users-to-target.md +1 -1
- package/registry/stubs/workflows/product-building/design.md +1 -1
- package/registry/stubs/workflows/product-building/implement.md +1 -1
- package/Claude.md +0 -1
- package/dist/registry/ai-manager-rules/customer-development-phases/phase1-customer-profiling.md +0 -101
- package/dist/registry/ai-manager-rules/customer-development-phases/phase2-platform-discovery.md +0 -235
- package/dist/registry/ai-manager-rules/customer-development-phases/phase3-prospect-qualification.md +0 -243
- package/dist/registry/ai-manager-rules/customer-development-phases/phase4-inventory-compilation.md +0 -206
- package/dist/registry/ai-manager-rules/design-phases/design-completeness-review.md +0 -73
- package/dist/registry/ai-manager-rules/design-phases/design-design.md +0 -145
- package/dist/registry/ai-manager-rules/implement-phases/implement-code.md +0 -283
- package/dist/registry/ai-manager-rules/implement-phases/implement-completeness-review.md +0 -120
- package/dist/registry/ai-manager-rules/implement-phases/implement-regression.md +0 -173
- package/dist/registry/ai-manager-rules/implement-phases/implement-repro.md +0 -104
- package/dist/registry/ai-manager-rules/implement-phases/implement-scoping.md +0 -100
- package/dist/registry/ai-manager-rules/implement-phases/implement-smoke.md +0 -237
- package/dist/registry/ai-manager-rules/implement-phases/implement-spike.md +0 -121
- package/dist/registry/ai-manager-rules/implement-phases/implement-validate.md +0 -375
- package/dist/registry/ai-manager-rules/retrospective.md +0 -116
- package/dist/registry/ai-manager-rules/shared-phases/address-pr-feedback.md +0 -188
- package/dist/registry/ai-manager-rules/shared-phases/submit-pr.md +0 -202
- package/dist/registry/ai-manager-rules/shared-phases/wait-for-pr-review.md +0 -170
- package/dist/registry/ai-manager-rules/spec-phases/spec-competitor-analysis.md +0 -105
- package/dist/registry/ai-manager-rules/spec-phases/spec-completeness-review.md +0 -66
- package/dist/registry/ai-manager-rules/spec-phases/spec-spec.md +0 -139
- package/dist/registry/ai-manager-rules/user-survey-phases/phase1-survey-scoping.md +0 -60
- package/dist/registry/ai-manager-rules/user-survey-phases/phase2-survey-build-linkedin.md +0 -23
- package/dist/registry/ai-manager-rules/user-survey-phases/phase3-survey-build-reddit.md +0 -22
- package/dist/registry/ai-manager-rules/user-survey-phases/phase4-survey-build-x.md +0 -21
- package/dist/registry/ai-manager-rules/user-survey-phases/phase5-survey-build-facebook.md +0 -19
- package/dist/registry/ai-manager-rules/user-survey-phases/phase6-survey-build-custom.md +0 -15
- package/dist/registry/ai-manager-rules/user-survey-phases/phase7-survey-dispatch.md +0 -45
- package/dist/registry/providers/ado.json +0 -19
- package/dist/registry/providers/github.json +0 -19
- package/dist/registry/scripts/cleanup-branch.js +0 -287
- package/dist/registry/scripts/evaluate-code-quality.js +0 -66
- package/dist/registry/scripts/exec-with-timeout.js +0 -142
- package/dist/registry/scripts/generate-engagement-emails.js +0 -705
- package/dist/registry/scripts/newsletter-helpers.js +0 -671
- package/dist/registry/scripts/profile-server.js +0 -388
- package/dist/registry/scripts/run-thank-you-workflow.js +0 -92
- package/dist/registry/scripts/send-newsletter-simple.js +0 -85
- package/dist/registry/scripts/send-thank-you-emails.js +0 -54
- package/dist/registry/scripts/validate-openapi-limits.js +0 -311
- package/dist/registry/scripts/validate-test-coverage.js +0 -262
- package/dist/registry/scripts/verify-test-coverage.js +0 -66
- package/dist/registry/templates/bootstrap/ARCHITECTURE-TEMPLATE.md +0 -53
- package/dist/registry/templates/bootstrap/CODE-QUALITY-REPORT-TEMPLATE.md +0 -37
- package/dist/registry/templates/bootstrap/TEST-COVERAGE-REPORT-TEMPLATE.md +0 -35
- package/dist/registry/templates/business-development/IDEATION-REPORT-TEMPLATE.md +0 -29
- package/dist/registry/templates/business-development/PRICING-STRATEGY-TEMPLATE.md +0 -126
- package/dist/registry/templates/customer-development/customer-interview-template.md +0 -99
- package/dist/registry/templates/customer-development/customer-persona-template.md +0 -69
- package/dist/registry/templates/customer-development/follow-up-email-templates.md +0 -132
- package/dist/registry/templates/customer-development/insight-analysis-template.md +0 -74
- package/dist/registry/templates/customer-development/prospect-inventory-template.csv +0 -3
- package/dist/registry/templates/customer-development/search-strategy-template.md +0 -123
- package/dist/registry/templates/customer-development/strategic-recommendations-template.md +0 -53
- package/dist/registry/templates/customer-development/thank-you-email-template.html +0 -124
- package/dist/registry/templates/customer-development/thank-you-note-template.md +0 -16
- package/dist/registry/templates/customer-development/triage-log-template.md +0 -278
- package/dist/registry/templates/customer-development/weekly-newsletter-template.html +0 -204
- package/dist/registry/templates/evidence/Design-Evidence.md +0 -30
- package/dist/registry/templates/evidence/Implementation-BugEvidence.md +0 -94
- package/dist/registry/templates/evidence/Implementation-FeatureEvidence.md +0 -129
- package/dist/registry/templates/evidence/Spec-Evidence.md +0 -19
- package/dist/registry/templates/help/HelpNeeded.md +0 -14
- package/dist/registry/templates/legal/NDA-TEMPLATE.md +0 -170
- package/dist/registry/templates/legal/PATENT-TEMPLATE.md +0 -372
- package/dist/registry/templates/legal/TRADEMARK-TEMPLATE.md +0 -339
- package/dist/registry/templates/legal/contract-review-checklist.md +0 -193
- package/dist/registry/templates/legal/review-report-template.md +0 -198
- package/dist/registry/templates/legal/saas-terms-template.md +0 -174
- package/dist/registry/templates/legal/sow-template.md +0 -117
- package/dist/registry/templates/legal/template-variables.md +0 -131
- package/dist/registry/templates/marketing/DOMAIN-REGISTRATION-TEMPLATE.md +0 -194
- package/dist/registry/templates/marketing/HBR-ARTICLE-TEMPLATE.md +0 -66
- package/dist/registry/templates/marketing/STORYTELLING-TEMPLATE.md +0 -130
- package/dist/registry/templates/marketing/WEBSITE-TEMPLATE.md +0 -262
- package/dist/registry/templates/marketing/github-pages-workflow.yml +0 -64
- package/dist/registry/templates/replicate/implementation-checklist.md +0 -39
- package/dist/registry/templates/replicate/use-cases-template.md +0 -88
- package/dist/registry/templates/retrospective/RETROSPECTIVE-TEMPLATE.md +0 -55
- package/dist/registry/templates/specs/BUGSPEC-TEMPLATE.md +0 -37
- package/dist/registry/templates/specs/FEATURESPEC-TEMPLATE.md +0 -66
- package/dist/registry/templates/specs/TECHSPEC-TEMPLATE.md +0 -39
- package/dist/registry/workflows/bootstrap/create-architecture.md +0 -38
- package/dist/registry/workflows/bootstrap/detect-broken-windows.md +0 -300
- package/dist/registry/workflows/bootstrap/evaluate-code-quality.md +0 -35
- package/dist/registry/workflows/bootstrap/verify-test-coverage.md +0 -36
- package/dist/registry/workflows/brainstorming/blue-sky-brainstorming.md +0 -211
- package/dist/registry/workflows/brainstorming/codebase-brainstorming.md +0 -165
- package/dist/registry/workflows/business-development/create-business-plan.md +0 -737
- package/dist/registry/workflows/business-development/ideate-business-opportunity.md +0 -55
- package/dist/registry/workflows/business-development/price-product.md +0 -325
- package/dist/registry/workflows/compliance/detect-compliance-requirements.md +0 -78
- package/dist/registry/workflows/compliance/generate-audit-evidence.md +0 -75
- package/dist/registry/workflows/compliance/soc2-evidence-generator.md +0 -332
- package/dist/registry/workflows/customer-development/insight-analysis.md +0 -156
- package/dist/registry/workflows/customer-development/insight-triage.md +0 -938
- package/dist/registry/workflows/customer-development/interview-preparation.md +0 -452
- package/dist/registry/workflows/customer-development/linkedin-outreach.md +0 -593
- package/dist/registry/workflows/customer-development/strategic-brainstorming.md +0 -146
- package/dist/registry/workflows/customer-development/thank-customers.md +0 -203
- package/dist/registry/workflows/customer-development/user-survey-dispatch.md +0 -60
- package/dist/registry/workflows/customer-development/users-to-target.md +0 -112
- package/dist/registry/workflows/customer-development/weekly-newsletter.md +0 -366
- package/dist/registry/workflows/deploy/cloud-deployment.md +0 -310
- package/dist/registry/workflows/improve-fraim/contribute.md +0 -32
- package/dist/registry/workflows/improve-fraim/file-issue.md +0 -32
- package/dist/registry/workflows/learning/build-skillset.md +0 -212
- package/dist/registry/workflows/learning/synthesize-learnings.md +0 -284
- package/dist/registry/workflows/legal/contract-review-analysis.md +0 -382
- package/dist/registry/workflows/legal/nda.md +0 -69
- package/dist/registry/workflows/legal/patent-filing.md +0 -76
- package/dist/registry/workflows/legal/saas-contract-development.md +0 -213
- package/dist/registry/workflows/legal/trademark-filing.md +0 -77
- package/dist/registry/workflows/marketing/content-creation.md +0 -37
- package/dist/registry/workflows/marketing/convert-to-pdf.md +0 -235
- package/dist/registry/workflows/marketing/create-modern-website.md +0 -456
- package/dist/registry/workflows/marketing/domain-registration.md +0 -323
- package/dist/registry/workflows/marketing/hbr-article.md +0 -73
- package/dist/registry/workflows/marketing/launch-checklist.md +0 -37
- package/dist/registry/workflows/marketing/marketing-strategy.md +0 -45
- package/dist/registry/workflows/marketing/storytelling.md +0 -65
- package/dist/registry/workflows/performance/analyze-performance.md +0 -65
- package/dist/registry/workflows/product-building/design.md +0 -103
- package/dist/registry/workflows/product-building/implement.md +0 -74
- package/dist/registry/workflows/product-building/iterate-on-pr-comments.md +0 -70
- package/dist/registry/workflows/product-building/prep-issue.md +0 -41
- package/dist/registry/workflows/product-building/prototype.md +0 -65
- package/dist/registry/workflows/product-building/resolve.md +0 -168
- package/dist/registry/workflows/product-building/retrospect.md +0 -86
- package/dist/registry/workflows/product-building/spec.md +0 -181
- package/dist/registry/workflows/product-building/test.md +0 -125
- package/dist/registry/workflows/productivity-report/productivity-report.md +0 -263
- package/dist/registry/workflows/quality-assurance/browser-validation.md +0 -221
- package/dist/registry/workflows/quality-assurance/iterative-improvement-cycle.md +0 -562
- package/dist/registry/workflows/replicate/replicate-discovery.md +0 -336
- package/dist/registry/workflows/replicate/replicate-to-issues.md +0 -324
- package/dist/registry/workflows/reviewer/review-implementation-vs-design-spec.md +0 -638
- package/dist/registry/workflows/reviewer/review-implementation-vs-feature-spec.md +0 -675
- package/dist/registry/workflows/startup-credits/aws-activate-application.md +0 -535
- package/dist/registry/workflows/startup-credits/google-cloud-application.md +0 -647
- package/dist/registry/workflows/startup-credits/microsoft-azure-application.md +0 -538
- package/dist/scripts/build-stub-registry.js +0 -108
- package/dist/src/ai-manager/ai-manager.js +0 -480
- package/dist/src/ai-manager/phase-flow.js +0 -357
- package/dist/src/ai-manager/types.js +0 -5
- package/dist/src/fraim-mcp-server.js +0 -1885
- package/dist/tests/debug-tools.js +0 -80
- package/dist/tests/shared-server-utils.js +0 -57
- package/dist/tests/test-add-ide.js +0 -283
- package/dist/tests/test-ai-coach-edge-cases.js +0 -420
- package/dist/tests/test-ai-coach-mcp-integration.js +0 -450
- package/dist/tests/test-ai-coach-performance.js +0 -328
- package/dist/tests/test-ai-coach-phase-content.js +0 -264
- package/dist/tests/test-ai-coach-workflows.js +0 -514
- package/dist/tests/test-cli.js +0 -228
- package/dist/tests/test-client-scripts-validation.js +0 -167
- package/dist/tests/test-complete-setup-flow.js +0 -110
- package/dist/tests/test-config-system.js +0 -279
- package/dist/tests/test-debug-session.js +0 -134
- package/dist/tests/test-end-to-end-hybrid-validation.js +0 -328
- package/dist/tests/test-enhanced-session-init.js +0 -188
- package/dist/tests/test-first-run-journey.js +0 -368
- package/dist/tests/test-fraim-issues.js +0 -59
- package/dist/tests/test-genericization.js +0 -44
- package/dist/tests/test-hybrid-script-execution.js +0 -340
- package/dist/tests/test-ide-detector.js +0 -46
- package/dist/tests/test-improved-setup.js +0 -121
- package/dist/tests/test-mcp-config-generator.js +0 -99
- package/dist/tests/test-mcp-connection.js +0 -107
- package/dist/tests/test-mcp-issue-integration.js +0 -156
- package/dist/tests/test-mcp-lifecycle-methods.js +0 -240
- package/dist/tests/test-mcp-shared-server.js +0 -308
- package/dist/tests/test-mcp-template-processing.js +0 -160
- package/dist/tests/test-modular-issue-tracking.js +0 -165
- package/dist/tests/test-node-compatibility.js +0 -95
- package/dist/tests/test-npm-install.js +0 -68
- package/dist/tests/test-package-size.js +0 -108
- package/dist/tests/test-pr-review-workflow.js +0 -307
- package/dist/tests/test-prep-issue.js +0 -129
- package/dist/tests/test-productivity-integration.js +0 -157
- package/dist/tests/test-script-location-independence.js +0 -198
- package/dist/tests/test-script-sync.js +0 -557
- package/dist/tests/test-server-utils.js +0 -32
- package/dist/tests/test-session-rehydration.js +0 -148
- package/dist/tests/test-setup-integration.js +0 -98
- package/dist/tests/test-setup-scenarios.js +0 -322
- package/dist/tests/test-standalone.js +0 -143
- package/dist/tests/test-stub-registry.js +0 -136
- package/dist/tests/test-sync-stubs.js +0 -143
- package/dist/tests/test-sync-version-update.js +0 -93
- package/dist/tests/test-telemetry.js +0 -193
- package/dist/tests/test-token-validator.js +0 -30
- package/dist/tests/test-user-journey.js +0 -236
- package/dist/tests/test-users-to-target-workflow.js +0 -253
- package/dist/tests/test-utils.js +0 -109
- package/dist/tests/test-wizard.js +0 -71
- package/dist/tests/test-workflow-discovery.js +0 -242
- package/labels.json +0 -52
- package/registry/agent-guardrails.md +0 -63
- package/registry/fraim.md +0 -48
- package/setup.js +0 -171
- package/tsconfig.json +0 -23
|
@@ -1,332 +0,0 @@
|
|
|
1
|
-
# Learned Skill: SOC2 Evidence Generator
|
|
2
|
-
|
|
3
|
-
**Category:** compliance
|
|
4
|
-
**Created:** 2026-02-01
|
|
5
|
-
**Last Updated:** 2026-02-01
|
|
6
|
-
**Project Context:** FRAIM Framework - AI Management System requiring SOC2 compliance for enterprise customers
|
|
7
|
-
|
|
8
|
-
---
|
|
9
|
-
|
|
10
|
-
## INTENT
|
|
11
|
-
Generate comprehensive SOC2 compliance evidence packages by automatically collecting, documenting, and formatting evidence from project systems to demonstrate adherence to Trust Service Criteria during annual audits.
|
|
12
|
-
|
|
13
|
-
## PRINCIPLES
|
|
14
|
-
- **Comprehensive Coverage**: Address all five Trust Service Criteria (Security, Availability, Processing Integrity, Confidentiality, Privacy)
|
|
15
|
-
- **Automated Collection**: Minimize manual effort through systematic evidence gathering
|
|
16
|
-
- **Auditor-Ready Format**: Present evidence in formats auditors expect and can easily review
|
|
17
|
-
- **Gap Detection**: Identify missing controls and evidence to ensure audit readiness
|
|
18
|
-
- **Continuous Monitoring**: Support ongoing evidence collection throughout the year
|
|
19
|
-
|
|
20
|
-
## SOC2 REFERENCE MATERIALS
|
|
21
|
-
|
|
22
|
-
### Official SOC2 Resources
|
|
23
|
-
- **AICPA SOC2 Framework**: https://www.aicpa.org/resources/landing/system-and-organization-controls-soc-suite-of-services
|
|
24
|
-
- **Trust Service Criteria**: https://www.aicpa.org/content/dam/aicpa/interestareas/frc/assuranceadvisoryservices/downloadabledocuments/trust-services-criteria.pdf
|
|
25
|
-
- **SOC2 Implementation Guide**: https://www.aicpa.org/resources/download/soc-2-implementation-guide
|
|
26
|
-
|
|
27
|
-
### Trust Service Criteria Details
|
|
28
|
-
1. **Security (CC1.0-CC9.0)**: https://www.aicpa.org/content/dam/aicpa/interestareas/frc/assuranceadvisoryservices/downloadabledocuments/trust-services-criteria.pdf#page=15
|
|
29
|
-
2. **Availability (A1.0-A1.3)**: System availability and operational requirements
|
|
30
|
-
3. **Processing Integrity (PI1.0-PI1.3)**: Data processing accuracy and completeness
|
|
31
|
-
4. **Confidentiality (C1.0-C1.2)**: Information protection and access controls
|
|
32
|
-
5. **Privacy (P1.0-P9.0)**: Personal information handling and protection
|
|
33
|
-
|
|
34
|
-
## WORKFLOW
|
|
35
|
-
|
|
36
|
-
### Phase 1: Evidence Planning & Scoping
|
|
37
|
-
**Objective**: Identify applicable controls and map evidence sources
|
|
38
|
-
|
|
39
|
-
**Actions**:
|
|
40
|
-
1. **Review Project Configuration**:
|
|
41
|
-
- Read `.fraim/config.json` compliance settings
|
|
42
|
-
- Confirm SOC2 Trust Service Criteria in scope
|
|
43
|
-
- Identify project-specific compliance requirements
|
|
44
|
-
|
|
45
|
-
2. **Map Controls to Evidence Sources**:
|
|
46
|
-
- **GitHub Repository**: Access controls, change management, code reviews
|
|
47
|
-
- **Application Logs**: Security events, error handling, monitoring
|
|
48
|
-
- **Infrastructure**: System configurations, backup procedures
|
|
49
|
-
- **Documentation**: Policies, procedures, incident response plans
|
|
50
|
-
- **Dependencies**: Vulnerability management, third-party assessments
|
|
51
|
-
|
|
52
|
-
3. **Create Evidence Collection Plan**:
|
|
53
|
-
- Define evidence collection timeline (typically 12 months)
|
|
54
|
-
- Assign responsibility for each evidence type
|
|
55
|
-
- Establish evidence retention and storage procedures
|
|
56
|
-
|
|
57
|
-
**Tools/Resources**:
|
|
58
|
-
- `.fraim/config.json` for compliance configuration
|
|
59
|
-
- SOC2 Trust Service Criteria mapping template
|
|
60
|
-
- Evidence collection checklist
|
|
61
|
-
|
|
62
|
-
**Output**: Comprehensive evidence collection plan with timelines and responsibilities
|
|
63
|
-
|
|
64
|
-
### Phase 2: Automated Evidence Collection
|
|
65
|
-
**Objective**: Systematically gather evidence from all identified sources
|
|
66
|
-
|
|
67
|
-
**Security Controls Evidence**:
|
|
68
|
-
1. **Access Management (CC6.0)**:
|
|
69
|
-
- GitHub user access reports and permissions
|
|
70
|
-
- Repository access logs and audit trails
|
|
71
|
-
- Multi-factor authentication configurations
|
|
72
|
-
- User provisioning/deprovisioning records
|
|
73
|
-
|
|
74
|
-
2. **Change Management (CC8.0)**:
|
|
75
|
-
- Git commit history with author attribution
|
|
76
|
-
- Pull request reviews and approvals
|
|
77
|
-
- Deployment logs and change approvals
|
|
78
|
-
- Emergency change procedures documentation
|
|
79
|
-
|
|
80
|
-
3. **System Monitoring (CC7.0)**:
|
|
81
|
-
- Application error logs and monitoring alerts
|
|
82
|
-
- Security incident logs and response records
|
|
83
|
-
- Vulnerability scan results and remediation
|
|
84
|
-
- System performance and availability metrics
|
|
85
|
-
|
|
86
|
-
**Availability Controls Evidence**:
|
|
87
|
-
1. **System Availability (A1.0)**:
|
|
88
|
-
- Uptime monitoring reports and SLA metrics
|
|
89
|
-
- Backup and recovery test results
|
|
90
|
-
- Disaster recovery procedures and testing
|
|
91
|
-
- Capacity planning and resource monitoring
|
|
92
|
-
|
|
93
|
-
**Processing Integrity Evidence**:
|
|
94
|
-
1. **Data Processing (PI1.0)**:
|
|
95
|
-
- Input validation and error handling logs
|
|
96
|
-
- Data processing accuracy controls
|
|
97
|
-
- System processing completeness checks
|
|
98
|
-
- Automated testing results and coverage
|
|
99
|
-
|
|
100
|
-
**Confidentiality Evidence**:
|
|
101
|
-
1. **Data Protection (C1.0)**:
|
|
102
|
-
- Encryption implementation and key management
|
|
103
|
-
- Data classification and handling procedures
|
|
104
|
-
- Secure transmission and storage controls
|
|
105
|
-
- Data access logging and monitoring
|
|
106
|
-
|
|
107
|
-
**Privacy Evidence** (if applicable):
|
|
108
|
-
1. **Personal Information (P1.0-P9.0)**:
|
|
109
|
-
- Privacy policy and consent management
|
|
110
|
-
- Data collection and usage documentation
|
|
111
|
-
- Data subject rights procedures
|
|
112
|
-
- Data retention and disposal records
|
|
113
|
-
|
|
114
|
-
**Tools/Resources**:
|
|
115
|
-
- GitHub API for access and change management data
|
|
116
|
-
- Application logging systems for security events
|
|
117
|
-
- Monitoring tools for availability and performance data
|
|
118
|
-
- Documentation repositories for policies and procedures
|
|
119
|
-
|
|
120
|
-
**Output**: Organized evidence files mapped to specific SOC2 controls
|
|
121
|
-
|
|
122
|
-
### Phase 3: Evidence Documentation & Formatting
|
|
123
|
-
**Objective**: Create auditor-ready evidence packages with proper documentation
|
|
124
|
-
|
|
125
|
-
**Actions**:
|
|
126
|
-
1. **Generate Evidence Narratives**:
|
|
127
|
-
- Create control descriptions explaining how each control operates
|
|
128
|
-
- Document control design and implementation details
|
|
129
|
-
- Provide context for evidence and its relevance to controls
|
|
130
|
-
|
|
131
|
-
2. **Format Evidence Packages**:
|
|
132
|
-
- Organize evidence by Trust Service Criteria
|
|
133
|
-
- Include screenshots and system configurations
|
|
134
|
-
- Create evidence matrices mapping controls to evidence
|
|
135
|
-
- Add timestamps and data integrity verification
|
|
136
|
-
|
|
137
|
-
3. **Create Supporting Documentation**:
|
|
138
|
-
- System boundary descriptions and network diagrams
|
|
139
|
-
- Vendor management and third-party assessments
|
|
140
|
-
- Incident response procedures and testing results
|
|
141
|
-
- Employee training records and security awareness
|
|
142
|
-
|
|
143
|
-
**Evidence Package Structure**:
|
|
144
|
-
```
|
|
145
|
-
docs/compliance/soc2-evidence/
|
|
146
|
-
├── 01-security/
|
|
147
|
-
│ ├── CC1-control-environment/
|
|
148
|
-
│ ├── CC2-communication-information/
|
|
149
|
-
│ ├── CC3-risk-assessment/
|
|
150
|
-
│ ├── CC4-monitoring-activities/
|
|
151
|
-
│ ├── CC5-control-activities/
|
|
152
|
-
│ ├── CC6-logical-physical-access/
|
|
153
|
-
│ ├── CC7-system-operations/
|
|
154
|
-
│ ├── CC8-change-management/
|
|
155
|
-
│ └── CC9-risk-mitigation/
|
|
156
|
-
├── 02-availability/
|
|
157
|
-
├── 03-processing-integrity/
|
|
158
|
-
├── 04-confidentiality/
|
|
159
|
-
├── 05-privacy/
|
|
160
|
-
└── evidence-matrix.xlsx
|
|
161
|
-
```
|
|
162
|
-
|
|
163
|
-
**Tools/Resources**:
|
|
164
|
-
- Evidence documentation templates
|
|
165
|
-
- Screenshot and configuration capture tools
|
|
166
|
-
- Evidence matrix spreadsheet templates
|
|
167
|
-
|
|
168
|
-
**Output**: Complete, organized evidence packages ready for auditor review
|
|
169
|
-
|
|
170
|
-
### Phase 4: Evidence Validation & Gap Analysis
|
|
171
|
-
**Objective**: Ensure evidence completeness and identify compliance gaps
|
|
172
|
-
|
|
173
|
-
**Actions**:
|
|
174
|
-
1. **Evidence Completeness Review**:
|
|
175
|
-
- Verify all required controls have supporting evidence
|
|
176
|
-
- Check evidence quality and relevance to controls
|
|
177
|
-
- Validate evidence covers the full audit period
|
|
178
|
-
- Confirm evidence integrity and authenticity
|
|
179
|
-
|
|
180
|
-
2. **Gap Analysis**:
|
|
181
|
-
- Identify missing evidence or incomplete controls
|
|
182
|
-
- Assess control design and operating effectiveness
|
|
183
|
-
- Document exceptions and compensating controls
|
|
184
|
-
- Prioritize gaps by risk and audit impact
|
|
185
|
-
|
|
186
|
-
3. **Create Evidence Documentation**:
|
|
187
|
-
- Generate evidence summary reports
|
|
188
|
-
- Create control testing worksheets
|
|
189
|
-
- Document management responses to findings
|
|
190
|
-
- Prepare evidence index and cross-references
|
|
191
|
-
|
|
192
|
-
4. **File Issues for Detected Gaps**:
|
|
193
|
-
- Create GitHub issues for missing controls
|
|
194
|
-
- Document remediation plans and timelines
|
|
195
|
-
- Assign responsibility for gap closure
|
|
196
|
-
- Track progress on compliance improvements
|
|
197
|
-
|
|
198
|
-
**Tools/Resources**:
|
|
199
|
-
- Evidence validation checklists
|
|
200
|
-
- Gap analysis templates
|
|
201
|
-
- GitHub issue templates for compliance gaps
|
|
202
|
-
|
|
203
|
-
**Output**: Validated evidence packages and documented remediation plans for any gaps
|
|
204
|
-
|
|
205
|
-
## EVIDENCE COLLECTION COMMANDS
|
|
206
|
-
|
|
207
|
-
### GitHub Evidence Collection
|
|
208
|
-
```bash
|
|
209
|
-
# Access management evidence
|
|
210
|
-
git log --pretty=format:"%h %an %ad %s" --date=short --since="1 year ago" > access-logs.txt
|
|
211
|
-
|
|
212
|
-
# Change management evidence
|
|
213
|
-
git log --oneline --since="1 year ago" --grep="security\|fix\|patch" > security-changes.txt
|
|
214
|
-
|
|
215
|
-
# Code review evidence
|
|
216
|
-
gh pr list --state=all --limit=1000 --json=number,title,author,reviewDecision,createdAt > pr-reviews.json
|
|
217
|
-
```
|
|
218
|
-
|
|
219
|
-
### System Evidence Collection
|
|
220
|
-
```bash
|
|
221
|
-
# Application logs (security events)
|
|
222
|
-
grep -i "error\|security\|auth\|access" logs/*.log > security-events.txt
|
|
223
|
-
|
|
224
|
-
# Dependency vulnerability scans
|
|
225
|
-
npm audit --json > vulnerability-scan.json
|
|
226
|
-
|
|
227
|
-
# Test coverage reports
|
|
228
|
-
npm test -- --coverage > test-coverage.txt
|
|
229
|
-
```
|
|
230
|
-
|
|
231
|
-
## EVIDENCE TEMPLATES
|
|
232
|
-
|
|
233
|
-
### Control Narrative Template
|
|
234
|
-
```markdown
|
|
235
|
-
# Control [Control ID]: [Control Title]
|
|
236
|
-
|
|
237
|
-
## Control Description
|
|
238
|
-
[Detailed description of how the control operates]
|
|
239
|
-
|
|
240
|
-
## Control Design
|
|
241
|
-
[How the control is designed to address the criteria]
|
|
242
|
-
|
|
243
|
-
## Control Implementation
|
|
244
|
-
[How the control is implemented in practice]
|
|
245
|
-
|
|
246
|
-
## Evidence Provided
|
|
247
|
-
- [Evidence item 1]: [Description and relevance]
|
|
248
|
-
- [Evidence item 2]: [Description and relevance]
|
|
249
|
-
|
|
250
|
-
## Testing Performed
|
|
251
|
-
[Description of control testing and results]
|
|
252
|
-
|
|
253
|
-
## Exceptions/Deviations
|
|
254
|
-
[Any exceptions or deviations noted]
|
|
255
|
-
```
|
|
256
|
-
|
|
257
|
-
### Gap Analysis Template
|
|
258
|
-
```markdown
|
|
259
|
-
# SOC2 Compliance Gap Analysis
|
|
260
|
-
|
|
261
|
-
## Control: [Control ID and Title]
|
|
262
|
-
|
|
263
|
-
### Gap Description
|
|
264
|
-
[Detailed description of the identified gap]
|
|
265
|
-
|
|
266
|
-
### Risk Assessment
|
|
267
|
-
- **Risk Level**: [High/Medium/Low]
|
|
268
|
-
- **Impact**: [Description of potential impact]
|
|
269
|
-
- **Likelihood**: [Assessment of likelihood]
|
|
270
|
-
|
|
271
|
-
### Remediation Plan
|
|
272
|
-
- **Action Required**: [Specific actions needed]
|
|
273
|
-
- **Owner**: [Responsible party]
|
|
274
|
-
- **Target Date**: [Completion deadline]
|
|
275
|
-
- **Status**: [Current status]
|
|
276
|
-
|
|
277
|
-
### Compensating Controls
|
|
278
|
-
[Any existing controls that partially address the gap]
|
|
279
|
-
```
|
|
280
|
-
|
|
281
|
-
## SUCCESS CRITERIA
|
|
282
|
-
- [ ] All applicable Trust Service Criteria have supporting evidence
|
|
283
|
-
- [ ] Evidence covers the full 12-month audit period
|
|
284
|
-
- [ ] Evidence is properly organized and documented for auditor review
|
|
285
|
-
- [ ] All compliance gaps are identified and documented
|
|
286
|
-
- [ ] Remediation plans are created for identified gaps
|
|
287
|
-
- [ ] GitHub issues are filed for missing controls or evidence
|
|
288
|
-
- [ ] Evidence packages are validated for completeness and quality
|
|
289
|
-
|
|
290
|
-
## COMMON EVIDENCE GAPS
|
|
291
|
-
|
|
292
|
-
### Frequently Missing Evidence
|
|
293
|
-
1. **Vendor Management**: Third-party security assessments and contracts
|
|
294
|
-
2. **Incident Response**: Documented incidents and response procedures
|
|
295
|
-
3. **Business Continuity**: Disaster recovery testing and procedures
|
|
296
|
-
4. **Employee Training**: Security awareness training records
|
|
297
|
-
5. **Risk Assessment**: Formal risk assessments and mitigation plans
|
|
298
|
-
|
|
299
|
-
### System-Specific Gaps for FRAIM
|
|
300
|
-
1. **AI/ML Controls**: Model governance and data processing integrity
|
|
301
|
-
2. **API Security**: Authentication and authorization controls
|
|
302
|
-
3. **Data Pipeline**: Processing accuracy and completeness controls
|
|
303
|
-
4. **Multi-tenant**: Data segregation and access controls
|
|
304
|
-
5. **Integration**: Third-party service security assessments
|
|
305
|
-
|
|
306
|
-
## FINAL ACTIONS
|
|
307
|
-
|
|
308
|
-
After completing evidence collection and gap analysis, this skill will:
|
|
309
|
-
|
|
310
|
-
1. **Create Evidence Documentation**:
|
|
311
|
-
- Generate complete evidence packages in `docs/compliance/soc2-evidence/`
|
|
312
|
-
- Create evidence matrix mapping controls to evidence
|
|
313
|
-
- Document control narratives and testing procedures
|
|
314
|
-
|
|
315
|
-
2. **File Compliance Issues**:
|
|
316
|
-
- Create GitHub issues for each identified gap
|
|
317
|
-
- Include remediation plans and target dates
|
|
318
|
-
- Assign appropriate labels (compliance, security, priority)
|
|
319
|
-
- Link related issues and dependencies
|
|
320
|
-
|
|
321
|
-
3. **Generate Audit Readiness Report**:
|
|
322
|
-
- Summarize evidence collection status
|
|
323
|
-
- Highlight any remaining gaps or risks
|
|
324
|
-
- Provide recommendations for audit preparation
|
|
325
|
-
- Create timeline for final audit preparation
|
|
326
|
-
|
|
327
|
-
## NOTES
|
|
328
|
-
- Evidence collection should begin at least 3 months before the audit
|
|
329
|
-
- Some evidence requires continuous collection throughout the year
|
|
330
|
-
- Coordinate with legal and security teams for policy documentation
|
|
331
|
-
- Consider engaging a SOC2 consultant for first-time audits
|
|
332
|
-
- Maintain evidence integrity through proper version control and access controls
|
|
@@ -1,156 +0,0 @@
|
|
|
1
|
-
# Insight Analysis Workflow
|
|
2
|
-
|
|
3
|
-
## INTENT
|
|
4
|
-
To help Product Managers extract, structure, and analyze customer insights from interview notes, enabling data-driven product decisions and systematic customer relationship management.
|
|
5
|
-
|
|
6
|
-
## PRINCIPLES
|
|
7
|
-
- **Comprehensive Extraction**: Capture all insights from raw notes
|
|
8
|
-
- **Structured Analysis**: Organize insights into actionable categories
|
|
9
|
-
- **Customer Scoring**: Evaluate customer fit and prioritization
|
|
10
|
-
- **Follow-up Generation**: Create personalized follow-up communications
|
|
11
|
-
|
|
12
|
-
## WORKFLOW TRIGGER
|
|
13
|
-
**PM explicitly starts this workflow**:
|
|
14
|
-
- "Starting Insight Analysis for [Customer Name]"
|
|
15
|
-
- "I want to analyze the interview with [Customer Name]"
|
|
16
|
-
- "Following the insight analysis workflow"
|
|
17
|
-
|
|
18
|
-
## INPUT REQUIREMENTS
|
|
19
|
-
**PM provides**:
|
|
20
|
-
- The `[customer-name]-interview-prep.md` file that needs to be updated
|
|
21
|
-
- Raw interview notes in any format (bullet points, paragraphs, voice-to-text, etc.)
|
|
22
|
-
- Brief unstructured thoughts about the interview (optional but helpful)
|
|
23
|
-
|
|
24
|
-
## AI AGENT PROCESS
|
|
25
|
-
|
|
26
|
-
### Step 1: Insight Extraction & Template Update
|
|
27
|
-
**AI Agent Analysis Process**:
|
|
28
|
-
1. **Read Existing Prep File**
|
|
29
|
-
- Load the `[customer-name]-interview-prep.md` file
|
|
30
|
-
- Understand the customer context and research from preparation phase
|
|
31
|
-
- Review the pre-filled template structure
|
|
32
|
-
|
|
33
|
-
2. **Parse Raw Notes**
|
|
34
|
-
- Extract customer quotes and key statements
|
|
35
|
-
- Identify pain points and challenges
|
|
36
|
-
- Capture success and failure criteria
|
|
37
|
-
- Note feature requests and preferences
|
|
38
|
-
- **Date Handling**: If user provides relative time references (e.g., "yesterday", "today", "last Friday"), run `new Date()` to determine the actual date and use that in the analysis file
|
|
39
|
-
|
|
40
|
-
3. **Create Analysis File**
|
|
41
|
-
- Create new file: `[customer-name]-interview-analysis.md`
|
|
42
|
-
- Include comprehensive analysis with customer scoring and insights
|
|
43
|
-
- Reference the prep file for context but keep files separate
|
|
44
|
-
- Include follow-up actions and next steps
|
|
45
|
-
|
|
46
|
-
### Step 2: Customer Scoring & Prioritization
|
|
47
|
-
**AI Agent Scoring Process**:
|
|
48
|
-
1. **Customer Fit Scoring (1-10)**
|
|
49
|
-
- Target customer segment alignment
|
|
50
|
-
- Pain point severity and frequency
|
|
51
|
-
- Budget and decision-making authority
|
|
52
|
-
- Influence and referral potential
|
|
53
|
-
|
|
54
|
-
2. **Urgency Assessment**
|
|
55
|
-
- Active seeking of solutions
|
|
56
|
-
- Budget allocation and timeline
|
|
57
|
-
- Competitive pressure
|
|
58
|
-
- Implementation readiness
|
|
59
|
-
|
|
60
|
-
3. **Willingness to Pay**
|
|
61
|
-
- Budget authority and constraints
|
|
62
|
-
- Current spending on similar solutions
|
|
63
|
-
- Value perception and ROI understanding
|
|
64
|
-
|
|
65
|
-
### Step 3: Follow-up Generation
|
|
66
|
-
**AI Agent Communication Process**:
|
|
67
|
-
1. **Generate Follow-up Email**
|
|
68
|
-
- Use follow-up email templates as reference
|
|
69
|
-
- Create personalized email based on interview content
|
|
70
|
-
- Include key takeaways confirmation
|
|
71
|
-
- Add specific next steps and timeline
|
|
72
|
-
- Reference customer quotes and insights
|
|
73
|
-
|
|
74
|
-
2. **Follow-up Questions**
|
|
75
|
-
- Clarify any gaps in understanding
|
|
76
|
-
- Deepen insights on key topics
|
|
77
|
-
- Validate assumptions and priorities
|
|
78
|
-
- Explore referral opportunities
|
|
79
|
-
|
|
80
|
-
3. **Next Steps Planning**
|
|
81
|
-
- Demo scheduling if appropriate
|
|
82
|
-
- Additional stakeholder meetings
|
|
83
|
-
- Resource sharing and education
|
|
84
|
-
- Timeline and milestone setting
|
|
85
|
-
|
|
86
|
-
### Step 4: File Creation & Finalization
|
|
87
|
-
**AI Agent File Management**:
|
|
88
|
-
1. **Create Analysis File**
|
|
89
|
-
- Create `[customer-name]-interview-analysis.md` with comprehensive analysis
|
|
90
|
-
- Include customer scoring, insights, and follow-up actions
|
|
91
|
-
- Reference the prep file for context but keep files separate
|
|
92
|
-
|
|
93
|
-
2. **Preserve Prep File**
|
|
94
|
-
- Keep `[customer-name]-interview-prep.md` unchanged
|
|
95
|
-
- Maintains clean separation between preparation and analysis
|
|
96
|
-
- Both files can be referenced independently
|
|
97
|
-
|
|
98
|
-
## OUTPUT TEMPLATE
|
|
99
|
-
|
|
100
|
-
### Analysis File Template
|
|
101
|
-
**Template**: Retrieve via `get_fraim_file({ path: "templates/customer-development/insight-analysis-template.md" })`
|
|
102
|
-
**File Location**: `docs/customer-development/[customer-name]-interview-analysis.md`
|
|
103
|
-
|
|
104
|
-
**Process**:
|
|
105
|
-
1. Use the insight analysis template
|
|
106
|
-
2. Extract insights from raw interview notes
|
|
107
|
-
3. Score customer based on fit, urgency, willingness to pay, and likelihood to buy
|
|
108
|
-
4. Include direct customer quotes for authenticity
|
|
109
|
-
5. Create next steps and follow-up questions
|
|
110
|
-
6. Reference the original prep file for context
|
|
111
|
-
7. **Generate personalized follow-up email** using follow-up email templates as reference `get_fraim_file({ path: "templates/customer-development/follow-up-email-templates.md" })` ... add this to the end of the analysis file.
|
|
112
|
-
|
|
113
|
-
## EXAMPLES
|
|
114
|
-
|
|
115
|
-
### Good: Insight Analysis
|
|
116
|
-
```
|
|
117
|
-
Input:
|
|
118
|
-
- File: ronil-dhruva-interview-prep.md
|
|
119
|
-
- Raw notes: "Ronil mentioned calendar conflicts, uses Outlook, frustrated with rescheduling, would pay $50/month, concerned about AI decisions. He was really engaged and seemed to understand the problem well."
|
|
120
|
-
|
|
121
|
-
AI Agent Process:
|
|
122
|
-
1. Reads existing prep file with LinkedIn research
|
|
123
|
-
2. Extracts insights from raw notes
|
|
124
|
-
3. Creates separate analysis file: ronil-dhruva-interview-analysis.md
|
|
125
|
-
4. Preserves original prep file unchanged
|
|
126
|
-
5. **Generates personalized follow-up email** using follow-up email templates
|
|
127
|
-
6. Creates next steps and follow-up questions
|
|
128
|
-
|
|
129
|
-
Output:
|
|
130
|
-
- New analysis file: ronil-dhruva-interview-analysis.md
|
|
131
|
-
- Original prep file: ronil-dhruva-interview-prep.md (unchanged)
|
|
132
|
-
- Customer score: 8/10 (high fit, clear pain points, enterprise budget)
|
|
133
|
-
- **Personalized follow-up email** using template structure with customer-specific content
|
|
134
|
-
- Next questions: "What specific hierarchy rules should AI respect?"
|
|
135
|
-
```
|
|
136
|
-
|
|
137
|
-
### Bad: Surface-Level Analysis
|
|
138
|
-
```
|
|
139
|
-
Input:
|
|
140
|
-
- File: ronil-dhruva-interview-prep.md
|
|
141
|
-
- Raw notes: "Ronil interview went well"
|
|
142
|
-
|
|
143
|
-
AI Agent Output:
|
|
144
|
-
- Generic analysis with no specific insights
|
|
145
|
-
- No customer scoring or prioritization
|
|
146
|
-
- No follow-up recommendations
|
|
147
|
-
- No actionable next steps
|
|
148
|
-
|
|
149
|
-
Result: Lost insights, no clear next steps, wasted prep work
|
|
150
|
-
```
|
|
151
|
-
|
|
152
|
-
## SUCCESS METRICS
|
|
153
|
-
- **Insight Extraction**: 95% of key insights captured from raw notes
|
|
154
|
-
- **Customer Scoring**: Consistent scoring across all customers
|
|
155
|
-
- **Follow-up Quality**: 80% of follow-up emails result in positive responses
|
|
156
|
-
- **Action Clarity**: Clear next steps for every customer
|