@heyai-rules/pilo-masterkit 1.2.2 → 3.1.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.agent/agents/architect.md +211 -211
- package/.agent/agents/build-error-resolver.md +114 -114
- package/.agent/agents/chief-of-staff.md +151 -151
- package/.agent/agents/code-reviewer.md +237 -237
- package/.agent/agents/cpp-build-resolver.md +90 -90
- package/.agent/agents/cpp-reviewer.md +72 -72
- package/.agent/agents/csharp-reviewer.md +101 -0
- package/.agent/agents/dart-build-resolver.md +201 -0
- package/.agent/agents/database-reviewer.md +91 -91
- package/.agent/agents/doc-updater.md +107 -107
- package/.agent/agents/docs-lookup.md +68 -68
- package/.agent/agents/e2e-runner.md +107 -107
- package/.agent/agents/flutter-reviewer.md +243 -243
- package/.agent/agents/gan-evaluator.md +209 -0
- package/.agent/agents/gan-generator.md +131 -0
- package/.agent/agents/gan-planner.md +99 -0
- package/.agent/agents/go-build-resolver.md +94 -94
- package/.agent/agents/go-reviewer.md +76 -76
- package/.agent/agents/harness-optimizer.md +35 -35
- package/.agent/agents/healthcare-reviewer.md +83 -0
- package/.agent/agents/java-build-resolver.md +153 -153
- package/.agent/agents/java-reviewer.md +92 -92
- package/.agent/agents/kotlin-build-resolver.md +118 -118
- package/.agent/agents/kotlin-reviewer.md +159 -159
- package/.agent/agents/loop-operator.md +36 -36
- package/.agent/agents/opensource-forker.md +198 -0
- package/.agent/agents/opensource-packager.md +249 -0
- package/.agent/agents/opensource-sanitizer.md +188 -0
- package/.agent/agents/performance-optimizer.md +392 -133
- package/.agent/agents/personas/athena-agent/agent.json +10 -0
- package/.agent/agents/personas/athena-agent/athena-backend-logic-architecture-profile.md +189 -0
- package/.agent/agents/personas/athena-agent/context-files/agents.md +55 -0
- package/.agent/agents/personas/athena-agent/context-files/identity.md +23 -0
- package/.agent/agents/personas/athena-agent/context-files/soul.md +51 -0
- package/.agent/agents/personas/athena-agent/context-files/user-predefined.md +15 -0
- package/.agent/agents/personas/athena-agent/user-context-files/system/bootstrap.md +37 -0
- package/.agent/agents/personas/athena-agent/user-context-files/system/user.md +45 -0
- package/.agent/agents/personas/da-vinci-agent/agent.json +10 -0
- package/.agent/agents/personas/da-vinci-agent/context-files/agents.md +55 -0
- package/.agent/agents/personas/da-vinci-agent/context-files/identity.md +23 -0
- package/.agent/agents/personas/da-vinci-agent/context-files/soul.md +51 -0
- package/.agent/agents/personas/da-vinci-agent/context-files/user-predefined.md +15 -0
- package/.agent/agents/personas/da-vinci-agent/da-vinci-frontend-ui-ux-design-profile.md +189 -0
- package/.agent/agents/personas/da-vinci-agent/user-context-files/system/bootstrap.md +37 -0
- package/.agent/agents/personas/da-vinci-agent/user-context-files/system/user.md +45 -0
- package/.agent/agents/personas/duong-tang-agent/agent.json +10 -0
- package/.agent/agents/personas/duong-tang-agent/context-files/agents.md +55 -0
- package/.agent/agents/personas/duong-tang-agent/context-files/identity.md +23 -0
- package/.agent/agents/personas/duong-tang-agent/context-files/soul.md +51 -0
- package/.agent/agents/personas/duong-tang-agent/context-files/user-predefined.md +15 -0
- package/.agent/agents/personas/duong-tang-agent/tang-monk-quality-testing-documentation-profile.md +189 -0
- package/.agent/agents/personas/duong-tang-agent/user-context-files/system/bootstrap.md +37 -0
- package/.agent/agents/personas/duong-tang-agent/user-context-files/system/user.md +45 -0
- package/.agent/agents/personas/gia-cat-luong-agent/agent.json +10 -0
- package/.agent/agents/personas/gia-cat-luong-agent/context-files/agents.md +55 -0
- package/.agent/agents/personas/gia-cat-luong-agent/context-files/identity.md +23 -0
- package/.agent/agents/personas/gia-cat-luong-agent/context-files/soul.md +51 -0
- package/.agent/agents/personas/gia-cat-luong-agent/context-files/user-predefined.md +15 -0
- package/.agent/agents/personas/gia-cat-luong-agent/kongming-research-strategy-analysis-profile.md +189 -0
- package/.agent/agents/personas/gia-cat-luong-agent/user-context-files/system/bootstrap.md +37 -0
- package/.agent/agents/personas/gia-cat-luong-agent/user-context-files/system/user.md +45 -0
- package/.agent/agents/personas/mihata-agent/agent.json +10 -0
- package/.agent/agents/personas/mihata-agent/context-files/agents.md +55 -0
- package/.agent/agents/personas/mihata-agent/context-files/identity.md +23 -0
- package/.agent/agents/personas/mihata-agent/context-files/soul.md +51 -0
- package/.agent/agents/personas/mihata-agent/context-files/user-predefined.md +15 -0
- package/.agent/agents/personas/mihata-agent/mihata-multi-agent-orchestration-profile.md +189 -0
- package/.agent/agents/personas/mihata-agent/user-context-files/system/bootstrap.md +37 -0
- package/.agent/agents/personas/mihata-agent/user-context-files/system/user.md +45 -0
- package/.agent/agents/personas/tesla-agent/agent.json +10 -0
- package/.agent/agents/personas/tesla-agent/context-files/agents.md +55 -0
- package/.agent/agents/personas/tesla-agent/context-files/identity.md +23 -0
- package/.agent/agents/personas/tesla-agent/context-files/soul.md +51 -0
- package/.agent/agents/personas/tesla-agent/context-files/user-predefined.md +15 -0
- package/.agent/agents/personas/tesla-agent/tesla-fullstack-system-optimization-profile.md +189 -0
- package/.agent/agents/personas/tesla-agent/user-context-files/system/bootstrap.md +37 -0
- package/.agent/agents/personas/tesla-agent/user-context-files/system/user.md +45 -0
- package/.agent/agents/personas/tu-ma-y-agent/agent.json +10 -0
- package/.agent/agents/personas/tu-ma-y-agent/context-files/agents.md +55 -0
- package/.agent/agents/personas/tu-ma-y-agent/context-files/identity.md +23 -0
- package/.agent/agents/personas/tu-ma-y-agent/context-files/soul.md +51 -0
- package/.agent/agents/personas/tu-ma-y-agent/context-files/user-predefined.md +15 -0
- package/.agent/agents/personas/tu-ma-y-agent/simayi-feasibility-risk-control-profile.md +189 -0
- package/.agent/agents/personas/tu-ma-y-agent/user-context-files/system/bootstrap.md +37 -0
- package/.agent/agents/personas/tu-ma-y-agent/user-context-files/system/user.md +45 -0
- package/.agent/agents/personas/venti-agent/agent.json +10 -0
- package/.agent/agents/personas/venti-agent/context-files/agents.md +55 -0
- package/.agent/agents/personas/venti-agent/context-files/identity.md +23 -0
- package/.agent/agents/personas/venti-agent/context-files/soul.md +51 -0
- package/.agent/agents/personas/venti-agent/context-files/user-predefined.md +15 -0
- package/.agent/agents/personas/venti-agent/user-context-files/system/bootstrap.md +37 -0
- package/.agent/agents/personas/venti-agent/user-context-files/system/user.md +45 -0
- package/.agent/agents/personas/venti-agent/venti-learning-communication-mentoring-profile.md +189 -0
- package/.agent/agents/planner.md +212 -212
- package/.agent/agents/python-reviewer.md +98 -98
- package/.agent/agents/pytorch-build-resolver.md +120 -120
- package/.agent/agents/refactor-cleaner.md +85 -85
- package/.agent/agents/rust-build-resolver.md +148 -148
- package/.agent/agents/rust-reviewer.md +94 -94
- package/.agent/agents/security-reviewer.md +108 -108
- package/.agent/agents/tdd-guide.md +91 -91
- package/.agent/agents/typescript-reviewer.md +112 -112
- package/.agent/contexts/dev.md +20 -0
- package/.agent/contexts/research.md +26 -0
- package/.agent/contexts/review.md +22 -0
- package/.agent/hooks/hooks.json +395 -0
- package/.agent/hooks/readme.md +222 -0
- package/.agent/mcp-configs/mcp-servers.json +181 -0
- package/.agent/rules/common/agents.md +50 -0
- package/.agent/rules/common/code-review.md +124 -0
- package/.agent/rules/common/coding-style.md +48 -0
- package/.agent/rules/common/development-workflow.md +44 -0
- package/.agent/rules/common/git-workflow.md +24 -0
- package/.agent/rules/common/hooks.md +30 -0
- package/.agent/rules/common/patterns.md +31 -0
- package/.agent/rules/common/performance.md +55 -0
- package/.agent/rules/common/security.md +29 -0
- package/.agent/rules/common/testing.md +29 -0
- package/.agent/rules/cpp/coding-style.md +44 -0
- package/.agent/rules/cpp/hooks.md +39 -0
- package/.agent/rules/cpp/patterns.md +51 -0
- package/.agent/rules/cpp/security.md +51 -0
- package/.agent/rules/cpp/testing.md +44 -0
- package/.agent/rules/csharp/coding-style.md +72 -0
- package/.agent/rules/csharp/hooks.md +25 -0
- package/.agent/rules/csharp/patterns.md +50 -0
- package/.agent/rules/csharp/security.md +58 -0
- package/.agent/rules/csharp/testing.md +46 -0
- package/.agent/rules/dart/coding-style.md +159 -0
- package/.agent/rules/dart/hooks.md +66 -0
- package/.agent/rules/dart/patterns.md +261 -0
- package/.agent/rules/dart/security.md +135 -0
- package/.agent/rules/dart/testing.md +215 -0
- package/.agent/rules/golang/coding-style.md +32 -0
- package/.agent/rules/golang/hooks.md +17 -0
- package/.agent/rules/golang/patterns.md +45 -0
- package/.agent/rules/golang/security.md +34 -0
- package/.agent/rules/golang/testing.md +31 -0
- package/.agent/rules/java/coding-style.md +114 -0
- package/.agent/rules/java/hooks.md +18 -0
- package/.agent/rules/java/patterns.md +146 -0
- package/.agent/rules/java/security.md +100 -0
- package/.agent/rules/java/testing.md +131 -0
- package/.agent/rules/kotlin/coding-style.md +86 -0
- package/.agent/rules/kotlin/hooks.md +17 -0
- package/.agent/rules/kotlin/patterns.md +146 -0
- package/.agent/rules/kotlin/security.md +82 -0
- package/.agent/rules/kotlin/testing.md +128 -0
- package/.agent/rules/perl/coding-style.md +46 -0
- package/.agent/rules/perl/hooks.md +22 -0
- package/.agent/rules/perl/patterns.md +76 -0
- package/.agent/rules/perl/security.md +69 -0
- package/.agent/rules/perl/testing.md +54 -0
- package/.agent/rules/php/coding-style.md +40 -0
- package/.agent/rules/php/hooks.md +24 -0
- package/.agent/rules/php/patterns.md +33 -0
- package/.agent/rules/php/security.md +37 -0
- package/.agent/rules/php/testing.md +39 -0
- package/.agent/rules/python/coding-style.md +42 -0
- package/.agent/rules/python/hooks.md +19 -0
- package/.agent/rules/python/patterns.md +39 -0
- package/.agent/rules/python/security.md +30 -0
- package/.agent/rules/python/testing.md +38 -0
- package/.agent/rules/readme.md +111 -0
- package/.agent/rules/rust/coding-style.md +151 -0
- package/.agent/rules/rust/hooks.md +16 -0
- package/.agent/rules/rust/patterns.md +168 -0
- package/.agent/rules/rust/security.md +141 -0
- package/.agent/rules/rust/testing.md +154 -0
- package/.agent/rules/swift/coding-style.md +47 -0
- package/.agent/rules/swift/hooks.md +20 -0
- package/.agent/rules/swift/patterns.md +66 -0
- package/.agent/rules/swift/security.md +33 -0
- package/.agent/rules/swift/testing.md +45 -0
- package/.agent/rules/typescript/coding-style.md +199 -0
- package/.agent/rules/typescript/hooks.md +22 -0
- package/.agent/rules/typescript/patterns.md +52 -0
- package/.agent/rules/typescript/security.md +28 -0
- package/.agent/rules/typescript/testing.md +18 -0
- package/.agent/rules/web/coding-style.md +96 -0
- package/.agent/rules/web/design-quality.md +63 -0
- package/.agent/rules/web/hooks.md +120 -0
- package/.agent/rules/web/patterns.md +79 -0
- package/.agent/rules/web/performance.md +64 -0
- package/.agent/rules/web/security.md +57 -0
- package/.agent/rules/web/testing.md +55 -0
- package/.agent/rules/zh/agents.md +50 -0
- package/.agent/rules/zh/code-review.md +124 -0
- package/.agent/rules/zh/coding-style.md +48 -0
- package/.agent/rules/zh/development-workflow.md +44 -0
- package/.agent/rules/zh/git-workflow.md +24 -0
- package/.agent/rules/zh/hooks.md +30 -0
- package/.agent/rules/zh/patterns.md +31 -0
- package/.agent/rules/zh/performance.md +55 -0
- package/.agent/rules/zh/readme.md +108 -0
- package/.agent/rules/zh/security.md +29 -0
- package/.agent/rules/zh/testing.md +29 -0
- package/.agent/skills/agent-eval/SKILL.md +145 -0
- package/.agent/skills/agent-harness-construction/SKILL.md +73 -0
- package/.agent/skills/agent-payment-x402/SKILL.md +178 -0
- package/.agent/skills/agentic-engineering/SKILL.md +63 -0
- package/.agent/skills/ai-first-engineering/SKILL.md +51 -0
- package/.agent/skills/ai-regression-testing/SKILL.md +385 -0
- package/.agent/skills/android-clean-architecture/SKILL.md +339 -0
- package/.agent/skills/api-design/SKILL.md +523 -0
- package/.agent/skills/architecture-decision-records/SKILL.md +179 -0
- package/.agent/skills/article-writing/SKILL.md +79 -0
- package/.agent/skills/autonomous-agent-harness/SKILL.md +267 -0
- package/.agent/skills/autonomous-loops/SKILL.md +610 -0
- package/.agent/skills/backend-patterns/SKILL.md +598 -0
- package/.agent/skills/benchmark/SKILL.md +93 -0
- package/.agent/skills/blueprint/SKILL.md +105 -0
- package/.agent/skills/brand-voice/SKILL.md +97 -0
- package/.agent/skills/brand-voice/references/voice-profile-schema.md +55 -0
- package/.agent/skills/browser-qa/SKILL.md +87 -0
- package/.agent/skills/bun-runtime/SKILL.md +84 -0
- package/.agent/skills/canary-watch/SKILL.md +99 -0
- package/.agent/skills/carrier-relationship-management/SKILL.md +212 -0
- package/.agent/skills/ck/SKILL.md +147 -0
- package/.agent/skills/ck/commands/forget.mjs +44 -0
- package/.agent/skills/ck/commands/info.mjs +24 -0
- package/.agent/skills/ck/commands/init.mjs +143 -0
- package/.agent/skills/ck/commands/list.mjs +40 -0
- package/.agent/skills/ck/commands/migrate.mjs +202 -0
- package/.agent/skills/ck/commands/resume.mjs +36 -0
- package/.agent/skills/ck/commands/save.mjs +210 -0
- package/.agent/skills/ck/commands/shared.mjs +387 -0
- package/.agent/skills/ck/hooks/session-start.mjs +224 -0
- package/.agent/skills/claude-api/SKILL.md +337 -0
- package/.agent/skills/claude-devfleet/SKILL.md +103 -0
- package/.agent/skills/click-path-audit/SKILL.md +244 -0
- package/.agent/skills/clickhouse-io/SKILL.md +439 -0
- package/.agent/skills/codebase-onboarding/SKILL.md +233 -0
- package/.agent/skills/coding-standards/SKILL.md +530 -0
- package/.agent/skills/compose-multiplatform-patterns/SKILL.md +299 -0
- package/.agent/skills/configure-ecc/SKILL.md +367 -0
- package/.agent/skills/connections-optimizer/SKILL.md +189 -0
- package/.agent/skills/content-engine/SKILL.md +131 -0
- package/.agent/skills/content-hash-cache-pattern/SKILL.md +161 -0
- package/.agent/skills/context-budget/SKILL.md +135 -0
- package/.agent/skills/continuous-agent-loop/SKILL.md +45 -0
- package/.agent/skills/continuous-learning/SKILL.md +119 -0
- package/.agent/skills/continuous-learning/config.json +18 -0
- package/.agent/skills/continuous-learning/evaluate-session.sh +69 -0
- package/.agent/skills/continuous-learning-v2/SKILL.md +365 -0
- package/.agent/skills/continuous-learning-v2/agents/observer-loop.sh +271 -0
- package/.agent/skills/continuous-learning-v2/agents/observer.md +198 -0
- package/.agent/skills/continuous-learning-v2/agents/session-guardian.sh +150 -0
- package/.agent/skills/continuous-learning-v2/agents/start-observer.sh +244 -0
- package/.agent/skills/continuous-learning-v2/config.json +8 -0
- package/.agent/skills/continuous-learning-v2/hooks/observe.sh +428 -0
- package/.agent/skills/continuous-learning-v2/scripts/detect-project.sh +228 -0
- package/.agent/skills/continuous-learning-v2/scripts/instinct-cli.py +1426 -0
- package/.agent/skills/continuous-learning-v2/scripts/test-parse-instinct.py +984 -0
- package/.agent/skills/cost-aware-llm-pipeline/SKILL.md +183 -0
- package/.agent/skills/cpp-coding-standards/SKILL.md +723 -0
- package/.agent/skills/cpp-testing/SKILL.md +324 -0
- package/.agent/skills/crosspost/SKILL.md +111 -0
- package/.agent/skills/csharp-testing/SKILL.md +321 -0
- package/.agent/skills/customer-billing-ops/SKILL.md +140 -0
- package/.agent/skills/customs-trade-compliance/SKILL.md +263 -0
- package/.agent/skills/dart-flutter-patterns/SKILL.md +563 -0
- package/.agent/skills/data-scraper-agent/SKILL.md +764 -0
- package/.agent/skills/database-migrations/SKILL.md +429 -0
- package/.agent/skills/deep-research/SKILL.md +155 -0
- package/.agent/skills/deployment-patterns/SKILL.md +427 -0
- package/.agent/skills/design-system/SKILL.md +82 -0
- package/.agent/skills/django-patterns/SKILL.md +734 -0
- package/.agent/skills/django-security/SKILL.md +593 -0
- package/.agent/skills/django-tdd/SKILL.md +729 -0
- package/.agent/skills/django-verification/SKILL.md +469 -0
- package/.agent/skills/dmux-workflows/SKILL.md +191 -0
- package/.agent/skills/docker-patterns/SKILL.md +364 -0
- package/.agent/skills/documentation-lookup/SKILL.md +90 -0
- package/.agent/skills/dotnet-patterns/SKILL.md +321 -0
- package/.agent/skills/e2e-testing/SKILL.md +326 -0
- package/.agent/skills/energy-procurement/SKILL.md +228 -0
- package/.agent/skills/enterprise-agent-ops/SKILL.md +50 -0
- package/.agent/skills/eval-harness/SKILL.md +270 -0
- package/.agent/skills/exa-search/SKILL.md +103 -0
- package/.agent/skills/fal-ai-media/SKILL.md +284 -0
- package/.agent/skills/flutter-dart-code-review/SKILL.md +435 -0
- package/.agent/skills/foundation-models-on-device/SKILL.md +243 -0
- package/.agent/skills/frontend-patterns/SKILL.md +642 -0
- package/.agent/skills/frontend-slides/SKILL.md +184 -0
- package/.agent/skills/frontend-slides/style-presets.md +330 -0
- package/.agent/skills/gan-style-harness/SKILL.md +278 -0
- package/.agent/skills/git-workflow/SKILL.md +715 -0
- package/.agent/skills/golang-patterns/SKILL.md +674 -0
- package/.agent/skills/golang-testing/SKILL.md +720 -0
- package/.agent/skills/google-workspace-ops/SKILL.md +95 -0
- package/.agent/skills/healthcare-cdss-patterns/SKILL.md +245 -0
- package/.agent/skills/healthcare-emr-patterns/SKILL.md +159 -0
- package/.agent/skills/healthcare-eval-harness/SKILL.md +207 -0
- package/.agent/skills/healthcare-phi-compliance/SKILL.md +145 -0
- package/.agent/skills/hexagonal-architecture/SKILL.md +276 -0
- package/.agent/skills/inventory-demand-planning/SKILL.md +247 -0
- package/.agent/skills/investor-materials/SKILL.md +96 -0
- package/.agent/skills/investor-outreach/SKILL.md +91 -0
- package/.agent/skills/iterative-retrieval/SKILL.md +211 -0
- package/.agent/skills/java-coding-standards/SKILL.md +147 -0
- package/.agent/skills/jira-integration/SKILL.md +293 -0
- package/.agent/skills/jpa-patterns/SKILL.md +151 -0
- package/.agent/skills/kotlin-coroutines-flows/SKILL.md +284 -0
- package/.agent/skills/kotlin-exposed-patterns/SKILL.md +719 -0
- package/.agent/skills/kotlin-ktor-patterns/SKILL.md +689 -0
- package/.agent/skills/kotlin-patterns/SKILL.md +711 -0
- package/.agent/skills/kotlin-testing/SKILL.md +824 -0
- package/.agent/skills/laravel-patterns/SKILL.md +415 -0
- package/.agent/skills/laravel-plugin-discovery/SKILL.md +229 -0
- package/.agent/skills/laravel-security/SKILL.md +285 -0
- package/.agent/skills/laravel-tdd/SKILL.md +283 -0
- package/.agent/skills/laravel-verification/SKILL.md +179 -0
- package/.agent/skills/lead-intelligence/SKILL.md +321 -0
- package/.agent/skills/lead-intelligence/agents/enrichment-agent.md +85 -0
- package/.agent/skills/lead-intelligence/agents/mutual-mapper.md +75 -0
- package/.agent/skills/lead-intelligence/agents/outreach-drafter.md +98 -0
- package/.agent/skills/lead-intelligence/agents/signal-scorer.md +60 -0
- package/.agent/skills/liquid-glass-design/SKILL.md +279 -0
- package/.agent/skills/logistics-exception-management/SKILL.md +222 -0
- package/.agent/skills/manim-video/SKILL.md +89 -0
- package/.agent/skills/manim-video/assets/network-graph-scene.py +52 -0
- package/.agent/skills/market-research/SKILL.md +75 -0
- package/.agent/skills/mcp-builder/SKILL.md +173 -113
- package/.agent/skills/mcp-builder/license.txt +202 -0
- package/.agent/skills/mcp-builder/reference/evaluation.md +602 -0
- package/.agent/skills/mcp-builder/reference/mcp-best-practices.md +249 -0
- package/.agent/skills/mcp-builder/reference/node-mcp-server.md +970 -0
- package/.agent/skills/mcp-builder/reference/python-mcp-server.md +719 -0
- package/.agent/skills/mcp-builder/scripts/connections.py +151 -0
- package/.agent/skills/mcp-builder/scripts/evaluation.py +373 -0
- package/.agent/skills/mcp-builder/scripts/example-evaluation.xml +22 -0
- package/.agent/skills/mcp-builder/scripts/requirements.txt +2 -0
- package/.agent/skills/mcp-server-patterns/SKILL.md +67 -0
- package/.agent/skills/nanoclaw-repl/SKILL.md +33 -0
- package/.agent/skills/nestjs-patterns/SKILL.md +230 -0
- package/.agent/skills/nextjs-turbopack/SKILL.md +44 -0
- package/.agent/skills/nutrient-document-processing/SKILL.md +167 -0
- package/.agent/skills/nuxt4-patterns/SKILL.md +100 -0
- package/.agent/skills/openclaw-persona-forge/SKILL.md +296 -0
- package/.agent/skills/openclaw-persona-forge/gacha.py +224 -0
- package/.agent/skills/openclaw-persona-forge/gacha.sh +5 -0
- package/.agent/skills/openclaw-persona-forge/references/avatar-style.md +124 -0
- package/.agent/skills/openclaw-persona-forge/references/boundary-rules.md +53 -0
- package/.agent/skills/openclaw-persona-forge/references/error-handling.md +53 -0
- package/.agent/skills/openclaw-persona-forge/references/identity-tension.md +48 -0
- package/.agent/skills/openclaw-persona-forge/references/naming-system.md +39 -0
- package/.agent/skills/openclaw-persona-forge/references/output-template.md +166 -0
- package/.agent/skills/opensource-pipeline/SKILL.md +255 -0
- package/.agent/skills/perl-patterns/SKILL.md +504 -0
- package/.agent/skills/perl-security/SKILL.md +503 -0
- package/.agent/skills/perl-testing/SKILL.md +475 -0
- package/.agent/skills/plankton-code-quality/SKILL.md +236 -0
- package/.agent/skills/postgres-patterns/SKILL.md +147 -0
- package/.agent/skills/product-lens/SKILL.md +85 -0
- package/.agent/skills/production-scheduling/SKILL.md +238 -0
- package/.agent/skills/project-flow-ops/SKILL.md +111 -0
- package/.agent/skills/project-guidelines-example/SKILL.md +349 -0
- package/.agent/skills/prompt-optimizer/SKILL.md +397 -0
- package/.agent/skills/python-patterns/SKILL.md +622 -313
- package/.agent/skills/python-testing/SKILL.md +816 -0
- package/.agent/skills/pytorch-patterns/SKILL.md +396 -0
- package/.agent/skills/quality-nonconformance/SKILL.md +260 -0
- package/.agent/skills/ralphinho-rfc-pipeline/SKILL.md +67 -0
- package/.agent/skills/regex-vs-llm-structured-text/SKILL.md +220 -0
- package/.agent/skills/remotion-video-creation/SKILL.md +43 -0
- package/.agent/skills/remotion-video-creation/rules/3d.md +86 -0
- package/.agent/skills/remotion-video-creation/rules/animations.md +29 -0
- package/.agent/skills/remotion-video-creation/rules/assets/charts-bar-chart.tsx +173 -0
- package/.agent/skills/remotion-video-creation/rules/assets/text-animations-typewriter.tsx +100 -0
- package/.agent/skills/remotion-video-creation/rules/assets/text-animations-word-highlight.tsx +108 -0
- package/.agent/skills/remotion-video-creation/rules/assets.md +78 -0
- package/.agent/skills/remotion-video-creation/rules/audio.md +172 -0
- package/.agent/skills/remotion-video-creation/rules/calculate-metadata.md +104 -0
- package/.agent/skills/remotion-video-creation/rules/can-decode.md +75 -0
- package/.agent/skills/remotion-video-creation/rules/charts.md +58 -0
- package/.agent/skills/remotion-video-creation/rules/compositions.md +146 -0
- package/.agent/skills/remotion-video-creation/rules/display-captions.md +126 -0
- package/.agent/skills/remotion-video-creation/rules/extract-frames.md +229 -0
- package/.agent/skills/remotion-video-creation/rules/fonts.md +152 -0
- package/.agent/skills/remotion-video-creation/rules/get-audio-duration.md +58 -0
- package/.agent/skills/remotion-video-creation/rules/get-video-dimensions.md +68 -0
- package/.agent/skills/remotion-video-creation/rules/get-video-duration.md +58 -0
- package/.agent/skills/remotion-video-creation/rules/gifs.md +138 -0
- package/.agent/skills/remotion-video-creation/rules/images.md +130 -0
- package/.agent/skills/remotion-video-creation/rules/import-srt-captions.md +67 -0
- package/.agent/skills/remotion-video-creation/rules/lottie.md +67 -0
- package/.agent/skills/remotion-video-creation/rules/measuring-dom-nodes.md +34 -0
- package/.agent/skills/remotion-video-creation/rules/measuring-text.md +143 -0
- package/.agent/skills/remotion-video-creation/rules/sequencing.md +106 -0
- package/.agent/skills/remotion-video-creation/rules/tailwind.md +11 -0
- package/.agent/skills/remotion-video-creation/rules/text-animations.md +20 -0
- package/.agent/skills/remotion-video-creation/rules/timing.md +179 -0
- package/.agent/skills/remotion-video-creation/rules/transcribe-captions.md +19 -0
- package/.agent/skills/remotion-video-creation/rules/transitions.md +122 -0
- package/.agent/skills/remotion-video-creation/rules/trimming.md +52 -0
- package/.agent/skills/remotion-video-creation/rules/videos.md +171 -0
- package/.agent/skills/repo-scan/SKILL.md +78 -0
- package/.agent/skills/returns-reverse-logistics/SKILL.md +240 -0
- package/.agent/skills/rules-distill/SKILL.md +264 -0
- package/.agent/skills/rules-distill/scripts/scan-rules.sh +58 -0
- package/.agent/skills/rules-distill/scripts/scan-skills.sh +129 -0
- package/.agent/skills/rust-patterns/SKILL.md +499 -0
- package/.agent/skills/rust-testing/SKILL.md +500 -0
- package/.agent/skills/safety-guard/SKILL.md +75 -0
- package/.agent/skills/santa-method/SKILL.md +306 -0
- package/.agent/skills/search-first/SKILL.md +161 -0
- package/.agent/skills/security-review/SKILL.md +495 -0
- package/.agent/skills/security-review/cloud-infrastructure-security.md +361 -0
- package/.agent/skills/security-scan/SKILL.md +165 -0
- package/.agent/skills/skill-comply/SKILL.md +58 -0
- package/.agent/skills/skill-comply/fixtures/compliant-trace.jsonl +5 -0
- package/.agent/skills/skill-comply/fixtures/noncompliant-trace.jsonl +3 -0
- package/.agent/skills/skill-comply/fixtures/tdd-spec.yaml +44 -0
- package/.agent/skills/skill-comply/prompts/classifier.md +24 -0
- package/.agent/skills/skill-comply/prompts/scenario-generator.md +62 -0
- package/.agent/skills/skill-comply/prompts/spec-generator.md +42 -0
- package/.agent/skills/skill-comply/pyproject.toml +15 -0
- package/.agent/skills/skill-comply/scripts/classifier.py +85 -0
- package/.agent/skills/skill-comply/scripts/grader.py +122 -0
- package/.agent/skills/skill-comply/scripts/init.py +0 -0
- package/.agent/skills/skill-comply/scripts/parser.py +107 -0
- package/.agent/skills/skill-comply/scripts/report.py +170 -0
- package/.agent/skills/skill-comply/scripts/run.py +127 -0
- package/.agent/skills/skill-comply/scripts/runner.py +161 -0
- package/.agent/skills/skill-comply/scripts/scenario-generator.py +70 -0
- package/.agent/skills/skill-comply/scripts/spec-generator.py +72 -0
- package/.agent/skills/skill-comply/scripts/utils.py +13 -0
- package/.agent/skills/skill-comply/tests/test-grader.py +137 -0
- package/.agent/skills/skill-comply/tests/test-parser.py +90 -0
- package/.agent/skills/skill-creator/SKILL.md +485 -0
- package/.agent/skills/skill-creator/agents/analyzer.md +274 -0
- package/.agent/skills/skill-creator/agents/comparator.md +202 -0
- package/.agent/skills/skill-creator/agents/grader.md +223 -0
- package/.agent/skills/skill-creator/assets/eval-review.html +146 -0
- package/.agent/skills/skill-creator/eval-viewer/generate-review.py +471 -0
- package/.agent/skills/skill-creator/eval-viewer/viewer.html +1325 -0
- package/.agent/skills/skill-creator/license.txt +202 -0
- package/.agent/skills/skill-creator/references/schemas.md +430 -0
- package/.agent/skills/skill-creator/scripts/aggregate-benchmark.py +401 -0
- package/.agent/skills/skill-creator/scripts/generate-report.py +326 -0
- package/.agent/skills/skill-creator/scripts/improve-description.py +247 -0
- package/.agent/skills/skill-creator/scripts/init.py +0 -0
- package/.agent/skills/skill-creator/scripts/package-skill.py +136 -0
- package/.agent/skills/skill-creator/scripts/quick-validate.py +103 -0
- package/.agent/skills/skill-creator/scripts/run-eval.py +310 -0
- package/.agent/skills/skill-creator/scripts/run-loop.py +328 -0
- package/.agent/skills/skill-creator/scripts/utils.py +47 -0
- package/.agent/skills/skill-stocktake/SKILL.md +193 -0
- package/.agent/skills/skill-stocktake/scripts/quick-diff.sh +87 -0
- package/.agent/skills/skill-stocktake/scripts/save-results.sh +56 -0
- package/.agent/skills/skill-stocktake/scripts/scan.sh +170 -0
- package/.agent/skills/social-graph-ranker/SKILL.md +154 -0
- package/.agent/skills/springboot-patterns/SKILL.md +314 -0
- package/.agent/skills/springboot-security/SKILL.md +272 -0
- package/.agent/skills/springboot-tdd/SKILL.md +158 -0
- package/.agent/skills/springboot-verification/SKILL.md +231 -0
- package/.agent/skills/strategic-compact/SKILL.md +131 -0
- package/.agent/skills/strategic-compact/suggest-compact.sh +54 -0
- package/.agent/skills/swift-actor-persistence/SKILL.md +143 -0
- package/.agent/skills/swift-concurrency-6-2/SKILL.md +216 -0
- package/.agent/skills/swift-protocol-di-testing/SKILL.md +190 -0
- package/.agent/skills/swiftui-patterns/SKILL.md +259 -0
- package/.agent/skills/tdd-workflow/SKILL.md +412 -98
- package/.agent/skills/team-builder/SKILL.md +168 -0
- package/.agent/skills/token-budget-advisor/SKILL.md +133 -0
- package/.agent/skills/ui-demo/SKILL.md +465 -0
- package/.agent/skills/ui-ux-pro-max/data/charts.csv +26 -26
- package/.agent/skills/ui-ux-pro-max/data/colors.csv +97 -97
- package/.agent/skills/ui-ux-pro-max/data/landing.csv +28 -28
- package/.agent/skills/ui-ux-pro-max/data/products.csv +96 -96
- package/.agent/skills/ui-ux-pro-max/data/stacks/flutter.csv +53 -53
- package/.agent/skills/ui-ux-pro-max/data/stacks/html-tailwind.csv +56 -56
- package/.agent/skills/ui-ux-pro-max/data/stacks/nextjs.csv +53 -53
- package/.agent/skills/ui-ux-pro-max/data/stacks/react-native.csv +52 -52
- package/.agent/skills/ui-ux-pro-max/data/stacks/react.csv +54 -54
- package/.agent/skills/ui-ux-pro-max/data/stacks/svelte.csv +54 -54
- package/.agent/skills/ui-ux-pro-max/data/stacks/swiftui.csv +51 -51
- package/.agent/skills/ui-ux-pro-max/data/stacks/vue.csv +50 -50
- package/.agent/skills/ui-ux-pro-max/data/styles.csv +68 -68
- package/.agent/skills/ui-ux-pro-max/data/ux-guidelines.csv +99 -99
- package/.agent/skills/ui-ux-pro-max/scripts/search.py +114 -114
- package/.agent/skills/verification-loop/SKILL.md +126 -0
- package/.agent/skills/video-editing/SKILL.md +310 -0
- package/.agent/skills/videodb/SKILL.md +374 -0
- package/.agent/skills/videodb/reference/api-reference.md +550 -0
- package/.agent/skills/videodb/reference/capture-reference.md +407 -0
- package/.agent/skills/videodb/reference/capture.md +101 -0
- package/.agent/skills/videodb/reference/editor.md +443 -0
- package/.agent/skills/videodb/reference/generative.md +331 -0
- package/.agent/skills/videodb/reference/rtstream-reference.md +564 -0
- package/.agent/skills/videodb/reference/rtstream.md +65 -0
- package/.agent/skills/videodb/reference/search.md +230 -0
- package/.agent/skills/videodb/reference/streaming.md +406 -0
- package/.agent/skills/videodb/reference/use-cases.md +118 -0
- package/.agent/skills/videodb/scripts/ws-listener.py +282 -0
- package/.agent/skills/visa-doc-translate/SKILL.md +117 -0
- package/.agent/skills/visa-doc-translate/readme.md +86 -0
- package/.agent/skills/workspace-surface-audit/SKILL.md +125 -0
- package/.agent/skills/x-api/SKILL.md +230 -0
- package/.agent/tasks/two-track-merge-contract.md +29 -0
- package/.agent/workflows/aside.md +164 -164
- package/.agent/workflows/build-fix.md +62 -62
- package/.agent/workflows/checkpoint.md +74 -74
- package/.agent/workflows/claw.md +23 -51
- package/.agent/workflows/clean-memory.md +34 -0
- package/.agent/workflows/code-review.md +289 -40
- package/.agent/workflows/context-budget.md +23 -29
- package/.agent/workflows/cpp-build.md +173 -173
- package/.agent/workflows/cpp-review.md +132 -132
- package/.agent/workflows/cpp-test.md +251 -251
- package/.agent/workflows/devfleet.md +23 -92
- package/.agent/workflows/docs.md +23 -31
- package/.agent/workflows/e2e.md +268 -365
- package/.agent/workflows/eval.md +23 -120
- package/.agent/workflows/evolve.md +178 -178
- package/.agent/workflows/flutter-build.md +164 -0
- package/.agent/workflows/flutter-review.md +116 -0
- package/.agent/workflows/flutter-test.md +144 -0
- package/.agent/workflows/gan-build.md +99 -0
- package/.agent/workflows/gan-design.md +35 -0
- package/.agent/workflows/go-build.md +183 -183
- package/.agent/workflows/go-review.md +148 -148
- package/.agent/workflows/go-test.md +268 -268
- package/.agent/workflows/gradle-build.md +70 -70
- package/.agent/workflows/harness-audit.md +73 -71
- package/.agent/workflows/instinct-export.md +66 -66
- package/.agent/workflows/instinct-import.md +114 -114
- package/.agent/workflows/instinct-status.md +59 -59
- package/.agent/workflows/jira.md +106 -0
- package/.agent/workflows/kotlin-build.md +174 -174
- package/.agent/workflows/kotlin-review.md +140 -140
- package/.agent/workflows/kotlin-test.md +312 -312
- package/.agent/workflows/learn-eval.md +116 -116
- package/.agent/workflows/learn.md +70 -70
- package/.agent/workflows/loop-start.md +32 -32
- package/.agent/workflows/loop-status.md +24 -24
- package/.agent/workflows/model-route.md +26 -26
- package/.agent/workflows/multi-backend.md +158 -158
- package/.agent/workflows/multi-execute.md +315 -315
- package/.agent/workflows/multi-frontend.md +158 -158
- package/.agent/workflows/multi-plan.md +268 -268
- package/.agent/workflows/multi-workflow.md +191 -191
- package/.agent/workflows/orchestrate.md +135 -231
- package/.agent/workflows/plan.md +117 -115
- package/.agent/workflows/pm2.md +272 -272
- package/.agent/workflows/projects.md +39 -39
- package/.agent/workflows/promote.md +41 -41
- package/.agent/workflows/prompt-optimize.md +23 -38
- package/.agent/workflows/prp-commit.md +112 -0
- package/.agent/workflows/prp-implement.md +385 -0
- package/.agent/workflows/prp-plan.md +502 -0
- package/.agent/workflows/prp-pr.md +184 -0
- package/.agent/workflows/prp-prd.md +447 -0
- package/.agent/workflows/prune.md +31 -31
- package/.agent/workflows/python-review.md +297 -297
- package/.agent/workflows/quality-gate.md +29 -29
- package/.agent/workflows/refactor-clean.md +80 -80
- package/.agent/workflows/resume-session.md +156 -156
- package/.agent/workflows/rules-distill.md +20 -11
- package/.agent/workflows/rust-build.md +187 -187
- package/.agent/workflows/rust-review.md +142 -142
- package/.agent/workflows/rust-test.md +308 -308
- package/.agent/workflows/santa-loop.md +175 -0
- package/.agent/workflows/save-session.md +275 -275
- package/.agent/workflows/sessions.md +333 -333
- package/.agent/workflows/setup-pm.md +80 -80
- package/.agent/workflows/skill-create.md +174 -174
- package/.agent/workflows/skill-health.md +54 -54
- package/.agent/workflows/tdd.md +231 -328
- package/.agent/workflows/test-coverage.md +69 -69
- package/.agent/workflows/update-codemaps.md +72 -72
- package/.agent/workflows/update-docs.md +84 -84
- package/.agent/workflows/verify.md +23 -59
- package/LICENSE +176 -176
- package/README.md +28 -20
- package/RELEASE.md +32 -36
- package/package.json +87 -79
- package/scripts/release-check.js +55 -55
- package/src/bin/cli.js +399 -53
- package/src/lib/installer.js +360 -114
- package/src/lib/manifests/stacks.js +122 -0
- package/src/lib/slash-commands.js +28 -0
- package/src/templates/claude/CLAUDE.en.md +42 -0
- package/src/templates/claude/CLAUDE.md +42 -0
- package/src/templates/claude/CLAUDE.vi.md +42 -0
- package/src/templates/codex/AGENTS.en.md +40 -0
- package/src/templates/codex/AGENTS.md +40 -0
- package/src/templates/codex/AGENTS.vi.md +40 -0
- package/src/templates/cursor/pilo-masterkit.mdc +20 -0
- package/src/templates/gemini/GEMINI.en.md +56 -0
- package/src/templates/gemini/GEMINI.md +56 -0
- package/src/templates/gemini/GEMINI.vi.md +56 -0
- package/src/templates/github/copilot-instructions.md +16 -0
|
@@ -0,0 +1,310 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: video-editing
|
|
3
|
+
description: AI-assisted video editing workflows for cutting, structuring, and augmenting real footage. Covers the full pipeline from raw capture through FFmpeg, Remotion, ElevenLabs, fal.ai, and final polish in Descript or CapCut. Use when the user wants to edit video, cut footage, create vlogs, or build video content.
|
|
4
|
+
origin: ECC
|
|
5
|
+
---
|
|
6
|
+
|
|
7
|
+
# Video Editing
|
|
8
|
+
|
|
9
|
+
AI-assisted editing for real footage. Not generation from prompts. Editing existing video fast.
|
|
10
|
+
|
|
11
|
+
## When to Activate
|
|
12
|
+
|
|
13
|
+
- User wants to edit, cut, or structure video footage
|
|
14
|
+
- Turning long recordings into short-form content
|
|
15
|
+
- Building vlogs, tutorials, or demo videos from raw capture
|
|
16
|
+
- Adding overlays, subtitles, music, or voiceover to existing video
|
|
17
|
+
- Reframing video for different platforms (YouTube, TikTok, Instagram)
|
|
18
|
+
- User says "edit video", "cut this footage", "make a vlog", or "video workflow"
|
|
19
|
+
|
|
20
|
+
## Core Thesis
|
|
21
|
+
|
|
22
|
+
AI video editing is useful when you stop asking it to create the whole video and start using it to compress, structure, and augment real footage. The value is not generation. The value is compression.
|
|
23
|
+
|
|
24
|
+
## The Pipeline
|
|
25
|
+
|
|
26
|
+
```
|
|
27
|
+
Screen Studio / raw footage
|
|
28
|
+
→ Claude / Codex
|
|
29
|
+
→ FFmpeg
|
|
30
|
+
→ Remotion
|
|
31
|
+
→ ElevenLabs / fal.ai
|
|
32
|
+
→ Descript or CapCut
|
|
33
|
+
```
|
|
34
|
+
|
|
35
|
+
Each layer has a specific job. Do not skip layers. Do not try to make one tool do everything.
|
|
36
|
+
|
|
37
|
+
## Layer 1: Capture (Screen Studio / Raw Footage)
|
|
38
|
+
|
|
39
|
+
Collect the source material:
|
|
40
|
+
- **Screen Studio**: polished screen recordings for app demos, coding sessions, browser workflows
|
|
41
|
+
- **Raw camera footage**: vlog footage, interviews, event recordings
|
|
42
|
+
- **Desktop capture via VideoDB**: session recording with real-time context (see `videodb` skill)
|
|
43
|
+
|
|
44
|
+
Output: raw files ready for organization.
|
|
45
|
+
|
|
46
|
+
## Layer 2: Organization (Claude / Codex)
|
|
47
|
+
|
|
48
|
+
Use Claude Code or Codex to:
|
|
49
|
+
- **Transcribe and label**: generate transcript, identify topics and themes
|
|
50
|
+
- **Plan structure**: decide what stays, what gets cut, what order works
|
|
51
|
+
- **Identify dead sections**: find pauses, tangents, repeated takes
|
|
52
|
+
- **Generate edit decision list**: timestamps for cuts, segments to keep
|
|
53
|
+
- **Scaffold FFmpeg and Remotion code**: generate the commands and compositions
|
|
54
|
+
|
|
55
|
+
```
|
|
56
|
+
Example prompt:
|
|
57
|
+
"Here's the transcript of a 4-hour recording. Identify the 8 strongest segments
|
|
58
|
+
for a 24-minute vlog. Give me FFmpeg cut commands for each segment."
|
|
59
|
+
```
|
|
60
|
+
|
|
61
|
+
This layer is about structure, not final creative taste.
|
|
62
|
+
|
|
63
|
+
## Layer 3: Deterministic Cuts (FFmpeg)
|
|
64
|
+
|
|
65
|
+
FFmpeg handles the boring but critical work: splitting, trimming, concatenating, and preprocessing.
|
|
66
|
+
|
|
67
|
+
### Extract segment by timestamp
|
|
68
|
+
|
|
69
|
+
```bash
|
|
70
|
+
ffmpeg -i raw.mp4 -ss 00:12:30 -to 00:15:45 -c copy segment_01.mp4
|
|
71
|
+
```
|
|
72
|
+
|
|
73
|
+
### Batch cut from edit decision list
|
|
74
|
+
|
|
75
|
+
```bash
|
|
76
|
+
#!/bin/bash
|
|
77
|
+
# cuts.txt: start,end,label
|
|
78
|
+
while IFS=, read -r start end label; do
|
|
79
|
+
ffmpeg -i raw.mp4 -ss "$start" -to "$end" -c copy "segments/${label}.mp4"
|
|
80
|
+
done < cuts.txt
|
|
81
|
+
```
|
|
82
|
+
|
|
83
|
+
### Concatenate segments
|
|
84
|
+
|
|
85
|
+
```bash
|
|
86
|
+
# Create file list
|
|
87
|
+
for f in segments/*.mp4; do echo "file '$f'"; done > concat.txt
|
|
88
|
+
ffmpeg -f concat -safe 0 -i concat.txt -c copy assembled.mp4
|
|
89
|
+
```
|
|
90
|
+
|
|
91
|
+
### Create proxy for faster editing
|
|
92
|
+
|
|
93
|
+
```bash
|
|
94
|
+
ffmpeg -i raw.mp4 -vf "scale=960:-2" -c:v libx264 -preset ultrafast -crf 28 proxy.mp4
|
|
95
|
+
```
|
|
96
|
+
|
|
97
|
+
### Extract audio for transcription
|
|
98
|
+
|
|
99
|
+
```bash
|
|
100
|
+
ffmpeg -i raw.mp4 -vn -acodec pcm_s16le -ar 16000 audio.wav
|
|
101
|
+
```
|
|
102
|
+
|
|
103
|
+
### Normalize audio levels
|
|
104
|
+
|
|
105
|
+
```bash
|
|
106
|
+
ffmpeg -i segment.mp4 -af loudnorm=I=-16:TP=-1.5:LRA=11 -c:v copy normalized.mp4
|
|
107
|
+
```
|
|
108
|
+
|
|
109
|
+
## Layer 4: Programmable Composition (Remotion)
|
|
110
|
+
|
|
111
|
+
Remotion turns editing problems into composable code. Use it for things that traditional editors make painful:
|
|
112
|
+
|
|
113
|
+
### When to use Remotion
|
|
114
|
+
|
|
115
|
+
- Overlays: text, images, branding, lower thirds
|
|
116
|
+
- Data visualizations: charts, stats, animated numbers
|
|
117
|
+
- Motion graphics: transitions, explainer animations
|
|
118
|
+
- Composable scenes: reusable templates across videos
|
|
119
|
+
- Product demos: annotated screenshots, UI highlights
|
|
120
|
+
|
|
121
|
+
### Basic Remotion composition
|
|
122
|
+
|
|
123
|
+
```tsx
|
|
124
|
+
import { AbsoluteFill, Sequence, Video, useCurrentFrame } from "remotion";
|
|
125
|
+
|
|
126
|
+
export const VlogComposition: React.FC = () => {
|
|
127
|
+
const frame = useCurrentFrame();
|
|
128
|
+
|
|
129
|
+
return (
|
|
130
|
+
<AbsoluteFill>
|
|
131
|
+
{/* Main footage */}
|
|
132
|
+
<Sequence from={0} durationInFrames={300}>
|
|
133
|
+
<Video src="/segments/intro.mp4" />
|
|
134
|
+
</Sequence>
|
|
135
|
+
|
|
136
|
+
{/* Title overlay */}
|
|
137
|
+
<Sequence from={30} durationInFrames={90}>
|
|
138
|
+
<AbsoluteFill style={{
|
|
139
|
+
justifyContent: "center",
|
|
140
|
+
alignItems: "center",
|
|
141
|
+
}}>
|
|
142
|
+
<h1 style={{
|
|
143
|
+
fontSize: 72,
|
|
144
|
+
color: "white",
|
|
145
|
+
textShadow: "2px 2px 8px rgba(0,0,0,0.8)",
|
|
146
|
+
}}>
|
|
147
|
+
The AI Editing Stack
|
|
148
|
+
</h1>
|
|
149
|
+
</AbsoluteFill>
|
|
150
|
+
</Sequence>
|
|
151
|
+
|
|
152
|
+
{/* Next segment */}
|
|
153
|
+
<Sequence from={300} durationInFrames={450}>
|
|
154
|
+
<Video src="/segments/demo.mp4" />
|
|
155
|
+
</Sequence>
|
|
156
|
+
</AbsoluteFill>
|
|
157
|
+
);
|
|
158
|
+
};
|
|
159
|
+
```
|
|
160
|
+
|
|
161
|
+
### Render output
|
|
162
|
+
|
|
163
|
+
```bash
|
|
164
|
+
npx remotion render src/index.ts VlogComposition output.mp4
|
|
165
|
+
```
|
|
166
|
+
|
|
167
|
+
See the [Remotion docs](https://www.remotion.dev/docs) for detailed patterns and API reference.
|
|
168
|
+
|
|
169
|
+
## Layer 5: Generated Assets (ElevenLabs / fal.ai)
|
|
170
|
+
|
|
171
|
+
Generate only what you need. Do not generate the whole video.
|
|
172
|
+
|
|
173
|
+
### Voiceover with ElevenLabs
|
|
174
|
+
|
|
175
|
+
```python
|
|
176
|
+
import os
|
|
177
|
+
import requests
|
|
178
|
+
|
|
179
|
+
resp = requests.post(
|
|
180
|
+
f"https://api.elevenlabs.io/v1/text-to-speech/{voice_id}",
|
|
181
|
+
headers={
|
|
182
|
+
"xi-api-key": os.environ["ELEVENLABS_API_KEY"],
|
|
183
|
+
"Content-Type": "application/json"
|
|
184
|
+
},
|
|
185
|
+
json={
|
|
186
|
+
"text": "Your narration text here",
|
|
187
|
+
"model_id": "eleven_turbo_v2_5",
|
|
188
|
+
"voice_settings": {"stability": 0.5, "similarity_boost": 0.75}
|
|
189
|
+
}
|
|
190
|
+
)
|
|
191
|
+
with open("voiceover.mp3", "wb") as f:
|
|
192
|
+
f.write(resp.content)
|
|
193
|
+
```
|
|
194
|
+
|
|
195
|
+
### Music and SFX with fal.ai
|
|
196
|
+
|
|
197
|
+
Use the `fal-ai-media` skill for:
|
|
198
|
+
- Background music generation
|
|
199
|
+
- Sound effects (ThinkSound model for video-to-audio)
|
|
200
|
+
- Transition sounds
|
|
201
|
+
|
|
202
|
+
### Generated visuals with fal.ai
|
|
203
|
+
|
|
204
|
+
Use for insert shots, thumbnails, or b-roll that doesn't exist:
|
|
205
|
+
```
|
|
206
|
+
generate(app_id: "fal-ai/nano-banana-pro", input_data: {
|
|
207
|
+
"prompt": "professional thumbnail for tech vlog, dark background, code on screen",
|
|
208
|
+
"image_size": "landscape_16_9"
|
|
209
|
+
})
|
|
210
|
+
```
|
|
211
|
+
|
|
212
|
+
### VideoDB generative audio
|
|
213
|
+
|
|
214
|
+
If VideoDB is configured:
|
|
215
|
+
```python
|
|
216
|
+
voiceover = coll.generate_voice(text="Narration here", voice="alloy")
|
|
217
|
+
music = coll.generate_music(prompt="lo-fi background for coding vlog", duration=120)
|
|
218
|
+
sfx = coll.generate_sound_effect(prompt="subtle whoosh transition")
|
|
219
|
+
```
|
|
220
|
+
|
|
221
|
+
## Layer 6: Final Polish (Descript / CapCut)
|
|
222
|
+
|
|
223
|
+
The last layer is human. Use a traditional editor for:
|
|
224
|
+
- **Pacing**: adjust cuts that feel too fast or slow
|
|
225
|
+
- **Captions**: auto-generated, then manually cleaned
|
|
226
|
+
- **Color grading**: basic correction and mood
|
|
227
|
+
- **Final audio mix**: balance voice, music, and SFX levels
|
|
228
|
+
- **Export**: platform-specific formats and quality settings
|
|
229
|
+
|
|
230
|
+
This is where taste lives. AI clears the repetitive work. You make the final calls.
|
|
231
|
+
|
|
232
|
+
## Social Media Reframing
|
|
233
|
+
|
|
234
|
+
Different platforms need different aspect ratios:
|
|
235
|
+
|
|
236
|
+
| Platform | Aspect Ratio | Resolution |
|
|
237
|
+
|----------|-------------|------------|
|
|
238
|
+
| YouTube | 16:9 | 1920x1080 |
|
|
239
|
+
| TikTok / Reels | 9:16 | 1080x1920 |
|
|
240
|
+
| Instagram Feed | 1:1 | 1080x1080 |
|
|
241
|
+
| X / Twitter | 16:9 or 1:1 | 1280x720 or 720x720 |
|
|
242
|
+
|
|
243
|
+
### Reframe with FFmpeg
|
|
244
|
+
|
|
245
|
+
```bash
|
|
246
|
+
# 16:9 to 9:16 (center crop)
|
|
247
|
+
ffmpeg -i input.mp4 -vf "crop=ih*9/16:ih,scale=1080:1920" vertical.mp4
|
|
248
|
+
|
|
249
|
+
# 16:9 to 1:1 (center crop)
|
|
250
|
+
ffmpeg -i input.mp4 -vf "crop=ih:ih,scale=1080:1080" square.mp4
|
|
251
|
+
```
|
|
252
|
+
|
|
253
|
+
### Reframe with VideoDB
|
|
254
|
+
|
|
255
|
+
```python
|
|
256
|
+
from videodb import ReframeMode
|
|
257
|
+
|
|
258
|
+
# Smart reframe (AI-guided subject tracking)
|
|
259
|
+
reframed = video.reframe(start=0, end=60, target="vertical", mode=ReframeMode.smart)
|
|
260
|
+
```
|
|
261
|
+
|
|
262
|
+
## Scene Detection and Auto-Cut
|
|
263
|
+
|
|
264
|
+
### FFmpeg scene detection
|
|
265
|
+
|
|
266
|
+
```bash
|
|
267
|
+
# Detect scene changes (threshold 0.3 = moderate sensitivity)
|
|
268
|
+
ffmpeg -i input.mp4 -vf "select='gt(scene,0.3)',showinfo" -vsync vfr -f null - 2>&1 | grep showinfo
|
|
269
|
+
```
|
|
270
|
+
|
|
271
|
+
### Silence detection for auto-cut
|
|
272
|
+
|
|
273
|
+
```bash
|
|
274
|
+
# Find silent segments (useful for cutting dead air)
|
|
275
|
+
ffmpeg -i input.mp4 -af silencedetect=noise=-30dB:d=2 -f null - 2>&1 | grep silence
|
|
276
|
+
```
|
|
277
|
+
|
|
278
|
+
### Highlight extraction
|
|
279
|
+
|
|
280
|
+
Use Claude to analyze transcript + scene timestamps:
|
|
281
|
+
```
|
|
282
|
+
"Given this transcript with timestamps and these scene change points,
|
|
283
|
+
identify the 5 most engaging 30-second clips for social media."
|
|
284
|
+
```
|
|
285
|
+
|
|
286
|
+
## What Each Tool Does Best
|
|
287
|
+
|
|
288
|
+
| Tool | Strength | Weakness |
|
|
289
|
+
|------|----------|----------|
|
|
290
|
+
| Claude / Codex | Organization, planning, code generation | Not the creative taste layer |
|
|
291
|
+
| FFmpeg | Deterministic cuts, batch processing, format conversion | No visual editing UI |
|
|
292
|
+
| Remotion | Programmable overlays, composable scenes, reusable templates | Learning curve for non-devs |
|
|
293
|
+
| Screen Studio | Polished screen recordings immediately | Only screen capture |
|
|
294
|
+
| ElevenLabs | Voice, narration, music, SFX | Not the center of the workflow |
|
|
295
|
+
| Descript / CapCut | Final pacing, captions, polish | Manual, not automatable |
|
|
296
|
+
|
|
297
|
+
## Key Principles
|
|
298
|
+
|
|
299
|
+
1. **Edit, don't generate.** This workflow is for cutting real footage, not creating from prompts.
|
|
300
|
+
2. **Structure before style.** Get the story right in Layer 2 before touching anything visual.
|
|
301
|
+
3. **FFmpeg is the backbone.** Boring but critical. Where long footage becomes manageable.
|
|
302
|
+
4. **Remotion for repeatability.** If you'll do it more than once, make it a Remotion component.
|
|
303
|
+
5. **Generate selectively.** Only use AI generation for assets that don't exist, not for everything.
|
|
304
|
+
6. **Taste is the last layer.** AI clears repetitive work. You make the final creative calls.
|
|
305
|
+
|
|
306
|
+
## Related Skills
|
|
307
|
+
|
|
308
|
+
- `fal-ai-media` — AI image, video, and audio generation
|
|
309
|
+
- `videodb` — Server-side video processing, indexing, and streaming
|
|
310
|
+
- `content-engine` — Platform-native content distribution
|
|
@@ -0,0 +1,374 @@
|
|
|
1
|
+
---
|
|
2
|
+
name: videodb
|
|
3
|
+
description: See, Understand, Act on video and audio. See- ingest from local files, URLs, RTSP/live feeds, or live record desktop; return realtime context and playable stream links. Understand- extract frames, build visual/semantic/temporal indexes, and search moments with timestamps and auto-clips. Act- transcode and normalize (codec, fps, resolution, aspect ratio), perform timeline edits (subtitles, text/image overlays, branding, audio overlays, dubbing, translation), generate media assets (image, audio, video), and create real time alerts for events from live streams or desktop capture.
|
|
4
|
+
origin: ECC
|
|
5
|
+
allowed-tools: Read Grep Glob Bash(python:*)
|
|
6
|
+
argument-hint: "[task description]"
|
|
7
|
+
---
|
|
8
|
+
|
|
9
|
+
# VideoDB Skill
|
|
10
|
+
|
|
11
|
+
**Perception + memory + actions for video, live streams, and desktop sessions.**
|
|
12
|
+
|
|
13
|
+
## When to use
|
|
14
|
+
|
|
15
|
+
### Desktop Perception
|
|
16
|
+
- Start/stop a **desktop session** capturing **screen, mic, and system audio**
|
|
17
|
+
- Stream **live context** and store **episodic session memory**
|
|
18
|
+
- Run **real-time alerts/triggers** on what's spoken and what's happening on screen
|
|
19
|
+
- Produce **session summaries**, a searchable timeline, and **playable evidence links**
|
|
20
|
+
|
|
21
|
+
### Video ingest + stream
|
|
22
|
+
- Ingest a **file or URL** and return a **playable web stream link**
|
|
23
|
+
- Transcode/normalize: **codec, bitrate, fps, resolution, aspect ratio**
|
|
24
|
+
|
|
25
|
+
### Index + search (timestamps + evidence)
|
|
26
|
+
- Build **visual**, **spoken**, and **keyword** indexes
|
|
27
|
+
- Search and return exact moments with **timestamps** and **playable evidence**
|
|
28
|
+
- Auto-create **clips** from search results
|
|
29
|
+
|
|
30
|
+
### Timeline editing + generation
|
|
31
|
+
- Subtitles: **generate**, **translate**, **burn-in**
|
|
32
|
+
- Overlays: **text/image/branding**, motion captions
|
|
33
|
+
- Audio: **background music**, **voiceover**, **dubbing**
|
|
34
|
+
- Programmatic composition and exports via **timeline operations**
|
|
35
|
+
|
|
36
|
+
### Live streams (RTSP) + monitoring
|
|
37
|
+
- Connect **RTSP/live feeds**
|
|
38
|
+
- Run **real-time visual and spoken understanding** and emit **events/alerts** for monitoring workflows
|
|
39
|
+
|
|
40
|
+
## How it works
|
|
41
|
+
|
|
42
|
+
### Common inputs
|
|
43
|
+
- Local **file path**, public **URL**, or **RTSP URL**
|
|
44
|
+
- Desktop capture request: **start / stop / summarize session**
|
|
45
|
+
- Desired operations: get context for understanding, transcode spec, index spec, search query, clip ranges, timeline edits, alert rules
|
|
46
|
+
|
|
47
|
+
### Common outputs
|
|
48
|
+
- **Stream URL**
|
|
49
|
+
- Search results with **timestamps** and **evidence links**
|
|
50
|
+
- Generated assets: subtitles, audio, images, clips
|
|
51
|
+
- **Event/alert payloads** for live streams
|
|
52
|
+
- Desktop **session summaries** and memory entries
|
|
53
|
+
|
|
54
|
+
### Running Python code
|
|
55
|
+
|
|
56
|
+
Before running any VideoDB code, change to the project directory and load environment variables:
|
|
57
|
+
|
|
58
|
+
```python
|
|
59
|
+
from dotenv import load_dotenv
|
|
60
|
+
load_dotenv(".env")
|
|
61
|
+
|
|
62
|
+
import videodb
|
|
63
|
+
conn = videodb.connect()
|
|
64
|
+
```
|
|
65
|
+
|
|
66
|
+
This reads `VIDEO_DB_API_KEY` from:
|
|
67
|
+
1. Environment (if already exported)
|
|
68
|
+
2. Project's `.env` file in current directory
|
|
69
|
+
|
|
70
|
+
If the key is missing, `videodb.connect()` raises `AuthenticationError` automatically.
|
|
71
|
+
|
|
72
|
+
Do NOT write a script file when a short inline command works.
|
|
73
|
+
|
|
74
|
+
When writing inline Python (`python -c "..."`), always use properly formatted code — use semicolons to separate statements and keep it readable. For anything longer than ~3 statements, use a heredoc instead:
|
|
75
|
+
|
|
76
|
+
```bash
|
|
77
|
+
python << 'EOF'
|
|
78
|
+
from dotenv import load_dotenv
|
|
79
|
+
load_dotenv(".env")
|
|
80
|
+
|
|
81
|
+
import videodb
|
|
82
|
+
conn = videodb.connect()
|
|
83
|
+
coll = conn.get_collection()
|
|
84
|
+
print(f"Videos: {len(coll.get_videos())}")
|
|
85
|
+
EOF
|
|
86
|
+
```
|
|
87
|
+
|
|
88
|
+
### Setup
|
|
89
|
+
|
|
90
|
+
When the user asks to "setup videodb" or similar:
|
|
91
|
+
|
|
92
|
+
### 1. Install SDK
|
|
93
|
+
|
|
94
|
+
```bash
|
|
95
|
+
pip install "videodb[capture]" python-dotenv
|
|
96
|
+
```
|
|
97
|
+
|
|
98
|
+
If `videodb[capture]` fails on Linux, install without the capture extra:
|
|
99
|
+
|
|
100
|
+
```bash
|
|
101
|
+
pip install videodb python-dotenv
|
|
102
|
+
```
|
|
103
|
+
|
|
104
|
+
### 2. Configure API key
|
|
105
|
+
|
|
106
|
+
The user must set `VIDEO_DB_API_KEY` using **either** method:
|
|
107
|
+
|
|
108
|
+
- **Export in terminal** (before starting Claude): `export VIDEO_DB_API_KEY=your-key`
|
|
109
|
+
- **Project `.env` file**: Save `VIDEO_DB_API_KEY=your-key` in the project's `.env` file
|
|
110
|
+
|
|
111
|
+
Get a free API key at [console.videodb.io](https://console.videodb.io) (50 free uploads, no credit card).
|
|
112
|
+
|
|
113
|
+
**Do NOT** read, write, or handle the API key yourself. Always let the user set it.
|
|
114
|
+
|
|
115
|
+
### Quick Reference
|
|
116
|
+
|
|
117
|
+
### Upload media
|
|
118
|
+
|
|
119
|
+
```python
|
|
120
|
+
# URL
|
|
121
|
+
video = coll.upload(url="https://example.com/video.mp4")
|
|
122
|
+
|
|
123
|
+
# YouTube
|
|
124
|
+
video = coll.upload(url="https://www.youtube.com/watch?v=VIDEO_ID")
|
|
125
|
+
|
|
126
|
+
# Local file
|
|
127
|
+
video = coll.upload(file_path="/path/to/video.mp4")
|
|
128
|
+
```
|
|
129
|
+
|
|
130
|
+
### Transcript + subtitle
|
|
131
|
+
|
|
132
|
+
```python
|
|
133
|
+
# force=True skips the error if the video is already indexed
|
|
134
|
+
video.index_spoken_words(force=True)
|
|
135
|
+
text = video.get_transcript_text()
|
|
136
|
+
stream_url = video.add_subtitle()
|
|
137
|
+
```
|
|
138
|
+
|
|
139
|
+
### Search inside videos
|
|
140
|
+
|
|
141
|
+
```python
|
|
142
|
+
from videodb.exceptions import InvalidRequestError
|
|
143
|
+
|
|
144
|
+
video.index_spoken_words(force=True)
|
|
145
|
+
|
|
146
|
+
# search() raises InvalidRequestError when no results are found.
|
|
147
|
+
# Always wrap in try/except and treat "No results found" as empty.
|
|
148
|
+
try:
|
|
149
|
+
results = video.search("product demo")
|
|
150
|
+
shots = results.get_shots()
|
|
151
|
+
stream_url = results.compile()
|
|
152
|
+
except InvalidRequestError as e:
|
|
153
|
+
if "No results found" in str(e):
|
|
154
|
+
shots = []
|
|
155
|
+
else:
|
|
156
|
+
raise
|
|
157
|
+
```
|
|
158
|
+
|
|
159
|
+
### Scene search
|
|
160
|
+
|
|
161
|
+
```python
|
|
162
|
+
import re
|
|
163
|
+
from videodb import SearchType, IndexType, SceneExtractionType
|
|
164
|
+
from videodb.exceptions import InvalidRequestError
|
|
165
|
+
|
|
166
|
+
# index_scenes() has no force parameter — it raises an error if a scene
|
|
167
|
+
# index already exists. Extract the existing index ID from the error.
|
|
168
|
+
try:
|
|
169
|
+
scene_index_id = video.index_scenes(
|
|
170
|
+
extraction_type=SceneExtractionType.shot_based,
|
|
171
|
+
prompt="Describe the visual content in this scene.",
|
|
172
|
+
)
|
|
173
|
+
except Exception as e:
|
|
174
|
+
match = re.search(r"id\s+([a-f0-9]+)", str(e))
|
|
175
|
+
if match:
|
|
176
|
+
scene_index_id = match.group(1)
|
|
177
|
+
else:
|
|
178
|
+
raise
|
|
179
|
+
|
|
180
|
+
# Use score_threshold to filter low-relevance noise (recommended: 0.3+)
|
|
181
|
+
try:
|
|
182
|
+
results = video.search(
|
|
183
|
+
query="person writing on a whiteboard",
|
|
184
|
+
search_type=SearchType.semantic,
|
|
185
|
+
index_type=IndexType.scene,
|
|
186
|
+
scene_index_id=scene_index_id,
|
|
187
|
+
score_threshold=0.3,
|
|
188
|
+
)
|
|
189
|
+
shots = results.get_shots()
|
|
190
|
+
stream_url = results.compile()
|
|
191
|
+
except InvalidRequestError as e:
|
|
192
|
+
if "No results found" in str(e):
|
|
193
|
+
shots = []
|
|
194
|
+
else:
|
|
195
|
+
raise
|
|
196
|
+
```
|
|
197
|
+
|
|
198
|
+
### Timeline editing
|
|
199
|
+
|
|
200
|
+
**Important:** Always validate timestamps before building a timeline:
|
|
201
|
+
- `start` must be >= 0 (negative values are silently accepted but produce broken output)
|
|
202
|
+
- `start` must be < `end`
|
|
203
|
+
- `end` must be <= `video.length`
|
|
204
|
+
|
|
205
|
+
```python
|
|
206
|
+
from videodb.timeline import Timeline
|
|
207
|
+
from videodb.asset import VideoAsset, TextAsset, TextStyle
|
|
208
|
+
|
|
209
|
+
timeline = Timeline(conn)
|
|
210
|
+
timeline.add_inline(VideoAsset(asset_id=video.id, start=10, end=30))
|
|
211
|
+
timeline.add_overlay(0, TextAsset(text="The End", duration=3, style=TextStyle(fontsize=36)))
|
|
212
|
+
stream_url = timeline.generate_stream()
|
|
213
|
+
```
|
|
214
|
+
|
|
215
|
+
### Transcode video (resolution / quality change)
|
|
216
|
+
|
|
217
|
+
```python
|
|
218
|
+
from videodb import TranscodeMode, VideoConfig, AudioConfig
|
|
219
|
+
|
|
220
|
+
# Change resolution, quality, or aspect ratio server-side
|
|
221
|
+
job_id = conn.transcode(
|
|
222
|
+
source="https://example.com/video.mp4",
|
|
223
|
+
callback_url="https://example.com/webhook",
|
|
224
|
+
mode=TranscodeMode.economy,
|
|
225
|
+
video_config=VideoConfig(resolution=720, quality=23, aspect_ratio="16:9"),
|
|
226
|
+
audio_config=AudioConfig(mute=False),
|
|
227
|
+
)
|
|
228
|
+
```
|
|
229
|
+
|
|
230
|
+
### Reframe aspect ratio (for social platforms)
|
|
231
|
+
|
|
232
|
+
**Warning:** `reframe()` is a slow server-side operation. For long videos it can take
|
|
233
|
+
several minutes and may time out. Best practices:
|
|
234
|
+
- Always limit to a short segment using `start`/`end` when possible
|
|
235
|
+
- For full-length videos, use `callback_url` for async processing
|
|
236
|
+
- Trim the video on a `Timeline` first, then reframe the shorter result
|
|
237
|
+
|
|
238
|
+
```python
|
|
239
|
+
from videodb import ReframeMode
|
|
240
|
+
|
|
241
|
+
# Always prefer reframing a short segment:
|
|
242
|
+
reframed = video.reframe(start=0, end=60, target="vertical", mode=ReframeMode.smart)
|
|
243
|
+
|
|
244
|
+
# Async reframe for full-length videos (returns None, result via webhook):
|
|
245
|
+
video.reframe(target="vertical", callback_url="https://example.com/webhook")
|
|
246
|
+
|
|
247
|
+
# Presets: "vertical" (9:16), "square" (1:1), "landscape" (16:9)
|
|
248
|
+
reframed = video.reframe(start=0, end=60, target="square")
|
|
249
|
+
|
|
250
|
+
# Custom dimensions
|
|
251
|
+
reframed = video.reframe(start=0, end=60, target={"width": 1280, "height": 720})
|
|
252
|
+
```
|
|
253
|
+
|
|
254
|
+
### Generative media
|
|
255
|
+
|
|
256
|
+
```python
|
|
257
|
+
image = coll.generate_image(
|
|
258
|
+
prompt="a sunset over mountains",
|
|
259
|
+
aspect_ratio="16:9",
|
|
260
|
+
)
|
|
261
|
+
```
|
|
262
|
+
|
|
263
|
+
## Error handling
|
|
264
|
+
|
|
265
|
+
```python
|
|
266
|
+
from videodb.exceptions import AuthenticationError, InvalidRequestError
|
|
267
|
+
|
|
268
|
+
try:
|
|
269
|
+
conn = videodb.connect()
|
|
270
|
+
except AuthenticationError:
|
|
271
|
+
print("Check your VIDEO_DB_API_KEY")
|
|
272
|
+
|
|
273
|
+
try:
|
|
274
|
+
video = coll.upload(url="https://example.com/video.mp4")
|
|
275
|
+
except InvalidRequestError as e:
|
|
276
|
+
print(f"Upload failed: {e}")
|
|
277
|
+
```
|
|
278
|
+
|
|
279
|
+
### Common pitfalls
|
|
280
|
+
|
|
281
|
+
| Scenario | Error message | Solution |
|
|
282
|
+
|----------|--------------|----------|
|
|
283
|
+
| Indexing an already-indexed video | `Spoken word index for video already exists` | Use `video.index_spoken_words(force=True)` to skip if already indexed |
|
|
284
|
+
| Scene index already exists | `Scene index with id XXXX already exists` | Extract the existing `scene_index_id` from the error with `re.search(r"id\s+([a-f0-9]+)", str(e))` |
|
|
285
|
+
| Search finds no matches | `InvalidRequestError: No results found` | Catch the exception and treat as empty results (`shots = []`) |
|
|
286
|
+
| Reframe times out | Blocks indefinitely on long videos | Use `start`/`end` to limit segment, or pass `callback_url` for async |
|
|
287
|
+
| Negative timestamps on Timeline | Silently produces broken stream | Always validate `start >= 0` before creating `VideoAsset` |
|
|
288
|
+
| `generate_video()` / `create_collection()` fails | `Operation not allowed` or `maximum limit` | Plan-gated features — inform the user about plan limits |
|
|
289
|
+
|
|
290
|
+
## Examples
|
|
291
|
+
|
|
292
|
+
### Canonical prompts
|
|
293
|
+
- "Start desktop capture and alert when a password field appears."
|
|
294
|
+
- "Record my session and produce an actionable summary when it ends."
|
|
295
|
+
- "Ingest this file and return a playable stream link."
|
|
296
|
+
- "Index this folder and find every scene with people, return timestamps."
|
|
297
|
+
- "Generate subtitles, burn them in, and add light background music."
|
|
298
|
+
- "Connect this RTSP URL and alert when a person enters the zone."
|
|
299
|
+
|
|
300
|
+
### Screen Recording (Desktop Capture)
|
|
301
|
+
|
|
302
|
+
Use `ws_listener.py` to capture WebSocket events during recording sessions. Desktop capture supports **macOS** only.
|
|
303
|
+
|
|
304
|
+
#### Quick Start
|
|
305
|
+
|
|
306
|
+
1. **Choose state dir**: `STATE_DIR="${VIDEODB_EVENTS_DIR:-$HOME/.local/state/videodb}"`
|
|
307
|
+
2. **Start listener**: `VIDEODB_EVENTS_DIR="$STATE_DIR" python scripts/ws_listener.py --clear "$STATE_DIR" &`
|
|
308
|
+
3. **Get WebSocket ID**: `cat "$STATE_DIR/videodb_ws_id"`
|
|
309
|
+
4. **Run capture code** (see reference/capture.md for the full workflow)
|
|
310
|
+
5. **Events written to**: `$STATE_DIR/videodb_events.jsonl`
|
|
311
|
+
|
|
312
|
+
Use `--clear` whenever you start a fresh capture run so stale transcript and visual events do not leak into the new session.
|
|
313
|
+
|
|
314
|
+
#### Query Events
|
|
315
|
+
|
|
316
|
+
```python
|
|
317
|
+
import json
|
|
318
|
+
import os
|
|
319
|
+
import time
|
|
320
|
+
from pathlib import Path
|
|
321
|
+
|
|
322
|
+
events_dir = Path(os.environ.get("VIDEODB_EVENTS_DIR", Path.home() / ".local" / "state" / "videodb"))
|
|
323
|
+
events_file = events_dir / "videodb_events.jsonl"
|
|
324
|
+
events = []
|
|
325
|
+
|
|
326
|
+
if events_file.exists():
|
|
327
|
+
with events_file.open(encoding="utf-8") as handle:
|
|
328
|
+
for line in handle:
|
|
329
|
+
try:
|
|
330
|
+
events.append(json.loads(line))
|
|
331
|
+
except json.JSONDecodeError:
|
|
332
|
+
continue
|
|
333
|
+
|
|
334
|
+
transcripts = [e["data"]["text"] for e in events if e.get("channel") == "transcript"]
|
|
335
|
+
cutoff = time.time() - 300
|
|
336
|
+
recent_visual = [
|
|
337
|
+
e for e in events
|
|
338
|
+
if e.get("channel") == "visual_index" and e["unix_ts"] > cutoff
|
|
339
|
+
]
|
|
340
|
+
```
|
|
341
|
+
|
|
342
|
+
## Additional docs
|
|
343
|
+
|
|
344
|
+
Reference documentation is in the `reference/` directory adjacent to this SKILL.md file. Use the Glob tool to locate it if needed.
|
|
345
|
+
|
|
346
|
+
- [reference/api-reference.md](reference/api-reference.md) - Complete VideoDB Python SDK API reference
|
|
347
|
+
- [reference/search.md](reference/search.md) - In-depth guide to video search (spoken word and scene-based)
|
|
348
|
+
- [reference/editor.md](reference/editor.md) - Timeline editing, assets, and composition
|
|
349
|
+
- [reference/streaming.md](reference/streaming.md) - HLS streaming and instant playback
|
|
350
|
+
- [reference/generative.md](reference/generative.md) - AI-powered media generation (images, video, audio)
|
|
351
|
+
- [reference/rtstream.md](reference/rtstream.md) - Live stream ingestion workflow (RTSP/RTMP)
|
|
352
|
+
- [reference/rtstream-reference.md](reference/rtstream-reference.md) - RTStream SDK methods and AI pipelines
|
|
353
|
+
- [reference/capture.md](reference/capture.md) - Desktop capture workflow
|
|
354
|
+
- [reference/capture-reference.md](reference/capture-reference.md) - Capture SDK and WebSocket events
|
|
355
|
+
- [reference/use-cases.md](reference/use-cases.md) - Common video processing patterns and examples
|
|
356
|
+
|
|
357
|
+
**Do not use ffmpeg, moviepy, or local encoding tools** when VideoDB supports the operation. The following are all handled server-side by VideoDB — trimming, combining clips, overlaying audio or music, adding subtitles, text/image overlays, transcoding, resolution changes, aspect-ratio conversion, resizing for platform requirements, transcription, and media generation. Only fall back to local tools for operations listed under Limitations in reference/editor.md (transitions, speed changes, crop/zoom, colour grading, volume mixing).
|
|
358
|
+
|
|
359
|
+
### When to use what
|
|
360
|
+
|
|
361
|
+
| Problem | VideoDB solution |
|
|
362
|
+
|---------|-----------------|
|
|
363
|
+
| Platform rejects video aspect ratio or resolution | `video.reframe()` or `conn.transcode()` with `VideoConfig` |
|
|
364
|
+
| Need to resize video for Twitter/Instagram/TikTok | `video.reframe(target="vertical")` or `target="square"` |
|
|
365
|
+
| Need to change resolution (e.g. 1080p → 720p) | `conn.transcode()` with `VideoConfig(resolution=720)` |
|
|
366
|
+
| Need to overlay audio/music on video | `AudioAsset` on a `Timeline` |
|
|
367
|
+
| Need to add subtitles | `video.add_subtitle()` or `CaptionAsset` |
|
|
368
|
+
| Need to combine/trim clips | `VideoAsset` on a `Timeline` |
|
|
369
|
+
| Need to generate voiceover, music, or SFX | `coll.generate_voice()`, `generate_music()`, `generate_sound_effect()` |
|
|
370
|
+
|
|
371
|
+
## Provenance
|
|
372
|
+
|
|
373
|
+
Reference material for this skill is vendored locally under `skills/videodb/reference/`.
|
|
374
|
+
Use the local copies above instead of following external repository links at runtime.
|