codeply-cli 0.5.0 → 0.5.2

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (387) hide show
  1. package/LICENSE +21 -0
  2. package/THIRD_PARTY_NOTICES.md +65 -63
  3. package/bin/codeply.js +1 -1
  4. package/lib/agent.mjs +133 -24
  5. package/lib/ai.js +268 -9
  6. package/lib/ai.mjs +6 -6
  7. package/lib/apply-patch.js +217 -217
  8. package/lib/arity-table.json +138 -138
  9. package/lib/arity.js +70 -70
  10. package/lib/auth.mjs +6 -6
  11. package/lib/bots.js +493 -16
  12. package/lib/chatgpt.js +282 -0
  13. package/lib/cloud-browser.mjs +143 -143
  14. package/lib/cloud.mjs +1186 -1105
  15. package/lib/commands.js +103 -103
  16. package/lib/config.js +83 -3
  17. package/lib/design-library/assemble-artifact.mjs +21 -21
  18. package/lib/design-library/cleanup.mjs +45 -45
  19. package/lib/design-library/index.json +22379 -22379
  20. package/lib/design-library/make-table-data.mjs +39 -39
  21. package/lib/diagnostics.js +192 -192
  22. package/lib/edit-engine.js +364 -364
  23. package/lib/github-agent.mjs +311 -311
  24. package/lib/history.js +75 -75
  25. package/lib/mail-watch.js +504 -0
  26. package/lib/mcp.js +258 -258
  27. package/lib/model-sync.js +114 -0
  28. package/lib/native-tools.mjs +16 -1
  29. package/lib/oauth-connectors.js +146 -24
  30. package/lib/permissions.js +109 -109
  31. package/lib/plugins.js +353 -353
  32. package/lib/publish.js +916 -0
  33. package/lib/reach.js +67 -0
  34. package/lib/server.mjs +457 -457
  35. package/lib/session-db.js +220 -220
  36. package/lib/share.js +168 -168
  37. package/lib/skills.js +2 -0
  38. package/lib/snapshot.js +146 -146
  39. package/lib/telemetry.js +102 -0
  40. package/lib/terminal-hints.js +154 -154
  41. package/lib/tools.mjs +316 -14
  42. package/lib/typecheck-worker.js +147 -147
  43. package/lib/web-tools.js +209 -158
  44. package/package.json +49 -49
  45. package/skills/SOURCE.md +58 -58
  46. package/skills/accessibility/SKILL.md +147 -147
  47. package/skills/agent-architecture-audit/SKILL.md +257 -257
  48. package/skills/agent-eval/SKILL.md +147 -147
  49. package/skills/agent-harness-construction/SKILL.md +74 -74
  50. package/skills/agent-introspection-debugging/SKILL.md +154 -154
  51. package/skills/agent-payment-x402/SKILL.md +225 -225
  52. package/skills/agent-self-evaluation/SKILL.md +182 -182
  53. package/skills/agent-self-evaluation/references/evaluation-criteria.md +71 -71
  54. package/skills/agent-self-evaluation/references/hook-integration.md +64 -64
  55. package/skills/agent-sort/SKILL.md +216 -216
  56. package/skills/agentic-engineering/SKILL.md +64 -64
  57. package/skills/agentic-os/SKILL.md +388 -388
  58. package/skills/ai-first-engineering/SKILL.md +52 -52
  59. package/skills/ai-regression-testing/SKILL.md +386 -386
  60. package/skills/android-clean-architecture/SKILL.md +340 -340
  61. package/skills/angular-developer/SKILL.md +155 -155
  62. package/skills/angular-developer/references/angular-animations.md +160 -160
  63. package/skills/angular-developer/references/angular-aria.md +410 -410
  64. package/skills/angular-developer/references/cli.md +86 -86
  65. package/skills/angular-developer/references/component-harnesses.md +59 -59
  66. package/skills/angular-developer/references/component-styling.md +91 -91
  67. package/skills/angular-developer/references/components.md +117 -117
  68. package/skills/angular-developer/references/creating-services.md +97 -97
  69. package/skills/angular-developer/references/data-resolvers.md +69 -69
  70. package/skills/angular-developer/references/define-routes.md +67 -67
  71. package/skills/angular-developer/references/defining-providers.md +72 -72
  72. package/skills/angular-developer/references/di-fundamentals.md +120 -120
  73. package/skills/angular-developer/references/e2e-testing.md +56 -56
  74. package/skills/angular-developer/references/effects.md +83 -83
  75. package/skills/angular-developer/references/hierarchical-injectors.md +43 -43
  76. package/skills/angular-developer/references/host-elements.md +80 -80
  77. package/skills/angular-developer/references/injection-context.md +63 -63
  78. package/skills/angular-developer/references/inputs.md +101 -101
  79. package/skills/angular-developer/references/linked-signal.md +59 -59
  80. package/skills/angular-developer/references/loading-strategies.md +61 -61
  81. package/skills/angular-developer/references/mcp.md +108 -108
  82. package/skills/angular-developer/references/navigate-to-routes.md +69 -69
  83. package/skills/angular-developer/references/outputs.md +86 -86
  84. package/skills/angular-developer/references/reactive-forms.md +122 -122
  85. package/skills/angular-developer/references/rendering-strategies.md +44 -44
  86. package/skills/angular-developer/references/resource.md +77 -77
  87. package/skills/angular-developer/references/route-animations.md +56 -56
  88. package/skills/angular-developer/references/route-guards.md +52 -52
  89. package/skills/angular-developer/references/router-lifecycle.md +45 -45
  90. package/skills/angular-developer/references/router-testing.md +87 -87
  91. package/skills/angular-developer/references/show-routes-with-outlets.md +68 -68
  92. package/skills/angular-developer/references/signal-forms.md +795 -795
  93. package/skills/angular-developer/references/signals-overview.md +94 -94
  94. package/skills/angular-developer/references/tailwind-css.md +69 -69
  95. package/skills/angular-developer/references/template-driven-forms.md +114 -114
  96. package/skills/angular-developer/references/testing-fundamentals.md +65 -65
  97. package/skills/api-connector-builder/SKILL.md +121 -121
  98. package/skills/api-design/SKILL.md +524 -524
  99. package/skills/architecture-decision-records/SKILL.md +180 -180
  100. package/skills/article-writing/SKILL.md +80 -80
  101. package/skills/automation-audit-ops/SKILL.md +143 -143
  102. package/skills/autonomous-agent-harness/SKILL.md +274 -274
  103. package/skills/autonomous-loops/SKILL.md +611 -611
  104. package/skills/backend-patterns/SKILL.md +562 -562
  105. package/skills/benchmark/SKILL.md +95 -95
  106. package/skills/benchmark-methodology/SKILL.md +191 -191
  107. package/skills/benchmark-optimization-loop/SKILL.md +71 -71
  108. package/skills/blender-motion-state-inspection/SKILL.md +165 -165
  109. package/skills/blueprint/SKILL.md +106 -106
  110. package/skills/brand-discovery/SKILL.md +145 -145
  111. package/skills/brand-discovery/references/10_purpose-why.md +40 -40
  112. package/skills/brand-discovery/references/20_positioning.md +44 -44
  113. package/skills/brand-discovery/references/30_audience-niche.md +52 -52
  114. package/skills/brand-discovery/references/40_personality-archetype.md +57 -57
  115. package/skills/brand-discovery/references/50_voice-tone.md +59 -59
  116. package/skills/brand-discovery/references/60_narrative-story.md +50 -50
  117. package/skills/brand-discovery/references/70_founder-tension.md +49 -49
  118. package/skills/brand-discovery/references/90_SYNTHESIS.md +133 -133
  119. package/skills/brand-voice/SKILL.md +98 -98
  120. package/skills/brand-voice/references/voice-profile-schema.md +55 -55
  121. package/skills/browser-qa/SKILL.md +105 -105
  122. package/skills/bun-runtime/SKILL.md +85 -85
  123. package/skills/canary-watch/SKILL.md +108 -108
  124. package/skills/carrier-relationship-management/SKILL.md +212 -212
  125. package/skills/cisco-ios-patterns/SKILL.md +164 -164
  126. package/skills/ck/SKILL.md +148 -148
  127. package/skills/claude-devfleet/SKILL.md +112 -112
  128. package/skills/click-path-audit/SKILL.md +245 -245
  129. package/skills/clickhouse-io/SKILL.md +445 -445
  130. package/skills/code-tour/SKILL.md +254 -254
  131. package/skills/codebase-onboarding/SKILL.md +234 -234
  132. package/skills/codehealth-mcp/SKILL.md +167 -167
  133. package/skills/coding-standards/SKILL.md +551 -551
  134. package/skills/competitive-platform-analysis/SKILL.md +214 -214
  135. package/skills/competitive-report-structure/SKILL.md +162 -162
  136. package/skills/compose-multiplatform-patterns/SKILL.md +300 -300
  137. package/skills/config-gc/SKILL.md +120 -120
  138. package/skills/configure-ecc/SKILL.md +385 -385
  139. package/skills/connections-optimizer/SKILL.md +190 -190
  140. package/skills/content-engine/SKILL.md +132 -132
  141. package/skills/content-hash-cache-pattern/SKILL.md +162 -162
  142. package/skills/context-budget/SKILL.md +136 -136
  143. package/skills/continuous-agent-loop/SKILL.md +46 -46
  144. package/skills/continuous-learning/SKILL.md +132 -132
  145. package/skills/continuous-learning-v2/SKILL.md +361 -361
  146. package/skills/contract-first/SKILL.md +287 -287
  147. package/skills/cost-aware-llm-pipeline/SKILL.md +184 -184
  148. package/skills/cost-tracking/SKILL.md +97 -97
  149. package/skills/council/SKILL.md +204 -204
  150. package/skills/cpp-coding-standards/SKILL.md +724 -724
  151. package/skills/cpp-testing/SKILL.md +325 -325
  152. package/skills/crosspost/SKILL.md +112 -112
  153. package/skills/csharp-testing/SKILL.md +322 -322
  154. package/skills/customer-billing-ops/SKILL.md +141 -141
  155. package/skills/customs-trade-compliance/SKILL.md +263 -263
  156. package/skills/dart-flutter-patterns/SKILL.md +564 -564
  157. package/skills/dashboard-builder/SKILL.md +109 -109
  158. package/skills/data-scraper-agent/SKILL.md +765 -765
  159. package/skills/data-throughput-accelerator/SKILL.md +74 -74
  160. package/skills/database-migrations/SKILL.md +430 -430
  161. package/skills/deep-research/SKILL.md +160 -160
  162. package/skills/defi-amm-security/SKILL.md +167 -167
  163. package/skills/delivery-gate/SKILL.md +126 -126
  164. package/skills/deployment-patterns/SKILL.md +428 -428
  165. package/skills/design-system/SKILL.md +83 -83
  166. package/skills/django-celery/SKILL.md +458 -458
  167. package/skills/django-patterns/SKILL.md +735 -735
  168. package/skills/django-security/SKILL.md +644 -644
  169. package/skills/django-tdd/SKILL.md +730 -730
  170. package/skills/django-verification/SKILL.md +470 -470
  171. package/skills/dmux-workflows/SKILL.md +192 -192
  172. package/skills/docker-patterns/SKILL.md +365 -365
  173. package/skills/documentation-lookup/SKILL.md +91 -91
  174. package/skills/dotnet-patterns/SKILL.md +322 -322
  175. package/skills/dynamic-workflow-mode/SKILL.md +124 -124
  176. package/skills/e2e-testing/SKILL.md +327 -327
  177. package/skills/ecc-guide/SKILL.md +190 -190
  178. package/skills/ecc-recipes/SKILL.md +149 -149
  179. package/skills/ecc-tools-cost-audit/SKILL.md +161 -161
  180. package/skills/email-ops/SKILL.md +122 -122
  181. package/skills/energy-procurement/SKILL.md +228 -228
  182. package/skills/enterprise-agent-ops/SKILL.md +51 -51
  183. package/skills/error-handling/SKILL.md +377 -377
  184. package/skills/eval-harness/SKILL.md +271 -271
  185. package/skills/evm-token-decimals/SKILL.md +131 -131
  186. package/skills/exa-search/SKILL.md +108 -108
  187. package/skills/fal-ai-media/SKILL.md +289 -289
  188. package/skills/fastapi-patterns/SKILL.md +514 -514
  189. package/skills/finance-billing-ops/SKILL.md +128 -128
  190. package/skills/flox-environments/SKILL.md +497 -497
  191. package/skills/flutter-dart-code-review/SKILL.md +436 -436
  192. package/skills/foundation-models-on-device/SKILL.md +243 -243
  193. package/skills/frontend-a11y/SKILL.md +446 -446
  194. package/skills/frontend-design-direction/SKILL.md +93 -93
  195. package/skills/frontend-patterns/SKILL.md +657 -657
  196. package/skills/frontend-slides/SKILL.md +185 -185
  197. package/skills/fsharp-testing/SKILL.md +281 -281
  198. package/skills/gan-style-harness/SKILL.md +279 -279
  199. package/skills/gateguard/SKILL.md +133 -133
  200. package/skills/generating-python-installer/SKILL.md +820 -820
  201. package/skills/git-workflow/SKILL.md +716 -716
  202. package/skills/github-ops/SKILL.md +145 -145
  203. package/skills/golang-patterns/SKILL.md +676 -676
  204. package/skills/golang-testing/SKILL.md +721 -721
  205. package/skills/google-workspace-ops/SKILL.md +96 -96
  206. package/skills/growth-log/SKILL.md +128 -128
  207. package/skills/healthcare-cdss-patterns/SKILL.md +246 -246
  208. package/skills/healthcare-emr-patterns/SKILL.md +160 -160
  209. package/skills/healthcare-eval-harness/SKILL.md +208 -208
  210. package/skills/healthcare-phi-compliance/SKILL.md +146 -146
  211. package/skills/hermes-imports/SKILL.md +89 -89
  212. package/skills/hexagonal-architecture/SKILL.md +277 -277
  213. package/skills/hipaa-compliance/SKILL.md +79 -79
  214. package/skills/homelab-network-readiness/SKILL.md +170 -170
  215. package/skills/homelab-network-setup/SKILL.md +130 -130
  216. package/skills/homelab-pihole-dns/SKILL.md +275 -275
  217. package/skills/homelab-vlan-segmentation/SKILL.md +312 -312
  218. package/skills/homelab-wireguard-vpn/SKILL.md +306 -306
  219. package/skills/hookify-rules/SKILL.md +128 -128
  220. package/skills/inherit-legacy-style/SKILL.md +157 -157
  221. package/skills/intent-driven-development/SKILL.md +360 -360
  222. package/skills/inventory-demand-planning/SKILL.md +247 -247
  223. package/skills/investor-materials/SKILL.md +97 -97
  224. package/skills/investor-outreach/SKILL.md +92 -92
  225. package/skills/ios-icon-gen/SKILL.md +158 -158
  226. package/skills/iterative-retrieval/SKILL.md +212 -212
  227. package/skills/ito-basket-compare/SKILL.md +64 -64
  228. package/skills/ito-compute/SKILL.md +129 -129
  229. package/skills/ito-data-atlas-agent/SKILL.md +64 -64
  230. package/skills/ito-market-intelligence/SKILL.md +61 -61
  231. package/skills/ito-trade-planner/SKILL.md +68 -68
  232. package/skills/java-coding-standards/SKILL.md +384 -384
  233. package/skills/jira-integration/SKILL.md +303 -303
  234. package/skills/jpa-patterns/SKILL.md +152 -152
  235. package/skills/knowledge-ops/SKILL.md +155 -155
  236. package/skills/kotlin-coroutines-flows/SKILL.md +285 -285
  237. package/skills/kotlin-exposed-patterns/SKILL.md +720 -720
  238. package/skills/kotlin-ktor-patterns/SKILL.md +690 -690
  239. package/skills/kotlin-patterns/SKILL.md +712 -712
  240. package/skills/kotlin-testing/SKILL.md +825 -825
  241. package/skills/kubernetes-patterns/SKILL.md +756 -756
  242. package/skills/laravel-patterns/SKILL.md +416 -416
  243. package/skills/laravel-plugin-discovery/SKILL.md +230 -230
  244. package/skills/laravel-security/SKILL.md +948 -948
  245. package/skills/laravel-tdd/SKILL.md +675 -675
  246. package/skills/laravel-verification/SKILL.md +180 -180
  247. package/skills/latency-critical-systems/SKILL.md +75 -75
  248. package/skills/lead-intelligence/SKILL.md +322 -322
  249. package/skills/liquid-glass-design/SKILL.md +279 -279
  250. package/skills/llm-trading-agent-security/SKILL.md +147 -147
  251. package/skills/logistics-exception-management/SKILL.md +222 -222
  252. package/skills/loop-design-check/SKILL.md +143 -143
  253. package/skills/mailtrap-email-integration/SKILL.md +77 -77
  254. package/skills/make-interfaces-feel-better/SKILL.md +152 -152
  255. package/skills/manim-video/SKILL.md +90 -90
  256. package/skills/market-research/SKILL.md +76 -76
  257. package/skills/marketing-campaign/SKILL.md +114 -114
  258. package/skills/mcp-server-patterns/SKILL.md +70 -70
  259. package/skills/messages-ops/SKILL.md +105 -105
  260. package/skills/ml-adoption-playbook/SKILL.md +57 -57
  261. package/skills/mle-workflow/SKILL.md +348 -348
  262. package/skills/motion-advanced/SKILL.md +596 -596
  263. package/skills/motion-foundations/SKILL.md +299 -299
  264. package/skills/motion-patterns/SKILL.md +434 -434
  265. package/skills/motion-ui/SKILL.md +576 -576
  266. package/skills/mysql-patterns/SKILL.md +413 -413
  267. package/skills/nanoclaw-repl/SKILL.md +34 -34
  268. package/skills/nestjs-patterns/SKILL.md +231 -231
  269. package/skills/netmiko-ssh-automation/SKILL.md +174 -174
  270. package/skills/network-bgp-diagnostics/SKILL.md +168 -168
  271. package/skills/network-config-validation/SKILL.md +211 -211
  272. package/skills/network-interface-health/SKILL.md +153 -153
  273. package/skills/nextjs-turbopack/SKILL.md +58 -58
  274. package/skills/nodejs-keccak256/SKILL.md +103 -103
  275. package/skills/nutrient-document-processing/SKILL.md +168 -168
  276. package/skills/nuxt4-patterns/SKILL.md +101 -101
  277. package/skills/openclaw-persona-forge/SKILL.md +289 -289
  278. package/skills/openclaw-persona-forge/references/avatar-style.md +124 -124
  279. package/skills/openclaw-persona-forge/references/boundary-rules.md +53 -53
  280. package/skills/openclaw-persona-forge/references/error-handling.md +53 -53
  281. package/skills/openclaw-persona-forge/references/identity-tension.md +48 -48
  282. package/skills/openclaw-persona-forge/references/naming-system.md +39 -39
  283. package/skills/openclaw-persona-forge/references/output-template.md +166 -166
  284. package/skills/opensource-pipeline/SKILL.md +256 -256
  285. package/skills/orch-add-feature/SKILL.md +45 -45
  286. package/skills/orch-build-mvp/SKILL.md +49 -49
  287. package/skills/orch-change-feature/SKILL.md +43 -43
  288. package/skills/orch-fix-defect/SKILL.md +43 -43
  289. package/skills/orch-pipeline/SKILL.md +121 -121
  290. package/skills/orch-refine-code/SKILL.md +44 -44
  291. package/skills/parallel-execution-optimizer/SKILL.md +74 -74
  292. package/skills/perl-patterns/SKILL.md +505 -505
  293. package/skills/perl-security/SKILL.md +504 -504
  294. package/skills/perl-testing/SKILL.md +476 -476
  295. package/skills/plan-canvas/SKILL.md +153 -153
  296. package/skills/plan-orchestrate/SKILL.md +263 -263
  297. package/skills/plankton-code-quality/SKILL.md +237 -237
  298. package/skills/postgres-patterns/SKILL.md +148 -148
  299. package/skills/prediction-market-oracle-research/SKILL.md +64 -64
  300. package/skills/prediction-market-risk-review/SKILL.md +61 -61
  301. package/skills/premium-web-design/SKILL.md +154 -154
  302. package/skills/prisma-patterns/SKILL.md +401 -401
  303. package/skills/product-capability/SKILL.md +142 -142
  304. package/skills/product-lens/SKILL.md +93 -93
  305. package/skills/production-audit/SKILL.md +207 -207
  306. package/skills/production-scheduling/SKILL.md +238 -238
  307. package/skills/project-flow-ops/SKILL.md +112 -112
  308. package/skills/prompt-optimizer/SKILL.md +398 -398
  309. package/skills/publish-website/SKILL.md +76 -0
  310. package/skills/python-patterns/SKILL.md +751 -751
  311. package/skills/python-testing/SKILL.md +817 -817
  312. package/skills/pytorch-patterns/SKILL.md +397 -397
  313. package/skills/quality-nonconformance/SKILL.md +260 -260
  314. package/skills/quarkus-patterns/SKILL.md +723 -723
  315. package/skills/quarkus-security/SKILL.md +468 -468
  316. package/skills/quarkus-tdd/SKILL.md +812 -812
  317. package/skills/quarkus-verification/SKILL.md +480 -480
  318. package/skills/ralphinho-rfc-pipeline/SKILL.md +68 -68
  319. package/skills/react-native-patterns/SKILL.md +326 -326
  320. package/skills/react-patterns/SKILL.md +342 -342
  321. package/skills/react-performance/SKILL.md +575 -575
  322. package/skills/react-testing/SKILL.md +424 -424
  323. package/skills/recsys-pipeline-architect/SKILL.md +115 -115
  324. package/skills/recursive-decision-ledger/SKILL.md +81 -81
  325. package/skills/redis-patterns/SKILL.md +404 -404
  326. package/skills/regex-vs-llm-structured-text/SKILL.md +221 -221
  327. package/skills/remotion-video-creation/SKILL.md +43 -43
  328. package/skills/repo-scan/SKILL.md +79 -79
  329. package/skills/research-ops/SKILL.md +113 -113
  330. package/skills/returns-reverse-logistics/SKILL.md +240 -240
  331. package/skills/rules-distill/SKILL.md +265 -265
  332. package/skills/rust-patterns/SKILL.md +500 -500
  333. package/skills/rust-testing/SKILL.md +501 -501
  334. package/skills/safety-guard/SKILL.md +76 -76
  335. package/skills/santa-method/SKILL.md +307 -307
  336. package/skills/scientific-db-pubmed-database/SKILL.md +176 -176
  337. package/skills/scientific-db-uspto-database/SKILL.md +178 -178
  338. package/skills/scientific-pkg-gget/SKILL.md +167 -167
  339. package/skills/scientific-thinking-literature-review/SKILL.md +193 -193
  340. package/skills/scientific-thinking-scholar-evaluation/SKILL.md +161 -161
  341. package/skills/search-first/SKILL.md +183 -183
  342. package/skills/security-bounty-hunter/SKILL.md +100 -100
  343. package/skills/security-review/SKILL.md +504 -504
  344. package/skills/security-scan/SKILL.md +166 -166
  345. package/skills/seo/SKILL.md +155 -155
  346. package/skills/skill-comply/SKILL.md +59 -59
  347. package/skills/skill-scout/SKILL.md +141 -141
  348. package/skills/skill-stocktake/SKILL.md +195 -195
  349. package/skills/social-graph-ranker/SKILL.md +155 -155
  350. package/skills/social-publisher/SKILL.md +130 -130
  351. package/skills/springboot-patterns/SKILL.md +315 -315
  352. package/skills/springboot-security/SKILL.md +273 -273
  353. package/skills/springboot-tdd/SKILL.md +159 -159
  354. package/skills/springboot-verification/SKILL.md +232 -232
  355. package/skills/strategic-compact/SKILL.md +142 -142
  356. package/skills/swift-actor-persistence/SKILL.md +144 -144
  357. package/skills/swift-concurrency-6-2/SKILL.md +216 -216
  358. package/skills/swift-protocol-di-testing/SKILL.md +191 -191
  359. package/skills/swiftui-patterns/SKILL.md +259 -259
  360. package/skills/taste/SKILL.md +264 -264
  361. package/skills/taste/references/genre-taxonomy.md +87 -87
  362. package/skills/tdd-workflow/SKILL.md +583 -583
  363. package/skills/team-agent-orchestration/SKILL.md +111 -111
  364. package/skills/team-builder/SKILL.md +169 -169
  365. package/skills/terminal-ops/SKILL.md +110 -110
  366. package/skills/tinystruct-patterns/SKILL.md +279 -279
  367. package/skills/tinystruct-patterns/references/architecture.md +90 -90
  368. package/skills/tinystruct-patterns/references/data-handling.md +60 -60
  369. package/skills/tinystruct-patterns/references/database.md +99 -99
  370. package/skills/tinystruct-patterns/references/routing.md +64 -64
  371. package/skills/tinystruct-patterns/references/system-usage.md +97 -97
  372. package/skills/tinystruct-patterns/references/testing.md +72 -72
  373. package/skills/token-budget-advisor/SKILL.md +134 -134
  374. package/skills/ui-demo/SKILL.md +466 -466
  375. package/skills/ui-to-vue/SKILL.md +135 -135
  376. package/skills/uncloud/SKILL.md +344 -344
  377. package/skills/unified-memory/SKILL.md +170 -170
  378. package/skills/unified-notifications-ops/SKILL.md +188 -188
  379. package/skills/verification-loop/SKILL.md +129 -129
  380. package/skills/video-editing/SKILL.md +311 -311
  381. package/skills/videodb/SKILL.md +375 -375
  382. package/skills/visa-doc-translate/SKILL.md +117 -117
  383. package/skills/vite-patterns/SKILL.md +450 -450
  384. package/skills/vue-patterns/SKILL.md +471 -471
  385. package/skills/windows-desktop-e2e/SKILL.md +888 -888
  386. package/skills/workspace-surface-audit/SKILL.md +126 -126
  387. package/skills/x-api/SKILL.md +235 -235
@@ -1,375 +1,375 @@
1
- ---
2
- name: videodb
3
- description: See, Understand, Act on video and audio. See- ingest from local files, URLs, RTSP/live feeds, or live record desktop; return realtime context and playable stream links. Understand- extract frames, build visual/semantic/temporal indexes, and search moments with timestamps and auto-clips. Act- transcode and normalize (codec, fps, resolution, aspect ratio), perform timeline edits (subtitles, text/image overlays, branding, audio overlays, dubbing, translation), generate media assets (image, audio, video), and create real time alerts for events from live streams or desktop capture.
4
- metadata:
5
- origin: ECC
6
- allowed-tools: Read Grep Glob Bash(python:*)
7
- argument-hint: "[task description]"
8
- ---
9
-
10
- # VideoDB Skill
11
-
12
- **Perception + memory + actions for video, live streams, and desktop sessions.**
13
-
14
- ## When to use
15
-
16
- ### Desktop Perception
17
- - Start/stop a **desktop session** capturing **screen, mic, and system audio**
18
- - Stream **live context** and store **episodic session memory**
19
- - Run **real-time alerts/triggers** on what's spoken and what's happening on screen
20
- - Produce **session summaries**, a searchable timeline, and **playable evidence links**
21
-
22
- ### Video ingest + stream
23
- - Ingest a **file or URL** and return a **playable web stream link**
24
- - Transcode/normalize: **codec, bitrate, fps, resolution, aspect ratio**
25
-
26
- ### Index + search (timestamps + evidence)
27
- - Build **visual**, **spoken**, and **keyword** indexes
28
- - Search and return exact moments with **timestamps** and **playable evidence**
29
- - Auto-create **clips** from search results
30
-
31
- ### Timeline editing + generation
32
- - Subtitles: **generate**, **translate**, **burn-in**
33
- - Overlays: **text/image/branding**, motion captions
34
- - Audio: **background music**, **voiceover**, **dubbing**
35
- - Programmatic composition and exports via **timeline operations**
36
-
37
- ### Live streams (RTSP) + monitoring
38
- - Connect **RTSP/live feeds**
39
- - Run **real-time visual and spoken understanding** and emit **events/alerts** for monitoring workflows
40
-
41
- ## How it works
42
-
43
- ### Common inputs
44
- - Local **file path**, public **URL**, or **RTSP URL**
45
- - Desktop capture request: **start / stop / summarize session**
46
- - Desired operations: get context for understanding, transcode spec, index spec, search query, clip ranges, timeline edits, alert rules
47
-
48
- ### Common outputs
49
- - **Stream URL**
50
- - Search results with **timestamps** and **evidence links**
51
- - Generated assets: subtitles, audio, images, clips
52
- - **Event/alert payloads** for live streams
53
- - Desktop **session summaries** and memory entries
54
-
55
- ### Running Python code
56
-
57
- Before running any VideoDB code, change to the project directory and load environment variables:
58
-
59
- ```python
60
- from dotenv import load_dotenv
61
- load_dotenv(".env")
62
-
63
- import videodb
64
- conn = videodb.connect()
65
- ```
66
-
67
- This reads `VIDEO_DB_API_KEY` from:
68
- 1. Environment (if already exported)
69
- 2. Project's `.env` file in current directory
70
-
71
- If the key is missing, `videodb.connect()` raises `AuthenticationError` automatically.
72
-
73
- Do NOT write a script file when a short inline command works.
74
-
75
- When writing inline Python (`python -c "..."`), always use properly formatted code — use semicolons to separate statements and keep it readable. For anything longer than ~3 statements, use a heredoc instead:
76
-
77
- ```bash
78
- python << 'EOF'
79
- from dotenv import load_dotenv
80
- load_dotenv(".env")
81
-
82
- import videodb
83
- conn = videodb.connect()
84
- coll = conn.get_collection()
85
- print(f"Videos: {len(coll.get_videos())}")
86
- EOF
87
- ```
88
-
89
- ### Setup
90
-
91
- When the user asks to "setup videodb" or similar:
92
-
93
- ### 1. Install SDK
94
-
95
- ```bash
96
- pip install "videodb[capture]" python-dotenv
97
- ```
98
-
99
- If `videodb[capture]` fails on Linux, install without the capture extra:
100
-
101
- ```bash
102
- pip install videodb python-dotenv
103
- ```
104
-
105
- ### 2. Configure API key
106
-
107
- The user must set `VIDEO_DB_API_KEY` using **either** method:
108
-
109
- - **Export in terminal** (before starting Claude): `export VIDEO_DB_API_KEY=your-key`
110
- - **Project `.env` file**: Save `VIDEO_DB_API_KEY=your-key` in the project's `.env` file
111
-
112
- Get a free API key at [console.videodb.io](https://console.videodb.io) (50 free uploads, no credit card).
113
-
114
- **Do NOT** read, write, or handle the API key yourself. Always let the user set it.
115
-
116
- ### Quick Reference
117
-
118
- ### Upload media
119
-
120
- ```python
121
- # URL
122
- video = coll.upload(url="https://example.com/video.mp4")
123
-
124
- # YouTube
125
- video = coll.upload(url="https://www.youtube.com/watch?v=VIDEO_ID")
126
-
127
- # Local file
128
- video = coll.upload(file_path="/path/to/video.mp4")
129
- ```
130
-
131
- ### Transcript + subtitle
132
-
133
- ```python
134
- # force=True skips the error if the video is already indexed
135
- video.index_spoken_words(force=True)
136
- text = video.get_transcript_text()
137
- stream_url = video.add_subtitle()
138
- ```
139
-
140
- ### Search inside videos
141
-
142
- ```python
143
- from videodb.exceptions import InvalidRequestError
144
-
145
- video.index_spoken_words(force=True)
146
-
147
- # search() raises InvalidRequestError when no results are found.
148
- # Always wrap in try/except and treat "No results found" as empty.
149
- try:
150
- results = video.search("product demo")
151
- shots = results.get_shots()
152
- stream_url = results.compile()
153
- except InvalidRequestError as e:
154
- if "No results found" in str(e):
155
- shots = []
156
- else:
157
- raise
158
- ```
159
-
160
- ### Scene search
161
-
162
- ```python
163
- import re
164
- from videodb import SearchType, IndexType, SceneExtractionType
165
- from videodb.exceptions import InvalidRequestError
166
-
167
- # index_scenes() has no force parameter — it raises an error if a scene
168
- # index already exists. Extract the existing index ID from the error.
169
- try:
170
- scene_index_id = video.index_scenes(
171
- extraction_type=SceneExtractionType.shot_based,
172
- prompt="Describe the visual content in this scene.",
173
- )
174
- except Exception as e:
175
- match = re.search(r"id\s+([a-f0-9]+)", str(e))
176
- if match:
177
- scene_index_id = match.group(1)
178
- else:
179
- raise
180
-
181
- # Use score_threshold to filter low-relevance noise (recommended: 0.3+)
182
- try:
183
- results = video.search(
184
- query="person writing on a whiteboard",
185
- search_type=SearchType.semantic,
186
- index_type=IndexType.scene,
187
- scene_index_id=scene_index_id,
188
- score_threshold=0.3,
189
- )
190
- shots = results.get_shots()
191
- stream_url = results.compile()
192
- except InvalidRequestError as e:
193
- if "No results found" in str(e):
194
- shots = []
195
- else:
196
- raise
197
- ```
198
-
199
- ### Timeline editing
200
-
201
- **Important:** Always validate timestamps before building a timeline:
202
- - `start` must be >= 0 (negative values are silently accepted but produce broken output)
203
- - `start` must be < `end`
204
- - `end` must be <= `video.length`
205
-
206
- ```python
207
- from videodb.timeline import Timeline
208
- from videodb.asset import VideoAsset, TextAsset, TextStyle
209
-
210
- timeline = Timeline(conn)
211
- timeline.add_inline(VideoAsset(asset_id=video.id, start=10, end=30))
212
- timeline.add_overlay(0, TextAsset(text="The End", duration=3, style=TextStyle(fontsize=36)))
213
- stream_url = timeline.generate_stream()
214
- ```
215
-
216
- ### Transcode video (resolution / quality change)
217
-
218
- ```python
219
- from videodb import TranscodeMode, VideoConfig, AudioConfig
220
-
221
- # Change resolution, quality, or aspect ratio server-side
222
- job_id = conn.transcode(
223
- source="https://example.com/video.mp4",
224
- callback_url="https://example.com/webhook",
225
- mode=TranscodeMode.economy,
226
- video_config=VideoConfig(resolution=720, quality=23, aspect_ratio="16:9"),
227
- audio_config=AudioConfig(mute=False),
228
- )
229
- ```
230
-
231
- ### Reframe aspect ratio (for social platforms)
232
-
233
- **Warning:** `reframe()` is a slow server-side operation. For long videos it can take
234
- several minutes and may time out. Best practices:
235
- - Always limit to a short segment using `start`/`end` when possible
236
- - For full-length videos, use `callback_url` for async processing
237
- - Trim the video on a `Timeline` first, then reframe the shorter result
238
-
239
- ```python
240
- from videodb import ReframeMode
241
-
242
- # Always prefer reframing a short segment:
243
- reframed = video.reframe(start=0, end=60, target="vertical", mode=ReframeMode.smart)
244
-
245
- # Async reframe for full-length videos (returns None, result via webhook):
246
- video.reframe(target="vertical", callback_url="https://example.com/webhook")
247
-
248
- # Presets: "vertical" (9:16), "square" (1:1), "landscape" (16:9)
249
- reframed = video.reframe(start=0, end=60, target="square")
250
-
251
- # Custom dimensions
252
- reframed = video.reframe(start=0, end=60, target={"width": 1280, "height": 720})
253
- ```
254
-
255
- ### Generative media
256
-
257
- ```python
258
- image = coll.generate_image(
259
- prompt="a sunset over mountains",
260
- aspect_ratio="16:9",
261
- )
262
- ```
263
-
264
- ## Error handling
265
-
266
- ```python
267
- from videodb.exceptions import AuthenticationError, InvalidRequestError
268
-
269
- try:
270
- conn = videodb.connect()
271
- except AuthenticationError:
272
- print("Check your VIDEO_DB_API_KEY")
273
-
274
- try:
275
- video = coll.upload(url="https://example.com/video.mp4")
276
- except InvalidRequestError as e:
277
- print(f"Upload failed: {e}")
278
- ```
279
-
280
- ### Common pitfalls
281
-
282
- | Scenario | Error message | Solution |
283
- |----------|--------------|----------|
284
- | Indexing an already-indexed video | `Spoken word index for video already exists` | Use `video.index_spoken_words(force=True)` to skip if already indexed |
285
- | Scene index already exists | `Scene index with id XXXX already exists` | Extract the existing `scene_index_id` from the error with `re.search(r"id\s+([a-f0-9]+)", str(e))` |
286
- | Search finds no matches | `InvalidRequestError: No results found` | Catch the exception and treat as empty results (`shots = []`) |
287
- | Reframe times out | Blocks indefinitely on long videos | Use `start`/`end` to limit segment, or pass `callback_url` for async |
288
- | Negative timestamps on Timeline | Silently produces broken stream | Always validate `start >= 0` before creating `VideoAsset` |
289
- | `generate_video()` / `create_collection()` fails | `Operation not allowed` or `maximum limit` | Plan-gated features — inform the user about plan limits |
290
-
291
- ## Examples
292
-
293
- ### Canonical prompts
294
- - "Start desktop capture and alert when a password field appears."
295
- - "Record my session and produce an actionable summary when it ends."
296
- - "Ingest this file and return a playable stream link."
297
- - "Index this folder and find every scene with people, return timestamps."
298
- - "Generate subtitles, burn them in, and add light background music."
299
- - "Connect this RTSP URL and alert when a person enters the zone."
300
-
301
- ### Screen Recording (Desktop Capture)
302
-
303
- Use `ws_listener.py` to capture WebSocket events during recording sessions. Desktop capture supports **macOS** only.
304
-
305
- #### Quick Start
306
-
307
- 1. **Choose state dir**: `STATE_DIR="${VIDEODB_EVENTS_DIR:-$HOME/.local/state/videodb}"`
308
- 2. **Start listener**: `VIDEODB_EVENTS_DIR="$STATE_DIR" python scripts/ws_listener.py --clear "$STATE_DIR" &`
309
- 3. **Get WebSocket ID**: `cat "$STATE_DIR/videodb_ws_id"`
310
- 4. **Run capture code** (see reference/capture.md for the full workflow)
311
- 5. **Events written to**: `$STATE_DIR/videodb_events.jsonl`
312
-
313
- Use `--clear` whenever you start a fresh capture run so stale transcript and visual events do not leak into the new session.
314
-
315
- #### Query Events
316
-
317
- ```python
318
- import json
319
- import os
320
- import time
321
- from pathlib import Path
322
-
323
- events_dir = Path(os.environ.get("VIDEODB_EVENTS_DIR", Path.home() / ".local" / "state" / "videodb"))
324
- events_file = events_dir / "videodb_events.jsonl"
325
- events = []
326
-
327
- if events_file.exists():
328
- with events_file.open(encoding="utf-8") as handle:
329
- for line in handle:
330
- try:
331
- events.append(json.loads(line))
332
- except json.JSONDecodeError:
333
- continue
334
-
335
- transcripts = [e["data"]["text"] for e in events if e.get("channel") == "transcript"]
336
- cutoff = time.time() - 300
337
- recent_visual = [
338
- e for e in events
339
- if e.get("channel") == "visual_index" and e["unix_ts"] > cutoff
340
- ]
341
- ```
342
-
343
- ## Additional docs
344
-
345
- Reference documentation is in the `reference/` directory adjacent to this SKILL.md file. Use the Glob tool to locate it if needed.
346
-
347
- - [reference/api-reference.md](reference/api-reference.md) - Complete VideoDB Python SDK API reference
348
- - [reference/search.md](reference/search.md) - In-depth guide to video search (spoken word and scene-based)
349
- - [reference/editor.md](reference/editor.md) - Timeline editing, assets, and composition
350
- - [reference/streaming.md](reference/streaming.md) - HLS streaming and instant playback
351
- - [reference/generative.md](reference/generative.md) - AI-powered media generation (images, video, audio)
352
- - [reference/rtstream.md](reference/rtstream.md) - Live stream ingestion workflow (RTSP/RTMP)
353
- - [reference/rtstream-reference.md](reference/rtstream-reference.md) - RTStream SDK methods and AI pipelines
354
- - [reference/capture.md](reference/capture.md) - Desktop capture workflow
355
- - [reference/capture-reference.md](reference/capture-reference.md) - Capture SDK and WebSocket events
356
- - [reference/use-cases.md](reference/use-cases.md) - Common video processing patterns and examples
357
-
358
- **Do not use ffmpeg, moviepy, or local encoding tools** when VideoDB supports the operation. The following are all handled server-side by VideoDB — trimming, combining clips, overlaying audio or music, adding subtitles, text/image overlays, transcoding, resolution changes, aspect-ratio conversion, resizing for platform requirements, transcription, and media generation. Only fall back to local tools for operations listed under Limitations in reference/editor.md (transitions, speed changes, crop/zoom, colour grading, volume mixing).
359
-
360
- ### When to use what
361
-
362
- | Problem | VideoDB solution |
363
- |---------|-----------------|
364
- | Platform rejects video aspect ratio or resolution | `video.reframe()` or `conn.transcode()` with `VideoConfig` |
365
- | Need to resize video for Twitter/Instagram/TikTok | `video.reframe(target="vertical")` or `target="square"` |
366
- | Need to change resolution (e.g. 1080p → 720p) | `conn.transcode()` with `VideoConfig(resolution=720)` |
367
- | Need to overlay audio/music on video | `AudioAsset` on a `Timeline` |
368
- | Need to add subtitles | `video.add_subtitle()` or `CaptionAsset` |
369
- | Need to combine/trim clips | `VideoAsset` on a `Timeline` |
370
- | Need to generate voiceover, music, or SFX | `coll.generate_voice()`, `generate_music()`, `generate_sound_effect()` |
371
-
372
- ## Provenance
373
-
374
- Reference material for this skill is vendored locally under `skills/videodb/reference/`.
375
- Use the local copies above instead of following external repository links at runtime.
1
+ ---
2
+ name: videodb
3
+ description: See, Understand, Act on video and audio. See- ingest from local files, URLs, RTSP/live feeds, or live record desktop; return realtime context and playable stream links. Understand- extract frames, build visual/semantic/temporal indexes, and search moments with timestamps and auto-clips. Act- transcode and normalize (codec, fps, resolution, aspect ratio), perform timeline edits (subtitles, text/image overlays, branding, audio overlays, dubbing, translation), generate media assets (image, audio, video), and create real time alerts for events from live streams or desktop capture.
4
+ metadata:
5
+ origin: ECC
6
+ allowed-tools: Read Grep Glob Bash(python:*)
7
+ argument-hint: "[task description]"
8
+ ---
9
+
10
+ # VideoDB Skill
11
+
12
+ **Perception + memory + actions for video, live streams, and desktop sessions.**
13
+
14
+ ## When to use
15
+
16
+ ### Desktop Perception
17
+ - Start/stop a **desktop session** capturing **screen, mic, and system audio**
18
+ - Stream **live context** and store **episodic session memory**
19
+ - Run **real-time alerts/triggers** on what's spoken and what's happening on screen
20
+ - Produce **session summaries**, a searchable timeline, and **playable evidence links**
21
+
22
+ ### Video ingest + stream
23
+ - Ingest a **file or URL** and return a **playable web stream link**
24
+ - Transcode/normalize: **codec, bitrate, fps, resolution, aspect ratio**
25
+
26
+ ### Index + search (timestamps + evidence)
27
+ - Build **visual**, **spoken**, and **keyword** indexes
28
+ - Search and return exact moments with **timestamps** and **playable evidence**
29
+ - Auto-create **clips** from search results
30
+
31
+ ### Timeline editing + generation
32
+ - Subtitles: **generate**, **translate**, **burn-in**
33
+ - Overlays: **text/image/branding**, motion captions
34
+ - Audio: **background music**, **voiceover**, **dubbing**
35
+ - Programmatic composition and exports via **timeline operations**
36
+
37
+ ### Live streams (RTSP) + monitoring
38
+ - Connect **RTSP/live feeds**
39
+ - Run **real-time visual and spoken understanding** and emit **events/alerts** for monitoring workflows
40
+
41
+ ## How it works
42
+
43
+ ### Common inputs
44
+ - Local **file path**, public **URL**, or **RTSP URL**
45
+ - Desktop capture request: **start / stop / summarize session**
46
+ - Desired operations: get context for understanding, transcode spec, index spec, search query, clip ranges, timeline edits, alert rules
47
+
48
+ ### Common outputs
49
+ - **Stream URL**
50
+ - Search results with **timestamps** and **evidence links**
51
+ - Generated assets: subtitles, audio, images, clips
52
+ - **Event/alert payloads** for live streams
53
+ - Desktop **session summaries** and memory entries
54
+
55
+ ### Running Python code
56
+
57
+ Before running any VideoDB code, change to the project directory and load environment variables:
58
+
59
+ ```python
60
+ from dotenv import load_dotenv
61
+ load_dotenv(".env")
62
+
63
+ import videodb
64
+ conn = videodb.connect()
65
+ ```
66
+
67
+ This reads `VIDEO_DB_API_KEY` from:
68
+ 1. Environment (if already exported)
69
+ 2. Project's `.env` file in current directory
70
+
71
+ If the key is missing, `videodb.connect()` raises `AuthenticationError` automatically.
72
+
73
+ Do NOT write a script file when a short inline command works.
74
+
75
+ When writing inline Python (`python -c "..."`), always use properly formatted code — use semicolons to separate statements and keep it readable. For anything longer than ~3 statements, use a heredoc instead:
76
+
77
+ ```bash
78
+ python << 'EOF'
79
+ from dotenv import load_dotenv
80
+ load_dotenv(".env")
81
+
82
+ import videodb
83
+ conn = videodb.connect()
84
+ coll = conn.get_collection()
85
+ print(f"Videos: {len(coll.get_videos())}")
86
+ EOF
87
+ ```
88
+
89
+ ### Setup
90
+
91
+ When the user asks to "setup videodb" or similar:
92
+
93
+ ### 1. Install SDK
94
+
95
+ ```bash
96
+ pip install "videodb[capture]" python-dotenv
97
+ ```
98
+
99
+ If `videodb[capture]` fails on Linux, install without the capture extra:
100
+
101
+ ```bash
102
+ pip install videodb python-dotenv
103
+ ```
104
+
105
+ ### 2. Configure API key
106
+
107
+ The user must set `VIDEO_DB_API_KEY` using **either** method:
108
+
109
+ - **Export in terminal** (before starting Claude): `export VIDEO_DB_API_KEY=your-key`
110
+ - **Project `.env` file**: Save `VIDEO_DB_API_KEY=your-key` in the project's `.env` file
111
+
112
+ Get a free API key at [console.videodb.io](https://console.videodb.io) (50 free uploads, no credit card).
113
+
114
+ **Do NOT** read, write, or handle the API key yourself. Always let the user set it.
115
+
116
+ ### Quick Reference
117
+
118
+ ### Upload media
119
+
120
+ ```python
121
+ # URL
122
+ video = coll.upload(url="https://example.com/video.mp4")
123
+
124
+ # YouTube
125
+ video = coll.upload(url="https://www.youtube.com/watch?v=VIDEO_ID")
126
+
127
+ # Local file
128
+ video = coll.upload(file_path="/path/to/video.mp4")
129
+ ```
130
+
131
+ ### Transcript + subtitle
132
+
133
+ ```python
134
+ # force=True skips the error if the video is already indexed
135
+ video.index_spoken_words(force=True)
136
+ text = video.get_transcript_text()
137
+ stream_url = video.add_subtitle()
138
+ ```
139
+
140
+ ### Search inside videos
141
+
142
+ ```python
143
+ from videodb.exceptions import InvalidRequestError
144
+
145
+ video.index_spoken_words(force=True)
146
+
147
+ # search() raises InvalidRequestError when no results are found.
148
+ # Always wrap in try/except and treat "No results found" as empty.
149
+ try:
150
+ results = video.search("product demo")
151
+ shots = results.get_shots()
152
+ stream_url = results.compile()
153
+ except InvalidRequestError as e:
154
+ if "No results found" in str(e):
155
+ shots = []
156
+ else:
157
+ raise
158
+ ```
159
+
160
+ ### Scene search
161
+
162
+ ```python
163
+ import re
164
+ from videodb import SearchType, IndexType, SceneExtractionType
165
+ from videodb.exceptions import InvalidRequestError
166
+
167
+ # index_scenes() has no force parameter — it raises an error if a scene
168
+ # index already exists. Extract the existing index ID from the error.
169
+ try:
170
+ scene_index_id = video.index_scenes(
171
+ extraction_type=SceneExtractionType.shot_based,
172
+ prompt="Describe the visual content in this scene.",
173
+ )
174
+ except Exception as e:
175
+ match = re.search(r"id\s+([a-f0-9]+)", str(e))
176
+ if match:
177
+ scene_index_id = match.group(1)
178
+ else:
179
+ raise
180
+
181
+ # Use score_threshold to filter low-relevance noise (recommended: 0.3+)
182
+ try:
183
+ results = video.search(
184
+ query="person writing on a whiteboard",
185
+ search_type=SearchType.semantic,
186
+ index_type=IndexType.scene,
187
+ scene_index_id=scene_index_id,
188
+ score_threshold=0.3,
189
+ )
190
+ shots = results.get_shots()
191
+ stream_url = results.compile()
192
+ except InvalidRequestError as e:
193
+ if "No results found" in str(e):
194
+ shots = []
195
+ else:
196
+ raise
197
+ ```
198
+
199
+ ### Timeline editing
200
+
201
+ **Important:** Always validate timestamps before building a timeline:
202
+ - `start` must be >= 0 (negative values are silently accepted but produce broken output)
203
+ - `start` must be < `end`
204
+ - `end` must be <= `video.length`
205
+
206
+ ```python
207
+ from videodb.timeline import Timeline
208
+ from videodb.asset import VideoAsset, TextAsset, TextStyle
209
+
210
+ timeline = Timeline(conn)
211
+ timeline.add_inline(VideoAsset(asset_id=video.id, start=10, end=30))
212
+ timeline.add_overlay(0, TextAsset(text="The End", duration=3, style=TextStyle(fontsize=36)))
213
+ stream_url = timeline.generate_stream()
214
+ ```
215
+
216
+ ### Transcode video (resolution / quality change)
217
+
218
+ ```python
219
+ from videodb import TranscodeMode, VideoConfig, AudioConfig
220
+
221
+ # Change resolution, quality, or aspect ratio server-side
222
+ job_id = conn.transcode(
223
+ source="https://example.com/video.mp4",
224
+ callback_url="https://example.com/webhook",
225
+ mode=TranscodeMode.economy,
226
+ video_config=VideoConfig(resolution=720, quality=23, aspect_ratio="16:9"),
227
+ audio_config=AudioConfig(mute=False),
228
+ )
229
+ ```
230
+
231
+ ### Reframe aspect ratio (for social platforms)
232
+
233
+ **Warning:** `reframe()` is a slow server-side operation. For long videos it can take
234
+ several minutes and may time out. Best practices:
235
+ - Always limit to a short segment using `start`/`end` when possible
236
+ - For full-length videos, use `callback_url` for async processing
237
+ - Trim the video on a `Timeline` first, then reframe the shorter result
238
+
239
+ ```python
240
+ from videodb import ReframeMode
241
+
242
+ # Always prefer reframing a short segment:
243
+ reframed = video.reframe(start=0, end=60, target="vertical", mode=ReframeMode.smart)
244
+
245
+ # Async reframe for full-length videos (returns None, result via webhook):
246
+ video.reframe(target="vertical", callback_url="https://example.com/webhook")
247
+
248
+ # Presets: "vertical" (9:16), "square" (1:1), "landscape" (16:9)
249
+ reframed = video.reframe(start=0, end=60, target="square")
250
+
251
+ # Custom dimensions
252
+ reframed = video.reframe(start=0, end=60, target={"width": 1280, "height": 720})
253
+ ```
254
+
255
+ ### Generative media
256
+
257
+ ```python
258
+ image = coll.generate_image(
259
+ prompt="a sunset over mountains",
260
+ aspect_ratio="16:9",
261
+ )
262
+ ```
263
+
264
+ ## Error handling
265
+
266
+ ```python
267
+ from videodb.exceptions import AuthenticationError, InvalidRequestError
268
+
269
+ try:
270
+ conn = videodb.connect()
271
+ except AuthenticationError:
272
+ print("Check your VIDEO_DB_API_KEY")
273
+
274
+ try:
275
+ video = coll.upload(url="https://example.com/video.mp4")
276
+ except InvalidRequestError as e:
277
+ print(f"Upload failed: {e}")
278
+ ```
279
+
280
+ ### Common pitfalls
281
+
282
+ | Scenario | Error message | Solution |
283
+ |----------|--------------|----------|
284
+ | Indexing an already-indexed video | `Spoken word index for video already exists` | Use `video.index_spoken_words(force=True)` to skip if already indexed |
285
+ | Scene index already exists | `Scene index with id XXXX already exists` | Extract the existing `scene_index_id` from the error with `re.search(r"id\s+([a-f0-9]+)", str(e))` |
286
+ | Search finds no matches | `InvalidRequestError: No results found` | Catch the exception and treat as empty results (`shots = []`) |
287
+ | Reframe times out | Blocks indefinitely on long videos | Use `start`/`end` to limit segment, or pass `callback_url` for async |
288
+ | Negative timestamps on Timeline | Silently produces broken stream | Always validate `start >= 0` before creating `VideoAsset` |
289
+ | `generate_video()` / `create_collection()` fails | `Operation not allowed` or `maximum limit` | Plan-gated features — inform the user about plan limits |
290
+
291
+ ## Examples
292
+
293
+ ### Canonical prompts
294
+ - "Start desktop capture and alert when a password field appears."
295
+ - "Record my session and produce an actionable summary when it ends."
296
+ - "Ingest this file and return a playable stream link."
297
+ - "Index this folder and find every scene with people, return timestamps."
298
+ - "Generate subtitles, burn them in, and add light background music."
299
+ - "Connect this RTSP URL and alert when a person enters the zone."
300
+
301
+ ### Screen Recording (Desktop Capture)
302
+
303
+ Use `ws_listener.py` to capture WebSocket events during recording sessions. Desktop capture supports **macOS** only.
304
+
305
+ #### Quick Start
306
+
307
+ 1. **Choose state dir**: `STATE_DIR="${VIDEODB_EVENTS_DIR:-$HOME/.local/state/videodb}"`
308
+ 2. **Start listener**: `VIDEODB_EVENTS_DIR="$STATE_DIR" python scripts/ws_listener.py --clear "$STATE_DIR" &`
309
+ 3. **Get WebSocket ID**: `cat "$STATE_DIR/videodb_ws_id"`
310
+ 4. **Run capture code** (see reference/capture.md for the full workflow)
311
+ 5. **Events written to**: `$STATE_DIR/videodb_events.jsonl`
312
+
313
+ Use `--clear` whenever you start a fresh capture run so stale transcript and visual events do not leak into the new session.
314
+
315
+ #### Query Events
316
+
317
+ ```python
318
+ import json
319
+ import os
320
+ import time
321
+ from pathlib import Path
322
+
323
+ events_dir = Path(os.environ.get("VIDEODB_EVENTS_DIR", Path.home() / ".local" / "state" / "videodb"))
324
+ events_file = events_dir / "videodb_events.jsonl"
325
+ events = []
326
+
327
+ if events_file.exists():
328
+ with events_file.open(encoding="utf-8") as handle:
329
+ for line in handle:
330
+ try:
331
+ events.append(json.loads(line))
332
+ except json.JSONDecodeError:
333
+ continue
334
+
335
+ transcripts = [e["data"]["text"] for e in events if e.get("channel") == "transcript"]
336
+ cutoff = time.time() - 300
337
+ recent_visual = [
338
+ e for e in events
339
+ if e.get("channel") == "visual_index" and e["unix_ts"] > cutoff
340
+ ]
341
+ ```
342
+
343
+ ## Additional docs
344
+
345
+ Reference documentation is in the `reference/` directory adjacent to this SKILL.md file. Use the Glob tool to locate it if needed.
346
+
347
+ - [reference/api-reference.md](reference/api-reference.md) - Complete VideoDB Python SDK API reference
348
+ - [reference/search.md](reference/search.md) - In-depth guide to video search (spoken word and scene-based)
349
+ - [reference/editor.md](reference/editor.md) - Timeline editing, assets, and composition
350
+ - [reference/streaming.md](reference/streaming.md) - HLS streaming and instant playback
351
+ - [reference/generative.md](reference/generative.md) - AI-powered media generation (images, video, audio)
352
+ - [reference/rtstream.md](reference/rtstream.md) - Live stream ingestion workflow (RTSP/RTMP)
353
+ - [reference/rtstream-reference.md](reference/rtstream-reference.md) - RTStream SDK methods and AI pipelines
354
+ - [reference/capture.md](reference/capture.md) - Desktop capture workflow
355
+ - [reference/capture-reference.md](reference/capture-reference.md) - Capture SDK and WebSocket events
356
+ - [reference/use-cases.md](reference/use-cases.md) - Common video processing patterns and examples
357
+
358
+ **Do not use ffmpeg, moviepy, or local encoding tools** when VideoDB supports the operation. The following are all handled server-side by VideoDB — trimming, combining clips, overlaying audio or music, adding subtitles, text/image overlays, transcoding, resolution changes, aspect-ratio conversion, resizing for platform requirements, transcription, and media generation. Only fall back to local tools for operations listed under Limitations in reference/editor.md (transitions, speed changes, crop/zoom, colour grading, volume mixing).
359
+
360
+ ### When to use what
361
+
362
+ | Problem | VideoDB solution |
363
+ |---------|-----------------|
364
+ | Platform rejects video aspect ratio or resolution | `video.reframe()` or `conn.transcode()` with `VideoConfig` |
365
+ | Need to resize video for Twitter/Instagram/TikTok | `video.reframe(target="vertical")` or `target="square"` |
366
+ | Need to change resolution (e.g. 1080p → 720p) | `conn.transcode()` with `VideoConfig(resolution=720)` |
367
+ | Need to overlay audio/music on video | `AudioAsset` on a `Timeline` |
368
+ | Need to add subtitles | `video.add_subtitle()` or `CaptionAsset` |
369
+ | Need to combine/trim clips | `VideoAsset` on a `Timeline` |
370
+ | Need to generate voiceover, music, or SFX | `coll.generate_voice()`, `generate_music()`, `generate_sound_effect()` |
371
+
372
+ ## Provenance
373
+
374
+ Reference material for this skill is vendored locally under `skills/videodb/reference/`.
375
+ Use the local copies above instead of following external repository links at runtime.