codeply-cli 0.5.5 → 0.6.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (429) hide show
  1. package/LICENSE +21 -21
  2. package/THIRD_PARTY_NOTICES.md +65 -65
  3. package/bin/codeply.js +8 -3
  4. package/lib/agent.mjs +2596 -2268
  5. package/lib/ai.js +135 -27
  6. package/lib/ai.mjs +6 -6
  7. package/lib/apply-patch.js +217 -217
  8. package/lib/arity-table.json +138 -138
  9. package/lib/arity.js +70 -70
  10. package/lib/auth.mjs +6 -6
  11. package/lib/autopilot.js +84 -0
  12. package/lib/bot-mail.js +46 -0
  13. package/lib/bots.js +142 -15
  14. package/lib/brain.js +914 -0
  15. package/lib/call-assist.js +120 -0
  16. package/lib/chatgpt.js +282 -282
  17. package/lib/cloud-browser.mjs +143 -143
  18. package/lib/cloud.mjs +1396 -1312
  19. package/lib/commands.js +103 -103
  20. package/lib/computer.js +136 -0
  21. package/lib/design-library/assemble-artifact.mjs +21 -21
  22. package/lib/design-library/cleanup.mjs +45 -45
  23. package/lib/design-library/index.json +22379 -22379
  24. package/lib/design-library/make-table-data.mjs +39 -39
  25. package/lib/design-tools.mjs +173 -0
  26. package/lib/diagnostics.js +192 -192
  27. package/lib/dsh-acp.mjs +444 -0
  28. package/lib/edit-engine.js +364 -364
  29. package/lib/github-agent.mjs +326 -326
  30. package/lib/handoff.mjs +245 -0
  31. package/lib/history.js +78 -75
  32. package/lib/life-sources.js +319 -0
  33. package/lib/life-store.js +356 -0
  34. package/lib/life-triggers.js +286 -0
  35. package/lib/life.js +487 -0
  36. package/lib/mail-watch.js +3 -3
  37. package/lib/mcp.js +258 -258
  38. package/lib/native-tools.mjs +17 -5
  39. package/lib/oauth-connectors.js +76 -21
  40. package/lib/permissions.js +109 -109
  41. package/lib/plugins.js +356 -353
  42. package/lib/reach.js +67 -67
  43. package/lib/render-md.mjs +647 -617
  44. package/lib/screen.js +77 -0
  45. package/lib/server.mjs +458 -457
  46. package/lib/session-db.js +220 -220
  47. package/lib/share.js +208 -168
  48. package/lib/skills.js +4 -1
  49. package/lib/snapshot.js +146 -146
  50. package/lib/subagents.js +4 -2
  51. package/lib/telemetry.js +105 -105
  52. package/lib/terminal-hints.js +154 -154
  53. package/lib/textarea.mjs +264 -258
  54. package/lib/tools.mjs +326 -40
  55. package/lib/tui.mjs +1459 -1086
  56. package/lib/typecheck-worker.js +147 -147
  57. package/lib/web-tools.js +209 -209
  58. package/package.json +1 -1
  59. package/skills/SOURCE.md +58 -58
  60. package/skills/accessibility/SKILL.md +147 -147
  61. package/skills/agent-architecture-audit/SKILL.md +257 -257
  62. package/skills/agent-eval/SKILL.md +147 -147
  63. package/skills/agent-harness-construction/SKILL.md +74 -74
  64. package/skills/agent-introspection-debugging/SKILL.md +154 -154
  65. package/skills/agent-payment-x402/SKILL.md +225 -225
  66. package/skills/agent-self-evaluation/SKILL.md +182 -182
  67. package/skills/agent-self-evaluation/references/evaluation-criteria.md +71 -71
  68. package/skills/agent-self-evaluation/references/hook-integration.md +64 -64
  69. package/skills/agent-sort/SKILL.md +216 -216
  70. package/skills/agentic-engineering/SKILL.md +64 -64
  71. package/skills/agentic-os/SKILL.md +388 -388
  72. package/skills/ai-first-engineering/SKILL.md +52 -52
  73. package/skills/ai-regression-testing/SKILL.md +386 -386
  74. package/skills/android-clean-architecture/SKILL.md +340 -340
  75. package/skills/angular-developer/SKILL.md +155 -155
  76. package/skills/angular-developer/references/angular-animations.md +160 -160
  77. package/skills/angular-developer/references/angular-aria.md +410 -410
  78. package/skills/angular-developer/references/cli.md +86 -86
  79. package/skills/angular-developer/references/component-harnesses.md +59 -59
  80. package/skills/angular-developer/references/component-styling.md +91 -91
  81. package/skills/angular-developer/references/components.md +117 -117
  82. package/skills/angular-developer/references/creating-services.md +97 -97
  83. package/skills/angular-developer/references/data-resolvers.md +69 -69
  84. package/skills/angular-developer/references/define-routes.md +67 -67
  85. package/skills/angular-developer/references/defining-providers.md +72 -72
  86. package/skills/angular-developer/references/di-fundamentals.md +120 -120
  87. package/skills/angular-developer/references/e2e-testing.md +56 -56
  88. package/skills/angular-developer/references/effects.md +83 -83
  89. package/skills/angular-developer/references/hierarchical-injectors.md +43 -43
  90. package/skills/angular-developer/references/host-elements.md +80 -80
  91. package/skills/angular-developer/references/injection-context.md +63 -63
  92. package/skills/angular-developer/references/inputs.md +101 -101
  93. package/skills/angular-developer/references/linked-signal.md +59 -59
  94. package/skills/angular-developer/references/loading-strategies.md +61 -61
  95. package/skills/angular-developer/references/mcp.md +108 -108
  96. package/skills/angular-developer/references/navigate-to-routes.md +69 -69
  97. package/skills/angular-developer/references/outputs.md +86 -86
  98. package/skills/angular-developer/references/reactive-forms.md +122 -122
  99. package/skills/angular-developer/references/rendering-strategies.md +44 -44
  100. package/skills/angular-developer/references/resource.md +77 -77
  101. package/skills/angular-developer/references/route-animations.md +56 -56
  102. package/skills/angular-developer/references/route-guards.md +52 -52
  103. package/skills/angular-developer/references/router-lifecycle.md +45 -45
  104. package/skills/angular-developer/references/router-testing.md +87 -87
  105. package/skills/angular-developer/references/show-routes-with-outlets.md +68 -68
  106. package/skills/angular-developer/references/signal-forms.md +795 -795
  107. package/skills/angular-developer/references/signals-overview.md +94 -94
  108. package/skills/angular-developer/references/tailwind-css.md +69 -69
  109. package/skills/angular-developer/references/template-driven-forms.md +114 -114
  110. package/skills/angular-developer/references/testing-fundamentals.md +65 -65
  111. package/skills/api-connector-builder/SKILL.md +121 -121
  112. package/skills/api-design/SKILL.md +524 -524
  113. package/skills/architecture-decision-records/SKILL.md +180 -180
  114. package/skills/article-writing/SKILL.md +80 -80
  115. package/skills/automation-audit-ops/SKILL.md +143 -143
  116. package/skills/autonomous-agent-harness/SKILL.md +274 -274
  117. package/skills/autonomous-loops/SKILL.md +611 -611
  118. package/skills/backend-patterns/SKILL.md +562 -562
  119. package/skills/benchmark/SKILL.md +95 -95
  120. package/skills/benchmark-methodology/SKILL.md +191 -191
  121. package/skills/benchmark-optimization-loop/SKILL.md +71 -71
  122. package/skills/blender-motion-state-inspection/SKILL.md +165 -165
  123. package/skills/blueprint/SKILL.md +106 -106
  124. package/skills/brand-discovery/SKILL.md +145 -145
  125. package/skills/brand-discovery/references/10_purpose-why.md +40 -40
  126. package/skills/brand-discovery/references/20_positioning.md +44 -44
  127. package/skills/brand-discovery/references/30_audience-niche.md +52 -52
  128. package/skills/brand-discovery/references/40_personality-archetype.md +57 -57
  129. package/skills/brand-discovery/references/50_voice-tone.md +59 -59
  130. package/skills/brand-discovery/references/60_narrative-story.md +50 -50
  131. package/skills/brand-discovery/references/70_founder-tension.md +49 -49
  132. package/skills/brand-discovery/references/90_SYNTHESIS.md +133 -133
  133. package/skills/brand-voice/SKILL.md +98 -98
  134. package/skills/brand-voice/references/voice-profile-schema.md +55 -55
  135. package/skills/browser-qa/SKILL.md +105 -105
  136. package/skills/bun-runtime/SKILL.md +85 -85
  137. package/skills/canary-watch/SKILL.md +108 -108
  138. package/skills/carrier-relationship-management/SKILL.md +212 -212
  139. package/skills/cisco-ios-patterns/SKILL.md +164 -164
  140. package/skills/ck/SKILL.md +148 -148
  141. package/skills/claude-devfleet/SKILL.md +112 -112
  142. package/skills/click-path-audit/SKILL.md +245 -245
  143. package/skills/clickhouse-io/SKILL.md +445 -445
  144. package/skills/code-tour/SKILL.md +254 -254
  145. package/skills/codebase-onboarding/SKILL.md +234 -234
  146. package/skills/codehealth-mcp/SKILL.md +167 -167
  147. package/skills/codeply-taste/LICENSE +21 -0
  148. package/skills/codeply-taste/SKILL.md +100 -0
  149. package/skills/codeply-taste/SOURCE.md +10 -0
  150. package/skills/codeply-taste/assets/base.css +100 -0
  151. package/skills/codeply-taste/assets/base.js +37 -0
  152. package/skills/codeply-taste/library/directions.json +1078 -0
  153. package/skills/codeply-taste/library/heroes.json +894 -0
  154. package/skills/codeply-taste/library/motions.json +57 -0
  155. package/skills/codeply-taste/library/palettes.json +1485 -0
  156. package/skills/codeply-taste/library/photos.json +7240 -0
  157. package/skills/codeply-taste/library/sections.json +4136 -0
  158. package/skills/codeply-taste/library/sites.json +7274 -0
  159. package/skills/codeply-taste/library/type.json +2024 -0
  160. package/skills/codeply-taste/references/colour.md +141 -0
  161. package/skills/codeply-taste/references/copy.md +177 -0
  162. package/skills/codeply-taste/references/critique.md +171 -0
  163. package/skills/codeply-taste/references/imagery.md +377 -0
  164. package/skills/codeply-taste/references/layout.md +178 -0
  165. package/skills/codeply-taste/references/motion.md +292 -0
  166. package/skills/codeply-taste/references/research.md +306 -0
  167. package/skills/codeply-taste/references/tells.md +115 -0
  168. package/skills/codeply-taste/references/type.md +170 -0
  169. package/skills/codeply-taste/scripts/assets.mjs +865 -0
  170. package/skills/codeply-taste/scripts/draw.mjs +525 -0
  171. package/skills/codeply-taste/scripts/inspect.mjs +205 -0
  172. package/skills/codeply-taste/scripts/lib/cdp.mjs +205 -0
  173. package/skills/codeply-taste/scripts/lib/probe.mjs +569 -0
  174. package/skills/codeply-taste/scripts/lib/rules.mjs +137 -0
  175. package/skills/codeply-taste/scripts/lint.mjs +108 -0
  176. package/skills/coding-standards/SKILL.md +551 -551
  177. package/skills/competitive-platform-analysis/SKILL.md +214 -214
  178. package/skills/competitive-report-structure/SKILL.md +162 -162
  179. package/skills/compose-multiplatform-patterns/SKILL.md +300 -300
  180. package/skills/config-gc/SKILL.md +120 -120
  181. package/skills/configure-ecc/SKILL.md +385 -385
  182. package/skills/connections-optimizer/SKILL.md +190 -190
  183. package/skills/content-engine/SKILL.md +132 -132
  184. package/skills/content-hash-cache-pattern/SKILL.md +162 -162
  185. package/skills/context-budget/SKILL.md +136 -136
  186. package/skills/continuous-agent-loop/SKILL.md +46 -46
  187. package/skills/continuous-learning/SKILL.md +132 -132
  188. package/skills/continuous-learning-v2/SKILL.md +361 -361
  189. package/skills/contract-first/SKILL.md +287 -287
  190. package/skills/cost-aware-llm-pipeline/SKILL.md +184 -184
  191. package/skills/cost-tracking/SKILL.md +97 -97
  192. package/skills/council/SKILL.md +204 -204
  193. package/skills/cpp-coding-standards/SKILL.md +724 -724
  194. package/skills/cpp-testing/SKILL.md +325 -325
  195. package/skills/crosspost/SKILL.md +112 -112
  196. package/skills/csharp-testing/SKILL.md +322 -322
  197. package/skills/customer-billing-ops/SKILL.md +141 -141
  198. package/skills/customs-trade-compliance/SKILL.md +263 -263
  199. package/skills/dart-flutter-patterns/SKILL.md +564 -564
  200. package/skills/dashboard-builder/SKILL.md +109 -109
  201. package/skills/data-scraper-agent/SKILL.md +765 -765
  202. package/skills/data-throughput-accelerator/SKILL.md +74 -74
  203. package/skills/database-migrations/SKILL.md +430 -430
  204. package/skills/deep-research/SKILL.md +160 -160
  205. package/skills/defi-amm-security/SKILL.md +167 -167
  206. package/skills/delivery-gate/SKILL.md +126 -126
  207. package/skills/deployment-patterns/SKILL.md +428 -428
  208. package/skills/design-system/SKILL.md +83 -83
  209. package/skills/django-celery/SKILL.md +458 -458
  210. package/skills/django-patterns/SKILL.md +735 -735
  211. package/skills/django-security/SKILL.md +644 -644
  212. package/skills/django-tdd/SKILL.md +730 -730
  213. package/skills/django-verification/SKILL.md +470 -470
  214. package/skills/dmux-workflows/SKILL.md +192 -192
  215. package/skills/docker-patterns/SKILL.md +365 -365
  216. package/skills/documentation-lookup/SKILL.md +91 -91
  217. package/skills/dotnet-patterns/SKILL.md +322 -322
  218. package/skills/dynamic-workflow-mode/SKILL.md +124 -124
  219. package/skills/e2e-testing/SKILL.md +327 -327
  220. package/skills/ecc-guide/SKILL.md +190 -190
  221. package/skills/ecc-recipes/SKILL.md +149 -149
  222. package/skills/ecc-tools-cost-audit/SKILL.md +161 -161
  223. package/skills/email-ops/SKILL.md +122 -122
  224. package/skills/energy-procurement/SKILL.md +228 -228
  225. package/skills/enterprise-agent-ops/SKILL.md +51 -51
  226. package/skills/error-handling/SKILL.md +377 -377
  227. package/skills/eval-harness/SKILL.md +271 -271
  228. package/skills/evm-token-decimals/SKILL.md +131 -131
  229. package/skills/exa-search/SKILL.md +108 -108
  230. package/skills/fal-ai-media/SKILL.md +289 -289
  231. package/skills/fastapi-patterns/SKILL.md +514 -514
  232. package/skills/finance-billing-ops/SKILL.md +128 -128
  233. package/skills/flox-environments/SKILL.md +497 -497
  234. package/skills/flutter-dart-code-review/SKILL.md +436 -436
  235. package/skills/foundation-models-on-device/SKILL.md +243 -243
  236. package/skills/frontend-a11y/SKILL.md +446 -446
  237. package/skills/frontend-design-direction/SKILL.md +93 -93
  238. package/skills/frontend-patterns/SKILL.md +657 -657
  239. package/skills/frontend-slides/SKILL.md +185 -185
  240. package/skills/fsharp-testing/SKILL.md +281 -281
  241. package/skills/gan-style-harness/SKILL.md +279 -279
  242. package/skills/gateguard/SKILL.md +133 -133
  243. package/skills/generating-python-installer/SKILL.md +820 -820
  244. package/skills/git-workflow/SKILL.md +716 -716
  245. package/skills/github-ops/SKILL.md +145 -145
  246. package/skills/golang-patterns/SKILL.md +676 -676
  247. package/skills/golang-testing/SKILL.md +721 -721
  248. package/skills/google-workspace-ops/SKILL.md +96 -96
  249. package/skills/growth-log/SKILL.md +128 -128
  250. package/skills/healthcare-cdss-patterns/SKILL.md +246 -246
  251. package/skills/healthcare-emr-patterns/SKILL.md +160 -160
  252. package/skills/healthcare-eval-harness/SKILL.md +208 -208
  253. package/skills/healthcare-phi-compliance/SKILL.md +146 -146
  254. package/skills/hermes-imports/SKILL.md +89 -89
  255. package/skills/hexagonal-architecture/SKILL.md +277 -277
  256. package/skills/hipaa-compliance/SKILL.md +79 -79
  257. package/skills/homelab-network-readiness/SKILL.md +170 -170
  258. package/skills/homelab-network-setup/SKILL.md +130 -130
  259. package/skills/homelab-pihole-dns/SKILL.md +275 -275
  260. package/skills/homelab-vlan-segmentation/SKILL.md +312 -312
  261. package/skills/homelab-wireguard-vpn/SKILL.md +306 -306
  262. package/skills/hookify-rules/SKILL.md +128 -128
  263. package/skills/inherit-legacy-style/SKILL.md +157 -157
  264. package/skills/intent-driven-development/SKILL.md +360 -360
  265. package/skills/inventory-demand-planning/SKILL.md +247 -247
  266. package/skills/investor-materials/SKILL.md +97 -97
  267. package/skills/investor-outreach/SKILL.md +92 -92
  268. package/skills/ios-icon-gen/SKILL.md +158 -158
  269. package/skills/iterative-retrieval/SKILL.md +212 -212
  270. package/skills/ito-basket-compare/SKILL.md +64 -64
  271. package/skills/ito-compute/SKILL.md +129 -129
  272. package/skills/ito-data-atlas-agent/SKILL.md +64 -64
  273. package/skills/ito-market-intelligence/SKILL.md +61 -61
  274. package/skills/ito-trade-planner/SKILL.md +68 -68
  275. package/skills/java-coding-standards/SKILL.md +384 -384
  276. package/skills/jira-integration/SKILL.md +303 -303
  277. package/skills/jpa-patterns/SKILL.md +152 -152
  278. package/skills/knowledge-ops/SKILL.md +155 -155
  279. package/skills/kotlin-coroutines-flows/SKILL.md +285 -285
  280. package/skills/kotlin-exposed-patterns/SKILL.md +720 -720
  281. package/skills/kotlin-ktor-patterns/SKILL.md +690 -690
  282. package/skills/kotlin-patterns/SKILL.md +712 -712
  283. package/skills/kotlin-testing/SKILL.md +825 -825
  284. package/skills/kubernetes-patterns/SKILL.md +756 -756
  285. package/skills/laravel-patterns/SKILL.md +416 -416
  286. package/skills/laravel-plugin-discovery/SKILL.md +230 -230
  287. package/skills/laravel-security/SKILL.md +948 -948
  288. package/skills/laravel-tdd/SKILL.md +675 -675
  289. package/skills/laravel-verification/SKILL.md +180 -180
  290. package/skills/latency-critical-systems/SKILL.md +75 -75
  291. package/skills/lead-intelligence/SKILL.md +322 -322
  292. package/skills/liquid-glass-design/SKILL.md +279 -279
  293. package/skills/llm-trading-agent-security/SKILL.md +147 -147
  294. package/skills/logistics-exception-management/SKILL.md +222 -222
  295. package/skills/loop-design-check/SKILL.md +143 -143
  296. package/skills/mailtrap-email-integration/SKILL.md +77 -77
  297. package/skills/make-interfaces-feel-better/SKILL.md +152 -152
  298. package/skills/manim-video/SKILL.md +90 -90
  299. package/skills/market-research/SKILL.md +76 -76
  300. package/skills/marketing-campaign/SKILL.md +114 -114
  301. package/skills/mcp-server-patterns/SKILL.md +70 -70
  302. package/skills/messages-ops/SKILL.md +105 -105
  303. package/skills/ml-adoption-playbook/SKILL.md +57 -57
  304. package/skills/mle-workflow/SKILL.md +348 -348
  305. package/skills/motion-advanced/SKILL.md +596 -596
  306. package/skills/motion-foundations/SKILL.md +299 -299
  307. package/skills/motion-patterns/SKILL.md +434 -434
  308. package/skills/motion-ui/SKILL.md +576 -576
  309. package/skills/mysql-patterns/SKILL.md +413 -413
  310. package/skills/nanoclaw-repl/SKILL.md +34 -34
  311. package/skills/nestjs-patterns/SKILL.md +231 -231
  312. package/skills/netmiko-ssh-automation/SKILL.md +174 -174
  313. package/skills/network-bgp-diagnostics/SKILL.md +168 -168
  314. package/skills/network-config-validation/SKILL.md +211 -211
  315. package/skills/network-interface-health/SKILL.md +153 -153
  316. package/skills/nextjs-turbopack/SKILL.md +58 -58
  317. package/skills/nodejs-keccak256/SKILL.md +103 -103
  318. package/skills/nutrient-document-processing/SKILL.md +168 -168
  319. package/skills/nuxt4-patterns/SKILL.md +101 -101
  320. package/skills/openclaw-persona-forge/SKILL.md +289 -289
  321. package/skills/openclaw-persona-forge/references/avatar-style.md +124 -124
  322. package/skills/openclaw-persona-forge/references/boundary-rules.md +53 -53
  323. package/skills/openclaw-persona-forge/references/error-handling.md +53 -53
  324. package/skills/openclaw-persona-forge/references/identity-tension.md +48 -48
  325. package/skills/openclaw-persona-forge/references/naming-system.md +39 -39
  326. package/skills/openclaw-persona-forge/references/output-template.md +166 -166
  327. package/skills/opensource-pipeline/SKILL.md +256 -256
  328. package/skills/orch-add-feature/SKILL.md +45 -45
  329. package/skills/orch-build-mvp/SKILL.md +49 -49
  330. package/skills/orch-change-feature/SKILL.md +43 -43
  331. package/skills/orch-fix-defect/SKILL.md +43 -43
  332. package/skills/orch-pipeline/SKILL.md +121 -121
  333. package/skills/orch-refine-code/SKILL.md +44 -44
  334. package/skills/parallel-execution-optimizer/SKILL.md +74 -74
  335. package/skills/perl-patterns/SKILL.md +505 -505
  336. package/skills/perl-security/SKILL.md +504 -504
  337. package/skills/perl-testing/SKILL.md +476 -476
  338. package/skills/plan-canvas/SKILL.md +153 -153
  339. package/skills/plan-orchestrate/SKILL.md +263 -263
  340. package/skills/plankton-code-quality/SKILL.md +237 -237
  341. package/skills/postgres-patterns/SKILL.md +148 -148
  342. package/skills/prediction-market-oracle-research/SKILL.md +64 -64
  343. package/skills/prediction-market-risk-review/SKILL.md +61 -61
  344. package/skills/premium-web-design/SKILL.md +154 -154
  345. package/skills/prisma-patterns/SKILL.md +401 -401
  346. package/skills/product-capability/SKILL.md +142 -142
  347. package/skills/product-lens/SKILL.md +93 -93
  348. package/skills/production-audit/SKILL.md +207 -207
  349. package/skills/production-scheduling/SKILL.md +238 -238
  350. package/skills/project-flow-ops/SKILL.md +112 -112
  351. package/skills/prompt-optimizer/SKILL.md +398 -398
  352. package/skills/python-patterns/SKILL.md +751 -751
  353. package/skills/python-testing/SKILL.md +817 -817
  354. package/skills/pytorch-patterns/SKILL.md +397 -397
  355. package/skills/quality-nonconformance/SKILL.md +260 -260
  356. package/skills/quarkus-patterns/SKILL.md +723 -723
  357. package/skills/quarkus-security/SKILL.md +468 -468
  358. package/skills/quarkus-tdd/SKILL.md +812 -812
  359. package/skills/quarkus-verification/SKILL.md +480 -480
  360. package/skills/ralphinho-rfc-pipeline/SKILL.md +68 -68
  361. package/skills/react-native-patterns/SKILL.md +326 -326
  362. package/skills/react-patterns/SKILL.md +342 -342
  363. package/skills/react-performance/SKILL.md +575 -575
  364. package/skills/react-testing/SKILL.md +424 -424
  365. package/skills/recsys-pipeline-architect/SKILL.md +115 -115
  366. package/skills/recursive-decision-ledger/SKILL.md +81 -81
  367. package/skills/redis-patterns/SKILL.md +404 -404
  368. package/skills/regex-vs-llm-structured-text/SKILL.md +221 -221
  369. package/skills/remotion-video-creation/SKILL.md +43 -43
  370. package/skills/repo-scan/SKILL.md +79 -79
  371. package/skills/research-ops/SKILL.md +113 -113
  372. package/skills/returns-reverse-logistics/SKILL.md +240 -240
  373. package/skills/rules-distill/SKILL.md +265 -265
  374. package/skills/rust-patterns/SKILL.md +500 -500
  375. package/skills/rust-testing/SKILL.md +501 -501
  376. package/skills/safety-guard/SKILL.md +76 -76
  377. package/skills/santa-method/SKILL.md +307 -307
  378. package/skills/scientific-db-pubmed-database/SKILL.md +176 -176
  379. package/skills/scientific-db-uspto-database/SKILL.md +178 -178
  380. package/skills/scientific-pkg-gget/SKILL.md +167 -167
  381. package/skills/scientific-thinking-literature-review/SKILL.md +193 -193
  382. package/skills/scientific-thinking-scholar-evaluation/SKILL.md +161 -161
  383. package/skills/search-first/SKILL.md +183 -183
  384. package/skills/security-bounty-hunter/SKILL.md +100 -100
  385. package/skills/security-review/SKILL.md +504 -504
  386. package/skills/security-scan/SKILL.md +166 -166
  387. package/skills/seo/SKILL.md +155 -155
  388. package/skills/skill-comply/SKILL.md +59 -59
  389. package/skills/skill-scout/SKILL.md +141 -141
  390. package/skills/skill-stocktake/SKILL.md +195 -195
  391. package/skills/social-graph-ranker/SKILL.md +155 -155
  392. package/skills/social-publisher/SKILL.md +130 -130
  393. package/skills/springboot-patterns/SKILL.md +315 -315
  394. package/skills/springboot-security/SKILL.md +273 -273
  395. package/skills/springboot-tdd/SKILL.md +159 -159
  396. package/skills/springboot-verification/SKILL.md +232 -232
  397. package/skills/strategic-compact/SKILL.md +142 -142
  398. package/skills/swift-actor-persistence/SKILL.md +144 -144
  399. package/skills/swift-concurrency-6-2/SKILL.md +216 -216
  400. package/skills/swift-protocol-di-testing/SKILL.md +191 -191
  401. package/skills/swiftui-patterns/SKILL.md +259 -259
  402. package/skills/taste/SKILL.md +264 -264
  403. package/skills/taste/references/genre-taxonomy.md +87 -87
  404. package/skills/tdd-workflow/SKILL.md +583 -583
  405. package/skills/team-agent-orchestration/SKILL.md +111 -111
  406. package/skills/team-builder/SKILL.md +169 -169
  407. package/skills/terminal-ops/SKILL.md +110 -110
  408. package/skills/tinystruct-patterns/SKILL.md +279 -279
  409. package/skills/tinystruct-patterns/references/architecture.md +90 -90
  410. package/skills/tinystruct-patterns/references/data-handling.md +60 -60
  411. package/skills/tinystruct-patterns/references/database.md +99 -99
  412. package/skills/tinystruct-patterns/references/routing.md +64 -64
  413. package/skills/tinystruct-patterns/references/system-usage.md +97 -97
  414. package/skills/tinystruct-patterns/references/testing.md +72 -72
  415. package/skills/token-budget-advisor/SKILL.md +134 -134
  416. package/skills/ui-demo/SKILL.md +466 -466
  417. package/skills/ui-to-vue/SKILL.md +135 -135
  418. package/skills/uncloud/SKILL.md +344 -344
  419. package/skills/unified-memory/SKILL.md +170 -170
  420. package/skills/unified-notifications-ops/SKILL.md +188 -188
  421. package/skills/verification-loop/SKILL.md +129 -129
  422. package/skills/video-editing/SKILL.md +311 -311
  423. package/skills/videodb/SKILL.md +375 -375
  424. package/skills/visa-doc-translate/SKILL.md +117 -117
  425. package/skills/vite-patterns/SKILL.md +450 -450
  426. package/skills/vue-patterns/SKILL.md +471 -471
  427. package/skills/windows-desktop-e2e/SKILL.md +888 -888
  428. package/skills/workspace-surface-audit/SKILL.md +126 -126
  429. package/skills/x-api/SKILL.md +235 -235
@@ -1,375 +1,375 @@
1
- ---
2
- name: videodb
3
- description: See, Understand, Act on video and audio. See- ingest from local files, URLs, RTSP/live feeds, or live record desktop; return realtime context and playable stream links. Understand- extract frames, build visual/semantic/temporal indexes, and search moments with timestamps and auto-clips. Act- transcode and normalize (codec, fps, resolution, aspect ratio), perform timeline edits (subtitles, text/image overlays, branding, audio overlays, dubbing, translation), generate media assets (image, audio, video), and create real time alerts for events from live streams or desktop capture.
4
- metadata:
5
- origin: ECC
6
- allowed-tools: Read Grep Glob Bash(python:*)
7
- argument-hint: "[task description]"
8
- ---
9
-
10
- # VideoDB Skill
11
-
12
- **Perception + memory + actions for video, live streams, and desktop sessions.**
13
-
14
- ## When to use
15
-
16
- ### Desktop Perception
17
- - Start/stop a **desktop session** capturing **screen, mic, and system audio**
18
- - Stream **live context** and store **episodic session memory**
19
- - Run **real-time alerts/triggers** on what's spoken and what's happening on screen
20
- - Produce **session summaries**, a searchable timeline, and **playable evidence links**
21
-
22
- ### Video ingest + stream
23
- - Ingest a **file or URL** and return a **playable web stream link**
24
- - Transcode/normalize: **codec, bitrate, fps, resolution, aspect ratio**
25
-
26
- ### Index + search (timestamps + evidence)
27
- - Build **visual**, **spoken**, and **keyword** indexes
28
- - Search and return exact moments with **timestamps** and **playable evidence**
29
- - Auto-create **clips** from search results
30
-
31
- ### Timeline editing + generation
32
- - Subtitles: **generate**, **translate**, **burn-in**
33
- - Overlays: **text/image/branding**, motion captions
34
- - Audio: **background music**, **voiceover**, **dubbing**
35
- - Programmatic composition and exports via **timeline operations**
36
-
37
- ### Live streams (RTSP) + monitoring
38
- - Connect **RTSP/live feeds**
39
- - Run **real-time visual and spoken understanding** and emit **events/alerts** for monitoring workflows
40
-
41
- ## How it works
42
-
43
- ### Common inputs
44
- - Local **file path**, public **URL**, or **RTSP URL**
45
- - Desktop capture request: **start / stop / summarize session**
46
- - Desired operations: get context for understanding, transcode spec, index spec, search query, clip ranges, timeline edits, alert rules
47
-
48
- ### Common outputs
49
- - **Stream URL**
50
- - Search results with **timestamps** and **evidence links**
51
- - Generated assets: subtitles, audio, images, clips
52
- - **Event/alert payloads** for live streams
53
- - Desktop **session summaries** and memory entries
54
-
55
- ### Running Python code
56
-
57
- Before running any VideoDB code, change to the project directory and load environment variables:
58
-
59
- ```python
60
- from dotenv import load_dotenv
61
- load_dotenv(".env")
62
-
63
- import videodb
64
- conn = videodb.connect()
65
- ```
66
-
67
- This reads `VIDEO_DB_API_KEY` from:
68
- 1. Environment (if already exported)
69
- 2. Project's `.env` file in current directory
70
-
71
- If the key is missing, `videodb.connect()` raises `AuthenticationError` automatically.
72
-
73
- Do NOT write a script file when a short inline command works.
74
-
75
- When writing inline Python (`python -c "..."`), always use properly formatted code — use semicolons to separate statements and keep it readable. For anything longer than ~3 statements, use a heredoc instead:
76
-
77
- ```bash
78
- python << 'EOF'
79
- from dotenv import load_dotenv
80
- load_dotenv(".env")
81
-
82
- import videodb
83
- conn = videodb.connect()
84
- coll = conn.get_collection()
85
- print(f"Videos: {len(coll.get_videos())}")
86
- EOF
87
- ```
88
-
89
- ### Setup
90
-
91
- When the user asks to "setup videodb" or similar:
92
-
93
- ### 1. Install SDK
94
-
95
- ```bash
96
- pip install "videodb[capture]" python-dotenv
97
- ```
98
-
99
- If `videodb[capture]` fails on Linux, install without the capture extra:
100
-
101
- ```bash
102
- pip install videodb python-dotenv
103
- ```
104
-
105
- ### 2. Configure API key
106
-
107
- The user must set `VIDEO_DB_API_KEY` using **either** method:
108
-
109
- - **Export in terminal** (before starting Claude): `export VIDEO_DB_API_KEY=your-key`
110
- - **Project `.env` file**: Save `VIDEO_DB_API_KEY=your-key` in the project's `.env` file
111
-
112
- Get a free API key at [console.videodb.io](https://console.videodb.io) (50 free uploads, no credit card).
113
-
114
- **Do NOT** read, write, or handle the API key yourself. Always let the user set it.
115
-
116
- ### Quick Reference
117
-
118
- ### Upload media
119
-
120
- ```python
121
- # URL
122
- video = coll.upload(url="https://example.com/video.mp4")
123
-
124
- # YouTube
125
- video = coll.upload(url="https://www.youtube.com/watch?v=VIDEO_ID")
126
-
127
- # Local file
128
- video = coll.upload(file_path="/path/to/video.mp4")
129
- ```
130
-
131
- ### Transcript + subtitle
132
-
133
- ```python
134
- # force=True skips the error if the video is already indexed
135
- video.index_spoken_words(force=True)
136
- text = video.get_transcript_text()
137
- stream_url = video.add_subtitle()
138
- ```
139
-
140
- ### Search inside videos
141
-
142
- ```python
143
- from videodb.exceptions import InvalidRequestError
144
-
145
- video.index_spoken_words(force=True)
146
-
147
- # search() raises InvalidRequestError when no results are found.
148
- # Always wrap in try/except and treat "No results found" as empty.
149
- try:
150
- results = video.search("product demo")
151
- shots = results.get_shots()
152
- stream_url = results.compile()
153
- except InvalidRequestError as e:
154
- if "No results found" in str(e):
155
- shots = []
156
- else:
157
- raise
158
- ```
159
-
160
- ### Scene search
161
-
162
- ```python
163
- import re
164
- from videodb import SearchType, IndexType, SceneExtractionType
165
- from videodb.exceptions import InvalidRequestError
166
-
167
- # index_scenes() has no force parameter — it raises an error if a scene
168
- # index already exists. Extract the existing index ID from the error.
169
- try:
170
- scene_index_id = video.index_scenes(
171
- extraction_type=SceneExtractionType.shot_based,
172
- prompt="Describe the visual content in this scene.",
173
- )
174
- except Exception as e:
175
- match = re.search(r"id\s+([a-f0-9]+)", str(e))
176
- if match:
177
- scene_index_id = match.group(1)
178
- else:
179
- raise
180
-
181
- # Use score_threshold to filter low-relevance noise (recommended: 0.3+)
182
- try:
183
- results = video.search(
184
- query="person writing on a whiteboard",
185
- search_type=SearchType.semantic,
186
- index_type=IndexType.scene,
187
- scene_index_id=scene_index_id,
188
- score_threshold=0.3,
189
- )
190
- shots = results.get_shots()
191
- stream_url = results.compile()
192
- except InvalidRequestError as e:
193
- if "No results found" in str(e):
194
- shots = []
195
- else:
196
- raise
197
- ```
198
-
199
- ### Timeline editing
200
-
201
- **Important:** Always validate timestamps before building a timeline:
202
- - `start` must be >= 0 (negative values are silently accepted but produce broken output)
203
- - `start` must be < `end`
204
- - `end` must be <= `video.length`
205
-
206
- ```python
207
- from videodb.timeline import Timeline
208
- from videodb.asset import VideoAsset, TextAsset, TextStyle
209
-
210
- timeline = Timeline(conn)
211
- timeline.add_inline(VideoAsset(asset_id=video.id, start=10, end=30))
212
- timeline.add_overlay(0, TextAsset(text="The End", duration=3, style=TextStyle(fontsize=36)))
213
- stream_url = timeline.generate_stream()
214
- ```
215
-
216
- ### Transcode video (resolution / quality change)
217
-
218
- ```python
219
- from videodb import TranscodeMode, VideoConfig, AudioConfig
220
-
221
- # Change resolution, quality, or aspect ratio server-side
222
- job_id = conn.transcode(
223
- source="https://example.com/video.mp4",
224
- callback_url="https://example.com/webhook",
225
- mode=TranscodeMode.economy,
226
- video_config=VideoConfig(resolution=720, quality=23, aspect_ratio="16:9"),
227
- audio_config=AudioConfig(mute=False),
228
- )
229
- ```
230
-
231
- ### Reframe aspect ratio (for social platforms)
232
-
233
- **Warning:** `reframe()` is a slow server-side operation. For long videos it can take
234
- several minutes and may time out. Best practices:
235
- - Always limit to a short segment using `start`/`end` when possible
236
- - For full-length videos, use `callback_url` for async processing
237
- - Trim the video on a `Timeline` first, then reframe the shorter result
238
-
239
- ```python
240
- from videodb import ReframeMode
241
-
242
- # Always prefer reframing a short segment:
243
- reframed = video.reframe(start=0, end=60, target="vertical", mode=ReframeMode.smart)
244
-
245
- # Async reframe for full-length videos (returns None, result via webhook):
246
- video.reframe(target="vertical", callback_url="https://example.com/webhook")
247
-
248
- # Presets: "vertical" (9:16), "square" (1:1), "landscape" (16:9)
249
- reframed = video.reframe(start=0, end=60, target="square")
250
-
251
- # Custom dimensions
252
- reframed = video.reframe(start=0, end=60, target={"width": 1280, "height": 720})
253
- ```
254
-
255
- ### Generative media
256
-
257
- ```python
258
- image = coll.generate_image(
259
- prompt="a sunset over mountains",
260
- aspect_ratio="16:9",
261
- )
262
- ```
263
-
264
- ## Error handling
265
-
266
- ```python
267
- from videodb.exceptions import AuthenticationError, InvalidRequestError
268
-
269
- try:
270
- conn = videodb.connect()
271
- except AuthenticationError:
272
- print("Check your VIDEO_DB_API_KEY")
273
-
274
- try:
275
- video = coll.upload(url="https://example.com/video.mp4")
276
- except InvalidRequestError as e:
277
- print(f"Upload failed: {e}")
278
- ```
279
-
280
- ### Common pitfalls
281
-
282
- | Scenario | Error message | Solution |
283
- |----------|--------------|----------|
284
- | Indexing an already-indexed video | `Spoken word index for video already exists` | Use `video.index_spoken_words(force=True)` to skip if already indexed |
285
- | Scene index already exists | `Scene index with id XXXX already exists` | Extract the existing `scene_index_id` from the error with `re.search(r"id\s+([a-f0-9]+)", str(e))` |
286
- | Search finds no matches | `InvalidRequestError: No results found` | Catch the exception and treat as empty results (`shots = []`) |
287
- | Reframe times out | Blocks indefinitely on long videos | Use `start`/`end` to limit segment, or pass `callback_url` for async |
288
- | Negative timestamps on Timeline | Silently produces broken stream | Always validate `start >= 0` before creating `VideoAsset` |
289
- | `generate_video()` / `create_collection()` fails | `Operation not allowed` or `maximum limit` | Plan-gated features — inform the user about plan limits |
290
-
291
- ## Examples
292
-
293
- ### Canonical prompts
294
- - "Start desktop capture and alert when a password field appears."
295
- - "Record my session and produce an actionable summary when it ends."
296
- - "Ingest this file and return a playable stream link."
297
- - "Index this folder and find every scene with people, return timestamps."
298
- - "Generate subtitles, burn them in, and add light background music."
299
- - "Connect this RTSP URL and alert when a person enters the zone."
300
-
301
- ### Screen Recording (Desktop Capture)
302
-
303
- Use `ws_listener.py` to capture WebSocket events during recording sessions. Desktop capture supports **macOS** only.
304
-
305
- #### Quick Start
306
-
307
- 1. **Choose state dir**: `STATE_DIR="${VIDEODB_EVENTS_DIR:-$HOME/.local/state/videodb}"`
308
- 2. **Start listener**: `VIDEODB_EVENTS_DIR="$STATE_DIR" python scripts/ws_listener.py --clear "$STATE_DIR" &`
309
- 3. **Get WebSocket ID**: `cat "$STATE_DIR/videodb_ws_id"`
310
- 4. **Run capture code** (see reference/capture.md for the full workflow)
311
- 5. **Events written to**: `$STATE_DIR/videodb_events.jsonl`
312
-
313
- Use `--clear` whenever you start a fresh capture run so stale transcript and visual events do not leak into the new session.
314
-
315
- #### Query Events
316
-
317
- ```python
318
- import json
319
- import os
320
- import time
321
- from pathlib import Path
322
-
323
- events_dir = Path(os.environ.get("VIDEODB_EVENTS_DIR", Path.home() / ".local" / "state" / "videodb"))
324
- events_file = events_dir / "videodb_events.jsonl"
325
- events = []
326
-
327
- if events_file.exists():
328
- with events_file.open(encoding="utf-8") as handle:
329
- for line in handle:
330
- try:
331
- events.append(json.loads(line))
332
- except json.JSONDecodeError:
333
- continue
334
-
335
- transcripts = [e["data"]["text"] for e in events if e.get("channel") == "transcript"]
336
- cutoff = time.time() - 300
337
- recent_visual = [
338
- e for e in events
339
- if e.get("channel") == "visual_index" and e["unix_ts"] > cutoff
340
- ]
341
- ```
342
-
343
- ## Additional docs
344
-
345
- Reference documentation is in the `reference/` directory adjacent to this SKILL.md file. Use the Glob tool to locate it if needed.
346
-
347
- - [reference/api-reference.md](reference/api-reference.md) - Complete VideoDB Python SDK API reference
348
- - [reference/search.md](reference/search.md) - In-depth guide to video search (spoken word and scene-based)
349
- - [reference/editor.md](reference/editor.md) - Timeline editing, assets, and composition
350
- - [reference/streaming.md](reference/streaming.md) - HLS streaming and instant playback
351
- - [reference/generative.md](reference/generative.md) - AI-powered media generation (images, video, audio)
352
- - [reference/rtstream.md](reference/rtstream.md) - Live stream ingestion workflow (RTSP/RTMP)
353
- - [reference/rtstream-reference.md](reference/rtstream-reference.md) - RTStream SDK methods and AI pipelines
354
- - [reference/capture.md](reference/capture.md) - Desktop capture workflow
355
- - [reference/capture-reference.md](reference/capture-reference.md) - Capture SDK and WebSocket events
356
- - [reference/use-cases.md](reference/use-cases.md) - Common video processing patterns and examples
357
-
358
- **Do not use ffmpeg, moviepy, or local encoding tools** when VideoDB supports the operation. The following are all handled server-side by VideoDB — trimming, combining clips, overlaying audio or music, adding subtitles, text/image overlays, transcoding, resolution changes, aspect-ratio conversion, resizing for platform requirements, transcription, and media generation. Only fall back to local tools for operations listed under Limitations in reference/editor.md (transitions, speed changes, crop/zoom, colour grading, volume mixing).
359
-
360
- ### When to use what
361
-
362
- | Problem | VideoDB solution |
363
- |---------|-----------------|
364
- | Platform rejects video aspect ratio or resolution | `video.reframe()` or `conn.transcode()` with `VideoConfig` |
365
- | Need to resize video for Twitter/Instagram/TikTok | `video.reframe(target="vertical")` or `target="square"` |
366
- | Need to change resolution (e.g. 1080p → 720p) | `conn.transcode()` with `VideoConfig(resolution=720)` |
367
- | Need to overlay audio/music on video | `AudioAsset` on a `Timeline` |
368
- | Need to add subtitles | `video.add_subtitle()` or `CaptionAsset` |
369
- | Need to combine/trim clips | `VideoAsset` on a `Timeline` |
370
- | Need to generate voiceover, music, or SFX | `coll.generate_voice()`, `generate_music()`, `generate_sound_effect()` |
371
-
372
- ## Provenance
373
-
374
- Reference material for this skill is vendored locally under `skills/videodb/reference/`.
375
- Use the local copies above instead of following external repository links at runtime.
1
+ ---
2
+ name: videodb
3
+ description: See, Understand, Act on video and audio. See- ingest from local files, URLs, RTSP/live feeds, or live record desktop; return realtime context and playable stream links. Understand- extract frames, build visual/semantic/temporal indexes, and search moments with timestamps and auto-clips. Act- transcode and normalize (codec, fps, resolution, aspect ratio), perform timeline edits (subtitles, text/image overlays, branding, audio overlays, dubbing, translation), generate media assets (image, audio, video), and create real time alerts for events from live streams or desktop capture.
4
+ metadata:
5
+ origin: ECC
6
+ allowed-tools: Read Grep Glob Bash(python:*)
7
+ argument-hint: "[task description]"
8
+ ---
9
+
10
+ # VideoDB Skill
11
+
12
+ **Perception + memory + actions for video, live streams, and desktop sessions.**
13
+
14
+ ## When to use
15
+
16
+ ### Desktop Perception
17
+ - Start/stop a **desktop session** capturing **screen, mic, and system audio**
18
+ - Stream **live context** and store **episodic session memory**
19
+ - Run **real-time alerts/triggers** on what's spoken and what's happening on screen
20
+ - Produce **session summaries**, a searchable timeline, and **playable evidence links**
21
+
22
+ ### Video ingest + stream
23
+ - Ingest a **file or URL** and return a **playable web stream link**
24
+ - Transcode/normalize: **codec, bitrate, fps, resolution, aspect ratio**
25
+
26
+ ### Index + search (timestamps + evidence)
27
+ - Build **visual**, **spoken**, and **keyword** indexes
28
+ - Search and return exact moments with **timestamps** and **playable evidence**
29
+ - Auto-create **clips** from search results
30
+
31
+ ### Timeline editing + generation
32
+ - Subtitles: **generate**, **translate**, **burn-in**
33
+ - Overlays: **text/image/branding**, motion captions
34
+ - Audio: **background music**, **voiceover**, **dubbing**
35
+ - Programmatic composition and exports via **timeline operations**
36
+
37
+ ### Live streams (RTSP) + monitoring
38
+ - Connect **RTSP/live feeds**
39
+ - Run **real-time visual and spoken understanding** and emit **events/alerts** for monitoring workflows
40
+
41
+ ## How it works
42
+
43
+ ### Common inputs
44
+ - Local **file path**, public **URL**, or **RTSP URL**
45
+ - Desktop capture request: **start / stop / summarize session**
46
+ - Desired operations: get context for understanding, transcode spec, index spec, search query, clip ranges, timeline edits, alert rules
47
+
48
+ ### Common outputs
49
+ - **Stream URL**
50
+ - Search results with **timestamps** and **evidence links**
51
+ - Generated assets: subtitles, audio, images, clips
52
+ - **Event/alert payloads** for live streams
53
+ - Desktop **session summaries** and memory entries
54
+
55
+ ### Running Python code
56
+
57
+ Before running any VideoDB code, change to the project directory and load environment variables:
58
+
59
+ ```python
60
+ from dotenv import load_dotenv
61
+ load_dotenv(".env")
62
+
63
+ import videodb
64
+ conn = videodb.connect()
65
+ ```
66
+
67
+ This reads `VIDEO_DB_API_KEY` from:
68
+ 1. Environment (if already exported)
69
+ 2. Project's `.env` file in current directory
70
+
71
+ If the key is missing, `videodb.connect()` raises `AuthenticationError` automatically.
72
+
73
+ Do NOT write a script file when a short inline command works.
74
+
75
+ When writing inline Python (`python -c "..."`), always use properly formatted code — use semicolons to separate statements and keep it readable. For anything longer than ~3 statements, use a heredoc instead:
76
+
77
+ ```bash
78
+ python << 'EOF'
79
+ from dotenv import load_dotenv
80
+ load_dotenv(".env")
81
+
82
+ import videodb
83
+ conn = videodb.connect()
84
+ coll = conn.get_collection()
85
+ print(f"Videos: {len(coll.get_videos())}")
86
+ EOF
87
+ ```
88
+
89
+ ### Setup
90
+
91
+ When the user asks to "setup videodb" or similar:
92
+
93
+ ### 1. Install SDK
94
+
95
+ ```bash
96
+ pip install "videodb[capture]" python-dotenv
97
+ ```
98
+
99
+ If `videodb[capture]` fails on Linux, install without the capture extra:
100
+
101
+ ```bash
102
+ pip install videodb python-dotenv
103
+ ```
104
+
105
+ ### 2. Configure API key
106
+
107
+ The user must set `VIDEO_DB_API_KEY` using **either** method:
108
+
109
+ - **Export in terminal** (before starting Claude): `export VIDEO_DB_API_KEY=your-key`
110
+ - **Project `.env` file**: Save `VIDEO_DB_API_KEY=your-key` in the project's `.env` file
111
+
112
+ Get a free API key at [console.videodb.io](https://console.videodb.io) (50 free uploads, no credit card).
113
+
114
+ **Do NOT** read, write, or handle the API key yourself. Always let the user set it.
115
+
116
+ ### Quick Reference
117
+
118
+ ### Upload media
119
+
120
+ ```python
121
+ # URL
122
+ video = coll.upload(url="https://example.com/video.mp4")
123
+
124
+ # YouTube
125
+ video = coll.upload(url="https://www.youtube.com/watch?v=VIDEO_ID")
126
+
127
+ # Local file
128
+ video = coll.upload(file_path="/path/to/video.mp4")
129
+ ```
130
+
131
+ ### Transcript + subtitle
132
+
133
+ ```python
134
+ # force=True skips the error if the video is already indexed
135
+ video.index_spoken_words(force=True)
136
+ text = video.get_transcript_text()
137
+ stream_url = video.add_subtitle()
138
+ ```
139
+
140
+ ### Search inside videos
141
+
142
+ ```python
143
+ from videodb.exceptions import InvalidRequestError
144
+
145
+ video.index_spoken_words(force=True)
146
+
147
+ # search() raises InvalidRequestError when no results are found.
148
+ # Always wrap in try/except and treat "No results found" as empty.
149
+ try:
150
+ results = video.search("product demo")
151
+ shots = results.get_shots()
152
+ stream_url = results.compile()
153
+ except InvalidRequestError as e:
154
+ if "No results found" in str(e):
155
+ shots = []
156
+ else:
157
+ raise
158
+ ```
159
+
160
+ ### Scene search
161
+
162
+ ```python
163
+ import re
164
+ from videodb import SearchType, IndexType, SceneExtractionType
165
+ from videodb.exceptions import InvalidRequestError
166
+
167
+ # index_scenes() has no force parameter — it raises an error if a scene
168
+ # index already exists. Extract the existing index ID from the error.
169
+ try:
170
+ scene_index_id = video.index_scenes(
171
+ extraction_type=SceneExtractionType.shot_based,
172
+ prompt="Describe the visual content in this scene.",
173
+ )
174
+ except Exception as e:
175
+ match = re.search(r"id\s+([a-f0-9]+)", str(e))
176
+ if match:
177
+ scene_index_id = match.group(1)
178
+ else:
179
+ raise
180
+
181
+ # Use score_threshold to filter low-relevance noise (recommended: 0.3+)
182
+ try:
183
+ results = video.search(
184
+ query="person writing on a whiteboard",
185
+ search_type=SearchType.semantic,
186
+ index_type=IndexType.scene,
187
+ scene_index_id=scene_index_id,
188
+ score_threshold=0.3,
189
+ )
190
+ shots = results.get_shots()
191
+ stream_url = results.compile()
192
+ except InvalidRequestError as e:
193
+ if "No results found" in str(e):
194
+ shots = []
195
+ else:
196
+ raise
197
+ ```
198
+
199
+ ### Timeline editing
200
+
201
+ **Important:** Always validate timestamps before building a timeline:
202
+ - `start` must be >= 0 (negative values are silently accepted but produce broken output)
203
+ - `start` must be < `end`
204
+ - `end` must be <= `video.length`
205
+
206
+ ```python
207
+ from videodb.timeline import Timeline
208
+ from videodb.asset import VideoAsset, TextAsset, TextStyle
209
+
210
+ timeline = Timeline(conn)
211
+ timeline.add_inline(VideoAsset(asset_id=video.id, start=10, end=30))
212
+ timeline.add_overlay(0, TextAsset(text="The End", duration=3, style=TextStyle(fontsize=36)))
213
+ stream_url = timeline.generate_stream()
214
+ ```
215
+
216
+ ### Transcode video (resolution / quality change)
217
+
218
+ ```python
219
+ from videodb import TranscodeMode, VideoConfig, AudioConfig
220
+
221
+ # Change resolution, quality, or aspect ratio server-side
222
+ job_id = conn.transcode(
223
+ source="https://example.com/video.mp4",
224
+ callback_url="https://example.com/webhook",
225
+ mode=TranscodeMode.economy,
226
+ video_config=VideoConfig(resolution=720, quality=23, aspect_ratio="16:9"),
227
+ audio_config=AudioConfig(mute=False),
228
+ )
229
+ ```
230
+
231
+ ### Reframe aspect ratio (for social platforms)
232
+
233
+ **Warning:** `reframe()` is a slow server-side operation. For long videos it can take
234
+ several minutes and may time out. Best practices:
235
+ - Always limit to a short segment using `start`/`end` when possible
236
+ - For full-length videos, use `callback_url` for async processing
237
+ - Trim the video on a `Timeline` first, then reframe the shorter result
238
+
239
+ ```python
240
+ from videodb import ReframeMode
241
+
242
+ # Always prefer reframing a short segment:
243
+ reframed = video.reframe(start=0, end=60, target="vertical", mode=ReframeMode.smart)
244
+
245
+ # Async reframe for full-length videos (returns None, result via webhook):
246
+ video.reframe(target="vertical", callback_url="https://example.com/webhook")
247
+
248
+ # Presets: "vertical" (9:16), "square" (1:1), "landscape" (16:9)
249
+ reframed = video.reframe(start=0, end=60, target="square")
250
+
251
+ # Custom dimensions
252
+ reframed = video.reframe(start=0, end=60, target={"width": 1280, "height": 720})
253
+ ```
254
+
255
+ ### Generative media
256
+
257
+ ```python
258
+ image = coll.generate_image(
259
+ prompt="a sunset over mountains",
260
+ aspect_ratio="16:9",
261
+ )
262
+ ```
263
+
264
+ ## Error handling
265
+
266
+ ```python
267
+ from videodb.exceptions import AuthenticationError, InvalidRequestError
268
+
269
+ try:
270
+ conn = videodb.connect()
271
+ except AuthenticationError:
272
+ print("Check your VIDEO_DB_API_KEY")
273
+
274
+ try:
275
+ video = coll.upload(url="https://example.com/video.mp4")
276
+ except InvalidRequestError as e:
277
+ print(f"Upload failed: {e}")
278
+ ```
279
+
280
+ ### Common pitfalls
281
+
282
+ | Scenario | Error message | Solution |
283
+ |----------|--------------|----------|
284
+ | Indexing an already-indexed video | `Spoken word index for video already exists` | Use `video.index_spoken_words(force=True)` to skip if already indexed |
285
+ | Scene index already exists | `Scene index with id XXXX already exists` | Extract the existing `scene_index_id` from the error with `re.search(r"id\s+([a-f0-9]+)", str(e))` |
286
+ | Search finds no matches | `InvalidRequestError: No results found` | Catch the exception and treat as empty results (`shots = []`) |
287
+ | Reframe times out | Blocks indefinitely on long videos | Use `start`/`end` to limit segment, or pass `callback_url` for async |
288
+ | Negative timestamps on Timeline | Silently produces broken stream | Always validate `start >= 0` before creating `VideoAsset` |
289
+ | `generate_video()` / `create_collection()` fails | `Operation not allowed` or `maximum limit` | Plan-gated features — inform the user about plan limits |
290
+
291
+ ## Examples
292
+
293
+ ### Canonical prompts
294
+ - "Start desktop capture and alert when a password field appears."
295
+ - "Record my session and produce an actionable summary when it ends."
296
+ - "Ingest this file and return a playable stream link."
297
+ - "Index this folder and find every scene with people, return timestamps."
298
+ - "Generate subtitles, burn them in, and add light background music."
299
+ - "Connect this RTSP URL and alert when a person enters the zone."
300
+
301
+ ### Screen Recording (Desktop Capture)
302
+
303
+ Use `ws_listener.py` to capture WebSocket events during recording sessions. Desktop capture supports **macOS** only.
304
+
305
+ #### Quick Start
306
+
307
+ 1. **Choose state dir**: `STATE_DIR="${VIDEODB_EVENTS_DIR:-$HOME/.local/state/videodb}"`
308
+ 2. **Start listener**: `VIDEODB_EVENTS_DIR="$STATE_DIR" python scripts/ws_listener.py --clear "$STATE_DIR" &`
309
+ 3. **Get WebSocket ID**: `cat "$STATE_DIR/videodb_ws_id"`
310
+ 4. **Run capture code** (see reference/capture.md for the full workflow)
311
+ 5. **Events written to**: `$STATE_DIR/videodb_events.jsonl`
312
+
313
+ Use `--clear` whenever you start a fresh capture run so stale transcript and visual events do not leak into the new session.
314
+
315
+ #### Query Events
316
+
317
+ ```python
318
+ import json
319
+ import os
320
+ import time
321
+ from pathlib import Path
322
+
323
+ events_dir = Path(os.environ.get("VIDEODB_EVENTS_DIR", Path.home() / ".local" / "state" / "videodb"))
324
+ events_file = events_dir / "videodb_events.jsonl"
325
+ events = []
326
+
327
+ if events_file.exists():
328
+ with events_file.open(encoding="utf-8") as handle:
329
+ for line in handle:
330
+ try:
331
+ events.append(json.loads(line))
332
+ except json.JSONDecodeError:
333
+ continue
334
+
335
+ transcripts = [e["data"]["text"] for e in events if e.get("channel") == "transcript"]
336
+ cutoff = time.time() - 300
337
+ recent_visual = [
338
+ e for e in events
339
+ if e.get("channel") == "visual_index" and e["unix_ts"] > cutoff
340
+ ]
341
+ ```
342
+
343
+ ## Additional docs
344
+
345
+ Reference documentation is in the `reference/` directory adjacent to this SKILL.md file. Use the Glob tool to locate it if needed.
346
+
347
+ - [reference/api-reference.md](reference/api-reference.md) - Complete VideoDB Python SDK API reference
348
+ - [reference/search.md](reference/search.md) - In-depth guide to video search (spoken word and scene-based)
349
+ - [reference/editor.md](reference/editor.md) - Timeline editing, assets, and composition
350
+ - [reference/streaming.md](reference/streaming.md) - HLS streaming and instant playback
351
+ - [reference/generative.md](reference/generative.md) - AI-powered media generation (images, video, audio)
352
+ - [reference/rtstream.md](reference/rtstream.md) - Live stream ingestion workflow (RTSP/RTMP)
353
+ - [reference/rtstream-reference.md](reference/rtstream-reference.md) - RTStream SDK methods and AI pipelines
354
+ - [reference/capture.md](reference/capture.md) - Desktop capture workflow
355
+ - [reference/capture-reference.md](reference/capture-reference.md) - Capture SDK and WebSocket events
356
+ - [reference/use-cases.md](reference/use-cases.md) - Common video processing patterns and examples
357
+
358
+ **Do not use ffmpeg, moviepy, or local encoding tools** when VideoDB supports the operation. The following are all handled server-side by VideoDB — trimming, combining clips, overlaying audio or music, adding subtitles, text/image overlays, transcoding, resolution changes, aspect-ratio conversion, resizing for platform requirements, transcription, and media generation. Only fall back to local tools for operations listed under Limitations in reference/editor.md (transitions, speed changes, crop/zoom, colour grading, volume mixing).
359
+
360
+ ### When to use what
361
+
362
+ | Problem | VideoDB solution |
363
+ |---------|-----------------|
364
+ | Platform rejects video aspect ratio or resolution | `video.reframe()` or `conn.transcode()` with `VideoConfig` |
365
+ | Need to resize video for Twitter/Instagram/TikTok | `video.reframe(target="vertical")` or `target="square"` |
366
+ | Need to change resolution (e.g. 1080p → 720p) | `conn.transcode()` with `VideoConfig(resolution=720)` |
367
+ | Need to overlay audio/music on video | `AudioAsset` on a `Timeline` |
368
+ | Need to add subtitles | `video.add_subtitle()` or `CaptionAsset` |
369
+ | Need to combine/trim clips | `VideoAsset` on a `Timeline` |
370
+ | Need to generate voiceover, music, or SFX | `coll.generate_voice()`, `generate_music()`, `generate_sound_effect()` |
371
+
372
+ ## Provenance
373
+
374
+ Reference material for this skill is vendored locally under `skills/videodb/reference/`.
375
+ Use the local copies above instead of following external repository links at runtime.