codeply-cli 0.5.0 → 0.5.2

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (387) hide show
  1. package/LICENSE +21 -0
  2. package/THIRD_PARTY_NOTICES.md +65 -63
  3. package/bin/codeply.js +1 -1
  4. package/lib/agent.mjs +133 -24
  5. package/lib/ai.js +268 -9
  6. package/lib/ai.mjs +6 -6
  7. package/lib/apply-patch.js +217 -217
  8. package/lib/arity-table.json +138 -138
  9. package/lib/arity.js +70 -70
  10. package/lib/auth.mjs +6 -6
  11. package/lib/bots.js +493 -16
  12. package/lib/chatgpt.js +282 -0
  13. package/lib/cloud-browser.mjs +143 -143
  14. package/lib/cloud.mjs +1186 -1105
  15. package/lib/commands.js +103 -103
  16. package/lib/config.js +83 -3
  17. package/lib/design-library/assemble-artifact.mjs +21 -21
  18. package/lib/design-library/cleanup.mjs +45 -45
  19. package/lib/design-library/index.json +22379 -22379
  20. package/lib/design-library/make-table-data.mjs +39 -39
  21. package/lib/diagnostics.js +192 -192
  22. package/lib/edit-engine.js +364 -364
  23. package/lib/github-agent.mjs +311 -311
  24. package/lib/history.js +75 -75
  25. package/lib/mail-watch.js +504 -0
  26. package/lib/mcp.js +258 -258
  27. package/lib/model-sync.js +114 -0
  28. package/lib/native-tools.mjs +16 -1
  29. package/lib/oauth-connectors.js +146 -24
  30. package/lib/permissions.js +109 -109
  31. package/lib/plugins.js +353 -353
  32. package/lib/publish.js +916 -0
  33. package/lib/reach.js +67 -0
  34. package/lib/server.mjs +457 -457
  35. package/lib/session-db.js +220 -220
  36. package/lib/share.js +168 -168
  37. package/lib/skills.js +2 -0
  38. package/lib/snapshot.js +146 -146
  39. package/lib/telemetry.js +102 -0
  40. package/lib/terminal-hints.js +154 -154
  41. package/lib/tools.mjs +316 -14
  42. package/lib/typecheck-worker.js +147 -147
  43. package/lib/web-tools.js +209 -158
  44. package/package.json +49 -49
  45. package/skills/SOURCE.md +58 -58
  46. package/skills/accessibility/SKILL.md +147 -147
  47. package/skills/agent-architecture-audit/SKILL.md +257 -257
  48. package/skills/agent-eval/SKILL.md +147 -147
  49. package/skills/agent-harness-construction/SKILL.md +74 -74
  50. package/skills/agent-introspection-debugging/SKILL.md +154 -154
  51. package/skills/agent-payment-x402/SKILL.md +225 -225
  52. package/skills/agent-self-evaluation/SKILL.md +182 -182
  53. package/skills/agent-self-evaluation/references/evaluation-criteria.md +71 -71
  54. package/skills/agent-self-evaluation/references/hook-integration.md +64 -64
  55. package/skills/agent-sort/SKILL.md +216 -216
  56. package/skills/agentic-engineering/SKILL.md +64 -64
  57. package/skills/agentic-os/SKILL.md +388 -388
  58. package/skills/ai-first-engineering/SKILL.md +52 -52
  59. package/skills/ai-regression-testing/SKILL.md +386 -386
  60. package/skills/android-clean-architecture/SKILL.md +340 -340
  61. package/skills/angular-developer/SKILL.md +155 -155
  62. package/skills/angular-developer/references/angular-animations.md +160 -160
  63. package/skills/angular-developer/references/angular-aria.md +410 -410
  64. package/skills/angular-developer/references/cli.md +86 -86
  65. package/skills/angular-developer/references/component-harnesses.md +59 -59
  66. package/skills/angular-developer/references/component-styling.md +91 -91
  67. package/skills/angular-developer/references/components.md +117 -117
  68. package/skills/angular-developer/references/creating-services.md +97 -97
  69. package/skills/angular-developer/references/data-resolvers.md +69 -69
  70. package/skills/angular-developer/references/define-routes.md +67 -67
  71. package/skills/angular-developer/references/defining-providers.md +72 -72
  72. package/skills/angular-developer/references/di-fundamentals.md +120 -120
  73. package/skills/angular-developer/references/e2e-testing.md +56 -56
  74. package/skills/angular-developer/references/effects.md +83 -83
  75. package/skills/angular-developer/references/hierarchical-injectors.md +43 -43
  76. package/skills/angular-developer/references/host-elements.md +80 -80
  77. package/skills/angular-developer/references/injection-context.md +63 -63
  78. package/skills/angular-developer/references/inputs.md +101 -101
  79. package/skills/angular-developer/references/linked-signal.md +59 -59
  80. package/skills/angular-developer/references/loading-strategies.md +61 -61
  81. package/skills/angular-developer/references/mcp.md +108 -108
  82. package/skills/angular-developer/references/navigate-to-routes.md +69 -69
  83. package/skills/angular-developer/references/outputs.md +86 -86
  84. package/skills/angular-developer/references/reactive-forms.md +122 -122
  85. package/skills/angular-developer/references/rendering-strategies.md +44 -44
  86. package/skills/angular-developer/references/resource.md +77 -77
  87. package/skills/angular-developer/references/route-animations.md +56 -56
  88. package/skills/angular-developer/references/route-guards.md +52 -52
  89. package/skills/angular-developer/references/router-lifecycle.md +45 -45
  90. package/skills/angular-developer/references/router-testing.md +87 -87
  91. package/skills/angular-developer/references/show-routes-with-outlets.md +68 -68
  92. package/skills/angular-developer/references/signal-forms.md +795 -795
  93. package/skills/angular-developer/references/signals-overview.md +94 -94
  94. package/skills/angular-developer/references/tailwind-css.md +69 -69
  95. package/skills/angular-developer/references/template-driven-forms.md +114 -114
  96. package/skills/angular-developer/references/testing-fundamentals.md +65 -65
  97. package/skills/api-connector-builder/SKILL.md +121 -121
  98. package/skills/api-design/SKILL.md +524 -524
  99. package/skills/architecture-decision-records/SKILL.md +180 -180
  100. package/skills/article-writing/SKILL.md +80 -80
  101. package/skills/automation-audit-ops/SKILL.md +143 -143
  102. package/skills/autonomous-agent-harness/SKILL.md +274 -274
  103. package/skills/autonomous-loops/SKILL.md +611 -611
  104. package/skills/backend-patterns/SKILL.md +562 -562
  105. package/skills/benchmark/SKILL.md +95 -95
  106. package/skills/benchmark-methodology/SKILL.md +191 -191
  107. package/skills/benchmark-optimization-loop/SKILL.md +71 -71
  108. package/skills/blender-motion-state-inspection/SKILL.md +165 -165
  109. package/skills/blueprint/SKILL.md +106 -106
  110. package/skills/brand-discovery/SKILL.md +145 -145
  111. package/skills/brand-discovery/references/10_purpose-why.md +40 -40
  112. package/skills/brand-discovery/references/20_positioning.md +44 -44
  113. package/skills/brand-discovery/references/30_audience-niche.md +52 -52
  114. package/skills/brand-discovery/references/40_personality-archetype.md +57 -57
  115. package/skills/brand-discovery/references/50_voice-tone.md +59 -59
  116. package/skills/brand-discovery/references/60_narrative-story.md +50 -50
  117. package/skills/brand-discovery/references/70_founder-tension.md +49 -49
  118. package/skills/brand-discovery/references/90_SYNTHESIS.md +133 -133
  119. package/skills/brand-voice/SKILL.md +98 -98
  120. package/skills/brand-voice/references/voice-profile-schema.md +55 -55
  121. package/skills/browser-qa/SKILL.md +105 -105
  122. package/skills/bun-runtime/SKILL.md +85 -85
  123. package/skills/canary-watch/SKILL.md +108 -108
  124. package/skills/carrier-relationship-management/SKILL.md +212 -212
  125. package/skills/cisco-ios-patterns/SKILL.md +164 -164
  126. package/skills/ck/SKILL.md +148 -148
  127. package/skills/claude-devfleet/SKILL.md +112 -112
  128. package/skills/click-path-audit/SKILL.md +245 -245
  129. package/skills/clickhouse-io/SKILL.md +445 -445
  130. package/skills/code-tour/SKILL.md +254 -254
  131. package/skills/codebase-onboarding/SKILL.md +234 -234
  132. package/skills/codehealth-mcp/SKILL.md +167 -167
  133. package/skills/coding-standards/SKILL.md +551 -551
  134. package/skills/competitive-platform-analysis/SKILL.md +214 -214
  135. package/skills/competitive-report-structure/SKILL.md +162 -162
  136. package/skills/compose-multiplatform-patterns/SKILL.md +300 -300
  137. package/skills/config-gc/SKILL.md +120 -120
  138. package/skills/configure-ecc/SKILL.md +385 -385
  139. package/skills/connections-optimizer/SKILL.md +190 -190
  140. package/skills/content-engine/SKILL.md +132 -132
  141. package/skills/content-hash-cache-pattern/SKILL.md +162 -162
  142. package/skills/context-budget/SKILL.md +136 -136
  143. package/skills/continuous-agent-loop/SKILL.md +46 -46
  144. package/skills/continuous-learning/SKILL.md +132 -132
  145. package/skills/continuous-learning-v2/SKILL.md +361 -361
  146. package/skills/contract-first/SKILL.md +287 -287
  147. package/skills/cost-aware-llm-pipeline/SKILL.md +184 -184
  148. package/skills/cost-tracking/SKILL.md +97 -97
  149. package/skills/council/SKILL.md +204 -204
  150. package/skills/cpp-coding-standards/SKILL.md +724 -724
  151. package/skills/cpp-testing/SKILL.md +325 -325
  152. package/skills/crosspost/SKILL.md +112 -112
  153. package/skills/csharp-testing/SKILL.md +322 -322
  154. package/skills/customer-billing-ops/SKILL.md +141 -141
  155. package/skills/customs-trade-compliance/SKILL.md +263 -263
  156. package/skills/dart-flutter-patterns/SKILL.md +564 -564
  157. package/skills/dashboard-builder/SKILL.md +109 -109
  158. package/skills/data-scraper-agent/SKILL.md +765 -765
  159. package/skills/data-throughput-accelerator/SKILL.md +74 -74
  160. package/skills/database-migrations/SKILL.md +430 -430
  161. package/skills/deep-research/SKILL.md +160 -160
  162. package/skills/defi-amm-security/SKILL.md +167 -167
  163. package/skills/delivery-gate/SKILL.md +126 -126
  164. package/skills/deployment-patterns/SKILL.md +428 -428
  165. package/skills/design-system/SKILL.md +83 -83
  166. package/skills/django-celery/SKILL.md +458 -458
  167. package/skills/django-patterns/SKILL.md +735 -735
  168. package/skills/django-security/SKILL.md +644 -644
  169. package/skills/django-tdd/SKILL.md +730 -730
  170. package/skills/django-verification/SKILL.md +470 -470
  171. package/skills/dmux-workflows/SKILL.md +192 -192
  172. package/skills/docker-patterns/SKILL.md +365 -365
  173. package/skills/documentation-lookup/SKILL.md +91 -91
  174. package/skills/dotnet-patterns/SKILL.md +322 -322
  175. package/skills/dynamic-workflow-mode/SKILL.md +124 -124
  176. package/skills/e2e-testing/SKILL.md +327 -327
  177. package/skills/ecc-guide/SKILL.md +190 -190
  178. package/skills/ecc-recipes/SKILL.md +149 -149
  179. package/skills/ecc-tools-cost-audit/SKILL.md +161 -161
  180. package/skills/email-ops/SKILL.md +122 -122
  181. package/skills/energy-procurement/SKILL.md +228 -228
  182. package/skills/enterprise-agent-ops/SKILL.md +51 -51
  183. package/skills/error-handling/SKILL.md +377 -377
  184. package/skills/eval-harness/SKILL.md +271 -271
  185. package/skills/evm-token-decimals/SKILL.md +131 -131
  186. package/skills/exa-search/SKILL.md +108 -108
  187. package/skills/fal-ai-media/SKILL.md +289 -289
  188. package/skills/fastapi-patterns/SKILL.md +514 -514
  189. package/skills/finance-billing-ops/SKILL.md +128 -128
  190. package/skills/flox-environments/SKILL.md +497 -497
  191. package/skills/flutter-dart-code-review/SKILL.md +436 -436
  192. package/skills/foundation-models-on-device/SKILL.md +243 -243
  193. package/skills/frontend-a11y/SKILL.md +446 -446
  194. package/skills/frontend-design-direction/SKILL.md +93 -93
  195. package/skills/frontend-patterns/SKILL.md +657 -657
  196. package/skills/frontend-slides/SKILL.md +185 -185
  197. package/skills/fsharp-testing/SKILL.md +281 -281
  198. package/skills/gan-style-harness/SKILL.md +279 -279
  199. package/skills/gateguard/SKILL.md +133 -133
  200. package/skills/generating-python-installer/SKILL.md +820 -820
  201. package/skills/git-workflow/SKILL.md +716 -716
  202. package/skills/github-ops/SKILL.md +145 -145
  203. package/skills/golang-patterns/SKILL.md +676 -676
  204. package/skills/golang-testing/SKILL.md +721 -721
  205. package/skills/google-workspace-ops/SKILL.md +96 -96
  206. package/skills/growth-log/SKILL.md +128 -128
  207. package/skills/healthcare-cdss-patterns/SKILL.md +246 -246
  208. package/skills/healthcare-emr-patterns/SKILL.md +160 -160
  209. package/skills/healthcare-eval-harness/SKILL.md +208 -208
  210. package/skills/healthcare-phi-compliance/SKILL.md +146 -146
  211. package/skills/hermes-imports/SKILL.md +89 -89
  212. package/skills/hexagonal-architecture/SKILL.md +277 -277
  213. package/skills/hipaa-compliance/SKILL.md +79 -79
  214. package/skills/homelab-network-readiness/SKILL.md +170 -170
  215. package/skills/homelab-network-setup/SKILL.md +130 -130
  216. package/skills/homelab-pihole-dns/SKILL.md +275 -275
  217. package/skills/homelab-vlan-segmentation/SKILL.md +312 -312
  218. package/skills/homelab-wireguard-vpn/SKILL.md +306 -306
  219. package/skills/hookify-rules/SKILL.md +128 -128
  220. package/skills/inherit-legacy-style/SKILL.md +157 -157
  221. package/skills/intent-driven-development/SKILL.md +360 -360
  222. package/skills/inventory-demand-planning/SKILL.md +247 -247
  223. package/skills/investor-materials/SKILL.md +97 -97
  224. package/skills/investor-outreach/SKILL.md +92 -92
  225. package/skills/ios-icon-gen/SKILL.md +158 -158
  226. package/skills/iterative-retrieval/SKILL.md +212 -212
  227. package/skills/ito-basket-compare/SKILL.md +64 -64
  228. package/skills/ito-compute/SKILL.md +129 -129
  229. package/skills/ito-data-atlas-agent/SKILL.md +64 -64
  230. package/skills/ito-market-intelligence/SKILL.md +61 -61
  231. package/skills/ito-trade-planner/SKILL.md +68 -68
  232. package/skills/java-coding-standards/SKILL.md +384 -384
  233. package/skills/jira-integration/SKILL.md +303 -303
  234. package/skills/jpa-patterns/SKILL.md +152 -152
  235. package/skills/knowledge-ops/SKILL.md +155 -155
  236. package/skills/kotlin-coroutines-flows/SKILL.md +285 -285
  237. package/skills/kotlin-exposed-patterns/SKILL.md +720 -720
  238. package/skills/kotlin-ktor-patterns/SKILL.md +690 -690
  239. package/skills/kotlin-patterns/SKILL.md +712 -712
  240. package/skills/kotlin-testing/SKILL.md +825 -825
  241. package/skills/kubernetes-patterns/SKILL.md +756 -756
  242. package/skills/laravel-patterns/SKILL.md +416 -416
  243. package/skills/laravel-plugin-discovery/SKILL.md +230 -230
  244. package/skills/laravel-security/SKILL.md +948 -948
  245. package/skills/laravel-tdd/SKILL.md +675 -675
  246. package/skills/laravel-verification/SKILL.md +180 -180
  247. package/skills/latency-critical-systems/SKILL.md +75 -75
  248. package/skills/lead-intelligence/SKILL.md +322 -322
  249. package/skills/liquid-glass-design/SKILL.md +279 -279
  250. package/skills/llm-trading-agent-security/SKILL.md +147 -147
  251. package/skills/logistics-exception-management/SKILL.md +222 -222
  252. package/skills/loop-design-check/SKILL.md +143 -143
  253. package/skills/mailtrap-email-integration/SKILL.md +77 -77
  254. package/skills/make-interfaces-feel-better/SKILL.md +152 -152
  255. package/skills/manim-video/SKILL.md +90 -90
  256. package/skills/market-research/SKILL.md +76 -76
  257. package/skills/marketing-campaign/SKILL.md +114 -114
  258. package/skills/mcp-server-patterns/SKILL.md +70 -70
  259. package/skills/messages-ops/SKILL.md +105 -105
  260. package/skills/ml-adoption-playbook/SKILL.md +57 -57
  261. package/skills/mle-workflow/SKILL.md +348 -348
  262. package/skills/motion-advanced/SKILL.md +596 -596
  263. package/skills/motion-foundations/SKILL.md +299 -299
  264. package/skills/motion-patterns/SKILL.md +434 -434
  265. package/skills/motion-ui/SKILL.md +576 -576
  266. package/skills/mysql-patterns/SKILL.md +413 -413
  267. package/skills/nanoclaw-repl/SKILL.md +34 -34
  268. package/skills/nestjs-patterns/SKILL.md +231 -231
  269. package/skills/netmiko-ssh-automation/SKILL.md +174 -174
  270. package/skills/network-bgp-diagnostics/SKILL.md +168 -168
  271. package/skills/network-config-validation/SKILL.md +211 -211
  272. package/skills/network-interface-health/SKILL.md +153 -153
  273. package/skills/nextjs-turbopack/SKILL.md +58 -58
  274. package/skills/nodejs-keccak256/SKILL.md +103 -103
  275. package/skills/nutrient-document-processing/SKILL.md +168 -168
  276. package/skills/nuxt4-patterns/SKILL.md +101 -101
  277. package/skills/openclaw-persona-forge/SKILL.md +289 -289
  278. package/skills/openclaw-persona-forge/references/avatar-style.md +124 -124
  279. package/skills/openclaw-persona-forge/references/boundary-rules.md +53 -53
  280. package/skills/openclaw-persona-forge/references/error-handling.md +53 -53
  281. package/skills/openclaw-persona-forge/references/identity-tension.md +48 -48
  282. package/skills/openclaw-persona-forge/references/naming-system.md +39 -39
  283. package/skills/openclaw-persona-forge/references/output-template.md +166 -166
  284. package/skills/opensource-pipeline/SKILL.md +256 -256
  285. package/skills/orch-add-feature/SKILL.md +45 -45
  286. package/skills/orch-build-mvp/SKILL.md +49 -49
  287. package/skills/orch-change-feature/SKILL.md +43 -43
  288. package/skills/orch-fix-defect/SKILL.md +43 -43
  289. package/skills/orch-pipeline/SKILL.md +121 -121
  290. package/skills/orch-refine-code/SKILL.md +44 -44
  291. package/skills/parallel-execution-optimizer/SKILL.md +74 -74
  292. package/skills/perl-patterns/SKILL.md +505 -505
  293. package/skills/perl-security/SKILL.md +504 -504
  294. package/skills/perl-testing/SKILL.md +476 -476
  295. package/skills/plan-canvas/SKILL.md +153 -153
  296. package/skills/plan-orchestrate/SKILL.md +263 -263
  297. package/skills/plankton-code-quality/SKILL.md +237 -237
  298. package/skills/postgres-patterns/SKILL.md +148 -148
  299. package/skills/prediction-market-oracle-research/SKILL.md +64 -64
  300. package/skills/prediction-market-risk-review/SKILL.md +61 -61
  301. package/skills/premium-web-design/SKILL.md +154 -154
  302. package/skills/prisma-patterns/SKILL.md +401 -401
  303. package/skills/product-capability/SKILL.md +142 -142
  304. package/skills/product-lens/SKILL.md +93 -93
  305. package/skills/production-audit/SKILL.md +207 -207
  306. package/skills/production-scheduling/SKILL.md +238 -238
  307. package/skills/project-flow-ops/SKILL.md +112 -112
  308. package/skills/prompt-optimizer/SKILL.md +398 -398
  309. package/skills/publish-website/SKILL.md +76 -0
  310. package/skills/python-patterns/SKILL.md +751 -751
  311. package/skills/python-testing/SKILL.md +817 -817
  312. package/skills/pytorch-patterns/SKILL.md +397 -397
  313. package/skills/quality-nonconformance/SKILL.md +260 -260
  314. package/skills/quarkus-patterns/SKILL.md +723 -723
  315. package/skills/quarkus-security/SKILL.md +468 -468
  316. package/skills/quarkus-tdd/SKILL.md +812 -812
  317. package/skills/quarkus-verification/SKILL.md +480 -480
  318. package/skills/ralphinho-rfc-pipeline/SKILL.md +68 -68
  319. package/skills/react-native-patterns/SKILL.md +326 -326
  320. package/skills/react-patterns/SKILL.md +342 -342
  321. package/skills/react-performance/SKILL.md +575 -575
  322. package/skills/react-testing/SKILL.md +424 -424
  323. package/skills/recsys-pipeline-architect/SKILL.md +115 -115
  324. package/skills/recursive-decision-ledger/SKILL.md +81 -81
  325. package/skills/redis-patterns/SKILL.md +404 -404
  326. package/skills/regex-vs-llm-structured-text/SKILL.md +221 -221
  327. package/skills/remotion-video-creation/SKILL.md +43 -43
  328. package/skills/repo-scan/SKILL.md +79 -79
  329. package/skills/research-ops/SKILL.md +113 -113
  330. package/skills/returns-reverse-logistics/SKILL.md +240 -240
  331. package/skills/rules-distill/SKILL.md +265 -265
  332. package/skills/rust-patterns/SKILL.md +500 -500
  333. package/skills/rust-testing/SKILL.md +501 -501
  334. package/skills/safety-guard/SKILL.md +76 -76
  335. package/skills/santa-method/SKILL.md +307 -307
  336. package/skills/scientific-db-pubmed-database/SKILL.md +176 -176
  337. package/skills/scientific-db-uspto-database/SKILL.md +178 -178
  338. package/skills/scientific-pkg-gget/SKILL.md +167 -167
  339. package/skills/scientific-thinking-literature-review/SKILL.md +193 -193
  340. package/skills/scientific-thinking-scholar-evaluation/SKILL.md +161 -161
  341. package/skills/search-first/SKILL.md +183 -183
  342. package/skills/security-bounty-hunter/SKILL.md +100 -100
  343. package/skills/security-review/SKILL.md +504 -504
  344. package/skills/security-scan/SKILL.md +166 -166
  345. package/skills/seo/SKILL.md +155 -155
  346. package/skills/skill-comply/SKILL.md +59 -59
  347. package/skills/skill-scout/SKILL.md +141 -141
  348. package/skills/skill-stocktake/SKILL.md +195 -195
  349. package/skills/social-graph-ranker/SKILL.md +155 -155
  350. package/skills/social-publisher/SKILL.md +130 -130
  351. package/skills/springboot-patterns/SKILL.md +315 -315
  352. package/skills/springboot-security/SKILL.md +273 -273
  353. package/skills/springboot-tdd/SKILL.md +159 -159
  354. package/skills/springboot-verification/SKILL.md +232 -232
  355. package/skills/strategic-compact/SKILL.md +142 -142
  356. package/skills/swift-actor-persistence/SKILL.md +144 -144
  357. package/skills/swift-concurrency-6-2/SKILL.md +216 -216
  358. package/skills/swift-protocol-di-testing/SKILL.md +191 -191
  359. package/skills/swiftui-patterns/SKILL.md +259 -259
  360. package/skills/taste/SKILL.md +264 -264
  361. package/skills/taste/references/genre-taxonomy.md +87 -87
  362. package/skills/tdd-workflow/SKILL.md +583 -583
  363. package/skills/team-agent-orchestration/SKILL.md +111 -111
  364. package/skills/team-builder/SKILL.md +169 -169
  365. package/skills/terminal-ops/SKILL.md +110 -110
  366. package/skills/tinystruct-patterns/SKILL.md +279 -279
  367. package/skills/tinystruct-patterns/references/architecture.md +90 -90
  368. package/skills/tinystruct-patterns/references/data-handling.md +60 -60
  369. package/skills/tinystruct-patterns/references/database.md +99 -99
  370. package/skills/tinystruct-patterns/references/routing.md +64 -64
  371. package/skills/tinystruct-patterns/references/system-usage.md +97 -97
  372. package/skills/tinystruct-patterns/references/testing.md +72 -72
  373. package/skills/token-budget-advisor/SKILL.md +134 -134
  374. package/skills/ui-demo/SKILL.md +466 -466
  375. package/skills/ui-to-vue/SKILL.md +135 -135
  376. package/skills/uncloud/SKILL.md +344 -344
  377. package/skills/unified-memory/SKILL.md +170 -170
  378. package/skills/unified-notifications-ops/SKILL.md +188 -188
  379. package/skills/verification-loop/SKILL.md +129 -129
  380. package/skills/video-editing/SKILL.md +311 -311
  381. package/skills/videodb/SKILL.md +375 -375
  382. package/skills/visa-doc-translate/SKILL.md +117 -117
  383. package/skills/vite-patterns/SKILL.md +450 -450
  384. package/skills/vue-patterns/SKILL.md +471 -471
  385. package/skills/windows-desktop-e2e/SKILL.md +888 -888
  386. package/skills/workspace-surface-audit/SKILL.md +126 -126
  387. package/skills/x-api/SKILL.md +235 -235
@@ -1,404 +1,404 @@
1
- ---
2
- name: redis-patterns
3
- description: Redis data structure patterns, caching strategies, distributed locks, rate limiting, pub/sub, and connection management for production applications.
4
- metadata:
5
- origin: ECC
6
- ---
7
-
8
- # Redis Patterns
9
-
10
- Quick reference for Redis best practices across common backend use cases.
11
-
12
- ## How It Works
13
-
14
- Redis is an in-memory data structure store that supports strings, hashes, lists, sets, sorted sets, streams, and more. Individual Redis commands are atomic on a single instance; multi-step workflows require Lua scripts, MULTI/EXEC transactions, or explicit synchronization to stay atomic. Data is optionally persisted via RDB snapshots or AOF logs. Clients communicate over TCP using the RESP protocol; connection pools are essential to avoid per-request handshake overhead.
15
-
16
- ## When to Activate
17
-
18
- - Adding caching to an application
19
- - Implementing rate limiting or throttling
20
- - Building distributed locks or coordination
21
- - Setting up session or token storage
22
- - Using Pub/Sub or Redis Streams for messaging
23
- - Configuring Redis in production (pooling, eviction, clustering)
24
-
25
- ## Data Structure Cheat Sheet
26
-
27
- | Use Case | Structure | Example Key |
28
- |----------|-----------|-------------|
29
- | Simple cache | String | `product:123` |
30
- | User session | Hash | `session:abc` |
31
- | Leaderboard | Sorted Set | `scores:weekly` |
32
- | Unique visitors | Set | `visitors:2024-01-01` |
33
- | Activity feed | List | `feed:user:456` |
34
- | Event stream | Stream | `events:orders` |
35
- | Counters / rate limits | String (INCR) | `ratelimit:user:123` |
36
- | Bloom filter / HLL | HyperLogLog | `hll:pageviews` |
37
-
38
- ## Core Patterns
39
-
40
- ### Cache-Aside (Lazy Loading)
41
-
42
- ```python
43
- import redis
44
- import json
45
-
46
- r = redis.Redis(host='localhost', port=6379, decode_responses=True)
47
-
48
- def get_product(product_id: int):
49
- cache_key = f"product:{product_id}"
50
- cached = r.get(cache_key)
51
-
52
- if cached:
53
- return json.loads(cached)
54
-
55
- product = db.query("SELECT * FROM products WHERE id = %s", product_id)
56
- r.setex(cache_key, 3600, json.dumps(product)) # TTL: 1 hour
57
- return product
58
- ```
59
-
60
- ### Write-Through Cache
61
-
62
- ```python
63
- def update_product(product_id: int, data: dict):
64
- # Write to DB first
65
- db.execute("UPDATE products SET ... WHERE id = %s", product_id)
66
-
67
- # Immediately update cache
68
- cache_key = f"product:{product_id}"
69
- r.setex(cache_key, 3600, json.dumps(data))
70
- ```
71
-
72
- ### Cache Invalidation
73
-
74
- ```python
75
- # Tag-based invalidation — group related keys under a set
76
- def cache_product(product_id: int, category_id: int, data: dict):
77
- key = f"product:{product_id}"
78
- tag = f"tag:category:{category_id}"
79
- pipe = r.pipeline(transaction=True)
80
- pipe.setex(key, 3600, json.dumps(data))
81
- pipe.sadd(tag, key)
82
- pipe.expire(tag, 3600)
83
- pipe.execute()
84
-
85
- def invalidate_category(category_id: int):
86
- tag = f"tag:category:{category_id}"
87
- keys = r.smembers(tag)
88
- if keys:
89
- r.delete(*keys)
90
- r.delete(tag)
91
- ```
92
-
93
- ### Session Storage
94
-
95
- ```python
96
- import time
97
- import uuid
98
-
99
- def create_session(user_id: int, ttl: int = 86400) -> str:
100
- session_id = str(uuid.uuid4())
101
- key = f"session:{session_id}"
102
- pipe = r.pipeline(transaction=True)
103
- pipe.hset(key, mapping={
104
- "user_id": user_id,
105
- "created_at": int(time.time()),
106
- })
107
- pipe.expire(key, ttl)
108
- pipe.execute()
109
- return session_id
110
-
111
- def get_session(session_id: str) -> dict | None:
112
- data = r.hgetall(f"session:{session_id}")
113
- return data if data else None
114
-
115
- def delete_session(session_id: str):
116
- r.delete(f"session:{session_id}")
117
- ```
118
-
119
- ## Rate Limiting
120
-
121
- ### Fixed Window (Simple)
122
-
123
- ```python
124
- def is_rate_limited(user_id: int, limit: int = 100, window: int = 60) -> bool:
125
- key = f"ratelimit:{user_id}:{int(time.time()) // window}"
126
- pipe = r.pipeline(transaction=True)
127
- pipe.incr(key)
128
- pipe.expire(key, window)
129
- count, _ = pipe.execute()
130
- return count > limit
131
- ```
132
-
133
- ### Sliding Window (Lua — Atomic)
134
-
135
- ```lua
136
- -- sliding_window.lua
137
- local key = KEYS[1]
138
- local now = tonumber(ARGV[1])
139
- local window = tonumber(ARGV[2])
140
- local limit = tonumber(ARGV[3])
141
-
142
- redis.call('ZREMRANGEBYSCORE', key, 0, now - window)
143
- local count = redis.call('ZCARD', key)
144
-
145
- if count < limit then
146
- -- Use unique member (now + sequence) to avoid collisions within the same millisecond
147
- local seq_key = key .. ':seq'
148
- local seq = redis.call('INCR', seq_key)
149
- redis.call('EXPIRE', seq_key, math.ceil(window / 1000))
150
- redis.call('ZADD', key, now, now .. '-' .. seq)
151
- redis.call('EXPIRE', key, math.ceil(window / 1000))
152
- return 1
153
- end
154
- return 0
155
- ```
156
-
157
- ```python
158
- sliding_window = r.register_script(open('sliding_window.lua').read())
159
-
160
- def allow_request(user_id: int) -> bool:
161
- key = f"ratelimit:sliding:{user_id}"
162
- now = int(time.time() * 1000)
163
- return bool(sliding_window(keys=[key], args=[now, 60000, 100]))
164
- ```
165
-
166
- ## Distributed Locks
167
-
168
- ### Distributed Lock (Single Node — SET NX PX)
169
-
170
- ```python
171
- import uuid
172
-
173
- def acquire_lock(resource: str, ttl_ms: int = 5000) -> str | None:
174
- lock_key = f"lock:{resource}"
175
- token = str(uuid.uuid4())
176
- acquired = r.set(lock_key, token, px=ttl_ms, nx=True)
177
- return token if acquired else None
178
-
179
- def release_lock(resource: str, token: str) -> bool:
180
- release_script = """
181
- if redis.call('get', KEYS[1]) == ARGV[1] then
182
- return redis.call('del', KEYS[1])
183
- else
184
- return 0
185
- end
186
- """
187
- result = r.eval(release_script, 1, f"lock:{resource}", token)
188
- return bool(result)
189
-
190
- # Usage
191
- token = acquire_lock("order:payment:123")
192
- if token:
193
- try:
194
- process_payment()
195
- finally:
196
- release_lock("order:payment:123", token)
197
- ```
198
-
199
- > For multi-node setups use the `redlock-py` library which implements the full Redlock algorithm.
200
-
201
- ## Pub/Sub & Streams
202
-
203
- ### Pub/Sub (Fire-and-Forget)
204
-
205
- ```python
206
- # Publisher
207
- def publish_event(channel: str, payload: dict):
208
- r.publish(channel, json.dumps(payload))
209
-
210
- # Subscriber (blocking — run in separate thread/process)
211
- def subscribe_events(channel: str):
212
- pubsub = r.pubsub()
213
- pubsub.subscribe(channel)
214
- for message in pubsub.listen():
215
- if message['type'] == 'message':
216
- handle(json.loads(message['data']))
217
- ```
218
-
219
- ### Redis Streams (Durable Queue)
220
-
221
- ```python
222
- # Producer
223
- def emit(stream: str, event: dict):
224
- r.xadd(stream, event, maxlen=10000) # Cap stream length
225
-
226
- # Consumer group — guarantees at-least-once delivery
227
- try:
228
- r.xgroup_create('events:orders', 'processor', id='0', mkstream=True)
229
- except Exception:
230
- pass # Group already exists
231
-
232
- def consume(stream: str, group: str, consumer: str):
233
- while True:
234
- messages = r.xreadgroup(group, consumer, {stream: '>'}, count=10, block=2000)
235
- for _, entries in (messages or []):
236
- for msg_id, data in entries:
237
- process(data)
238
- r.xack(stream, group, msg_id)
239
- ```
240
-
241
- > Prefer **Streams** over Pub/Sub when you need delivery guarantees, consumer groups, or replay.
242
-
243
- ## Key Design
244
-
245
- ### Naming Conventions
246
-
247
- ```
248
- # Pattern: resource:id:field
249
- user:123:profile
250
- order:456:status
251
- cache:product:789
252
-
253
- # Pattern: namespace:resource:id
254
- myapp:session:abc123
255
- myapp:ratelimit:user:123
256
-
257
- # Pattern: resource:date (time-bound keys)
258
- stats:pageviews:2024-01-01
259
- ```
260
-
261
- ### TTL Strategy
262
-
263
- | Data Type | Suggested TTL |
264
- |-----------|--------------|
265
- | User session | 24h (`86400`) |
266
- | API response cache | 5–15 min |
267
- | Rate limit window | Match window size |
268
- | Short-lived tokens | 5–10 min |
269
- | Leaderboard | 1h–24h |
270
- | Static/reference data | 1h–1 week |
271
-
272
- Always set a TTL. Keys without TTL accumulate indefinitely and cause memory pressure.
273
-
274
- ## Connection Management
275
-
276
- ### Connection Pooling
277
-
278
- ```python
279
- from redis import ConnectionPool, Redis
280
-
281
- pool = ConnectionPool(
282
- host='localhost',
283
- port=6379,
284
- db=0,
285
- max_connections=20,
286
- decode_responses=True,
287
- socket_connect_timeout=2,
288
- socket_timeout=2,
289
- )
290
-
291
- r = Redis(connection_pool=pool)
292
- ```
293
-
294
- ### Cluster Mode
295
-
296
- ```python
297
- from redis.cluster import RedisCluster
298
-
299
- r = RedisCluster(
300
- startup_nodes=[{"host": "redis-1", "port": 6379}],
301
- decode_responses=True,
302
- skip_full_coverage_check=True,
303
- )
304
- ```
305
-
306
- ### Sentinel (High Availability)
307
-
308
- ```python
309
- from redis.sentinel import Sentinel
310
-
311
- sentinel = Sentinel(
312
- [('sentinel-1', 26379), ('sentinel-2', 26379)],
313
- socket_timeout=0.5,
314
- )
315
- master = sentinel.master_for('mymaster', decode_responses=True)
316
- replica = sentinel.slave_for('mymaster', decode_responses=True)
317
- ```
318
-
319
- ## Eviction Policies
320
-
321
- | Policy | Behavior | Best For |
322
- |--------|----------|----------|
323
- | `noeviction` | Error on write when full | Queues / critical data |
324
- | `allkeys-lru` | Evict least recently used | General cache |
325
- | `volatile-lru` | LRU only among keys with TTL | Mixed data store |
326
- | `allkeys-lfu` | Evict least frequently used | Skewed access patterns |
327
- | `volatile-ttl` | Evict soonest-to-expire | Prioritize long-lived data |
328
-
329
- Set via `redis.conf`: `maxmemory-policy allkeys-lru`
330
-
331
- ## Anti-Patterns
332
-
333
- | Anti-Pattern | Problem | Fix |
334
- |---|---|---|
335
- | Keys with no TTL | Memory grows unbounded | Always set TTL |
336
- | `KEYS *` in production | Blocks the server (O(N)) | Use `SCAN` cursor |
337
- | Storing large blobs (>100KB) | Slow serialization, memory pressure | Store reference + fetch from object store |
338
- | Single Redis for everything | No isolation between cache & queue | Use separate DBs or instances |
339
- | Ignoring connection pool limits | Connection exhaustion under load | Size pool to workload |
340
- | Not handling cache miss stampede | Thundering herd on cold start | Use locks or probabilistic early expiry |
341
- | `FLUSHALL` without thought | Wipes entire instance | Scope deletes by key pattern |
342
-
343
- ### Cache Miss Stampede Prevention
344
-
345
- ```python
346
- import threading
347
-
348
- _locks: dict[str, threading.Lock] = {}
349
- _locks_mutex = threading.Lock()
350
-
351
- def get_with_lock(key: str, fetch_fn, ttl: int = 300):
352
- cached = r.get(key)
353
- if cached:
354
- return json.loads(cached)
355
-
356
- with _locks_mutex:
357
- if key not in _locks:
358
- _locks[key] = threading.Lock()
359
- lock = _locks[key]
360
- with lock:
361
- cached = r.get(key) # Re-check after acquiring lock
362
- if cached:
363
- return json.loads(cached)
364
- value = fetch_fn()
365
- r.setex(key, ttl, json.dumps(value))
366
- return value
367
- ```
368
-
369
- > Note: for multi-process deployments, replace the in-process lock with `acquire_lock`/`release_lock` from the Distributed Locks section above.
370
-
371
- ## Examples
372
-
373
- **Add caching to a Django/Flask API endpoint:**
374
- Use cache-aside with `setex` and a 5-minute TTL on the response. Key on the request parameters.
375
-
376
- **Rate-limit an API by user:**
377
- Use fixed-window with `pipeline(transaction=True)` for low-traffic endpoints; use sliding-window Lua for accurate per-user throttling.
378
-
379
- **Coordinate a background job across workers:**
380
- Use `acquire_lock` with a TTL that exceeds the expected job duration. Always release in a `finally` block.
381
-
382
- **Fan-out notifications to multiple subscribers:**
383
- Use Pub/Sub for fire-and-forget. Switch to Streams if you need guaranteed delivery or replay for late consumers.
384
-
385
- ## Quick Reference
386
-
387
- | Pattern | When to Use |
388
- |---------|-------------|
389
- | Cache-aside | Read-heavy, tolerate slight staleness |
390
- | Write-through | Strong consistency required |
391
- | Distributed lock | Prevent concurrent access to a resource |
392
- | Sliding window rate limit | Accurate per-user throttling |
393
- | Redis Streams | Durable event queue with consumer groups |
394
- | Pub/Sub | Broadcast with no delivery guarantees needed |
395
- | Sorted Set leaderboard | Ranked scoring, pagination |
396
- | HyperLogLog | Approximate unique count at low memory |
397
-
398
- ## Related
399
-
400
- - Skill: `postgres-patterns` — relational data patterns
401
- - Skill: `backend-patterns` — API and service layer patterns
402
- - Skill: `database-migrations` — schema versioning
403
- - Skill: `django-patterns` — Django cache framework integration
404
- - Agent: `database-reviewer` — full database review workflow
1
+ ---
2
+ name: redis-patterns
3
+ description: Redis data structure patterns, caching strategies, distributed locks, rate limiting, pub/sub, and connection management for production applications.
4
+ metadata:
5
+ origin: ECC
6
+ ---
7
+
8
+ # Redis Patterns
9
+
10
+ Quick reference for Redis best practices across common backend use cases.
11
+
12
+ ## How It Works
13
+
14
+ Redis is an in-memory data structure store that supports strings, hashes, lists, sets, sorted sets, streams, and more. Individual Redis commands are atomic on a single instance; multi-step workflows require Lua scripts, MULTI/EXEC transactions, or explicit synchronization to stay atomic. Data is optionally persisted via RDB snapshots or AOF logs. Clients communicate over TCP using the RESP protocol; connection pools are essential to avoid per-request handshake overhead.
15
+
16
+ ## When to Activate
17
+
18
+ - Adding caching to an application
19
+ - Implementing rate limiting or throttling
20
+ - Building distributed locks or coordination
21
+ - Setting up session or token storage
22
+ - Using Pub/Sub or Redis Streams for messaging
23
+ - Configuring Redis in production (pooling, eviction, clustering)
24
+
25
+ ## Data Structure Cheat Sheet
26
+
27
+ | Use Case | Structure | Example Key |
28
+ |----------|-----------|-------------|
29
+ | Simple cache | String | `product:123` |
30
+ | User session | Hash | `session:abc` |
31
+ | Leaderboard | Sorted Set | `scores:weekly` |
32
+ | Unique visitors | Set | `visitors:2024-01-01` |
33
+ | Activity feed | List | `feed:user:456` |
34
+ | Event stream | Stream | `events:orders` |
35
+ | Counters / rate limits | String (INCR) | `ratelimit:user:123` |
36
+ | Bloom filter / HLL | HyperLogLog | `hll:pageviews` |
37
+
38
+ ## Core Patterns
39
+
40
+ ### Cache-Aside (Lazy Loading)
41
+
42
+ ```python
43
+ import redis
44
+ import json
45
+
46
+ r = redis.Redis(host='localhost', port=6379, decode_responses=True)
47
+
48
+ def get_product(product_id: int):
49
+ cache_key = f"product:{product_id}"
50
+ cached = r.get(cache_key)
51
+
52
+ if cached:
53
+ return json.loads(cached)
54
+
55
+ product = db.query("SELECT * FROM products WHERE id = %s", product_id)
56
+ r.setex(cache_key, 3600, json.dumps(product)) # TTL: 1 hour
57
+ return product
58
+ ```
59
+
60
+ ### Write-Through Cache
61
+
62
+ ```python
63
+ def update_product(product_id: int, data: dict):
64
+ # Write to DB first
65
+ db.execute("UPDATE products SET ... WHERE id = %s", product_id)
66
+
67
+ # Immediately update cache
68
+ cache_key = f"product:{product_id}"
69
+ r.setex(cache_key, 3600, json.dumps(data))
70
+ ```
71
+
72
+ ### Cache Invalidation
73
+
74
+ ```python
75
+ # Tag-based invalidation — group related keys under a set
76
+ def cache_product(product_id: int, category_id: int, data: dict):
77
+ key = f"product:{product_id}"
78
+ tag = f"tag:category:{category_id}"
79
+ pipe = r.pipeline(transaction=True)
80
+ pipe.setex(key, 3600, json.dumps(data))
81
+ pipe.sadd(tag, key)
82
+ pipe.expire(tag, 3600)
83
+ pipe.execute()
84
+
85
+ def invalidate_category(category_id: int):
86
+ tag = f"tag:category:{category_id}"
87
+ keys = r.smembers(tag)
88
+ if keys:
89
+ r.delete(*keys)
90
+ r.delete(tag)
91
+ ```
92
+
93
+ ### Session Storage
94
+
95
+ ```python
96
+ import time
97
+ import uuid
98
+
99
+ def create_session(user_id: int, ttl: int = 86400) -> str:
100
+ session_id = str(uuid.uuid4())
101
+ key = f"session:{session_id}"
102
+ pipe = r.pipeline(transaction=True)
103
+ pipe.hset(key, mapping={
104
+ "user_id": user_id,
105
+ "created_at": int(time.time()),
106
+ })
107
+ pipe.expire(key, ttl)
108
+ pipe.execute()
109
+ return session_id
110
+
111
+ def get_session(session_id: str) -> dict | None:
112
+ data = r.hgetall(f"session:{session_id}")
113
+ return data if data else None
114
+
115
+ def delete_session(session_id: str):
116
+ r.delete(f"session:{session_id}")
117
+ ```
118
+
119
+ ## Rate Limiting
120
+
121
+ ### Fixed Window (Simple)
122
+
123
+ ```python
124
+ def is_rate_limited(user_id: int, limit: int = 100, window: int = 60) -> bool:
125
+ key = f"ratelimit:{user_id}:{int(time.time()) // window}"
126
+ pipe = r.pipeline(transaction=True)
127
+ pipe.incr(key)
128
+ pipe.expire(key, window)
129
+ count, _ = pipe.execute()
130
+ return count > limit
131
+ ```
132
+
133
+ ### Sliding Window (Lua — Atomic)
134
+
135
+ ```lua
136
+ -- sliding_window.lua
137
+ local key = KEYS[1]
138
+ local now = tonumber(ARGV[1])
139
+ local window = tonumber(ARGV[2])
140
+ local limit = tonumber(ARGV[3])
141
+
142
+ redis.call('ZREMRANGEBYSCORE', key, 0, now - window)
143
+ local count = redis.call('ZCARD', key)
144
+
145
+ if count < limit then
146
+ -- Use unique member (now + sequence) to avoid collisions within the same millisecond
147
+ local seq_key = key .. ':seq'
148
+ local seq = redis.call('INCR', seq_key)
149
+ redis.call('EXPIRE', seq_key, math.ceil(window / 1000))
150
+ redis.call('ZADD', key, now, now .. '-' .. seq)
151
+ redis.call('EXPIRE', key, math.ceil(window / 1000))
152
+ return 1
153
+ end
154
+ return 0
155
+ ```
156
+
157
+ ```python
158
+ sliding_window = r.register_script(open('sliding_window.lua').read())
159
+
160
+ def allow_request(user_id: int) -> bool:
161
+ key = f"ratelimit:sliding:{user_id}"
162
+ now = int(time.time() * 1000)
163
+ return bool(sliding_window(keys=[key], args=[now, 60000, 100]))
164
+ ```
165
+
166
+ ## Distributed Locks
167
+
168
+ ### Distributed Lock (Single Node — SET NX PX)
169
+
170
+ ```python
171
+ import uuid
172
+
173
+ def acquire_lock(resource: str, ttl_ms: int = 5000) -> str | None:
174
+ lock_key = f"lock:{resource}"
175
+ token = str(uuid.uuid4())
176
+ acquired = r.set(lock_key, token, px=ttl_ms, nx=True)
177
+ return token if acquired else None
178
+
179
+ def release_lock(resource: str, token: str) -> bool:
180
+ release_script = """
181
+ if redis.call('get', KEYS[1]) == ARGV[1] then
182
+ return redis.call('del', KEYS[1])
183
+ else
184
+ return 0
185
+ end
186
+ """
187
+ result = r.eval(release_script, 1, f"lock:{resource}", token)
188
+ return bool(result)
189
+
190
+ # Usage
191
+ token = acquire_lock("order:payment:123")
192
+ if token:
193
+ try:
194
+ process_payment()
195
+ finally:
196
+ release_lock("order:payment:123", token)
197
+ ```
198
+
199
+ > For multi-node setups use the `redlock-py` library which implements the full Redlock algorithm.
200
+
201
+ ## Pub/Sub & Streams
202
+
203
+ ### Pub/Sub (Fire-and-Forget)
204
+
205
+ ```python
206
+ # Publisher
207
+ def publish_event(channel: str, payload: dict):
208
+ r.publish(channel, json.dumps(payload))
209
+
210
+ # Subscriber (blocking — run in separate thread/process)
211
+ def subscribe_events(channel: str):
212
+ pubsub = r.pubsub()
213
+ pubsub.subscribe(channel)
214
+ for message in pubsub.listen():
215
+ if message['type'] == 'message':
216
+ handle(json.loads(message['data']))
217
+ ```
218
+
219
+ ### Redis Streams (Durable Queue)
220
+
221
+ ```python
222
+ # Producer
223
+ def emit(stream: str, event: dict):
224
+ r.xadd(stream, event, maxlen=10000) # Cap stream length
225
+
226
+ # Consumer group — guarantees at-least-once delivery
227
+ try:
228
+ r.xgroup_create('events:orders', 'processor', id='0', mkstream=True)
229
+ except Exception:
230
+ pass # Group already exists
231
+
232
+ def consume(stream: str, group: str, consumer: str):
233
+ while True:
234
+ messages = r.xreadgroup(group, consumer, {stream: '>'}, count=10, block=2000)
235
+ for _, entries in (messages or []):
236
+ for msg_id, data in entries:
237
+ process(data)
238
+ r.xack(stream, group, msg_id)
239
+ ```
240
+
241
+ > Prefer **Streams** over Pub/Sub when you need delivery guarantees, consumer groups, or replay.
242
+
243
+ ## Key Design
244
+
245
+ ### Naming Conventions
246
+
247
+ ```
248
+ # Pattern: resource:id:field
249
+ user:123:profile
250
+ order:456:status
251
+ cache:product:789
252
+
253
+ # Pattern: namespace:resource:id
254
+ myapp:session:abc123
255
+ myapp:ratelimit:user:123
256
+
257
+ # Pattern: resource:date (time-bound keys)
258
+ stats:pageviews:2024-01-01
259
+ ```
260
+
261
+ ### TTL Strategy
262
+
263
+ | Data Type | Suggested TTL |
264
+ |-----------|--------------|
265
+ | User session | 24h (`86400`) |
266
+ | API response cache | 5–15 min |
267
+ | Rate limit window | Match window size |
268
+ | Short-lived tokens | 5–10 min |
269
+ | Leaderboard | 1h–24h |
270
+ | Static/reference data | 1h–1 week |
271
+
272
+ Always set a TTL. Keys without TTL accumulate indefinitely and cause memory pressure.
273
+
274
+ ## Connection Management
275
+
276
+ ### Connection Pooling
277
+
278
+ ```python
279
+ from redis import ConnectionPool, Redis
280
+
281
+ pool = ConnectionPool(
282
+ host='localhost',
283
+ port=6379,
284
+ db=0,
285
+ max_connections=20,
286
+ decode_responses=True,
287
+ socket_connect_timeout=2,
288
+ socket_timeout=2,
289
+ )
290
+
291
+ r = Redis(connection_pool=pool)
292
+ ```
293
+
294
+ ### Cluster Mode
295
+
296
+ ```python
297
+ from redis.cluster import RedisCluster
298
+
299
+ r = RedisCluster(
300
+ startup_nodes=[{"host": "redis-1", "port": 6379}],
301
+ decode_responses=True,
302
+ skip_full_coverage_check=True,
303
+ )
304
+ ```
305
+
306
+ ### Sentinel (High Availability)
307
+
308
+ ```python
309
+ from redis.sentinel import Sentinel
310
+
311
+ sentinel = Sentinel(
312
+ [('sentinel-1', 26379), ('sentinel-2', 26379)],
313
+ socket_timeout=0.5,
314
+ )
315
+ master = sentinel.master_for('mymaster', decode_responses=True)
316
+ replica = sentinel.slave_for('mymaster', decode_responses=True)
317
+ ```
318
+
319
+ ## Eviction Policies
320
+
321
+ | Policy | Behavior | Best For |
322
+ |--------|----------|----------|
323
+ | `noeviction` | Error on write when full | Queues / critical data |
324
+ | `allkeys-lru` | Evict least recently used | General cache |
325
+ | `volatile-lru` | LRU only among keys with TTL | Mixed data store |
326
+ | `allkeys-lfu` | Evict least frequently used | Skewed access patterns |
327
+ | `volatile-ttl` | Evict soonest-to-expire | Prioritize long-lived data |
328
+
329
+ Set via `redis.conf`: `maxmemory-policy allkeys-lru`
330
+
331
+ ## Anti-Patterns
332
+
333
+ | Anti-Pattern | Problem | Fix |
334
+ |---|---|---|
335
+ | Keys with no TTL | Memory grows unbounded | Always set TTL |
336
+ | `KEYS *` in production | Blocks the server (O(N)) | Use `SCAN` cursor |
337
+ | Storing large blobs (>100KB) | Slow serialization, memory pressure | Store reference + fetch from object store |
338
+ | Single Redis for everything | No isolation between cache & queue | Use separate DBs or instances |
339
+ | Ignoring connection pool limits | Connection exhaustion under load | Size pool to workload |
340
+ | Not handling cache miss stampede | Thundering herd on cold start | Use locks or probabilistic early expiry |
341
+ | `FLUSHALL` without thought | Wipes entire instance | Scope deletes by key pattern |
342
+
343
+ ### Cache Miss Stampede Prevention
344
+
345
+ ```python
346
+ import threading
347
+
348
+ _locks: dict[str, threading.Lock] = {}
349
+ _locks_mutex = threading.Lock()
350
+
351
+ def get_with_lock(key: str, fetch_fn, ttl: int = 300):
352
+ cached = r.get(key)
353
+ if cached:
354
+ return json.loads(cached)
355
+
356
+ with _locks_mutex:
357
+ if key not in _locks:
358
+ _locks[key] = threading.Lock()
359
+ lock = _locks[key]
360
+ with lock:
361
+ cached = r.get(key) # Re-check after acquiring lock
362
+ if cached:
363
+ return json.loads(cached)
364
+ value = fetch_fn()
365
+ r.setex(key, ttl, json.dumps(value))
366
+ return value
367
+ ```
368
+
369
+ > Note: for multi-process deployments, replace the in-process lock with `acquire_lock`/`release_lock` from the Distributed Locks section above.
370
+
371
+ ## Examples
372
+
373
+ **Add caching to a Django/Flask API endpoint:**
374
+ Use cache-aside with `setex` and a 5-minute TTL on the response. Key on the request parameters.
375
+
376
+ **Rate-limit an API by user:**
377
+ Use fixed-window with `pipeline(transaction=True)` for low-traffic endpoints; use sliding-window Lua for accurate per-user throttling.
378
+
379
+ **Coordinate a background job across workers:**
380
+ Use `acquire_lock` with a TTL that exceeds the expected job duration. Always release in a `finally` block.
381
+
382
+ **Fan-out notifications to multiple subscribers:**
383
+ Use Pub/Sub for fire-and-forget. Switch to Streams if you need guaranteed delivery or replay for late consumers.
384
+
385
+ ## Quick Reference
386
+
387
+ | Pattern | When to Use |
388
+ |---------|-------------|
389
+ | Cache-aside | Read-heavy, tolerate slight staleness |
390
+ | Write-through | Strong consistency required |
391
+ | Distributed lock | Prevent concurrent access to a resource |
392
+ | Sliding window rate limit | Accurate per-user throttling |
393
+ | Redis Streams | Durable event queue with consumer groups |
394
+ | Pub/Sub | Broadcast with no delivery guarantees needed |
395
+ | Sorted Set leaderboard | Ranked scoring, pagination |
396
+ | HyperLogLog | Approximate unique count at low memory |
397
+
398
+ ## Related
399
+
400
+ - Skill: `postgres-patterns` — relational data patterns
401
+ - Skill: `backend-patterns` — API and service layer patterns
402
+ - Skill: `database-migrations` — schema versioning
403
+ - Skill: `django-patterns` — Django cache framework integration
404
+ - Agent: `database-reviewer` — full database review workflow