@thinkingai/ae-cli 1.0.1 → 1.0.3

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (170) hide show
  1. package/README.md +16 -13
  2. package/dist/auth-BQC5DBE7.js +19 -0
  3. package/dist/auth-DXKYLMO7.js +81 -0
  4. package/dist/chunk-3CDLNXTD.js +218 -0
  5. package/dist/chunk-53FNNCZW.js +174 -0
  6. package/dist/chunk-EBFUVWIZ.js +127 -0
  7. package/dist/chunk-ZYXIGPG7.js +148 -0
  8. package/dist/client-T4VODLA6.js +16 -0
  9. package/dist/community-FVDAWGS4.js +684 -0
  10. package/dist/config-V7AXKDMB.js +242 -0
  11. package/dist/index.js +16 -15
  12. package/dist/raw-G3GKHAPZ.js +61 -0
  13. package/dist/te-analysis-CHFTDN55.js +871 -0
  14. package/dist/te-audience-M6LQY6M7.js +350 -0
  15. package/dist/te-common-BLQ7DVGC.js +144 -0
  16. package/dist/te-dataops-V4OTKY35.js +1853 -0
  17. package/dist/te-engage-DXE4R5EW.js +1470 -0
  18. package/dist/te-meta-FMM7KCVI.js +479 -0
  19. package/package.json +7 -5
  20. package/skills/te-analysis/SKILL.md +10 -10
  21. package/skills/te-analysis/references/build-entity-details-sql.md +10 -10
  22. package/skills/te-analysis/references/build-event-details-sql.md +10 -10
  23. package/skills/te-analysis/references/create-alert.md +4 -4
  24. package/skills/te-analysis/references/create-dashboard.md +4 -4
  25. package/skills/te-analysis/references/create-or-update-dashboard-note.md +4 -4
  26. package/skills/te-analysis/references/create-public-access-link.md +4 -4
  27. package/skills/te-analysis/references/create-report.md +10 -10
  28. package/skills/te-analysis/references/create-result-cluster.md +4 -4
  29. package/skills/te-analysis/references/drilldown-user-events.md +6 -6
  30. package/skills/te-analysis/references/drilldown-users.md +4 -4
  31. package/skills/te-analysis/references/get-alert-definition-schema.md +3 -3
  32. package/skills/te-analysis/references/get-alert.md +3 -3
  33. package/skills/te-analysis/references/get-analysis-query-schema.md +4 -4
  34. package/skills/te-analysis/references/get-filter-schema.md +3 -3
  35. package/skills/te-analysis/references/get-groupby-schema.md +3 -3
  36. package/skills/te-analysis/references/get-report-definition.md +3 -3
  37. package/skills/te-analysis/references/get-table-columns.md +3 -3
  38. package/skills/te-analysis/references/list-alerts.md +4 -4
  39. package/skills/te-analysis/references/list-dashboards.md +4 -4
  40. package/skills/te-analysis/references/list-public-access-links.md +3 -3
  41. package/skills/te-analysis/references/list-reports.md +4 -4
  42. package/skills/te-analysis/references/load-filters.md +4 -4
  43. package/skills/te-analysis/references/query-adhoc.md +10 -10
  44. package/skills/te-analysis/references/query-dashboard-detail.md +3 -3
  45. package/skills/te-analysis/references/query-dashboard-report-data.md +9 -9
  46. package/skills/te-analysis/references/query-entity-details.md +10 -10
  47. package/skills/te-analysis/references/query-event-details.md +10 -10
  48. package/skills/te-analysis/references/query-report-data.md +11 -11
  49. package/skills/te-analysis/references/update-alert.md +4 -4
  50. package/skills/te-analysis/references/update-dashboard.md +4 -4
  51. package/skills/te-analysis/references/update-public-access-link.md +4 -4
  52. package/skills/te-audience/SKILL.md +5 -5
  53. package/skills/te-audience/references/create-cluster.md +10 -10
  54. package/skills/te-audience/references/create-tag.md +10 -10
  55. package/skills/te-audience/references/get-cluster-definition-schema.md +9 -9
  56. package/skills/te-audience/references/get-clusters-by-name.md +3 -3
  57. package/skills/te-audience/references/get-tag-definition-schema.md +3 -3
  58. package/skills/te-audience/references/get-tags-by-name.md +3 -3
  59. package/skills/te-audience/references/list-cluster-members.md +4 -4
  60. package/skills/te-audience/references/list-clusters.md +4 -4
  61. package/skills/te-audience/references/list-tag-members.md +4 -4
  62. package/skills/te-audience/references/list-tags.md +4 -4
  63. package/skills/te-audience/references/refresh-cluster.md +3 -3
  64. package/skills/te-audience/references/refresh-tag.md +3 -3
  65. package/skills/te-audience/references/update-cluster.md +9 -9
  66. package/skills/te-audience/references/update-tag.md +10 -10
  67. package/skills/te-common/SKILL.md +2 -2
  68. package/skills/te-common/references/get-resource-url.md +5 -5
  69. package/skills/te-common/references/list-projects.md +3 -3
  70. package/skills/te-community/SKILL.md +61 -69
  71. package/skills/te-community/references/community-activity-analysis.md +43 -43
  72. package/skills/te-community/references/community-analyzing-official-content.md +47 -47
  73. package/skills/te-community/references/community-analyzing-theme-comment.md +87 -87
  74. package/skills/te-community/references/community-character-analysis.md +44 -44
  75. package/skills/te-community/references/community-daily-report.md +56 -53
  76. package/skills/te-community/references/community-hottopic-insight.md +81 -87
  77. package/skills/te-community/references/community-weekly-report.md +54 -53
  78. package/skills/te-community/references/get_channel_info.md +9 -9
  79. package/skills/te-community/references/get_comment_tag_analysis.md +15 -15
  80. package/skills/te-community/references/get_comments_summary.md +15 -15
  81. package/skills/te-community/references/get_corpus_tags.md +9 -9
  82. package/skills/te-community/references/get_daily_summary.md +10 -10
  83. package/skills/te-community/references/get_hot_topics.md +12 -12
  84. package/skills/te-community/references/get_livestream_analysis.md +9 -9
  85. package/skills/te-community/references/get_livestream_detail.md +19 -19
  86. package/skills/te-community/references/get_livestream_list.md +13 -13
  87. package/skills/te-community/references/get_livestream_overview.md +11 -11
  88. package/skills/te-community/references/get_livestream_room_metrics.md +12 -12
  89. package/skills/te-community/references/get_livestream_rooms.md +12 -12
  90. package/skills/te-community/references/get_overview_metrics.md +12 -12
  91. package/skills/te-community/references/get_post_detail.md +21 -21
  92. package/skills/te-community/references/get_risk_content.md +23 -23
  93. package/skills/te-community/references/get_sentiment_overview.md +16 -16
  94. package/skills/te-community/references/get_tag_trends.md +13 -13
  95. package/skills/te-community/references/get_topic_detail.md +12 -12
  96. package/skills/te-community/references/search_posts.md +26 -26
  97. package/skills/te-dataops/SKILL.md +390 -392
  98. package/skills/te-dataops/references/dataops-flow-create.md +87 -87
  99. package/skills/te-dataops/references/dataops-flow-monitor.md +65 -65
  100. package/skills/te-dataops/references/dataops-integration.md +90 -85
  101. package/skills/te-dataops/references/dataops-query.md +58 -58
  102. package/skills/te-dataops/references/dataops-table.md +63 -63
  103. package/skills/te-engage/SKILL.md +103 -103
  104. package/skills/te-engage/references/add-approver.md +11 -11
  105. package/skills/te-engage/references/add-channel.md +34 -34
  106. package/skills/te-engage/references/approver-list.md +8 -8
  107. package/skills/te-engage/references/cancel-query-by-request-id.md +10 -10
  108. package/skills/te-engage/references/channel-detail.md +13 -13
  109. package/skills/te-engage/references/channel-list.md +15 -15
  110. package/skills/te-engage/references/config-channel-detail.md +10 -10
  111. package/skills/te-engage/references/config-channel-list.md +11 -11
  112. package/skills/te-engage/references/config-item-analysis-report.md +21 -21
  113. package/skills/te-engage/references/config-item-detail.md +10 -10
  114. package/skills/te-engage/references/config-item-list.md +8 -8
  115. package/skills/te-engage/references/config-item-strategy-comparison.md +14 -14
  116. package/skills/te-engage/references/config-item-trigger-report.md +26 -26
  117. package/skills/te-engage/references/copy-config-template.md +16 -16
  118. package/skills/te-engage/references/delete-channel.md +11 -11
  119. package/skills/te-engage/references/delete-config-channel.md +11 -11
  120. package/skills/te-engage/references/delete-config-item.md +12 -12
  121. package/skills/te-engage/references/delete-flow.md +11 -11
  122. package/skills/te-engage/references/flow-ab-split-node-report.md +29 -29
  123. package/skills/te-engage/references/flow-detail.md +19 -19
  124. package/skills/te-engage/references/flow-list.md +8 -8
  125. package/skills/te-engage/references/flow-node-config-schema.md +11 -11
  126. package/skills/te-engage/references/flow-node-detail-report.md +30 -30
  127. package/skills/te-engage/references/flow-node-overview-report.md +27 -27
  128. package/skills/te-engage/references/flow-process-report.md +32 -32
  129. package/skills/te-engage/references/manage-flow.md +44 -44
  130. package/skills/te-engage/references/manage-strategy.md +37 -37
  131. package/skills/te-engage/references/manage-task.md +20 -20
  132. package/skills/te-engage/references/modify-flow-base-info.md +14 -14
  133. package/skills/te-engage/references/save-flow.md +264 -263
  134. package/skills/te-engage/references/strategy-detail.md +16 -16
  135. package/skills/te-engage/references/strategy-list.md +10 -10
  136. package/skills/te-engage/references/task-data-detail.md +47 -47
  137. package/skills/te-engage/references/task-data-overview.md +23 -23
  138. package/skills/te-engage/references/task-detail.md +18 -18
  139. package/skills/te-engage/references/task-experiment-report.md +26 -26
  140. package/skills/te-engage/references/task-list.md +35 -35
  141. package/skills/te-engage/references/task-metric-detail.md +31 -31
  142. package/skills/te-engage/references/task-stats.md +31 -31
  143. package/skills/te-engage/references/update-channel-status.md +13 -13
  144. package/skills/te-engage/references/update-config-channel-status.md +14 -14
  145. package/skills/te-engage/references/validate-flow-node-config.md +15 -15
  146. package/skills/te-engage/references/whitelist-list.md +8 -8
  147. package/skills/te-meta/SKILL.md +5 -5
  148. package/skills/te-meta/references/batch-create-metadata.md +4 -4
  149. package/skills/te-meta/references/batch-edit-metadata.md +3 -3
  150. package/skills/te-meta/references/create-metric.md +12 -12
  151. package/skills/te-meta/references/create-project-mark-time.md +4 -4
  152. package/skills/te-meta/references/create-virtual-event.md +10 -10
  153. package/skills/te-meta/references/create-virtual-property.md +8 -8
  154. package/skills/te-meta/references/delete-project-mark-times.md +3 -3
  155. package/skills/te-meta/references/delete-track-items.md +3 -3
  156. package/skills/te-meta/references/get-metric.md +3 -3
  157. package/skills/te-meta/references/get-project-config.md +3 -3
  158. package/skills/te-meta/references/get-track-program.md +3 -3
  159. package/skills/te-meta/references/list-entities.md +4 -4
  160. package/skills/te-meta/references/list-events.md +4 -4
  161. package/skills/te-meta/references/list-metrics.md +4 -4
  162. package/skills/te-meta/references/list-project-mark-times.md +4 -4
  163. package/skills/te-meta/references/list-project-users.md +3 -3
  164. package/skills/te-meta/references/list-properties.md +4 -4
  165. package/skills/te-meta/references/save-track-items.md +3 -3
  166. package/skills/te-meta/references/update-metric.md +10 -10
  167. package/skills/te-meta/references/update-project-mark-time.md +4 -4
  168. package/skills/te-shared/SKILL.md +8 -8
  169. package/skills/te-community/references/community-release-analysis.md +0 -79
  170. package/skills/te-dataops/references/dataops-operations.md +0 -107
@@ -1,163 +1,163 @@
1
1
  ---
2
2
  name: dataops-flow-create
3
3
  version: 1.0.0
4
- description: "任务流创建与配置:创建任务流、添加任务节点、配置依赖关系、保存任务定义、配置调度、测试、发布到生产。触发关键词:创建任务流、新建工作流、配置调度、添加任务节点、发布、cron、定时执行。"
4
+ description: "Flow creation and configuration: create flows, add task nodes, configure dependencies, save task definitions, configure scheduling, test, and release to production. Trigger keywords: create flow, new workflow, configure schedule, add task node, release, cron, scheduled execution."
5
5
  metadata:
6
6
  requires:
7
- bins: ["te-cli"]
7
+ bins: ["ae-cli"]
8
8
  ---
9
9
 
10
- # DataOps 任务流创建与配置
10
+ # DataOps Flow Creation and Configuration
11
11
 
12
- > **前置条件:** 阅读 [`te-dataops/SKILL.md`](../SKILL.md) 了解通用规则。
12
+ > **Prerequisites:** Read [`te-dataops/SKILL.md`](../SKILL.md) for general rules.
13
13
 
14
- 使用 `dataops_flow` 子命令管理任务流生命周期。
14
+ Use the `dataops_flow` subcommand to manage flow lifecycle.
15
15
 
16
- **任务流生命周期:创建 → 配置节点 → 配置调度 → DEV 环境测试 → 发布到 PROD → 上线调度**
16
+ **Flow Lifecycle: Create → Configure Nodes → Configure Schedule → Test in DEV → Release to PROD → Online Schedule**
17
17
 
18
18
  ---
19
19
 
20
- ## 完整任务流创建流程
20
+ ## Complete Flow Creation Process
21
21
 
22
- 按顺序执行以下步骤,从零创建一个可上线的任务流。
22
+ Follow these steps in order to create a production-ready flow from scratch.
23
23
 
24
- ### Step 1: 创建任务流
24
+ ### Step 1: Create Flow
25
25
 
26
26
  ```bash
27
- te-cli dataops_flow +create_flow --spaceCode "${spaceCode}" \
28
- --flowName "每日ETL流程" --remark "处理用户数据" --confirmed true
29
- # 返回 flowCode,后续步骤都需要
27
+ ae-cli dataops_flow +create_flow --spaceCode "${spaceCode}" \
28
+ --flowName "Daily ETL Process" --remark "Process user data" --confirmed true
29
+ # Returns flowCode, required for subsequent steps
30
30
  ```
31
31
 
32
- ### Step 2: 创建任务节点(可多次调用)
32
+ ### Step 2: Create Task Nodes (can be called multiple times)
33
33
 
34
34
  ```bash
35
- # 创建 SQL 任务
36
- te-cli dataops_flow +create_task --spaceCode "${spaceCode}" \
37
- --flowCode "${flowCode}" --taskName "处理用户数据" --taskType "TRINO_SQL" --confirmed true
38
- # 返回 taskCode
39
-
40
- # 创建带前置依赖的任务
41
- te-cli dataops_flow +create_task --spaceCode "${spaceCode}" \
42
- --flowCode "${flowCode}" --taskName "导出结果" --taskType "TRINO_SQL" \
35
+ # Create SQL task
36
+ ae-cli dataops_flow +create_task --spaceCode "${spaceCode}" \
37
+ --flowCode "${flowCode}" --taskName "Process User Data" --taskType "TRINO_SQL" --confirmed true
38
+ # Returns taskCode
39
+
40
+ # Create task with upstream dependency
41
+ ae-cli dataops_flow +create_task --spaceCode "${spaceCode}" \
42
+ --flowCode "${flowCode}" --taskName "Export Results" --taskType "TRINO_SQL" \
43
43
  --preTaskCode "${upstreamTaskCode}" --confirmed true
44
44
  ```
45
45
 
46
- **任务节点类型:**
46
+ **Task Node Types:**
47
47
 
48
- | 类型 | 说明 | 典型用途 |
49
- |------|------|---------|
50
- | TRINO_SQL | Trino SQL 查询 | 数据加工、ETL |
51
- | SHELL | Shell 脚本 | 系统命令、文件操作 |
52
- | FLOW_CHECK | 流程检查 | 检查上游任务流是否完成 |
53
- | TASK_CHECK | 任务检查 | 检查指定任务是否完成 |
54
- | OFFLINE_SYNC | 离线同步 | 集成方案数据同步(需 syncId) |
55
- | APP_SYNC | 应用同步 | 应用表数据同步(需 syncId) |
56
- | PLACE_HOLDER | 占位符 | 流程控制、逻辑分组 |
48
+ | Type | Description | Typical Use |
49
+ |------|-------------|-------------|
50
+ | TRINO_SQL | Trino SQL query | Data processing, ETL |
51
+ | SHELL | Shell script | System commands, file operations |
52
+ | FLOW_CHECK | Flow check | Check if upstream flow is complete |
53
+ | TASK_CHECK | Task check | Check if specified task is complete |
54
+ | OFFLINE_SYNC | Offline sync | Integration solution data sync (requires syncId) |
55
+ | APP_SYNC | App sync | App table data sync (requires syncId) |
56
+ | PLACE_HOLDER | Placeholder | Flow control, logical grouping |
57
57
 
58
- ### Step 3: 保存任务定义(配置 SQL/Shell 内容)
58
+ ### Step 3: Save Task Definition (configure SQL/Shell content)
59
59
 
60
60
  ```bash
61
- # SQL 任务
62
- te-cli dataops_flow +save_task_definition --spaceCode "${spaceCode}" \
61
+ # SQL task
62
+ ae-cli dataops_flow +save_task_definition --spaceCode "${spaceCode}" \
63
63
  --flowCode "${flowCode}" --taskCode "${taskCode}" \
64
64
  --taskContentJson '{"sql":"SELECT * FROM dwd_user","repoCode":"te_etl","catalog":"hive","schema":"ws_default_dev"}' \
65
65
  --failRetryTimes 3 --failRetryInterval 30 --timeout 60 --confirmed true
66
66
 
67
- # Shell 任务
68
- te-cli dataops_flow +save_task_definition --spaceCode "${spaceCode}" \
67
+ # Shell task
68
+ ae-cli dataops_flow +save_task_definition --spaceCode "${spaceCode}" \
69
69
  --flowCode "${flowCode}" --taskCode "${taskCode}" \
70
70
  --taskContentJson '{"script":"#!/bin/bash\necho hello"}' \
71
71
  --confirmed true
72
72
  ```
73
73
 
74
- ### Step 4: 校验 SQL(推荐,仅 TRINO_SQL 类型)
74
+ ### Step 4: Validate SQL (recommended, TRINO_SQL type only)
75
75
 
76
76
  ```bash
77
- te-cli dataops_flow +validate_task_sql --spaceCode "${spaceCode}" \
77
+ ae-cli dataops_flow +validate_task_sql --spaceCode "${spaceCode}" \
78
78
  --flowCode "${flowCode}" --taskCode "${taskCode}" \
79
79
  --sql "SELECT * FROM dwd_user" --repoCode "te_etl" \
80
80
  --catalog "hive" --schema "ws_default_dev"
81
- # 检查 valid=true,否则查看 message 和 errorPosition
81
+ # Check valid=true, otherwise review message and errorPosition
82
82
  ```
83
83
 
84
- ### Step 5: 添加任务依赖关系(DAG 连线)
84
+ ### Step 5: Add Task Dependencies (DAG connections)
85
85
 
86
86
  ```bash
87
- te-cli dataops_flow +add_task_relation --spaceCode "${spaceCode}" \
87
+ ae-cli dataops_flow +add_task_relation --spaceCode "${spaceCode}" \
88
88
  --flowCode "${flowCode}" --preTaskCode "${upstreamTaskCode}" --taskCode "${downstreamTaskCode}" \
89
89
  --confirmed true
90
90
  ```
91
91
 
92
- ### Step 6: 配置调度
92
+ ### Step 6: Configure Schedule
93
93
 
94
94
  ```bash
95
- # CRON 表达式定时执行
96
- te-cli dataops_flow +save_schedule_config --spaceCode "${spaceCode}" \
95
+ # CRON expression for scheduled execution
96
+ ae-cli dataops_flow +save_schedule_config --spaceCode "${spaceCode}" \
97
97
  --flowCode "${flowCode}" --scheduled 1 --scheduleType "CRON" \
98
98
  --cron "0 0 2 * * ?" --confirmed true
99
- # 示例:0 0 2 * * ? = 每天凌晨2点
99
+ # Example: 0 0 2 * * ? = Daily at 2 AM
100
100
  ```
101
101
 
102
- **CRON 格式**(6 字段):`秒 分 时 日 月 周`
103
- - `0 0 */4 * * ?` — 每 4 小时
104
- - `0 30 8 * * 1-5` — 工作日 8:30
102
+ **CRON Format** (6 fields): `second minute hour day month weekday`
103
+ - `0 0 */4 * * ?` — Every 4 hours
104
+ - `0 30 8 * * 1-5` — Weekdays at 8:30
105
105
 
106
- ### Step 7: DEV 环境测试
106
+ ### Step 7: Test in DEV Environment
107
107
 
108
108
  ```bash
109
- # 手动触发执行
110
- te-cli dataops_flow +execute_flow --spaceCode "${spaceCode}" \
109
+ # Manually trigger execution
110
+ ae-cli dataops_flow +execute_flow --spaceCode "${spaceCode}" \
111
111
  --flowCode "${flowCode}" --env "DEV" --confirmed true
112
112
 
113
- # 查看执行状态
114
- te-cli dataops_flow +get_execute_dag --spaceCode "${spaceCode}" --executeId "${executeId}"
113
+ # Check execution status
114
+ ae-cli dataops_flow +get_execute_dag --spaceCode "${spaceCode}" --executeId "${executeId}"
115
115
 
116
- # 查看任务日志(从 DAG 获取 bsTaskInstanceId 和 taskCode)
117
- te-cli dataops_flow +get_task_instance_log --bsTaskInstanceId "${instanceId}" --taskCode "${taskCode}"
116
+ # View task logs (get bsTaskInstanceId and taskCode from DAG)
117
+ ae-cli dataops_flow +get_task_instance_log --bsTaskInstanceId "${instanceId}" --taskCode "${taskCode}"
118
118
 
119
- # 根据日志调整配置后,重复测试
119
+ # Adjust configuration based on logs, then repeat testing
120
120
  ```
121
121
 
122
- ### Step 8: 发布到生产
122
+ ### Step 8: Release to Production
123
123
 
124
124
  ```bash
125
- te-cli dataops_flow +release_flow --spaceCode "${spaceCode}" \
125
+ ae-cli dataops_flow +release_flow --spaceCode "${spaceCode}" \
126
126
  --flowCode "${flowCode}" --confirmed true
127
- # 发布后 PROD 调度立即生效,不会中断运行中的实例
127
+ # After release, PROD schedule takes effect immediately without interrupting running instances
128
128
  ```
129
129
 
130
130
  ---
131
131
 
132
- ## 命令速查
133
-
134
- | 命令 | 用途 | 关键 Flags |
135
- |------|------|-----------|
136
- | `+create_flow` | 创建任务流 | `--spaceCode` `--flowName` `--remark` `--confirmed` |
137
- | `+create_task` | 创建任务节点 | `--spaceCode` `--flowCode` `--taskName` `--taskType` `--syncId` `--preTaskCode` `--confirmed` |
138
- | `+save_task_definition` | 保存任务定义 | `--spaceCode` `--flowCode` `--taskCode` `--taskContentJson` `--failRetryTimes` `--failRetryInterval` `--timeout` `--confirmed` |
139
- | `+validate_task_sql` | 校验 SQL | `--spaceCode` `--flowCode` `--taskCode` `--sql` `--repoCode` `--catalog` `--schema` |
140
- | `+add_task_relation` | 添加依赖 | `--spaceCode` `--flowCode` `--preTaskCode` `--taskCode` `--confirmed` |
141
- | `+save_schedule_config` | 配置调度 | `--spaceCode` `--flowCode` `--scheduled` `--scheduleType` `--cron` `--confirmed` |
142
- | `+get_flow_dag` | 查看 DAG 结构 | `--spaceCode` `--flowCode` `--env` |
143
- | `+get_task_params` | 查看任务参数 | `--spaceCode` `--flowCode` `--taskCode` `--env` |
144
- | `+execute_flow` | 手动执行 | `--spaceCode` `--flowCode` `--env` `--confirmed` |
145
- | `+get_execute_dag` | 查看运行态 DAG | `--spaceCode` `--executeId` |
146
- | `+get_task_instance_log` | 查看任务日志 | `--bsTaskInstanceId` `--taskCode` `--startOffset` `--limit` |
147
- | `+release_flow` | 发布到生产 | `--spaceCode` `--flowCode` `--confirmed` |
148
-
149
- ## 参数说明
150
-
151
- - **参数引用**: 任务中通过 `${paramKey}` 引用空间参数(如 `${ws_run_date}`)
152
- - **环境**: `DEV`(默认)| `PROD`
153
- - **taskContentJson**: JSON 字符串,格式因 taskType 而异:
132
+ ## Command Quick Reference
133
+
134
+ | Command | Purpose | Key Flags |
135
+ |---------|---------|-----------|
136
+ | `+create_flow` | Create flow | `--spaceCode` `--flowName` `--remark` `--confirmed` |
137
+ | `+create_task` | Create task node | `--spaceCode` `--flowCode` `--taskName` `--taskType` `--syncId` `--preTaskCode` `--confirmed` |
138
+ | `+save_task_definition` | Save task definition | `--spaceCode` `--flowCode` `--taskCode` `--taskContentJson` `--failRetryTimes` `--failRetryInterval` `--timeout` `--confirmed` |
139
+ | `+validate_task_sql` | Validate SQL | `--spaceCode` `--flowCode` `--taskCode` `--sql` `--repoCode` `--catalog` `--schema` |
140
+ | `+add_task_relation` | Add dependency | `--spaceCode` `--flowCode` `--preTaskCode` `--taskCode` `--confirmed` |
141
+ | `+save_schedule_config` | Configure schedule | `--spaceCode` `--flowCode` `--scheduled` `--scheduleType` `--cron` `--confirmed` |
142
+ | `+get_flow_dag` | View DAG structure | `--spaceCode` `--flowCode` `--env` |
143
+ | `+get_task_params` | View task parameters | `--spaceCode` `--flowCode` `--taskCode` `--env` |
144
+ | `+execute_flow` | Manual execution | `--spaceCode` `--flowCode` `--env` `--confirmed` |
145
+ | `+get_execute_dag` | View runtime DAG | `--spaceCode` `--executeId` |
146
+ | `+get_task_instance_log` | View task logs | `--bsTaskInstanceId` `--taskCode` `--startOffset` `--limit` |
147
+ | `+release_flow` | Release to production | `--spaceCode` `--flowCode` `--confirmed` |
148
+
149
+ ## Parameter Notes
150
+
151
+ - **Parameter Reference**: Reference workspace parameters in tasks using `${paramKey}` (e.g., `${ws_run_date}`)
152
+ - **Environment**: `DEV` (default) | `PROD`
153
+ - **taskContentJson**: JSON string, format varies by taskType:
154
154
  - TRINO_SQL: `{"sql":"SELECT ...","repoCode":"xxx","catalog":"hive","schema":"db"}`
155
155
  - SHELL: `{"script":"#!/bin/bash\n..."}`
156
156
 
157
- ## 注意事项
157
+ ## Important Notes
158
158
 
159
- 1. **flowCode 获取**: 通过 `+list_flows` 获取(见 `dataops-flow-monitor` Skill)
160
- 2. **taskCode 获取**: 通过 `+create_task` 返回或 `+get_flow_dag` 查询
161
- 3. **发布影响**: 将 DEV 所有变更同步到 PROD,PROD 调度立即生效
162
- 4. **SQL 校验**: 保存 TRINO_SQL 任务前建议先校验
163
- 5. **不能创建循环依赖**
159
+ 1. **Getting flowCode**: Use `+list_flows` (see `dataops-flow-monitor` Skill)
160
+ 2. **Getting taskCode**: Returned by `+create_task` or query via `+get_flow_dag`
161
+ 3. **Release Impact**: Syncs all DEV changes to PROD, PROD schedule takes effect immediately
162
+ 4. **SQL Validation**: Recommended to validate before saving TRINO_SQL tasks
163
+ 5. **Cannot create circular dependencies**
@@ -1,118 +1,118 @@
1
1
  ---
2
2
  name: dataops-flow-monitor
3
3
  version: 1.0.0
4
- description: "任务流执行与监控:查看执行实例、运行态 DAG、任务日志、手动执行/停止任务流。触发关键词:执行任务流、运行实例、监控、日志、停止、DAG、排错、实例、flow instance。"
4
+ description: "Flow execution and monitoring: view execution instances, runtime DAG, task logs, manually execute/stop flows. Trigger keywords: execute flow, running instance, monitor, logs, stop, DAG, troubleshoot, instance, flow instance."
5
5
  metadata:
6
6
  requires:
7
- bins: ["te-cli"]
7
+ bins: ["ae-cli"]
8
8
  ---
9
9
 
10
- # DataOps 任务流执行与监控
10
+ # DataOps Flow Execution and Monitoring
11
11
 
12
- > **前置条件:** 阅读 [`te-dataops/SKILL.md`](../SKILL.md) 了解通用规则。
12
+ > **Prerequisites:** Read [`te-dataops/SKILL.md`](../SKILL.md) for general rules.
13
13
 
14
- 使用 `dataops_flow` 子命令执行和监控任务流。
14
+ Use the `dataops_flow` subcommand to execute and monitor flows.
15
15
 
16
- **核心概念:**
17
- - **executeId** — flow_* 工具使用的执行记录 ID(通过 `+list_flow_instances` 获取)
18
- - **flowInstanceId** — operations_* 工具使用的运维实例 ID(两者不互通,不可混用)
19
- - **实例列表默认查询 PROD 环境**(与其他工具默认 DEV 不同)
16
+ **Core Concepts:**
17
+ - **executeId** — Execution record ID used by flow_* tools (obtained via `+list_flow_instances`)
18
+ - **flowInstanceId** — Operations instance ID used by operations_* tools (these two are not interchangeable)
19
+ - **Instance list queries PROD environment by default** (unlike other tools which default to DEV)
20
20
 
21
21
  ---
22
22
 
23
- ## 工作流 A:查找并查看任务流执行状态
23
+ ## Workflow A: Find and View Flow Execution Status
24
24
 
25
25
  ```bash
26
- # Step 1: 搜索任务流(获取 flowCode)
27
- te-cli dataops_flow +list_flows --spaceCode "${spaceCode}" --keyword "etl"
26
+ # Step 1: Search flows (get flowCode)
27
+ ae-cli dataops_flow +list_flows --spaceCode "${spaceCode}" --keyword "etl"
28
28
 
29
- # Step 2: 查看执行实例列表(默认 PROD,按时间倒序)
30
- te-cli dataops_flow +list_flow_instances --spaceCode "${spaceCode}" \
29
+ # Step 2: View execution instance list (default PROD, sorted by time descending)
30
+ ae-cli dataops_flow +list_flow_instances --spaceCode "${spaceCode}" \
31
31
  --flowCode "${flowCode}" --env "PROD" --size 30
32
32
 
33
- # Step 3: 查看运行态 DAG(含各节点执行状态)
34
- te-cli dataops_flow +get_execute_dag --spaceCode "${spaceCode}" --executeId "${executeId}"
33
+ # Step 3: View runtime DAG (with execution status for each node)
34
+ ae-cli dataops_flow +get_execute_dag --spaceCode "${spaceCode}" --executeId "${executeId}"
35
35
 
36
- # Step 4: 查看执行记录详情
37
- te-cli dataops_flow +get_execute_record --spaceCode "${spaceCode}" --executeId "${executeId}"
36
+ # Step 4: View execution record details
37
+ ae-cli dataops_flow +get_execute_record --spaceCode "${spaceCode}" --executeId "${executeId}"
38
38
  ```
39
39
 
40
40
  ---
41
41
 
42
- ## 工作流 B:排查任务失败
42
+ ## Workflow B: Troubleshoot Task Failures
43
43
 
44
44
  ```bash
45
- # Step 1: 获取运行态 DAG,定位失败节点
46
- te-cli dataops_flow +get_execute_dag --spaceCode "${spaceCode}" --executeId "${executeId}"
47
- # 从返回中找到 status=FAILED 的节点,获取其 bsTaskInstanceId 和 taskCode
45
+ # Step 1: Get runtime DAG, locate failed node
46
+ ae-cli dataops_flow +get_execute_dag --spaceCode "${spaceCode}" --executeId "${executeId}"
47
+ # Find node with status=FAILED, get its bsTaskInstanceId and taskCode
48
48
 
49
- # Step 2: 查看失败任务的日志
50
- te-cli dataops_flow +get_task_instance_log --bsTaskInstanceId "${bsTaskInstanceId}" \
49
+ # Step 2: View failed task logs
50
+ ae-cli dataops_flow +get_task_instance_log --bsTaskInstanceId "${bsTaskInstanceId}" \
51
51
  --taskCode "${taskCode}" --limit 100
52
52
 
53
- # Step 3: 查看任务定义(确认 SQL/配置)
54
- te-cli dataops_flow +get_task_params --spaceCode "${spaceCode}" \
53
+ # Step 3: View task definition (confirm SQL/configuration)
54
+ ae-cli dataops_flow +get_task_params --spaceCode "${spaceCode}" \
55
55
  --flowCode "${flowCode}" --taskCode "${taskCode}"
56
56
 
57
- # Step 4: 修复后重新执行
58
- te-cli dataops_flow +execute_flow --spaceCode "${spaceCode}" \
57
+ # Step 4: Re-execute after fixing
58
+ ae-cli dataops_flow +execute_flow --spaceCode "${spaceCode}" \
59
59
  --flowCode "${flowCode}" --env "DEV" --confirmed true
60
60
  ```
61
61
 
62
62
  ---
63
63
 
64
- ## 工作流 C:手动执行与停止
64
+ ## Workflow C: Manual Execution and Stop
65
65
 
66
66
  ```bash
67
- # 手动触发执行(默认 DEV,可指定 PROD)
68
- te-cli dataops_flow +execute_flow --spaceCode "${spaceCode}" \
67
+ # Manually trigger execution (default DEV, can specify PROD)
68
+ ae-cli dataops_flow +execute_flow --spaceCode "${spaceCode}" \
69
69
  --flowCode "${flowCode}" --env "DEV" --confirmed true
70
- # 返回 executeId
70
+ # Returns executeId
71
71
 
72
- # 监控执行过程
73
- te-cli dataops_flow +get_execute_dag --spaceCode "${spaceCode}" --executeId "${executeId}"
72
+ # Monitor execution progress
73
+ ae-cli dataops_flow +get_execute_dag --spaceCode "${spaceCode}" --executeId "${executeId}"
74
74
 
75
- # 必要时停止执行(不可撤销)
76
- te-cli dataops_flow +stop_flow --spaceCode "${spaceCode}" \
75
+ # Stop execution if necessary (irreversible)
76
+ ae-cli dataops_flow +stop_flow --spaceCode "${spaceCode}" \
77
77
  --flowCode "${flowCode}" --executeId "${executeId}" --confirmed true
78
78
  ```
79
79
 
80
80
  ---
81
81
 
82
- ## 工作流 D:查看任务流结构
82
+ ## Workflow D: View Flow Structure
83
83
 
84
84
  ```bash
85
- # 查看任务流定义态 DAG(静态结构、依赖关系)
86
- te-cli dataops_flow +get_flow_dag --spaceCode "${spaceCode}" --flowCode "${flowCode}"
85
+ # View flow definition DAG (static structure, dependencies)
86
+ ae-cli dataops_flow +get_flow_dag --spaceCode "${spaceCode}" --flowCode "${flowCode}"
87
87
 
88
- # 查看任务流基本信息
89
- te-cli dataops_flow +get_flow_detail --spaceCode "${spaceCode}" --flowCode "${flowCode}"
88
+ # View flow basic information
89
+ ae-cli dataops_flow +get_flow_detail --spaceCode "${spaceCode}" --flowCode "${flowCode}"
90
90
 
91
- # 查看调度配置
92
- te-cli dataops_flow +get_schedule_config --spaceCode "${spaceCode}" --flowCode "${flowCode}"
91
+ # View schedule configuration
92
+ ae-cli dataops_flow +get_schedule_config --spaceCode "${spaceCode}" --flowCode "${flowCode}"
93
93
  ```
94
94
 
95
95
  ---
96
96
 
97
- ## 命令速查
98
-
99
- | 命令 | 用途 | 关键 Flags |
100
- |------|------|-----------|
101
- | `+list_flows` | 搜索任务流 | `--spaceCode` `--keyword` |
102
- | `+get_flow_detail` | 任务流信息 | `--spaceCode` `--flowCode` `--env` |
103
- | `+get_flow_dag` | 定义态 DAG | `--spaceCode` `--flowCode` `--env` |
104
- | `+get_schedule_config` | 调度配置 | `--spaceCode` `--flowCode` `--env` |
105
- | `+execute_flow` | 手动执行 | `--spaceCode` `--flowCode` `--env` `--confirmed` |
106
- | `+stop_flow` | 停止执行 | `--spaceCode` `--flowCode` `--executeId` `--confirmed` |
107
- | `+list_flow_instances` | 实例列表 | `--spaceCode` `--flowCode` `--env` `--size` |
108
- | `+get_execute_record` | 执行记录 | `--spaceCode` `--executeId` |
109
- | `+get_execute_dag` | 运行态 DAG | `--spaceCode` `--executeId` |
110
- | `+get_task_instance_log` | 任务日志 | `--bsTaskInstanceId` `--taskCode` `--startOffset` `--limit` |
111
- | `+get_task_params` | 任务参数 | `--spaceCode` `--flowCode` `--taskCode` `--env` |
112
- | `+update_flow` | 更新任务流 | `--spaceCode` `--flowCode` `--flowName` `--remark` `--confirmed` |
113
-
114
- ## 参数说明
115
-
116
- - **env**: `DEV`(开发)| `PROD`(生产,实例列表默认 PROD)
117
- - **任务状态**: `success` / `failure` / `running` / `waiting`
118
- - **DAG 区别**: `+get_flow_dag` 返回静态定义结构,`+get_execute_dag` 返回含执行状态的运行态结构
97
+ ## Command Quick Reference
98
+
99
+ | Command | Purpose | Key Flags |
100
+ |---------|---------|-----------|
101
+ | `+list_flows` | Search flows | `--spaceCode` `--keyword` |
102
+ | `+get_flow_detail` | Flow information | `--spaceCode` `--flowCode` `--env` |
103
+ | `+get_flow_dag` | Definition DAG | `--spaceCode` `--flowCode` `--env` |
104
+ | `+get_schedule_config` | Schedule configuration | `--spaceCode` `--flowCode` `--env` |
105
+ | `+execute_flow` | Manual execution | `--spaceCode` `--flowCode` `--env` `--confirmed` |
106
+ | `+stop_flow` | Stop execution | `--spaceCode` `--flowCode` `--executeId` `--confirmed` |
107
+ | `+list_flow_instances` | Instance list | `--spaceCode` `--flowCode` `--env` `--size` |
108
+ | `+get_execute_record` | Execution record | `--spaceCode` `--executeId` |
109
+ | `+get_execute_dag` | Runtime DAG | `--spaceCode` `--executeId` |
110
+ | `+get_task_instance_log` | Task logs | `--bsTaskInstanceId` `--taskCode` `--startOffset` `--limit` |
111
+ | `+get_task_params` | Task parameters | `--spaceCode` `--flowCode` `--taskCode` `--env` |
112
+ | `+update_flow` | Update flow | `--spaceCode` `--flowCode` `--flowName` `--remark` `--confirmed` |
113
+
114
+ ## Parameter Notes
115
+
116
+ - **env**: `DEV` (development) | `PROD` (production, instance list defaults to PROD)
117
+ - **Task Status**: `success` / `failure` / `running` / `waiting`
118
+ - **DAG Difference**: `+get_flow_dag` returns static definition structure, `+get_execute_dag` returns runtime structure with execution status