@thinkingai/ae-cli 1.0.1 → 1.0.3

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (170) hide show
  1. package/README.md +16 -13
  2. package/dist/auth-BQC5DBE7.js +19 -0
  3. package/dist/auth-DXKYLMO7.js +81 -0
  4. package/dist/chunk-3CDLNXTD.js +218 -0
  5. package/dist/chunk-53FNNCZW.js +174 -0
  6. package/dist/chunk-EBFUVWIZ.js +127 -0
  7. package/dist/chunk-ZYXIGPG7.js +148 -0
  8. package/dist/client-T4VODLA6.js +16 -0
  9. package/dist/community-FVDAWGS4.js +684 -0
  10. package/dist/config-V7AXKDMB.js +242 -0
  11. package/dist/index.js +16 -15
  12. package/dist/raw-G3GKHAPZ.js +61 -0
  13. package/dist/te-analysis-CHFTDN55.js +871 -0
  14. package/dist/te-audience-M6LQY6M7.js +350 -0
  15. package/dist/te-common-BLQ7DVGC.js +144 -0
  16. package/dist/te-dataops-V4OTKY35.js +1853 -0
  17. package/dist/te-engage-DXE4R5EW.js +1470 -0
  18. package/dist/te-meta-FMM7KCVI.js +479 -0
  19. package/package.json +7 -5
  20. package/skills/te-analysis/SKILL.md +10 -10
  21. package/skills/te-analysis/references/build-entity-details-sql.md +10 -10
  22. package/skills/te-analysis/references/build-event-details-sql.md +10 -10
  23. package/skills/te-analysis/references/create-alert.md +4 -4
  24. package/skills/te-analysis/references/create-dashboard.md +4 -4
  25. package/skills/te-analysis/references/create-or-update-dashboard-note.md +4 -4
  26. package/skills/te-analysis/references/create-public-access-link.md +4 -4
  27. package/skills/te-analysis/references/create-report.md +10 -10
  28. package/skills/te-analysis/references/create-result-cluster.md +4 -4
  29. package/skills/te-analysis/references/drilldown-user-events.md +6 -6
  30. package/skills/te-analysis/references/drilldown-users.md +4 -4
  31. package/skills/te-analysis/references/get-alert-definition-schema.md +3 -3
  32. package/skills/te-analysis/references/get-alert.md +3 -3
  33. package/skills/te-analysis/references/get-analysis-query-schema.md +4 -4
  34. package/skills/te-analysis/references/get-filter-schema.md +3 -3
  35. package/skills/te-analysis/references/get-groupby-schema.md +3 -3
  36. package/skills/te-analysis/references/get-report-definition.md +3 -3
  37. package/skills/te-analysis/references/get-table-columns.md +3 -3
  38. package/skills/te-analysis/references/list-alerts.md +4 -4
  39. package/skills/te-analysis/references/list-dashboards.md +4 -4
  40. package/skills/te-analysis/references/list-public-access-links.md +3 -3
  41. package/skills/te-analysis/references/list-reports.md +4 -4
  42. package/skills/te-analysis/references/load-filters.md +4 -4
  43. package/skills/te-analysis/references/query-adhoc.md +10 -10
  44. package/skills/te-analysis/references/query-dashboard-detail.md +3 -3
  45. package/skills/te-analysis/references/query-dashboard-report-data.md +9 -9
  46. package/skills/te-analysis/references/query-entity-details.md +10 -10
  47. package/skills/te-analysis/references/query-event-details.md +10 -10
  48. package/skills/te-analysis/references/query-report-data.md +11 -11
  49. package/skills/te-analysis/references/update-alert.md +4 -4
  50. package/skills/te-analysis/references/update-dashboard.md +4 -4
  51. package/skills/te-analysis/references/update-public-access-link.md +4 -4
  52. package/skills/te-audience/SKILL.md +5 -5
  53. package/skills/te-audience/references/create-cluster.md +10 -10
  54. package/skills/te-audience/references/create-tag.md +10 -10
  55. package/skills/te-audience/references/get-cluster-definition-schema.md +9 -9
  56. package/skills/te-audience/references/get-clusters-by-name.md +3 -3
  57. package/skills/te-audience/references/get-tag-definition-schema.md +3 -3
  58. package/skills/te-audience/references/get-tags-by-name.md +3 -3
  59. package/skills/te-audience/references/list-cluster-members.md +4 -4
  60. package/skills/te-audience/references/list-clusters.md +4 -4
  61. package/skills/te-audience/references/list-tag-members.md +4 -4
  62. package/skills/te-audience/references/list-tags.md +4 -4
  63. package/skills/te-audience/references/refresh-cluster.md +3 -3
  64. package/skills/te-audience/references/refresh-tag.md +3 -3
  65. package/skills/te-audience/references/update-cluster.md +9 -9
  66. package/skills/te-audience/references/update-tag.md +10 -10
  67. package/skills/te-common/SKILL.md +2 -2
  68. package/skills/te-common/references/get-resource-url.md +5 -5
  69. package/skills/te-common/references/list-projects.md +3 -3
  70. package/skills/te-community/SKILL.md +61 -69
  71. package/skills/te-community/references/community-activity-analysis.md +43 -43
  72. package/skills/te-community/references/community-analyzing-official-content.md +47 -47
  73. package/skills/te-community/references/community-analyzing-theme-comment.md +87 -87
  74. package/skills/te-community/references/community-character-analysis.md +44 -44
  75. package/skills/te-community/references/community-daily-report.md +56 -53
  76. package/skills/te-community/references/community-hottopic-insight.md +81 -87
  77. package/skills/te-community/references/community-weekly-report.md +54 -53
  78. package/skills/te-community/references/get_channel_info.md +9 -9
  79. package/skills/te-community/references/get_comment_tag_analysis.md +15 -15
  80. package/skills/te-community/references/get_comments_summary.md +15 -15
  81. package/skills/te-community/references/get_corpus_tags.md +9 -9
  82. package/skills/te-community/references/get_daily_summary.md +10 -10
  83. package/skills/te-community/references/get_hot_topics.md +12 -12
  84. package/skills/te-community/references/get_livestream_analysis.md +9 -9
  85. package/skills/te-community/references/get_livestream_detail.md +19 -19
  86. package/skills/te-community/references/get_livestream_list.md +13 -13
  87. package/skills/te-community/references/get_livestream_overview.md +11 -11
  88. package/skills/te-community/references/get_livestream_room_metrics.md +12 -12
  89. package/skills/te-community/references/get_livestream_rooms.md +12 -12
  90. package/skills/te-community/references/get_overview_metrics.md +12 -12
  91. package/skills/te-community/references/get_post_detail.md +21 -21
  92. package/skills/te-community/references/get_risk_content.md +23 -23
  93. package/skills/te-community/references/get_sentiment_overview.md +16 -16
  94. package/skills/te-community/references/get_tag_trends.md +13 -13
  95. package/skills/te-community/references/get_topic_detail.md +12 -12
  96. package/skills/te-community/references/search_posts.md +26 -26
  97. package/skills/te-dataops/SKILL.md +390 -392
  98. package/skills/te-dataops/references/dataops-flow-create.md +87 -87
  99. package/skills/te-dataops/references/dataops-flow-monitor.md +65 -65
  100. package/skills/te-dataops/references/dataops-integration.md +90 -85
  101. package/skills/te-dataops/references/dataops-query.md +58 -58
  102. package/skills/te-dataops/references/dataops-table.md +63 -63
  103. package/skills/te-engage/SKILL.md +103 -103
  104. package/skills/te-engage/references/add-approver.md +11 -11
  105. package/skills/te-engage/references/add-channel.md +34 -34
  106. package/skills/te-engage/references/approver-list.md +8 -8
  107. package/skills/te-engage/references/cancel-query-by-request-id.md +10 -10
  108. package/skills/te-engage/references/channel-detail.md +13 -13
  109. package/skills/te-engage/references/channel-list.md +15 -15
  110. package/skills/te-engage/references/config-channel-detail.md +10 -10
  111. package/skills/te-engage/references/config-channel-list.md +11 -11
  112. package/skills/te-engage/references/config-item-analysis-report.md +21 -21
  113. package/skills/te-engage/references/config-item-detail.md +10 -10
  114. package/skills/te-engage/references/config-item-list.md +8 -8
  115. package/skills/te-engage/references/config-item-strategy-comparison.md +14 -14
  116. package/skills/te-engage/references/config-item-trigger-report.md +26 -26
  117. package/skills/te-engage/references/copy-config-template.md +16 -16
  118. package/skills/te-engage/references/delete-channel.md +11 -11
  119. package/skills/te-engage/references/delete-config-channel.md +11 -11
  120. package/skills/te-engage/references/delete-config-item.md +12 -12
  121. package/skills/te-engage/references/delete-flow.md +11 -11
  122. package/skills/te-engage/references/flow-ab-split-node-report.md +29 -29
  123. package/skills/te-engage/references/flow-detail.md +19 -19
  124. package/skills/te-engage/references/flow-list.md +8 -8
  125. package/skills/te-engage/references/flow-node-config-schema.md +11 -11
  126. package/skills/te-engage/references/flow-node-detail-report.md +30 -30
  127. package/skills/te-engage/references/flow-node-overview-report.md +27 -27
  128. package/skills/te-engage/references/flow-process-report.md +32 -32
  129. package/skills/te-engage/references/manage-flow.md +44 -44
  130. package/skills/te-engage/references/manage-strategy.md +37 -37
  131. package/skills/te-engage/references/manage-task.md +20 -20
  132. package/skills/te-engage/references/modify-flow-base-info.md +14 -14
  133. package/skills/te-engage/references/save-flow.md +264 -263
  134. package/skills/te-engage/references/strategy-detail.md +16 -16
  135. package/skills/te-engage/references/strategy-list.md +10 -10
  136. package/skills/te-engage/references/task-data-detail.md +47 -47
  137. package/skills/te-engage/references/task-data-overview.md +23 -23
  138. package/skills/te-engage/references/task-detail.md +18 -18
  139. package/skills/te-engage/references/task-experiment-report.md +26 -26
  140. package/skills/te-engage/references/task-list.md +35 -35
  141. package/skills/te-engage/references/task-metric-detail.md +31 -31
  142. package/skills/te-engage/references/task-stats.md +31 -31
  143. package/skills/te-engage/references/update-channel-status.md +13 -13
  144. package/skills/te-engage/references/update-config-channel-status.md +14 -14
  145. package/skills/te-engage/references/validate-flow-node-config.md +15 -15
  146. package/skills/te-engage/references/whitelist-list.md +8 -8
  147. package/skills/te-meta/SKILL.md +5 -5
  148. package/skills/te-meta/references/batch-create-metadata.md +4 -4
  149. package/skills/te-meta/references/batch-edit-metadata.md +3 -3
  150. package/skills/te-meta/references/create-metric.md +12 -12
  151. package/skills/te-meta/references/create-project-mark-time.md +4 -4
  152. package/skills/te-meta/references/create-virtual-event.md +10 -10
  153. package/skills/te-meta/references/create-virtual-property.md +8 -8
  154. package/skills/te-meta/references/delete-project-mark-times.md +3 -3
  155. package/skills/te-meta/references/delete-track-items.md +3 -3
  156. package/skills/te-meta/references/get-metric.md +3 -3
  157. package/skills/te-meta/references/get-project-config.md +3 -3
  158. package/skills/te-meta/references/get-track-program.md +3 -3
  159. package/skills/te-meta/references/list-entities.md +4 -4
  160. package/skills/te-meta/references/list-events.md +4 -4
  161. package/skills/te-meta/references/list-metrics.md +4 -4
  162. package/skills/te-meta/references/list-project-mark-times.md +4 -4
  163. package/skills/te-meta/references/list-project-users.md +3 -3
  164. package/skills/te-meta/references/list-properties.md +4 -4
  165. package/skills/te-meta/references/save-track-items.md +3 -3
  166. package/skills/te-meta/references/update-metric.md +10 -10
  167. package/skills/te-meta/references/update-project-mark-time.md +4 -4
  168. package/skills/te-shared/SKILL.md +8 -8
  169. package/skills/te-community/references/community-release-analysis.md +0 -79
  170. package/skills/te-dataops/references/dataops-operations.md +0 -107
@@ -1,645 +1,643 @@
1
1
  ---
2
2
  name: te-dataops
3
3
  version: 2.0.0
4
- description: "TE 数据开发运维:数据仓库管理、任务流编排、IDE查询、数据集成、运维操作与补数管理"
4
+ description: "TE Data Development and Operations: Data warehouse management, flow orchestration, IDE queries, data integration, operations and backfill management"
5
5
  metadata:
6
6
  requires:
7
- bins: ["te-cli"]
8
- cliHelp: "te-cli dataops_repo --help, te-cli dataops_datatable --help, te-cli dataops_flow --help, te-cli dataops_ide --help, te-cli dataops_integration --help, te-cli dataops_operations --help"
7
+ bins: ["ae-cli"]
8
+ cliHelp: "ae-cli dataops_repo --help, ae-cli dataops_datatable --help, ae-cli dataops_flow --help, ae-cli dataops_ide --help, ae-cli dataops_integration --help, ae-cli dataops_operations --help"
9
9
  ---
10
10
 
11
11
  # te-dataops
12
12
 
13
- > **前置条件:** 使用本技能前,请先阅读 [`te-shared/SKILL.md`](../te-shared/SKILL.md),了解认证、全局参数和安全约束。
13
+ > **Prerequisites:** Before using this skill, please read [`te-shared/SKILL.md`](../te-shared/SKILL.md) to understand authentication, global parameters, and security constraints.
14
14
 
15
- TE 数据开发运维域提供数据仓库管理、任务流编排、IDE SQL 查询、数据集成、运维操作与补数管理等能力,包含以下子命令:
15
+ The TE Data Development and Operations domain provides capabilities for data warehouse management, flow orchestration, IDE SQL queries, data integration, operations and backfill management, including the following subcommands:
16
16
 
17
- | 子命令 | 职责 | 对应场景化 Skill |
18
- |--------|------|-----------------|
19
- | `dataops_repo` | 空间与资源管理 | — |
20
- | `dataops_datatable` | 数据表与视图管理 | `dataops-table` |
21
- | `dataops_flow` | 任务流创建与编排 | `dataops-flow-create` |
22
- | `dataops_flow` | 任务流执行与监控 | `dataops-flow-monitor` |
23
- | `dataops_ide` | 数据探索与 SQL 查询 | `dataops-query` |
24
- | `dataops_integration` | 数据源与数据集成 | `dataops-integration` |
25
- | `dataops_operations` | 运维操作与补数管理 | `dataops-operations` |
17
+ | Subcommand | Responsibility | Corresponding Scenario Skill |
18
+ |------------|----------------|------------------------------|
19
+ | `dataops_repo` | Space and resource management | — |
20
+ | `dataops_datatable` | Data table and view management | `dataops-table` |
21
+ | `dataops_flow` | Flow creation and orchestration | `dataops-flow-create` |
22
+ | `dataops_flow` | Flow execution and monitoring | `dataops-flow-monitor` |
23
+ | `dataops_ide` | Data exploration and SQL queries | `dataops-query` |
24
+ | `dataops_integration` | Datasource and data integration | `dataops-integration` |
25
+ | `dataops_operations` | Operations and backfill management | `dataops-operations` |
26
26
 
27
27
  ---
28
28
 
29
- ## 核心概念与规则
29
+ ## Core Concepts and Rules
30
30
 
31
- 在使用前务必理解以下关键概念,否则极易出错。
31
+ You must understand the following key concepts before use, otherwise errors are highly likely.
32
32
 
33
- ### ID 体系(不可混用)
33
+ ### ID System (Not Interchangeable)
34
34
 
35
- | ID | 来源 | 使用范围 |
36
- |----|------|---------|
37
- | **executeId** | `dataops_flow +execute_flow` 返回 / `+list_flow_instances` 获取 | `dataops_flow` 的所有执行相关命令 |
38
- | **flowInstanceId** | `dataops_operations +search_flow_instances` 获取 | `dataops_operations` 的所有运维命令 |
35
+ | ID | Source | Usage Scope |
36
+ |----|--------|-------------|
37
+ | **executeId** | Returned by `dataops_flow +execute_flow` / obtained via `+list_flow_instances` | All execution-related commands in `dataops_flow` |
38
+ | **flowInstanceId** | Obtained via `dataops_operations +search_flow_instances` | All operations commands in `dataops_operations` |
39
39
 
40
- > **executeId 和 flowInstanceId 不互通,不可混用。** `dataops_flow` 工具用 executeId,`dataops_operations` 工具用 flowInstanceId。
40
+ > **executeId and flowInstanceId are not interchangeable.** `dataops_flow` tools use executeId, `dataops_operations` tools use flowInstanceId.
41
41
 
42
- ### 环境与默认值
42
+ ### Environment and Defaults
43
43
 
44
- | 场景 | 默认环境 | 说明 |
45
- |------|---------|------|
46
- | 大多数 flow/ide/datatable 命令 | `DEV` | 开发环境 |
47
- | `+list_flow_instances` 实例列表 | **PROD** | 运维场景默认查生产 |
48
- | `dataops_operations` 所有命令 | **PROD** | 运维视角关注生产 |
44
+ | Scenario | Default Environment | Description |
45
+ |----------|---------------------|-------------|
46
+ | Most flow/ide/datatable commands | `DEV` | Development environment |
47
+ | `+list_flow_instances` instance list | **PROD** | Operations scenarios default to production |
48
+ | All `dataops_operations` commands | **PROD** | Operations perspective focuses on production |
49
49
 
50
- ### Schema 命名规则
50
+ ### Schema Naming Rules
51
51
 
52
- - DEV 环境: `ws_${spaceCode}_dev`
53
- - PROD 环境: `ws_${spaceCode}_product`
52
+ - DEV environment: `ws_${spaceCode}_dev`
53
+ - PROD environment: `ws_${spaceCode}_product`
54
54
 
55
- ### 职责边界
55
+ ### Responsibility Boundaries
56
56
 
57
- | 操作 | 正确工具 | 禁止使用 |
58
- |------|---------|---------|
59
- | 执行 SELECT 查询 | `dataops_ide` | — |
60
- | 创建/修改/删除数据表(DDL) | `dataops_datatable` | `dataops_ide` |
61
- | 在外部数据源执行 DDL | `dataops_integration +execute_sql` | — |
57
+ | Operation | Correct Tool | Prohibited |
58
+ |-----------|--------------|------------|
59
+ | Execute SELECT queries | `dataops_ide` | — |
60
+ | Create/modify/delete data tables (DDL) | `dataops_datatable` | `dataops_ide` |
61
+ | Execute DDL on external datasources | `dataops_integration +execute_sql` | — |
62
62
 
63
- ### 任务流生命周期
63
+ ### Flow Lifecycle
64
64
 
65
65
  ```
66
- 创建任务流 → 创建任务节点 → 保存任务定义 → 配置依赖 → 配置调度 → DEV 测试 → 发布到 PROD
66
+ Create Flow → Create Task Nodes → Save Task Definitions → Configure Dependencies → Configure Schedule → DEV Testing → Release to PROD
67
67
  ```
68
68
 
69
- ### CRON 格式(6 字段)
69
+ ### CRON Format (6 fields)
70
70
 
71
- `秒 分 时 日 月 周` — 注意比标准 5 字段多一个"秒"。
72
- - `0 0 2 * * ?` — 每天凌晨 2 点
73
- - `0 0 */4 * * ?` — 每 4 小时
74
- - `0 30 8 * * 1-5` — 工作日 8:30
71
+ `second minute hour day month weekday` — Note: one more "second" field than standard 5-field format.
72
+ - `0 0 2 * * ?` — Daily at 2 AM
73
+ - `0 0 */4 * * ?` — Every 4 hours
74
+ - `0 30 8 * * 1-5` — Weekdays at 8:30
75
75
 
76
- ### 预置仓 vs 非预置仓
76
+ ### Preset Repository vs Non-Preset Repository
77
77
 
78
- - **预置仓 (te_etl)**: `datasourceId` 为 `te_etl@TASK_ENGINE_TRINO`,database 字段为空,需要 `gatewayConfig`
79
- - **非预置仓**: `datasourceId` 为具体数据源 ID,database 字段必填
78
+ - **Preset Repository (te_etl)**: `datasourceId` is `te_etl@TASK_ENGINE_TRINO`, database field is empty, requires `gatewayConfig`
79
+ - **Non-Preset Repository**: `datasourceId` is specific datasource ID, database field is required
80
80
 
81
81
  ---
82
82
 
83
- ## 场景路由
83
+ ## Scenario Routing
84
84
 
85
- 根据用户意图选择合适的场景化 Skill,以获取完整的分步工作流指引。
85
+ Choose the appropriate scenario skill based on user intent to get complete step-by-step workflow guidance.
86
86
 
87
- | 用户意图 | 触发 Skill | 关键词 |
88
- |---------|-----------|--------|
89
- | 创建任务流、添加节点、配置调度、发布 | `dataops-flow-create` | 创建任务流、新建工作流、配置调度、添加任务节点、发布、cron、定时执行 |
90
- | 查看执行状态、排查失败、查看日志 | `dataops-flow-monitor` | 执行任务流、运行实例、监控、日志、停止、DAG、排错 |
91
- | 创建数据源、配置同步方案、执行同步 | `dataops-integration` | 数据源、同步、integration、sync、字段映射、数据接入、MySQL、ClickHouse |
92
- | 运维实例管理、重跑失败、补数操作 | `dataops-operations` | 运维、补数、重跑、告警、operations、backfill |
93
- | 浏览元数据、搜索表、执行 SQL 查询 | `dataops-query` | 查询、SQL、数据探索、搜索表、查看表结构、IDE、catalog、select |
94
- | 建表、创建视图、批量创建关联视图 | `dataops-table` | 建表、创建表、视图、数据字典、关联视图、linkview、DDL |
87
+ | User Intent | Trigger Skill | Keywords |
88
+ |-------------|---------------|----------|
89
+ | Create flow, add nodes, configure schedule, release | `dataops-flow-create` | create flow, new workflow, configure schedule, add task node, release, cron, scheduled execution |
90
+ | View execution status, troubleshoot failures, view logs | `dataops-flow-monitor` | execute flow, running instance, monitor, logs, stop, DAG, troubleshoot |
91
+ | Create datasource, configure sync solution, execute sync | `dataops-integration` | datasource, sync, integration, sync, field mapping, data ingestion, MySQL, ClickHouse |
92
+ | Operations instance management, rerun failures, backfill operations | `dataops-operations` | operations, backfill, rerun, alert, operations, backfill |
93
+ | Browse metadata, search tables, execute SQL queries | `dataops-query` | query, SQL, data exploration, search tables, view table structure, IDE, catalog, select |
94
+ | Create tables, create views, batch create linked views | `dataops-table` | create table, table creation, view, data dictionary, linked view, linkview, DDL |
95
95
 
96
96
  ---
97
97
 
98
- ## 1. 空间与资源管理
98
+ ## 1. Space and Resource Management
99
99
 
100
100
  ```bash
101
- # 获取空间列表(入口命令,获取 spaceCode)
102
- te-cli dataops_repo +list_spaces
101
+ # Get space list (entry command, get spaceCode)
102
+ ae-cli dataops_repo +list_spaces
103
103
 
104
- # 获取仓库列表
105
- te-cli dataops_repo +list_repos --spaceCode "${spaceCode}"
104
+ # Get repository list
105
+ ae-cli dataops_repo +list_repos --spaceCode "${spaceCode}"
106
106
 
107
- # 浏览仓库结构
108
- te-cli dataops_repo +list_catalogs --spaceCode "${spaceCode}" --repoCode "te_etl"
109
- te-cli dataops_repo +list_schemas --spaceCode "${spaceCode}" --repoCode "te_etl" --catalog "hive"
107
+ # Browse repository structure
108
+ ae-cli dataops_repo +list_catalogs --spaceCode "${spaceCode}" --repoCode "te_etl"
109
+ ae-cli dataops_repo +list_schemas --spaceCode "${spaceCode}" --repoCode "te_etl" --catalog "hive"
110
110
 
111
- # 查看空间成员
112
- te-cli dataops_repo +list_space_members --spaceCode "${spaceCode}"
111
+ # View space members
112
+ ae-cli dataops_repo +list_space_members --spaceCode "${spaceCode}"
113
113
 
114
- # 添加成员
115
- te-cli dataops_repo +add_space_member --spaceCode "${spaceCode}" --openId "${openId}" --confirmed true
114
+ # Add member
115
+ ae-cli dataops_repo +add_space_member --spaceCode "${spaceCode}" --openId "${openId}" --confirmed true
116
116
 
117
- # 查看空间参数
118
- te-cli dataops_repo +list_support_params --spaceCode "${spaceCode}"
117
+ # View space parameters
118
+ ae-cli dataops_repo +list_support_params --spaceCode "${spaceCode}"
119
119
 
120
- # 预览参数表达式
121
- te-cli dataops_repo +preview_param_expression --spaceCode "${spaceCode}" --expression '${ws_run_date}'
120
+ # Preview parameter expression
121
+ ae-cli dataops_repo +preview_param_expression --spaceCode "${spaceCode}" --expression '${ws_run_date}'
122
122
  ```
123
123
 
124
- ### 命令速查
124
+ ### Command Quick Reference
125
125
 
126
- | 命令 | 用途 | 关键 Flags |
127
- |------|------|-----------|
128
- | `+list_spaces` | 空间列表 | — |
129
- | `+list_repos` | 仓库列表 | `--spaceCode` |
130
- | `+list_catalogs` | catalog 列表 | `--spaceCode` `--repoCode` |
131
- | `+list_schemas` | schema 列表 | `--spaceCode` `--repoCode` `--catalog` |
132
- | `+list_space_members` | 空间成员 | `--spaceCode` |
133
- | `+add_space_member` | 添加成员 | `--spaceCode` `--openId` `--confirmed` |
134
- | `+list_support_params` | 空间参数 | `--spaceCode` |
135
- | `+preview_param_expression` | 预览参数 | `--spaceCode` `--expression` |
136
- | `+list_param_used_flows` | 参数引用的任务流 | `--spaceCode` `--paramKey` |
126
+ | Command | Purpose | Key Flags |
127
+ |---------|---------|-----------|
128
+ | `+list_spaces` | Space list | — |
129
+ | `+list_repos` | Repository list | `--spaceCode` |
130
+ | `+list_catalogs` | Catalog list | `--spaceCode` `--repoCode` |
131
+ | `+list_schemas` | Schema list | `--spaceCode` `--repoCode` `--catalog` |
132
+ | `+list_space_members` | Space members | `--spaceCode` |
133
+ | `+add_space_member` | Add member | `--spaceCode` `--openId` `--confirmed` |
134
+ | `+list_support_params` | Space parameters | `--spaceCode` |
135
+ | `+preview_param_expression` | Preview parameter | `--spaceCode` `--expression` |
136
+ | `+list_param_used_flows` | Flows using parameter | `--spaceCode` `--paramKey` |
137
137
 
138
138
  ---
139
139
 
140
- ## 2. 数据表与视图管理
140
+ ## 2. Data Table and View Management
141
141
 
142
- > 详细分步工作流见 `dataops-table` Skill。
142
+ > See `dataops-table` Skill for detailed step-by-step workflows.
143
143
 
144
- ### 典型流程:搜索 → 查看 → 创建
144
+ ### Typical Flow: Search → View → Create
145
145
 
146
146
  ```bash
147
- # 在数据字典中搜索表
148
- te-cli dataops_datatable +dict_search_tables --spaceCode "${spaceCode}" --search "user" --maxResults 20
147
+ # Search tables in data dictionary
148
+ ae-cli dataops_datatable +dict_search_tables --spaceCode "${spaceCode}" --search "user" --maxResults 20
149
149
 
150
- # 获取表详情(字段定义、DDL、数据血缘)
151
- te-cli dataops_datatable +get_table_detail --spaceCode "${spaceCode}" --tableName "dwd_user_info"
150
+ # Get table details (field definitions, DDL, data lineage)
151
+ ae-cli dataops_datatable +get_table_detail --spaceCode "${spaceCode}" --tableName "dwd_user_info"
152
152
 
153
- # 分页查询已注册的表列表
154
- te-cli dataops_datatable +list_tables_by_page --spaceCode "${spaceCode}" --search "user" --pageNum 1 --pageSize 20
153
+ # Paginated query of registered tables
154
+ ae-cli dataops_datatable +list_tables_by_page --spaceCode "${spaceCode}" --search "user" --pageNum 1 --pageSize 20
155
155
 
156
- # 按仓库维度获取层级结构
157
- te-cli dataops_datatable +struct_by_repo --spaceCode "${spaceCode}"
156
+ # Get hierarchy by repository dimension
157
+ ae-cli dataops_datatable +struct_by_repo --spaceCode "${spaceCode}"
158
158
 
159
- # 创建物理表(DEV 环境,DDL 遵循 Trino 规范)
160
- te-cli dataops_datatable +create_table --spaceCode "${spaceCode}" \
159
+ # Create physical table (DEV environment, DDL follows Trino specifications)
160
+ ae-cli dataops_datatable +create_table --spaceCode "${spaceCode}" \
161
161
  --ddl "CREATE TABLE dwd_user_info (user_id VARCHAR, user_name VARCHAR, age INTEGER) WITH (format = 'ORC')" \
162
162
  --repoCode "te_etl" --catalog "hive" --schema "ws_default_dev" --confirmed true
163
163
 
164
- # 创建 PROD 环境(同 DDL,schema 改为 product 库)
165
- te-cli dataops_datatable +create_table --spaceCode "${spaceCode}" \
164
+ # Create PROD environment (same DDL, change schema to product database)
165
+ ae-cli dataops_datatable +create_table --spaceCode "${spaceCode}" \
166
166
  --ddl "CREATE TABLE dwd_user_info (user_id VARCHAR, user_name VARCHAR, age INTEGER) WITH (format = 'ORC')" \
167
167
  --repoCode "te_etl" --catalog "hive" --schema "ws_default_product" --confirmed true
168
168
 
169
- # 创建视图
170
- te-cli dataops_datatable +create_view --spaceCode "${spaceCode}" \
169
+ # Create view
170
+ ae-cli dataops_datatable +create_view --spaceCode "${spaceCode}" \
171
171
  --ddl "CREATE VIEW v_user_info AS SELECT user_id, user_name FROM hive.ws_default_dev.dwd_user_info" \
172
172
  --repoCode "te_etl" --catalog "hive" --schema "ws_default_dev" --confirmed true
173
173
 
174
- # 批量创建直连视图(异步)
175
- te-cli dataops_datatable +batch_create --spaceCode "${spaceCode}" \
174
+ # Batch create linked views (async)
175
+ ae-cli dataops_datatable +batch_create --spaceCode "${spaceCode}" \
176
176
  --srcRepoCode "te_etl" --srcCatalog "hive" --srcSchema "ws_default_hidden" \
177
177
  --processType 2 --batchCreationMode 1 --owner "${ownerOpenId}" \
178
178
  --viewInfos '[{"viewName":"v_orders","srcTableName":"ta_event_123","srcTableType":"TABLE"}]' \
179
179
  --confirmed true
180
180
 
181
- # 轮询批量创建状态(建议 3-5 秒间隔)
182
- te-cli dataops_datatable +linkview_get_batch_status --spaceCode "${spaceCode}" --batchId "${batchId}"
181
+ # Poll batch creation status (recommend 3-5 second interval)
182
+ ae-cli dataops_datatable +linkview_get_batch_status --spaceCode "${spaceCode}" --batchId "${batchId}"
183
183
  ```
184
184
 
185
- ### 命令速查
186
-
187
- | 命令 | 用途 | 关键 Flags |
188
- |------|------|-----------|
189
- | `+dict_search_tables` | 数据字典搜索 | `--spaceCode` `--search` `--maxResults` |
190
- | `+get_table_detail` | 表详情 | `--spaceCode` `--tableName` |
191
- | `+list_tables_by_page` | 分页列表 | `--spaceCode` `--search` `--pageNum` `--pageSize` |
192
- | `+struct_by_repo` | 按仓库层级 | `--spaceCode` `--search` |
193
- | `+list_system_tables` | 系统表列表 | `--spaceCode` `--projectId`/`--projectName` `--pageNum` `--pageSize` |
194
- | `+create_table` | 创建物理表 | `--spaceCode` `--ddl` `--repoCode` `--catalog` `--schema` `--confirmed` |
195
- | `+create_view` | 创建视图 | `--spaceCode` `--ddl` `--repoCode` `--catalog` `--schema` `--confirmed` |
196
- | `+batch_create` | 批量创建视图 | `--spaceCode` `--srcRepoCode` `--srcCatalog` `--srcSchema` `--processType` `--batchCreationMode` `--owner` `--viewInfos` `--confirmed` |
197
- | `+linkview_list_source_tables` | 可用源表 | `--spaceCode` `--srcRepoCode` `--srcCatalog` `--srcSchema` |
198
- | `+linkview_get_batch_status` | 批量状态 | `--spaceCode` `--batchId` |
199
- | `+list_batches` | 历史批量记录 | `--spaceCode` `--status` |
200
-
201
- ### 参数说明
202
-
203
- - **schema 命名**: DEV 环境用 `ws_${spaceCode}_dev`,PROD 环境用 `ws_${spaceCode}_product`
204
- - **processType**: `1`=仅 DEV | `2`=DEV+PROD
205
- - **batchCreationMode**: `1`=全量同步 | `2`=失败重试
206
- - **表名规则**: `^[a-z][0-9a-z_]{0,127}$`
207
- - **DDL 规范**: 遵循 Trino DDL 语法
185
+ ### Command Quick Reference
186
+
187
+ | Command | Purpose | Key Flags |
188
+ |---------|---------|-----------|
189
+ | `+dict_search_tables` | Data dictionary search | `--spaceCode` `--search` `--maxResults` |
190
+ | `+get_table_detail` | Table details | `--spaceCode` `--tableName` |
191
+ | `+list_tables_by_page` | Paginated list | `--spaceCode` `--search` `--pageNum` `--pageSize` |
192
+ | `+struct_by_repo` | By repository hierarchy | `--spaceCode` `--search` |
193
+ | `+list_system_tables` | System table list | `--spaceCode` `--projectId`/`--projectName` `--pageNum` `--pageSize` |
194
+ | `+create_table` | Create physical table | `--spaceCode` `--ddl` `--repoCode` `--catalog` `--schema` `--confirmed` |
195
+ | `+create_view` | Create view | `--spaceCode` `--ddl` `--repoCode` `--catalog` `--schema` `--confirmed` |
196
+ | `+batch_create` | Batch create views | `--spaceCode` `--srcRepoCode` `--srcCatalog` `--srcSchema` `--processType` `--batchCreationMode` `--owner` `--viewInfos` `--confirmed` |
197
+ | `+linkview_list_source_tables` | Available source tables | `--spaceCode` `--srcRepoCode` `--srcCatalog` `--srcSchema` |
198
+ | `+linkview_get_batch_status` | Batch status | `--spaceCode` `--batchId` |
199
+ | `+list_batches` | Historical batch records | `--spaceCode` `--status` |
200
+
201
+ ### Parameter Notes
202
+
203
+ - **schema naming**: DEV environment uses `ws_${spaceCode}_dev`, PROD environment uses `ws_${spaceCode}_product`
204
+ - **processType**: `1`=DEV only | `2`=DEV+PROD
205
+ - **batchCreationMode**: `1`=full sync | `2`=retry failures
206
+ - **Table name rule**: `^[a-z][0-9a-z_]{0,127}$`
207
+ - **DDL specification**: Follow Trino DDL syntax
208
208
 
209
209
  ---
210
210
 
211
- ## 3. 任务流编排
211
+ ## 3. Flow Orchestration
212
212
 
213
- 任务流编排分两个场景化 Skill:**创建配置**和**执行监控**。
213
+ Flow orchestration is divided into two scenario skills: **creation and configuration** and **execution and monitoring**.
214
214
 
215
- ### 3a. 创建与配置
215
+ ### 3a. Creation and Configuration
216
216
 
217
- > 详细 8 步完整流程见 `dataops-flow-create` Skill。
217
+ > See `dataops-flow-create` Skill for detailed 8-step complete process.
218
218
 
219
- **生命周期:创建 → 配置节点 → 配置调度 → DEV 测试 → 发布 PROD**
219
+ **Lifecycle: Create → Configure Nodes → Configure Schedule → DEV Testing → Release to PROD**
220
220
 
221
221
  ```bash
222
- # 创建任务流(返回 flowCode)
223
- te-cli dataops_flow +create_flow --spaceCode "${spaceCode}" \
224
- --flowName "每日ETL流程" --remark "处理用户数据" --confirmed true
222
+ # Create flow (returns flowCode)
223
+ ae-cli dataops_flow +create_flow --spaceCode "${spaceCode}" \
224
+ --flowName "Daily ETL Process" --remark "Process user data" --confirmed true
225
225
 
226
- # 创建 SQL 任务节点(返回 taskCode)
227
- te-cli dataops_flow +create_task --spaceCode "${spaceCode}" \
228
- --flowCode "${flowCode}" --taskName "处理用户数据" --taskType "TRINO_SQL" --confirmed true
226
+ # Create SQL task node (returns taskCode)
227
+ ae-cli dataops_flow +create_task --spaceCode "${spaceCode}" \
228
+ --flowCode "${flowCode}" --taskName "Process User Data" --taskType "TRINO_SQL" --confirmed true
229
229
 
230
- # 创建带前置依赖的任务
231
- te-cli dataops_flow +create_task --spaceCode "${spaceCode}" \
232
- --flowCode "${flowCode}" --taskName "导出结果" --taskType "TRINO_SQL" \
230
+ # Create task with upstream dependency
231
+ ae-cli dataops_flow +create_task --spaceCode "${spaceCode}" \
232
+ --flowCode "${flowCode}" --taskName "Export Results" --taskType "TRINO_SQL" \
233
233
  --preTaskCode "${upstreamTaskCode}" --confirmed true
234
234
 
235
- # 保存任务定义(SQL 任务)
236
- te-cli dataops_flow +save_task_definition --spaceCode "${spaceCode}" \
235
+ # Save task definition (SQL task)
236
+ ae-cli dataops_flow +save_task_definition --spaceCode "${spaceCode}" \
237
237
  --flowCode "${flowCode}" --taskCode "${taskCode}" \
238
238
  --taskContentJson '{"sql":"SELECT * FROM dwd_user","repoCode":"te_etl","catalog":"hive","schema":"ws_default_dev"}' \
239
239
  --failRetryTimes 3 --failRetryInterval 30 --timeout 60 --confirmed true
240
240
 
241
- # 校验 SQL(推荐在保存前执行)
242
- te-cli dataops_flow +validate_task_sql --spaceCode "${spaceCode}" \
241
+ # Validate SQL (recommended before saving)
242
+ ae-cli dataops_flow +validate_task_sql --spaceCode "${spaceCode}" \
243
243
  --flowCode "${flowCode}" --taskCode "${taskCode}" \
244
244
  --sql "SELECT * FROM dwd_user" --repoCode "te_etl" \
245
245
  --catalog "hive" --schema "ws_default_dev"
246
246
 
247
- # 添加任务依赖关系(DAG 连线)
248
- te-cli dataops_flow +add_task_relation --spaceCode "${spaceCode}" \
247
+ # Add task dependency (DAG connection)
248
+ ae-cli dataops_flow +add_task_relation --spaceCode "${spaceCode}" \
249
249
  --flowCode "${flowCode}" --preTaskCode "${upstreamTaskCode}" --taskCode "${downstreamTaskCode}" \
250
250
  --confirmed true
251
251
 
252
- # 配置定时调度(CRON 6 字段: 秒 分 时 日 月 周)
253
- te-cli dataops_flow +save_schedule_config --spaceCode "${spaceCode}" \
252
+ # Configure scheduled execution (CRON 6 fields: second minute hour day month weekday)
253
+ ae-cli dataops_flow +save_schedule_config --spaceCode "${spaceCode}" \
254
254
  --flowCode "${flowCode}" --scheduled 1 --scheduleType "CRON" \
255
255
  --cron "0 0 2 * * ?" --confirmed true
256
256
 
257
- # DEV 环境手动测试
258
- te-cli dataops_flow +execute_flow --spaceCode "${spaceCode}" \
257
+ # Manual testing in DEV environment
258
+ ae-cli dataops_flow +execute_flow --spaceCode "${spaceCode}" \
259
259
  --flowCode "${flowCode}" --env "DEV" --confirmed true
260
260
 
261
- # 发布到生产(PROD 调度立即生效,不会中断运行中的实例)
262
- te-cli dataops_flow +release_flow --spaceCode "${spaceCode}" \
261
+ # Release to production (PROD schedule takes effect immediately, does not interrupt running instances)
262
+ ae-cli dataops_flow +release_flow --spaceCode "${spaceCode}" \
263
263
  --flowCode "${flowCode}" --confirmed true
264
264
  ```
265
265
 
266
- **任务节点类型:**
266
+ **Task Node Types:**
267
267
 
268
- | 类型 | 说明 | 典型用途 |
269
- |------|------|---------|
270
- | TRINO_SQL | Trino SQL 查询 | 数据加工、ETL |
271
- | SHELL | Shell 脚本 | 系统命令、文件操作 |
272
- | FLOW_CHECK | 流程检查 | 检查上游任务流是否完成 |
273
- | TASK_CHECK | 任务检查 | 检查指定任务是否完成 |
274
- | OFFLINE_SYNC | 离线同步 | 集成方案数据同步(需 syncId) |
275
- | APP_SYNC | 应用同步 | 应用表数据同步(需 syncId) |
276
- | PLACE_HOLDER | 占位符 | 流程控制、逻辑分组 |
268
+ | Type | Description | Typical Use |
269
+ |------|-------------|-------------|
270
+ | TRINO_SQL | Trino SQL query | Data processing, ETL |
271
+ | SHELL | Shell script | System commands, file operations |
272
+ | FLOW_CHECK | Flow check | Check if upstream flow is complete |
273
+ | TASK_CHECK | Task check | Check if specified task is complete |
274
+ | OFFLINE_SYNC | Offline sync | Integration solution data sync (requires syncId) |
275
+ | APP_SYNC | App sync | App table data sync (requires syncId) |
276
+ | PLACE_HOLDER | Placeholder | Flow control, logical grouping |
277
277
 
278
- ### 3b. 执行与监控
278
+ ### 3b. Execution and Monitoring
279
279
 
280
- > 详细排查工作流见 `dataops-flow-monitor` Skill。
280
+ > See `dataops-flow-monitor` Skill for detailed troubleshooting workflows.
281
281
 
282
282
  ```bash
283
- # 搜索任务流(获取 flowCode)
284
- te-cli dataops_flow +list_flows --spaceCode "${spaceCode}" --keyword "etl"
283
+ # Search flows (get flowCode)
284
+ ae-cli dataops_flow +list_flows --spaceCode "${spaceCode}" --keyword "etl"
285
285
 
286
- # 查看任务流基本信息
287
- te-cli dataops_flow +get_flow_detail --spaceCode "${spaceCode}" --flowCode "${flowCode}"
286
+ # View flow basic information
287
+ ae-cli dataops_flow +get_flow_detail --spaceCode "${spaceCode}" --flowCode "${flowCode}"
288
288
 
289
- # 查看定义态 DAG(静态结构)
290
- te-cli dataops_flow +get_flow_dag --spaceCode "${spaceCode}" --flowCode "${flowCode}"
289
+ # View definition DAG (static structure)
290
+ ae-cli dataops_flow +get_flow_dag --spaceCode "${spaceCode}" --flowCode "${flowCode}"
291
291
 
292
- # 查看调度配置
293
- te-cli dataops_flow +get_schedule_config --spaceCode "${spaceCode}" --flowCode "${flowCode}"
292
+ # View schedule configuration
293
+ ae-cli dataops_flow +get_schedule_config --spaceCode "${spaceCode}" --flowCode "${flowCode}"
294
294
 
295
- # 查看执行实例列表(默认 PROD 环境,按时间倒序)
296
- te-cli dataops_flow +list_flow_instances --spaceCode "${spaceCode}" \
295
+ # View execution instance list (default PROD environment, sorted by time descending)
296
+ ae-cli dataops_flow +list_flow_instances --spaceCode "${spaceCode}" \
297
297
  --flowCode "${flowCode}" --env "PROD" --size 30
298
298
 
299
- # 查看运行态 DAG(含各节点执行状态)
300
- te-cli dataops_flow +get_execute_dag --spaceCode "${spaceCode}" --executeId "${executeId}"
299
+ # View runtime DAG (with execution status for each node)
300
+ ae-cli dataops_flow +get_execute_dag --spaceCode "${spaceCode}" --executeId "${executeId}"
301
301
 
302
- # 查看执行记录详情
303
- te-cli dataops_flow +get_execute_record --spaceCode "${spaceCode}" --executeId "${executeId}"
302
+ # View execution record details
303
+ ae-cli dataops_flow +get_execute_record --spaceCode "${spaceCode}" --executeId "${executeId}"
304
304
 
305
- # 查看任务日志(从 DAG 获取 bsTaskInstanceId 和 taskCode)
306
- te-cli dataops_flow +get_task_instance_log --bsTaskInstanceId "${instanceId}" \
305
+ # View task logs (get bsTaskInstanceId and taskCode from DAG)
306
+ ae-cli dataops_flow +get_task_instance_log --bsTaskInstanceId "${instanceId}" \
307
307
  --taskCode "${taskCode}" --limit 100
308
308
 
309
- # 查看任务参数
310
- te-cli dataops_flow +get_task_params --spaceCode "${spaceCode}" \
309
+ # View task parameters
310
+ ae-cli dataops_flow +get_task_params --spaceCode "${spaceCode}" \
311
311
  --flowCode "${flowCode}" --taskCode "${taskCode}"
312
312
 
313
- # 手动触发执行
314
- te-cli dataops_flow +execute_flow --spaceCode "${spaceCode}" \
313
+ # Manually trigger execution
314
+ ae-cli dataops_flow +execute_flow --spaceCode "${spaceCode}" \
315
315
  --flowCode "${flowCode}" --env "DEV" --confirmed true
316
316
 
317
- # 停止执行(不可撤销)
318
- te-cli dataops_flow +stop_flow --spaceCode "${spaceCode}" \
317
+ # Stop execution (irreversible)
318
+ ae-cli dataops_flow +stop_flow --spaceCode "${spaceCode}" \
319
319
  --flowCode "${flowCode}" --executeId "${executeId}" --confirmed true
320
320
 
321
- # 更新任务流信息
322
- te-cli dataops_flow +update_flow --spaceCode "${spaceCode}" \
323
- --flowCode "${flowCode}" --flowName "新名称" --remark "新备注" --confirmed true
321
+ # Update flow information
322
+ ae-cli dataops_flow +update_flow --spaceCode "${spaceCode}" \
323
+ --flowCode "${flowCode}" --flowName "New Name" --remark "New Remark" --confirmed true
324
324
  ```
325
325
 
326
- ### 命令速查(任务流全量)
327
-
328
- | 命令 | 用途 | 关键 Flags |
329
- |------|------|-----------|
330
- | `+create_flow` | 创建任务流 | `--spaceCode` `--flowName` `--remark` `--confirmed` |
331
- | `+create_task` | 创建任务节点 | `--spaceCode` `--flowCode` `--taskName` `--taskType` `--syncId` `--preTaskCode` `--confirmed` |
332
- | `+save_task_definition` | 保存任务定义 | `--spaceCode` `--flowCode` `--taskCode` `--taskContentJson` `--failRetryTimes` `--failRetryInterval` `--timeout` `--confirmed` |
333
- | `+validate_task_sql` | 校验 SQL | `--spaceCode` `--flowCode` `--taskCode` `--sql` `--repoCode` `--catalog` `--schema` |
334
- | `+add_task_relation` | 添加依赖 | `--spaceCode` `--flowCode` `--preTaskCode` `--taskCode` `--confirmed` |
335
- | `+save_schedule_config` | 配置调度 | `--spaceCode` `--flowCode` `--scheduled` `--scheduleType` `--cron` `--confirmed` |
336
- | `+get_schedule_config` | 查看调度 | `--spaceCode` `--flowCode` `--env` |
337
- | `+list_flows` | 搜索任务流 | `--spaceCode` `--keyword` |
338
- | `+get_flow_detail` | 任务流信息 | `--spaceCode` `--flowCode` `--env` |
339
- | `+get_flow_dag` | 定义态 DAG | `--spaceCode` `--flowCode` `--env` |
340
- | `+update_flow` | 更新任务流 | `--spaceCode` `--flowCode` `--flowName` `--remark` `--confirmed` |
341
- | `+execute_flow` | 手动执行 | `--spaceCode` `--flowCode` `--env` `--confirmed` |
342
- | `+stop_flow` | 停止执行 | `--spaceCode` `--flowCode` `--executeId` `--confirmed` |
343
- | `+release_flow` | 发布到生产 | `--spaceCode` `--flowCode` `--confirmed` |
344
- | `+list_flow_instances` | 实例列表 | `--spaceCode` `--flowCode` `--env` `--size` |
345
- | `+get_execute_record` | 执行记录 | `--spaceCode` `--executeId` |
346
- | `+get_execute_dag` | 运行态 DAG | `--spaceCode` `--executeId` |
347
- | `+get_task_instance_log` | 任务日志 | `--bsTaskInstanceId` `--taskCode` `--startOffset` `--limit` |
348
- | `+get_task_params` | 任务参数 | `--spaceCode` `--flowCode` `--taskCode` `--env` |
349
-
350
- ### 参数说明
351
-
352
- - **参数引用**: 任务中通过 `${paramKey}` 引用空间参数(如 `${ws_run_date}`)
353
- - **env**: `DEV`(开发,默认)| `PROD`(生产)
354
- - **任务状态**: `success` / `failure` / `running` / `waiting`
355
- - **DAG 区别**: `+get_flow_dag` 返回静态定义结构,`+get_execute_dag` 返回含执行状态的运行态结构
356
- - **taskContentJson 格式**(因 taskType 而异):
326
+ ### Command Quick Reference (Complete Flow Commands)
327
+
328
+ | Command | Purpose | Key Flags |
329
+ |---------|---------|-----------|
330
+ | `+create_flow` | Create flow | `--spaceCode` `--flowName` `--remark` `--confirmed` |
331
+ | `+create_task` | Create task node | `--spaceCode` `--flowCode` `--taskName` `--taskType` `--syncId` `--preTaskCode` `--confirmed` |
332
+ | `+save_task_definition` | Save task definition | `--spaceCode` `--flowCode` `--taskCode` `--taskContentJson` `--failRetryTimes` `--failRetryInterval` `--timeout` `--confirmed` |
333
+ | `+validate_task_sql` | Validate SQL | `--spaceCode` `--flowCode` `--taskCode` `--sql` `--repoCode` `--catalog` `--schema` |
334
+ | `+add_task_relation` | Add dependency | `--spaceCode` `--flowCode` `--preTaskCode` `--taskCode` `--confirmed` |
335
+ | `+save_schedule_config` | Configure schedule | `--spaceCode` `--flowCode` `--scheduled` `--scheduleType` `--cron` `--confirmed` |
336
+ | `+get_schedule_config` | View schedule | `--spaceCode` `--flowCode` `--env` |
337
+ | `+list_flows` | Search flows | `--spaceCode` `--keyword` |
338
+ | `+get_flow_detail` | Flow information | `--spaceCode` `--flowCode` `--env` |
339
+ | `+get_flow_dag` | Definition DAG | `--spaceCode` `--flowCode` `--env` |
340
+ | `+update_flow` | Update flow | `--spaceCode` `--flowCode` `--flowName` `--remark` `--confirmed` |
341
+ | `+execute_flow` | Manual execution | `--spaceCode` `--flowCode` `--env` `--confirmed` |
342
+ | `+stop_flow` | Stop execution | `--spaceCode` `--flowCode` `--executeId` `--confirmed` |
343
+ | `+release_flow` | Release to production | `--spaceCode` `--flowCode` `--confirmed` |
344
+ | `+list_flow_instances` | Instance list | `--spaceCode` `--flowCode` `--env` `--size` |
345
+ | `+get_execute_record` | Execution record | `--spaceCode` `--executeId` |
346
+ | `+get_execute_dag` | Runtime DAG | `--spaceCode` `--executeId` |
347
+ | `+get_task_instance_log` | Task logs | `--bsTaskInstanceId` `--taskCode` `--startOffset` `--limit` |
348
+ | `+get_task_params` | Task parameters | `--spaceCode` `--flowCode` `--taskCode` `--env` |
349
+
350
+ ### Parameter Notes
351
+
352
+ - **Parameter reference**: Reference workspace parameters in tasks using `${paramKey}` (e.g., `${ws_run_date}`)
353
+ - **env**: `DEV` (development, default) | `PROD` (production)
354
+ - **Task status**: `success` / `failure` / `running` / `waiting`
355
+ - **DAG difference**: `+get_flow_dag` returns static definition structure, `+get_execute_dag` returns runtime structure with execution status
356
+ - **taskContentJson format** (varies by taskType):
357
357
  - TRINO_SQL: `{"sql":"SELECT ...","repoCode":"xxx","catalog":"hive","schema":"db"}`
358
358
  - SHELL: `{"script":"#!/bin/bash\n..."}`
359
359
 
360
360
  ---
361
361
 
362
- ## 4. IDE SQL 查询
362
+ ## 4. IDE SQL Queries
363
363
 
364
- > 详细分步工作流见 `dataops-query` Skill。
364
+ > See `dataops-query` Skill for detailed step-by-step workflows.
365
365
 
366
- > **IDE 只允许查询操作(SELECT),禁止创建/修改/删除数据表。表 DDL 操作请用 `dataops_datatable`。**
366
+ > **IDE only allows query operations (SELECT), prohibits creating/modifying/deleting data tables. Use `dataops_datatable` for table DDL operations.**
367
367
 
368
- ### 典型流程:浏览元数据 → 搜索表 → 执行查询
368
+ ### Typical Flow: Browse Metadata → Search Tables → Execute Queries
369
369
 
370
370
  ```bash
371
- # 列出可用仓库
372
- te-cli dataops_ide +list_repos --spaceCode "${spaceCode}"
371
+ # List available repositories
372
+ ae-cli dataops_ide +list_repos --spaceCode "${spaceCode}"
373
373
 
374
- # 列出仓库下所有 catalog 及其 schema
375
- te-cli dataops_ide +list_catalogs --spaceCode "${spaceCode}" --connType "SPACE" --repoCode "${repoCode}"
374
+ # List all catalogs and their schemas in repository
375
+ ae-cli dataops_ide +list_catalogs --spaceCode "${spaceCode}" --connType "SPACE" --repoCode "${repoCode}"
376
376
 
377
- # 列出 schema 下的表/视图
378
- te-cli dataops_ide +list_tables --spaceCode "${spaceCode}" --connType "SPACE" --repoCode "${repoCode}" \
377
+ # List tables/views under schema
378
+ ae-cli dataops_ide +list_tables --spaceCode "${spaceCode}" --connType "SPACE" --repoCode "${repoCode}" \
379
379
  --catalog "${catalog}" --schema "${schema}" --isView false --pageNum 1 --pageSize 100
380
380
 
381
- # 获取表的详细元数据(列定义、DDL、分区、行数)
382
- te-cli dataops_ide +get_table_detail --spaceCode "${spaceCode}" --connType "SPACE" --repoCode "${repoCode}" \
381
+ # Get detailed table metadata (column definitions, DDL, partitions, row count)
382
+ ae-cli dataops_ide +get_table_detail --spaceCode "${spaceCode}" --connType "SPACE" --repoCode "${repoCode}" \
383
383
  --catalog "${catalog}" --schema "${schema}" --tableName "${tableName}" \
384
384
  --engineType "TASK_ENGINE_TRINO" --isView false
385
385
 
386
- # 获取 schema 统计信息
387
- te-cli dataops_ide +get_schema_info --spaceCode "${spaceCode}" --connType "SPACE" --repoCode "${repoCode}" \
386
+ # Get schema statistics
387
+ ae-cli dataops_ide +get_schema_info --spaceCode "${spaceCode}" --connType "SPACE" --repoCode "${repoCode}" \
388
388
  --catalog "${catalog}" --schema "${schema}"
389
389
 
390
- # 跨 catalog/schema 模糊搜索表
391
- te-cli dataops_ide +search_tables --spaceCode "${spaceCode}" --connType "SPACE" --repoCode "${repoCode}" \
390
+ # Fuzzy search tables across catalog/schema
391
+ ae-cli dataops_ide +search_tables --spaceCode "${spaceCode}" --connType "SPACE" --repoCode "${repoCode}" \
392
392
  --searchKey "user" --size 20
393
393
 
394
- # 跨表模糊搜索列名
395
- te-cli dataops_ide +search_columns --spaceCode "${spaceCode}" --repoCode "${repoCode}" \
394
+ # Fuzzy search column names across tables
395
+ ae-cli dataops_ide +search_columns --spaceCode "${spaceCode}" --repoCode "${repoCode}" \
396
396
  --searchKey "user_id" --tables '[{"catalog":"hive","isView":false,"schema":"ws_default_dev","tableName":"dwd_user"}]' \
397
397
  --engineType "TASK_ENGINE_TRINO" --pageNum 1 --pageSize 100
398
398
 
399
- # 根据表名和列名生成 SELECT SQL
400
- te-cli dataops_ide +generate_sql --spaceCode "${spaceCode}" --repoCode "${repoCode}" \
399
+ # Generate SELECT SQL based on table and column names
400
+ ae-cli dataops_ide +generate_sql --spaceCode "${spaceCode}" --repoCode "${repoCode}" \
401
401
  --catalog "hive" --schema "ws_default_dev" --tableName "dwd_user" \
402
402
  --engineType "TASK_ENGINE_TRINO" --selectColumns '["user_id","user_name","age"]'
403
403
  ```
404
404
 
405
- ### SQL 异步查询流程(3 步:执行 → 轮询 → 取结果)
405
+ ### SQL Async Query Flow (3 steps: Execute → Poll → Get Results)
406
406
 
407
407
  ```bash
408
- # Step 1: 异步执行 SQL(返回 requestId)
409
- te-cli dataops_ide +execute_sql --spaceCode "${spaceCode}" --repoCode "te_etl" \
408
+ # Step 1: Execute SQL asynchronously (returns requestId)
409
+ ae-cli dataops_ide +execute_sql --spaceCode "${spaceCode}" --repoCode "te_etl" \
410
410
  --sql "SELECT * FROM hive.ws_default_dev.dwd_user LIMIT 10" \
411
411
  --engineType "TASK_ENGINE_TRINO" --confirmed true
412
412
 
413
- # Step 2: 查询执行进度(建议 2-5 秒轮询)
413
+ # Step 2: Query execution progress (recommend 2-5 second polling)
414
414
  # state: QUEUED / RUNNING / FINISHED / FAILED / CANCELLED
415
- te-cli dataops_ide +get_query_progress --requestId "${requestId}"
415
+ ae-cli dataops_ide +get_query_progress --requestId "${requestId}"
416
416
 
417
- # Step 3: state=FINISHED 后获取结果
418
- te-cli dataops_ide +get_query_result --spaceCode "${spaceCode}" --connType "SPACE" \
417
+ # Step 3: Get results after state=FINISHED
418
+ ae-cli dataops_ide +get_query_result --spaceCode "${spaceCode}" --connType "SPACE" \
419
419
  --repoCode "te_etl" --recordId "${recordId}"
420
420
 
421
- # (可选)取消正在执行的查询
422
- te-cli dataops_ide +cancel_query --requestId "${requestId}" --confirmed true
421
+ # (Optional) Cancel running query
422
+ ae-cli dataops_ide +cancel_query --requestId "${requestId}" --confirmed true
423
423
  ```
424
424
 
425
- ### 命令速查
426
-
427
- | 命令 | 用途 | 关键 Flags |
428
- |------|------|-----------|
429
- | `+list_repos` | 列出仓库 | `--spaceCode` |
430
- | `+list_catalogs` | 列出 catalog/schema | `--spaceCode` `--connType` `--repoCode` |
431
- | `+list_tables` | 列出表 | `--spaceCode` `--connType` `--repoCode` `--catalog` `--schema` `--isView` `--pageNum` `--pageSize` |
432
- | `+get_table_detail` | 表元数据 | `--spaceCode` `--connType` `--repoCode` `--catalog` `--schema` `--tableName` `--engineType` `--isView` |
433
- | `+get_schema_info` | schema 统计 | `--spaceCode` `--connType` `--repoCode` `--catalog` `--schema` |
434
- | `+search_tables` | 模糊搜索表 | `--spaceCode` `--connType` `--repoCode` `--searchKey` `--size` |
435
- | `+search_columns` | 模糊搜索列 | `--spaceCode` `--repoCode` `--searchKey` `--tables` (JSON) `--engineType` `--pageNum` `--pageSize` |
436
- | `+generate_sql` | 生成 SELECT | `--spaceCode` `--repoCode` `--catalog` `--schema` `--tableName` `--engineType` `--selectColumns` (JSON) |
437
- | `+execute_sql` | 执行 SQL | `--spaceCode` `--repoCode` `--sql` `--engineType` `--confirmed` |
438
- | `+get_query_progress` | 查询进度 | `--requestId` |
439
- | `+get_query_result` | 获取结果 | `--spaceCode` `--connType` `--repoCode` `--recordId` |
440
- | `+cancel_query` | 取消查询 | `--requestId` `--confirmed` |
441
-
442
- ### 参数说明
443
-
444
- - **connType**: `SPACE`(数据仓库日常查询,默认)| `ETL`(ETL 引擎)| `APP`(应用仓对外服务)
445
- - **engineType**: `TASK_ENGINE_TRINO`(默认,交互式查询)| `TASK_ENGINE_STARROCKS`(实时分析、高并发)
446
- - **isView**: `false` 查物理表 | `true` 查视图
425
+ ### Command Quick Reference
426
+
427
+ | Command | Purpose | Key Flags |
428
+ |---------|---------|-----------|
429
+ | `+list_repos` | List repositories | `--spaceCode` |
430
+ | `+list_catalogs` | List catalog/schema | `--spaceCode` `--connType` `--repoCode` |
431
+ | `+list_tables` | List tables | `--spaceCode` `--connType` `--repoCode` `--catalog` `--schema` `--isView` `--pageNum` `--pageSize` |
432
+ | `+get_table_detail` | Table metadata | `--spaceCode` `--connType` `--repoCode` `--catalog` `--schema` `--tableName` `--engineType` `--isView` |
433
+ | `+get_schema_info` | Schema statistics | `--spaceCode` `--connType` `--repoCode` `--catalog` `--schema` |
434
+ | `+search_tables` | Fuzzy search tables | `--spaceCode` `--connType` `--repoCode` `--searchKey` `--size` |
435
+ | `+search_columns` | Fuzzy search columns | `--spaceCode` `--repoCode` `--searchKey` `--tables` (JSON) `--engineType` `--pageNum` `--pageSize` |
436
+ | `+generate_sql` | Generate SELECT | `--spaceCode` `--repoCode` `--catalog` `--schema` `--tableName` `--engineType` `--selectColumns` (JSON) |
437
+ | `+execute_sql` | Execute SQL | `--spaceCode` `--repoCode` `--sql` `--engineType` `--confirmed` |
438
+ | `+get_query_progress` | Query progress | `--requestId` |
439
+ | `+get_query_result` | Get results | `--spaceCode` `--connType` `--repoCode` `--recordId` |
440
+ | `+cancel_query` | Cancel query | `--requestId` `--confirmed` |
441
+
442
+ ### Parameter Notes
443
+
444
+ - **connType**: `SPACE` (data warehouse for daily queries, default) | `ETL` (ETL engine) | `APP` (app warehouse for external services)
445
+ - **engineType**: `TASK_ENGINE_TRINO` (default, interactive queries) | `TASK_ENGINE_STARROCKS` (real-time analytics, high concurrency)
446
+ - **isView**: `false` for physical tables | `true` for views
447
447
 
448
448
  ---
449
449
 
450
- ## 5. 数据集成
450
+ ## 5. Data Integration
451
451
 
452
- > 详细分步工作流和 JSON 配置模板见 `dataops-integration` Skill。
452
+ > See `dataops-integration` Skill for detailed step-by-step workflows and JSON configuration templates.
453
453
 
454
- > **同步方案创建涉及复杂 JSON 配置(sourceConfig/sinkConfig/channelConfig/fieldsMapping),务必参考 `dataops-integration` Skill 中的完整模板。**
454
+ > **Sync solution creation involves complex JSON configurations (sourceConfig/sinkConfig/channelConfig/fieldsMapping), be sure to refer to complete templates in `dataops-integration` Skill.**
455
455
 
456
- ### 典型流程:创建数据源 → 浏览源表 → 创建同步方案 → 执行
456
+ ### Typical Flow: Create Datasource → Browse Source Tables → Create Sync Solution → Execute
457
457
 
458
458
  ```bash
459
- # 查看支持的数据源组件类型
460
- te-cli dataops_integration +list_datasource_components
459
+ # View supported datasource component types
460
+ ae-cli dataops_integration +list_datasource_components
461
461
 
462
- # 测试数据源连接
463
- te-cli dataops_integration +test_datasource_connect --spaceCode "${spaceCode}" \
462
+ # Test datasource connection
463
+ ae-cli dataops_integration +test_datasource_connect --spaceCode "${spaceCode}" \
464
464
  --componentName "MySQL" \
465
465
  --configValue '{"host":"localhost","port":3306,"username":"root","password":"xxx","database":"test"}'
466
466
 
467
- # 创建数据源
468
- te-cli dataops_integration +add_datasource --spaceCode "${spaceCode}" \
469
- --componentName "MySQL" --dataSourceName "生产MySQL" \
467
+ # Create datasource
468
+ ae-cli dataops_integration +add_datasource --spaceCode "${spaceCode}" \
469
+ --componentName "MySQL" --dataSourceName "Production MySQL" \
470
470
  --sharedConfig true \
471
471
  --envJsonList '[{"host":"localhost","port":3306,"username":"root","password":"xxx"}]' \
472
472
  --confirmed true
473
473
 
474
- # 查看空间所有数据源
475
- te-cli dataops_integration +list_space_datasources --spaceCode "${spaceCode}"
474
+ # View all datasources in workspace
475
+ ae-cli dataops_integration +list_space_datasources --spaceCode "${spaceCode}"
476
476
 
477
- # 查看可用于同步的数据源(按 source/sink 分类)
478
- te-cli dataops_integration +list_sync_datasources --spaceCode "${spaceCode}"
477
+ # View datasources available for sync (categorized by source/sink)
478
+ ae-cli dataops_integration +list_sync_datasources --spaceCode "${spaceCode}"
479
479
 
480
- # 浏览源端数据库和表
481
- te-cli dataops_integration +list_datasource_databases --spaceCode "${spaceCode}" \
480
+ # Browse source databases and tables
481
+ ae-cli dataops_integration +list_datasource_databases --spaceCode "${spaceCode}" \
482
482
  --datasourceId "${datasourceId}"
483
- te-cli dataops_integration +list_datasource_tables --spaceCode "${spaceCode}" \
483
+ ae-cli dataops_integration +list_datasource_tables --spaceCode "${spaceCode}" \
484
484
  --datasourceId "${datasourceId}" --database "test"
485
485
 
486
- # 获取表结构(列定义、分区)
487
- te-cli dataops_integration +get_table_structure --spaceCode "${spaceCode}" \
486
+ # Get table structure (column definitions, partitions)
487
+ ae-cli dataops_integration +get_table_structure --spaceCode "${spaceCode}" \
488
488
  --datasourceId "${datasourceId}" --database "test" --tablePath "users"
489
489
 
490
- # 创建同步方案(需要完整 JSON 配置,详见 dataops-integration Skill)
491
- te-cli dataops_integration +add_sync_solution --spaceCode "${spaceCode}" \
492
- --syncName "MySQL到预置仓同步" \
490
+ # Create sync solution (requires complete JSON configuration, see dataops-integration Skill)
491
+ ae-cli dataops_integration +add_sync_solution --spaceCode "${spaceCode}" \
492
+ --syncName "MySQL to Preset Repository Sync" \
493
493
  --srcComponent "MySQL" --srcDatasourceId "${mysqlDatasourceId}" \
494
494
  --sinkComponent "hive" --sinkDatasourceId "te_etl@TASK_ENGINE_TRINO" \
495
495
  --sourceConfig '...' --sinkConfig '...' --channelConfig '...' --fieldsMapping '...' \
496
496
  --confirmed true
497
497
 
498
- # 执行同步方案
499
- te-cli dataops_integration +exec_sync_solution --spaceCode "${spaceCode}" \
498
+ # Execute sync solution
499
+ ae-cli dataops_integration +exec_sync_solution --spaceCode "${spaceCode}" \
500
500
  --syncId "${syncId}" --confirmed true
501
501
 
502
- # 查看执行历史
503
- te-cli dataops_integration +list_sync_exec_histories --spaceCode "${spaceCode}" \
502
+ # View execution history
503
+ ae-cli dataops_integration +list_sync_exec_histories --spaceCode "${spaceCode}" \
504
504
  --syncId "${syncId}" --limit 20
505
505
 
506
- # 查看执行详情
507
- te-cli dataops_integration +get_sync_exec_info --spaceCode "${spaceCode}" \
506
+ # View execution details
507
+ ae-cli dataops_integration +get_sync_exec_info --spaceCode "${spaceCode}" \
508
508
  --syncId "${syncId}" --taskId "${taskId}"
509
509
 
510
- # 停止同步执行
511
- te-cli dataops_integration +stop_sync_solution --spaceCode "${spaceCode}" \
510
+ # Stop sync execution
511
+ ae-cli dataops_integration +stop_sync_solution --spaceCode "${spaceCode}" \
512
512
  --syncId "${syncId}" --taskId "${taskId}" --confirmed true
513
513
  ```
514
514
 
515
- ### JSON 配置要点
516
-
517
- 创建同步方案时,以下 JSON 配置必须严格按模板生成:
518
-
519
- | 配置项 | 说明 |
520
- |--------|------|
521
- | **sourceConfig** | 源端连接信息(组件、数据源ID、数据库、表) |
522
- | **sinkConfig** | 目标端配置(预置仓 database 为空,非预置仓 database 必填) |
523
- | **channelConfig** | 通道配置(涉及预置仓时必须包含 gatewayConfig) |
524
- | **fieldsMapping** | 双列字段映射(每个字段必须包含 manual/partitionKey/primaryKey/shardingKey/sortingKey/upsertKey) |
525
-
526
- > 完整 JSON 模板和 MongoDB 等组件条件必填参数详见 `dataops-integration` Skill。
527
-
528
- ### 命令速查
529
-
530
- | 命令 | 用途 | 关键 Flags |
531
- |------|------|-----------|
532
- | `+list_datasource_components` | 支持的组件 | — |
533
- | `+list_space_datasources` | 空间数据源 | `--spaceCode` `--componentName` `--dataSourceName` |
534
- | `+add_datasource` | 创建数据源 | `--spaceCode` `--componentName` `--dataSourceName` `--sharedConfig` `--envJsonList` `--confirmed` |
535
- | `+test_datasource_connect` | 测试连接 | `--spaceCode` `--componentName` `--configValue` |
536
- | `+modify_datasource` | 修改数据源 | `--spaceCode` `--datasourceId` `--confirmed` |
537
- | `+online_datasource` | 上线数据源 | `--spaceCode` `--datasourceId` `--confirmed` |
538
- | `+list_datasource_databases` | 列出数据库 | `--spaceCode` `--datasourceId` |
539
- | `+list_datasource_tables` | 列出表 | `--spaceCode` `--datasourceId` `--database` |
540
- | `+get_table_structure` | 表结构 | `--spaceCode` `--datasourceId` `--database` `--tablePath` |
541
- | `+list_sync_datasources` | 同步数据源 | `--spaceCode` |
542
- | `+list_sync_solutions` | 同步方案列表 | `--spaceCode` |
543
- | `+get_sync_detail` | 同步方案详情 | `--spaceCode` `--syncId` |
544
- | `+add_sync_solution` | 创建同步方案 | `--spaceCode` `--syncName` `--srcComponent` `--srcDatasourceId` `--sinkComponent` `--sinkDatasourceId` `--sourceConfig` `--sinkConfig` `--channelConfig` `--fieldsMapping` `--confirmed` |
545
- | `+save_sync_solution` | 更新同步方案 | `--spaceCode` `--syncId` `--confirmed` |
546
- | `+exec_sync_solution` | 执行同步 | `--spaceCode` `--syncId` `--confirmed` |
547
- | `+list_sync_exec_histories` | 执行历史 | `--spaceCode` `--syncId` `--execType` `--limit` |
548
- | `+get_sync_exec_info` | 执行详情 | `--spaceCode` `--syncId` `--taskId` |
549
- | `+stop_sync_solution` | 停止同步 | `--spaceCode` `--syncId` `--taskId` `--confirmed` |
550
- | `+execute_sql` | 外部DDL执行 | `--spaceCode` `--datasourceId` `--database` `--sql` `--confirmed` |
551
- | `+validate_sql` | 校验SQL | `--spaceCode` `--datasourceId` `--database` `--sql` |
515
+ ### JSON Configuration Key Points
516
+
517
+ When creating sync solutions, the following JSON configurations must be strictly generated according to templates:
518
+
519
+ | Configuration | Description |
520
+ |---------------|-------------|
521
+ | **sourceConfig** | Source connection information (component, datasource ID, database, table) |
522
+ | **sinkConfig** | Target configuration (preset repository database is empty, non-preset repository database is required) |
523
+ | **channelConfig** | Channel configuration (must include gatewayConfig when involving preset repository) |
524
+ | **fieldsMapping** | Bidirectional field mapping (each field must include manual/partitionKey/primaryKey/shardingKey/sortingKey/upsertKey) |
525
+
526
+ > See `dataops-integration` Skill for complete JSON templates and conditional required parameters for components like MongoDB.
527
+
528
+ ### Command Quick Reference
529
+
530
+ | Command | Purpose | Key Flags |
531
+ |---------|---------|-----------|
532
+ | `+list_datasource_components` | Supported components | — |
533
+ | `+list_space_datasources` | Workspace datasources | `--spaceCode` `--componentName` `--dataSourceName` |
534
+ | `+add_datasource` | Create datasource | `--spaceCode` `--componentName` `--dataSourceName` `--sharedConfig` `--envJsonList` `--confirmed` |
535
+ | `+test_datasource_connect` | Test connection | `--spaceCode` `--componentName` `--configValue` |
536
+ | `+modify_datasource` | Modify datasource | `--spaceCode` `--datasourceId` `--confirmed` |
537
+ | `+online_datasource` | Online datasource | `--spaceCode` `--datasourceId` `--confirmed` |
538
+ | `+list_datasource_databases` | List databases | `--spaceCode` `--datasourceId` |
539
+ | `+list_datasource_tables` | List tables | `--spaceCode` `--datasourceId` `--database` |
540
+ | `+get_table_structure` | Table structure | `--spaceCode` `--datasourceId` `--database` `--tablePath` |
541
+ | `+list_sync_datasources` | Sync datasources | `--spaceCode` |
542
+ | `+list_sync_solutions` | Sync solution list | `--spaceCode` |
543
+ | `+get_sync_detail` | Sync solution details | `--spaceCode` `--syncId` |
544
+ | `+add_sync_solution` | Create sync solution | `--spaceCode` `--syncName` `--srcComponent` `--srcDatasourceId` `--sinkComponent` `--sinkDatasourceId` `--sourceConfig` `--sinkConfig` `--channelConfig` `--fieldsMapping` `--confirmed` |
545
+ | `+save_sync_solution` | Update sync solution | `--spaceCode` `--syncId` `--confirmed` |
546
+ | `+exec_sync_solution` | Execute sync | `--spaceCode` `--syncId` `--confirmed` |
547
+ | `+list_sync_exec_histories` | Execution history | `--spaceCode` `--syncId` `--execType` `--limit` |
548
+ | `+get_sync_exec_info` | Execution details | `--spaceCode` `--syncId` `--taskId` |
549
+ | `+stop_sync_solution` | Stop sync | `--spaceCode` `--syncId` `--taskId` `--confirmed` |
550
+ | `+execute_sql` | External DDL execution | `--spaceCode` `--datasourceId` `--database` `--sql` `--confirmed` |
551
+ | `+validate_sql` | Validate SQL | `--spaceCode` `--datasourceId` `--database` `--sql` |
552
552
 
553
553
  ---
554
554
 
555
- ## 6. 运维操作与补数管理
555
+ ## 6. Operations and Backfill Management
556
556
 
557
- > 详细分步工作流见 `dataops-operations` Skill。
557
+ > See `dataops-operations` Skill for detailed step-by-step workflows.
558
558
 
559
- > **运维命令使用 flowInstanceId(非 executeId),通过 `+search_flow_instances` 获取。**
559
+ > **Operations commands use flowInstanceId (not executeId), obtained via `+search_flow_instances`.**
560
560
 
561
- ### 典型流程 A:运维实例查询与操作
561
+ ### Typical Flow A: Operations Instance Query and Operations
562
562
 
563
563
  ```bash
564
- # 搜索任务流实例(支持按状态/负责人/时间筛选)
565
- te-cli dataops_operations +search_flow_instances --spaceCode "${spaceCode}" \
564
+ # Search flow instances (supports filtering by status/owner/time)
565
+ ae-cli dataops_operations +search_flow_instances --spaceCode "${spaceCode}" \
566
566
  --pageNum 1 --pageSize 20
567
567
 
568
- # 查看实例下的所有任务节点及执行状态
569
- te-cli dataops_operations +list_flow_task_instances --spaceCode "${spaceCode}" \
568
+ # View all task nodes and execution status under instance
569
+ ae-cli dataops_operations +list_flow_task_instances --spaceCode "${spaceCode}" \
570
570
  --flowInstanceId "${flowInstanceId}"
571
571
 
572
- # 获取任务节点定义详情
573
- te-cli dataops_operations +get_task_definition --spaceCode "${spaceCode}" \
572
+ # Get task node definition details
573
+ ae-cli dataops_operations +get_task_definition --spaceCode "${spaceCode}" \
574
574
  --flowInstanceId "${flowInstanceId}" --taskCode "${taskCode}"
575
575
 
576
- # 重跑失败的任务流实例(从失败节点继续)
577
- te-cli dataops_operations +rerun_flow_instance --spaceCode "${spaceCode}" \
576
+ # Rerun failed flow instance (continue from failed node)
577
+ ae-cli dataops_operations +rerun_flow_instance --spaceCode "${spaceCode}" \
578
578
  --flowInstanceId "${flowInstanceId}" --confirmed true
579
579
 
580
- # 停止正在运行的实例
581
- te-cli dataops_operations +stop_flow_instance --spaceCode "${spaceCode}" \
580
+ # Stop running instance
581
+ ae-cli dataops_operations +stop_flow_instance --spaceCode "${spaceCode}" \
582
582
  --flowInstanceId "${flowInstanceId}" --confirmed true
583
583
 
584
- # 控制实例运行状态(暂停/强制暂停/恢复)
585
- te-cli dataops_operations +control_flow_instance --spaceCode "${spaceCode}" \
584
+ # Control instance running status (pause/force pause/resume)
585
+ ae-cli dataops_operations +control_flow_instance --spaceCode "${spaceCode}" \
586
586
  --flowInstanceId "${flowInstanceId}" --action "PAUSE" --confirmed true
587
587
  ```
588
588
 
589
- ### 典型流程 B:补数任务管理
590
-
591
- 补数任务用于批量重跑历史数据。
589
+ ### Typical Flow B: Backfill Task Management
592
590
 
593
591
  ```bash
594
- # 查询补数任务列表
595
- te-cli dataops_operations +list_flow_jobs --spaceCode "${spaceCode}" \
592
+ # Query backfill task list
593
+ ae-cli dataops_operations +list_flow_jobs --spaceCode "${spaceCode}" \
596
594
  --pageNum 1 --pageSize 20
597
595
 
598
- # 获取补数任务详情(配置、日期范围、并发设置)
599
- te-cli dataops_operations +get_flow_job_detail --spaceCode "${spaceCode}" \
596
+ # Get backfill task details (configuration, date range, concurrency settings)
597
+ ae-cli dataops_operations +get_flow_job_detail --spaceCode "${spaceCode}" \
600
598
  --jobId "${jobId}"
601
599
 
602
- # 获取补数任务的执行计划列表(每个日期的状态)
603
- te-cli dataops_operations +list_flow_job_plans --spaceCode "${spaceCode}" \
600
+ # Get backfill task execution plan list (status for each date)
601
+ ae-cli dataops_operations +list_flow_job_plans --spaceCode "${spaceCode}" \
604
602
  --jobId "${jobId}"
605
603
 
606
- # 停止正在执行的补数任务
607
- te-cli dataops_operations +stop_flow_job --spaceCode "${spaceCode}" \
604
+ # Stop running backfill task
605
+ ae-cli dataops_operations +stop_flow_job --spaceCode "${spaceCode}" \
608
606
  --jobId "${jobId}" --confirmed true
609
607
  ```
610
608
 
611
- ### 典型流程 C:任务节点实例查询
609
+ ### Typical Flow C: Task Node Instance Query
612
610
 
613
611
  ```bash
614
- # 搜索任务节点实例(支持按状态/类型/时间筛选)
615
- te-cli dataops_operations +search_task_instances --spaceCode "${spaceCode}" \
612
+ # Search task node instances (supports filtering by status/type/time)
613
+ ae-cli dataops_operations +search_task_instances --spaceCode "${spaceCode}" \
616
614
  --pageNum 1 --pageSize 20
617
615
  ```
618
616
 
619
- ### 命令速查
617
+ ### Command Quick Reference
620
618
 
621
- | 命令 | 用途 | 关键 Flags |
622
- |------|------|-----------|
623
- | `+search_flow_instances` | 搜索任务流实例 | `--spaceCode` `--pageNum` `--pageSize` |
624
- | `+list_flow_task_instances` | 实例任务节点 | `--spaceCode` `--flowInstanceId` |
625
- | `+get_task_definition` | 任务节点定义 | `--spaceCode` `--flowInstanceId` `--taskCode` |
626
- | `+rerun_flow_instance` | 重跑实例 | `--spaceCode` `--flowInstanceId` `--confirmed` |
627
- | `+stop_flow_instance` | 停止实例 | `--spaceCode` `--flowInstanceId` `--confirmed` |
628
- | `+control_flow_instance` | 控制实例状态 | `--spaceCode` `--flowInstanceId` `--action` `--confirmed` |
629
- | `+search_task_instances` | 搜索任务实例 | `--spaceCode` `--pageNum` `--pageSize` |
630
- | `+list_flow_jobs` | 补数任务列表 | `--spaceCode` `--pageNum` `--pageSize` |
631
- | `+get_flow_job_detail` | 补数任务详情 | `--spaceCode` `--jobId` |
632
- | `+list_flow_job_plans` | 补数执行计划 | `--spaceCode` `--jobId` |
633
- | `+stop_flow_job` | 停止补数任务 | `--spaceCode` `--jobId` `--confirmed` |
619
+ | Command | Purpose | Key Flags |
620
+ |---------|---------|-----------|
621
+ | `+search_flow_instances` | Search flow instances | `--spaceCode` `--pageNum` `--pageSize` |
622
+ | `+list_flow_task_instances` | Instance task nodes | `--spaceCode` `--flowInstanceId` |
623
+ | `+get_task_definition` | Task node definition | `--spaceCode` `--flowInstanceId` `--taskCode` |
624
+ | `+rerun_flow_instance` | Rerun instance | `--spaceCode` `--flowInstanceId` `--confirmed` |
625
+ | `+stop_flow_instance` | Stop instance | `--spaceCode` `--flowInstanceId` `--confirmed` |
626
+ | `+control_flow_instance` | Control instance status | `--spaceCode` `--flowInstanceId` `--action` `--confirmed` |
627
+ | `+search_task_instances` | Search task instances | `--spaceCode` `--pageNum` `--pageSize` |
628
+ | `+list_flow_jobs` | Backfill task list | `--spaceCode` `--pageNum` `--pageSize` |
629
+ | `+get_flow_job_detail` | Backfill task details | `--spaceCode` `--jobId` |
630
+ | `+list_flow_job_plans` | Backfill execution plan | `--spaceCode` `--jobId` |
631
+ | `+stop_flow_job` | Stop backfill task | `--spaceCode` `--jobId` `--confirmed` |
634
632
 
635
- ### 参数说明
633
+ ### Parameter Notes
636
634
 
637
- - **action**: `PAUSE`(暂停)| `FORCE_PAUSE`(强制暂停)| `RESUME`(恢复)
638
- - **实例状态**: `RUNNING` / `SUCCESS` / `FAILURE` / `WAITING` / `STOPPED`
639
- - **flowInstanceId vs executeId**: 运维工具用 flowInstanceId,flow 工具用 executeId,**不可混用**
635
+ - **action**: `PAUSE` (pause) | `FORCE_PAUSE` (force pause) | `RESUME` (resume)
636
+ - **Instance status**: `RUNNING` / `SUCCESS` / `FAILURE` / `WAITING` / `STOPPED`
637
+ - **flowInstanceId vs executeId**: Operations tools use flowInstanceId, flow tools use executeId, **not interchangeable**
640
638
 
641
639
  ---
642
640
 
643
- ## 参考文档
641
+ ## Reference Documentation
644
642
 
645
- 详细的命令 Flags 和用法请查看 [`references/`](./references/) 目录下的各命令文档。
643
+ For detailed command flags and usage, please refer to the command documentation in the [`references/`](./references/) directory.