@clickzetta/cz-cli-darwin-arm64 0.5.15 → 0.5.17

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (243) hide show
  1. package/bin/cz-cli +0 -0
  2. package/bin/skills/lakehouse-doc-en/SKILL.md +6 -11
  3. package/bin/skills/lakehouse-doc-en/references/AIGateway.md +58 -13
  4. package/bin/skills/lakehouse-doc-en/references/Computation.md +1 -1
  5. package/bin/skills/lakehouse-doc-en/references/DataSource_Amazon_DocumentDB.md +3 -1
  6. package/bin/skills/lakehouse-doc-en/references/Foreach.md +14 -14
  7. package/bin/skills/lakehouse-doc-en/references/JDBC-Driver.md +0 -1
  8. package/bin/skills/lakehouse-doc-en/references/LakehouseAI-overview.md +21 -8
  9. package/bin/skills/lakehouse-doc-en/references/LakehouseDataGPT-tour.md +4 -9
  10. package/bin/skills/lakehouse-doc-en/references/LakehouseStudio-tour.md +14 -19
  11. package/bin/skills/lakehouse-doc-en/references/Lakehouse_Zilliz_MakeDataReadyforBIandAI.md +1 -1
  12. package/bin/skills/lakehouse-doc-en/references/Logstash.md +3 -3
  13. package/bin/skills/lakehouse-doc-en/references/Migrate_Spark_DataEngineeringBestPractices_Project_to_Lakehouse.md +1 -1
  14. package/bin/skills/lakehouse-doc-en/references/Notebook.md +17 -17
  15. package/bin/skills/lakehouse-doc-en/references/RemoteFunction-as-udf.md +14 -14
  16. package/bin/skills/lakehouse-doc-en/references/SQL_External_Catalog_Guide.md +1 -9
  17. package/bin/skills/lakehouse-doc-en/references/SUMMARY.md +59 -29
  18. package/bin/skills/lakehouse-doc-en/references/WINDOWFUNCTION.md +99 -57
  19. package/bin/skills/lakehouse-doc-en/references/Zettapark_Data_Engineering_Demo.md +1 -1
  20. package/bin/skills/lakehouse-doc-en/references/access-control-configuration.md +1 -8
  21. package/bin/skills/lakehouse-doc-en/references/aigw-2026-2-5-1.0.md +16 -0
  22. package/bin/skills/lakehouse-doc-en/references/aigw-2026-3-29-1.0.2.md +14 -0
  23. package/bin/skills/lakehouse-doc-en/references/aigw-2026-3-8-1.0.1.md +16 -0
  24. package/bin/skills/lakehouse-doc-en/references/aigw-2026-4-28-1.1.md +29 -0
  25. package/bin/skills/lakehouse-doc-en/references/aigw-2026-5-12-1.1.1.md +18 -0
  26. package/bin/skills/lakehouse-doc-en/references/aigw-2026-5-15-1.2.md +9 -0
  27. package/bin/skills/lakehouse-doc-en/references/aigw-2026-5-21-1.3.md +9 -0
  28. package/bin/skills/lakehouse-doc-en/references/aigw-2026-5-28-1.4.md +10 -0
  29. package/bin/skills/lakehouse-doc-en/references/aigw-2026-6-3-1.5.md +9 -0
  30. package/bin/skills/lakehouse-doc-en/references/alicloud-arn-externalid.md +0 -5
  31. package/bin/skills/lakehouse-doc-en/references/answer-accuracy-improve.md +120 -103
  32. package/bin/skills/lakehouse-doc-en/references/application-list.md +1 -3
  33. package/bin/skills/lakehouse-doc-en/references/approval-list.md +16 -17
  34. package/bin/skills/lakehouse-doc-en/references/batch-load-parquet-file-into-lakehouse.md +1 -1
  35. package/bin/skills/lakehouse-doc-en/references/batch_sync.md +9 -9
  36. package/bin/skills/lakehouse-doc-en/references/batch_sync_Sop.md +2 -2
  37. package/bin/skills/lakehouse-doc-en/references/batchloadparquetfileintoLakehouse.md +1 -1
  38. package/bin/skills/lakehouse-doc-en/references/bulkloadv1-python-sdk.md +3 -3
  39. package/bin/skills/lakehouse-doc-en/references/chart-auto-refresh-guide.md +12 -6
  40. package/bin/skills/lakehouse-doc-en/references/clickzetta-sample-data.md +3 -3
  41. package/bin/skills/lakehouse-doc-en/references/code_approval.md +1 -5
  42. package/bin/skills/lakehouse-doc-en/references/composite_task.md +31 -42
  43. package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_environment_and_data_generate.md +6 -9
  44. package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_javasdk_bulkload_realtime.md +4 -10
  45. package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_kafka_realtime_sync.md +1 -10
  46. package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_local_file_into_table_by_studio.md +0 -6
  47. package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_studio_batchload_public_network.md +0 -5
  48. package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_studio_python_node.md +2 -7
  49. package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_studio_realtime_cdc_public_network.md +13 -18
  50. package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_studio_sql_insert.md +0 -1
  51. package/bin/skills/lakehouse-doc-en/references/concepts.md +1 -1
  52. package/bin/skills/lakehouse-doc-en/references/config-datasource.md +5 -7
  53. package/bin/skills/lakehouse-doc-en/references/connect-with-cli.md +116 -72
  54. package/bin/skills/lakehouse-doc-en/references/connect-with-cz-cli.md +151 -0
  55. package/bin/skills/lakehouse-doc-en/references/continue-job.md +9 -17
  56. package/bin/skills/lakehouse-doc-en/references/create-api-connection.md +315 -286
  57. package/bin/skills/lakehouse-doc-en/references/create-catalog-connection.md +1 -0
  58. package/bin/skills/lakehouse-doc-en/references/create-dynamic-table.md +4 -4
  59. package/bin/skills/lakehouse-doc-en/references/create-external-catalog.md +85 -22
  60. package/bin/skills/lakehouse-doc-en/references/create-table-ddl.md +45 -0
  61. package/bin/skills/lakehouse-doc-en/references/creating_alicloud_privatelinkendpoint.md +4 -6
  62. package/bin/skills/lakehouse-doc-en/references/creating_alicloud_privatelinkservice.md +4 -7
  63. package/bin/skills/lakehouse-doc-en/references/creating_tencentcloud_privatelinkendpoint.md +2 -7
  64. package/bin/skills/lakehouse-doc-en/references/creating_tencentcloud_privatelinkservice.md +1 -5
  65. package/bin/skills/lakehouse-doc-en/references/cz-cli-agent.md +15 -10
  66. package/bin/skills/lakehouse-doc-en/references/cz-cli-datasource.md +0 -8
  67. package/bin/skills/lakehouse-doc-en/references/cz-cli-sql.md +2 -45
  68. package/bin/skills/lakehouse-doc-en/references/cz-cli.md +53 -42
  69. package/bin/skills/lakehouse-doc-en/references/dashboard-version-management-guide.md +12 -4
  70. package/bin/skills/lakehouse-doc-en/references/data-integration-intro.md +1 -1
  71. package/bin/skills/lakehouse-doc-en/references/data-integration.md +29 -27
  72. package/bin/skills/lakehouse-doc-en/references/data-load-summary.md +3 -3
  73. package/bin/skills/lakehouse-doc-en/references/data-quality.md +25 -25
  74. package/bin/skills/lakehouse-doc-en/references/data-sharing.md +31 -54
  75. package/bin/skills/lakehouse-doc-en/references/data-sources.md +45 -45
  76. package/bin/skills/lakehouse-doc-en/references/data_catalog.md +23 -25
  77. package/bin/skills/lakehouse-doc-en/references/data_privacy.md +5 -2
  78. package/bin/skills/lakehouse-doc-en/references/data_sharing_between_accounts_guide.md +0 -4
  79. package/bin/skills/lakehouse-doc-en/references/data_visualization.md +4 -15
  80. package/bin/skills/lakehouse-doc-en/references/dataagent.md +39 -7
  81. package/bin/skills/lakehouse-doc-en/references/databricks-delta-to-lakehouse-migration.md +168 -0
  82. package/bin/skills/lakehouse-doc-en/references/databricks-dlt-to-lakehouse-migration.md +331 -0
  83. package/bin/skills/lakehouse-doc-en/references/databricks-external-catalog-practice.md +367 -0
  84. package/bin/skills/lakehouse-doc-en/references/databricks-jobs-to-studio-migration.md +199 -0
  85. package/bin/skills/lakehouse-doc-en/references/databricks-notebook-to-studio-migration.md +350 -0
  86. package/bin/skills/lakehouse-doc-en/references/databricks-uc-governance-to-lakehouse-migration.md +327 -0
  87. package/bin/skills/lakehouse-doc-en/references/datagpt-model-config.md +34 -0
  88. package/bin/skills/lakehouse-doc-en/references/datagpt_data_source.md +50 -37
  89. package/bin/skills/lakehouse-doc-en/references/datagpt_introduction.md +55 -79
  90. package/bin/skills/lakehouse-doc-en/references/datagpt_quickstart.md +50 -64
  91. package/bin/skills/lakehouse-doc-en/references/datalake-acceleration.md +75 -2
  92. package/bin/skills/lakehouse-doc-en/references/dbt-databricks-to-clickzetta-migration.md +242 -0
  93. package/bin/skills/lakehouse-doc-en/references/dynamic-mask.md +30 -30
  94. package/bin/skills/lakehouse-doc-en/references/dynamic-table-bestpractice.md +1 -1
  95. package/bin/skills/lakehouse-doc-en/references/dynamic-table-introduce.md +1 -1
  96. package/bin/skills/lakehouse-doc-en/references/dynamic_table_summary.md +1 -1
  97. package/bin/skills/lakehouse-doc-en/references/eco_integration/streamlit.md +1 -1
  98. package/bin/skills/lakehouse-doc-en/references/eco_integration/superset.md +1 -1
  99. package/bin/skills/lakehouse-doc-en/references/ecosystem-all.md +1 -3
  100. package/bin/skills/lakehouse-doc-en/references/ecosystem.md +145 -0
  101. package/bin/skills/lakehouse-doc-en/references/external-catalog-summary.md +33 -38
  102. package/bin/skills/lakehouse-doc-en/references/external-function-combo-practice.md +466 -0
  103. package/bin/skills/lakehouse-doc-en/references/f6fc6447ee.md +7 -9
  104. package/bin/skills/lakehouse-doc-en/references/federation-query.md +56 -6
  105. package/bin/skills/lakehouse-doc-en/references/finebi-mysql.md +2 -0
  106. package/bin/skills/lakehouse-doc-en/references/get-started-with-sample-data.md +10 -11
  107. package/bin/skills/lakehouse-doc-en/references/gitfolder.md +2 -3
  108. package/bin/skills/lakehouse-doc-en/references/grant-privileges.md +2 -0
  109. package/bin/skills/lakehouse-doc-en/references/iceberg-rest-catalog-databricks.md +166 -0
  110. package/bin/skills/lakehouse-doc-en/references/ide.md +1 -1
  111. package/bin/skills/lakehouse-doc-en/references/if_else_task.md +59 -57
  112. package/bin/skills/lakehouse-doc-en/references/input_output.md +10 -7
  113. package/bin/skills/lakehouse-doc-en/references/jobprofile-bestpractices.md +60 -64
  114. package/bin/skills/lakehouse-doc-en/references/kafka-connection.md +0 -1
  115. package/bin/skills/lakehouse-doc-en/references/key-concepts.md +146 -117
  116. package/bin/skills/lakehouse-doc-en/references/lakehouse-ai-gateway-cz-cli.md +317 -0
  117. package/bin/skills/lakehouse-doc-en/references/lakehouse-ai-sql-analysis.md +345 -0
  118. package/bin/skills/lakehouse-doc-en/references/lakehouse-dqc-guide.md +300 -0
  119. package/bin/skills/lakehouse-doc-en/references/lakehouse-medallion-sql-dt-guide.md +543 -0
  120. package/bin/skills/lakehouse-doc-en/references/lakehouse-multi-cloud-acceleration.md +274 -0
  121. package/bin/skills/lakehouse-doc-en/references/lakehouse-multimodal-ai-pipeline.md +198 -0
  122. package/bin/skills/lakehouse-doc-en/references/lakehouse-quick-experience_guide.md +49 -52
  123. package/bin/skills/lakehouse-doc-en/references/lakehouse-volume-pipe-acceleration-guide.md +380 -0
  124. package/bin/skills/lakehouse-doc-en/references/langchain-plug-installation.md +1 -1
  125. package/bin/skills/lakehouse-doc-en/references/management.md +4 -9
  126. package/bin/skills/lakehouse-doc-en/references/medallion-lakehouse-from-scratch.md +2 -1
  127. package/bin/skills/lakehouse-doc-en/references/metrics_answer_build.md +58 -21
  128. package/bin/skills/lakehouse-doc-en/references/migrate-spark-data-engineering-best-practices-to-lakehouse.md +1 -1
  129. package/bin/skills/lakehouse-doc-en/references/mindsdb.md +1 -1
  130. package/bin/skills/lakehouse-doc-en/references/monitoring_and_alerting.md +65 -60
  131. package/bin/skills/lakehouse-doc-en/references/monitoring_item_specification.md +33 -33
  132. package/bin/skills/lakehouse-doc-en/references/multitable_batch_sync.md +16 -16
  133. package/bin/skills/lakehouse-doc-en/references/multitable_realtime_sync.md +65 -72
  134. package/bin/skills/lakehouse-doc-en/references/multitable_realtime_sync_sop.md +54 -52
  135. package/bin/skills/lakehouse-doc-en/references/navicat-mysql.md +2 -0
  136. package/bin/skills/lakehouse-doc-en/references/om-dynamic-table.md +71 -66
  137. package/bin/skills/lakehouse-doc-en/references/om-vcluster.md +2 -0
  138. package/bin/skills/lakehouse-doc-en/references/open-api-create-session.md +79 -0
  139. package/bin/skills/lakehouse-doc-en/references/open-api-generate-auth-token.md +63 -0
  140. package/bin/skills/lakehouse-doc-en/references/open-api-overview.md +96 -0
  141. package/bin/skills/lakehouse-doc-en/references/open-api-quick-start.md +286 -0
  142. package/bin/skills/lakehouse-doc-en/references/open-api-response-guide.md +264 -0
  143. package/bin/skills/lakehouse-doc-en/references/open-api-safe-question-poll.md +201 -0
  144. package/bin/skills/lakehouse-doc-en/references/open-api-text2insight-query.md +99 -0
  145. package/bin/skills/lakehouse-doc-en/references/open-api-text2insight-stop.md +74 -0
  146. package/bin/skills/lakehouse-doc-en/references/overview.md +6 -7
  147. package/bin/skills/lakehouse-doc-en/references/permission-application.md +5 -5
  148. package/bin/skills/lakehouse-doc-en/references/pipe-introduction.md +1 -0
  149. package/bin/skills/lakehouse-doc-en/references/pipe-kafka-table-stream.md +72 -70
  150. package/bin/skills/lakehouse-doc-en/references/pipe-kafka.md +105 -110
  151. package/bin/skills/lakehouse-doc-en/references/pipe-overview.md +40 -40
  152. package/bin/skills/lakehouse-doc-en/references/pipe-storage-object.md +43 -48
  153. package/bin/skills/lakehouse-doc-en/references/pipe-summary.md +14 -4
  154. package/bin/skills/lakehouse-doc-en/references/pipe-syntax.md +58 -151
  155. package/bin/skills/lakehouse-doc-en/references/practice_python_task.md +4 -4
  156. package/bin/skills/lakehouse-doc-en/references/pricing-ai-gateway.md +181 -0
  157. package/bin/skills/lakehouse-doc-en/references/pricing-lakehouse.md +316 -0
  158. package/bin/skills/lakehouse-doc-en/references/pricing.md +44 -288
  159. package/bin/skills/lakehouse-doc-en/references/private-link-general.md +0 -2
  160. package/bin/skills/lakehouse-doc-en/references/pyspark-to-zettapark-migration-f1.md +1 -1
  161. package/bin/skills/lakehouse-doc-en/references/python-igs.md +7 -3
  162. package/bin/skills/lakehouse-doc-en/references/python-sample-put-github-rt-events.md +1 -1
  163. package/bin/skills/lakehouse-doc-en/references/python-task.md +1 -1
  164. package/bin/skills/lakehouse-doc-en/references/python_reference/connector.md +3 -3
  165. package/bin/skills/lakehouse-doc-en/references/python_reference/connector_advanced.md +2 -2
  166. package/bin/skills/lakehouse-doc-en/references/python_reference/connector_examples.md +2 -2
  167. package/bin/skills/lakehouse-doc-en/references/python_sdk_guide.md +1 -1
  168. package/bin/skills/lakehouse-doc-en/references/python_shell_datasource.md +11 -9
  169. package/bin/skills/lakehouse-doc-en/references/quick_start_batch_sync_data.md +9 -18
  170. package/bin/skills/lakehouse-doc-en/references/quick_start_bi_analysis.md +8 -25
  171. package/bin/skills/lakehouse-doc-en/references/quick_start_create_workspace.md +4 -6
  172. package/bin/skills/lakehouse-doc-en/references/quick_start_data_quality.md +8 -8
  173. package/bin/skills/lakehouse-doc-en/references/quick_start_etl.md +16 -20
  174. package/bin/skills/lakehouse-doc-en/references/quick_start_monitoring_and_alerting.md +10 -18
  175. package/bin/skills/lakehouse-doc-en/references/quick_start_sql_query.md +7 -10
  176. package/bin/skills/lakehouse-doc-en/references/quick_start_upload_data.md +5 -7
  177. package/bin/skills/lakehouse-doc-en/references/quick_start_user_management.md +8 -8
  178. package/bin/skills/lakehouse-doc-en/references/quick_start_workspace.md +0 -5
  179. package/bin/skills/lakehouse-doc-en/references/quick_start_workspace_user.md +8 -8
  180. package/bin/skills/lakehouse-doc-en/references/quickstart.md +69 -56
  181. package/bin/skills/lakehouse-doc-en/references/quickstart_datashare_between_companies.md +0 -5
  182. package/bin/skills/lakehouse-doc-en/references/quickstart_envirment_for_team.md +0 -24
  183. package/bin/skills/lakehouse-doc-en/references/realtime-pipeline-selection-guide.md +1 -2
  184. package/bin/skills/lakehouse-doc-en/references/realtime-sales-dashboard-with-dynamic-table.md +3 -3
  185. package/bin/skills/lakehouse-doc-en/references/realtime_sync.md +0 -1
  186. package/bin/skills/lakehouse-doc-en/references/release-note-2026-05-19.md +5 -3
  187. package/bin/skills/lakehouse-doc-en/references/revoke-privileges.md +3 -1
  188. package/bin/skills/lakehouse-doc-en/references/roles.md +2 -3
  189. package/bin/skills/lakehouse-doc-en/references/row-filter.md +165 -0
  190. package/bin/skills/lakehouse-doc-en/references/row_level_permission.md +30 -19
  191. package/bin/skills/lakehouse-doc-en/references/scheduled_task.md +28 -21
  192. package/bin/skills/lakehouse-doc-en/references/security_overview.md +99 -21
  193. package/bin/skills/lakehouse-doc-en/references/set-command.md +1 -1
  194. package/bin/skills/lakehouse-doc-en/references/setup.md +13 -15
  195. package/bin/skills/lakehouse-doc-en/references/show-grants.md +1 -1
  196. package/bin/skills/lakehouse-doc-en/references/snowflake-dynamic-tables-to-lakehouse.md +2 -2
  197. package/bin/skills/lakehouse-doc-en/references/spark-connector-summary.md +1 -1
  198. package/bin/skills/lakehouse-doc-en/references/sql_functions/context_functions/current_vcluster.md +1 -1
  199. package/bin/skills/lakehouse-doc-en/references/sso-configuration.md +2 -2
  200. package/bin/skills/lakehouse-doc-en/references/streaming_pipeline_with_dynamic_table.md +0 -1
  201. package/bin/skills/lakehouse-doc-en/references/studio-incremental-sync-practice.md +27 -23
  202. package/bin/skills/lakehouse-doc-en/references/studio-shell-task.md +1 -1
  203. package/bin/skills/lakehouse-doc-en/references/supported-cloud-platforms.md +32 -0
  204. package/bin/skills/lakehouse-doc-en/references/table_rendering.md +18 -12
  205. package/bin/skills/lakehouse-doc-en/references/task-develop.md +89 -91
  206. package/bin/skills/lakehouse-doc-en/references/task_development.md +19 -17
  207. package/bin/skills/lakehouse-doc-en/references/task_group.md +16 -14
  208. package/bin/skills/lakehouse-doc-en/references/task_instance.md +21 -21
  209. package/bin/skills/lakehouse-doc-en/references/task_param.md +38 -35
  210. package/bin/skills/lakehouse-doc-en/references/task_param_reference.md +81 -79
  211. package/bin/skills/lakehouse-doc-en/references/task_scheduling_dependency.md +20 -21
  212. package/bin/skills/lakehouse-doc-en/references/tencentcloud_arn_and_externalid.md +1 -5
  213. package/bin/skills/lakehouse-doc-en/references/trial-account-quotas-and-limits.md +1 -3
  214. package/bin/skills/lakehouse-doc-en/references/tutorial_connect_to_lakehouse.md +69 -0
  215. package/bin/skills/lakehouse-doc-en/references/tutorials.md +4 -1
  216. package/bin/skills/lakehouse-doc-en/references/unique-key.md +167 -0
  217. package/bin/skills/lakehouse-doc-en/references/usageandbillingview.md +138 -0
  218. package/bin/skills/lakehouse-doc-en/references/use-dbt-dev.md +3 -3
  219. package/bin/skills/lakehouse-doc-en/references/use-java-sdk-realtime-uploaddata.md +1 -1
  220. package/bin/skills/lakehouse-doc-en/references/use-java-sdk-upload-data-local.md +3 -3
  221. package/bin/skills/lakehouse-doc-en/references/use-models.md +128 -0
  222. package/bin/skills/lakehouse-doc-en/references/use-mysql-client.md +81 -81
  223. package/bin/skills/lakehouse-doc-en/references/use-python-sdk-upload-data.md +10 -12
  224. package/bin/skills/lakehouse-doc-en/references/user-identification.md +2 -3
  225. package/bin/skills/lakehouse-doc-en/references/user_permission_grand_guide.md +1 -1
  226. package/bin/skills/lakehouse-doc-en/references/using-udf-in-dynamic-table.md +1 -1
  227. package/bin/skills/lakehouse-doc-en/references/vc_cache.md +18 -22
  228. package/bin/skills/lakehouse-doc-en/references/vcluster_size_description.md +33 -31
  229. package/bin/skills/lakehouse-doc-en/references/virtual-cluster.md +43 -45
  230. package/bin/skills/lakehouse-doc-en/references/web-job-history.md +94 -108
  231. package/bin/skills/lakehouse-doc-en/references/web_search.md +16 -7
  232. package/bin/skills/lakehouse-doc-en/references/zettapark-data-engineering-demo.md +1 -1
  233. package/bin/skills/lakehouse-doc-en/references/zettapark-dataframe-guide.md +144 -70
  234. package/bin/skills/lakehouse-doc-en/references/zettapark-dynamic-table-guide.md +2 -2
  235. package/bin/skills/lakehouse-doc-en/references/zettapark-etl-guide.md +73 -33
  236. package/bin/skills/lakehouse-doc-en/references/zettapark-feature-engineering.md +2 -2
  237. package/bin/skills/lakehouse-doc-en/references/zettapark-functions-guide.md +75 -46
  238. package/bin/skills/lakehouse-doc-en/references/zettapark-quick-start.md +2 -2
  239. package/bin/skills/lakehouse-doc-en/references/zettapark-stream-guide.md +4 -4
  240. package/bin/skills/lakehouse-doc-en/references/zettapark-volume-guide.md +93 -29
  241. package/package.json +1 -1
  242. package/bin/skills/lakehouse-doc-en/references/CLAUDE.md +0 -606
  243. package/bin/skills/lakehouse-doc-en/references/modelprice.md +0 -155
@@ -27,46 +27,42 @@ You can use the "Sync Task" feature provided by Lakehouse Studio to sync data fr
27
27
 
28
28
  1. As shown below, click the button to enter the Lakehouse service instance:
29
29
 
30
- ![](.topwrite/assets/image_1748337538227.png)
30
+
31
31
 
32
32
  2. Navigate to the "Development" page:
33
33
 
34
- ![](.topwrite/assets/image_1748337566571.png)
35
34
 
36
- 3. In the folder area of the left directory tree, click the + (New) button, and select the "Batch Sync" task type from the menu:
37
35
 
38
- ![](.topwrite/assets/image_1748337579720.png)
36
+ 3. In the folder area of the left directory tree, click the + (New) button, and select the "Batch Sync" task type from the menu.
37
+
38
+
39
39
 
40
40
  4. In the dialog, enter the task name (you can create a folder, not required), and click "OK".
41
41
 
42
- ![](.topwrite/assets/image_1748337590537.png)
43
42
 
44
- 5. You can see the newly created sync task on the page, as shown below:
45
43
 
46
- ![](.topwrite/assets/image_1748337598616.png)
44
+ 5. You can see the newly created sync task on the page, as shown below:
47
45
 
46
+
48
47
  6. Start configuring the required information for the sync task. The core is to configure the source and target information.
49
48
  Note: You need to understand the concept of "Data Source" here. A "Data Source" is an object that defines external service connection information, including service address, authentication information, connection method, etc. A defined data source can be used as a data source or data target in data sync tasks.
50
49
 
51
50
  7. The source configuration is shown below. Click "+" to quickly bring up the interface for creating a new data source:
52
51
 
53
- ![](.topwrite/assets/image_1748337608071.png)
52
+
54
53
 
55
54
  8. Select the type of data source to import. In this example, MySQL is selected. Click "Next" to enter the detailed configuration page. The "Usage Instructions" in the upper right corner provides a detailed configuration guide, as shown below. Ensure that the filled-in JDBC connection address, username, and password are correct. The serverTimezone configuration item refers to the timezone where the database is located, which will affect the values of date and time fields after syncing to the target. Please select correctly based on the actual situation.
56
55
 
57
- ![](.topwrite/assets/image_1748337616322.png)
56
+
58
57
 
59
58
  9. After completing the required information configuration for the data source, you can click the "Connectivity Test" button to test whether the data source is reachable. A successful connection test is shown below. If the connection fails, please check the network and whether the configuration information is accurate. After the test passes, click "OK" in the lower right corner to save.
60
59
 
61
- ![](.topwrite/assets/image_1748337623157.png)
62
60
 
63
61
  10. After creating the data source, return to the sync task configuration page, select this data source as the source (if it does not display automatically, please reopen the task), and select the namespace (i.e., database) and data object (i.e., table). Other configuration items can be left empty.
64
62
 
65
- ![](.topwrite/assets/image_1748337630413.png)
66
63
 
67
64
  11. After completing the source configuration, proceed to configure the target, as shown below:
68
65
 
69
- ![](.topwrite/assets/image_1748337636870.png)
70
66
 
71
67
  1) Select the Lakehouse data source type
72
68
 
@@ -76,31 +72,26 @@ You can use the "Sync Task" feature provided by Lakehouse Studio to sync data fr
76
72
 
77
73
  4) Data object: Click the + button to quickly create a new target Lakehouse table. In the dialog, verify the table name and schema information, then click "OK" to complete the table creation.
78
74
 
79
- ![](.topwrite/assets/image_1748337664468.png)
80
75
 
81
76
  5) Select "Overwrite" as the data write mode, meaning the target table will be truncated before syncing data from the source.
82
77
 
83
78
  12. After completing the above steps, the field mapping relationship between the source table and target table will be automatically displayed in the "Field Mapping Configuration" (default is same-name mapping). The default approach is fine here, no modification needed.
84
79
 
85
- ![](.topwrite/assets/image_1748337679341.png)
86
80
 
87
81
  13. For other configuration items, such as sync rule configuration and advanced configuration, use the default values.
88
82
 
89
- ![](.topwrite/assets/image_1748337686553.png)
90
83
 
91
84
  14. Click the "Save" button above the task configuration area to save all task configurations.
92
85
 
93
- ![](.topwrite/assets/image_1748337694348.png)
94
86
 
95
87
  15. Click the "Run" button in the upper right corner to run a test and trigger data sync (use the default value for the cluster option).
96
88
 
97
- ![](.topwrite/assets/image_1748337705970.png)
89
+
98
90
 
99
91
  16. In the "Run History" area at the bottom right of the page, you can view the task's running status.
100
92
 
101
93
  Note: If you want to test sync speed, it is recommended to use a table with a relatively large data volume to reduce the impact of task startup time.
102
94
 
103
- ![](.topwrite/assets/image_1748337713243.png)
104
95
 
105
96
  17. At this point, a sync task has been created and run, importing MySQL data into Lakehouse. You can now perform subsequent analysis and processing based on the imported data.
106
97
 
@@ -20,13 +20,12 @@ Enterprise business intelligence (BI) generally obtains raw data from the enterp
20
20
 
21
21
  ### Workflow Diagram
22
22
 
23
- ![](.topwrite/assets/image_1692343510673.png =648)
23
+
24
24
 
25
25
  ### Business Requirements
26
26
 
27
27
  The business requirements in this example simulate common BI analysis scenarios in e-commerce, generating a wide table at the detailed layer of the data warehouse by associating user behavior log data with dimension tables such as products, stores, and time zones. This wide table is then provided to downstream data application layers, and BI tools are used for sales and order statistics, funnel conversion models, popular product displays, etc.
28
28
 
29
- ![](.topwrite/assets/image_1692975150801.png =704)
30
29
 
31
30
  ^
32
31
 
@@ -54,7 +53,6 @@ Configure task dependencies in the order of data integration tasks first, follow
54
53
 
55
54
  Deploy all tasks to the production environment.
56
55
 
57
- ![](.topwrite/assets/image_1693020935459.png =627)
58
56
 
59
57
  ^
60
58
 
@@ -64,7 +62,7 @@ Refer to the **Preparations** in the previous chapter. Before starting the "Quic
64
62
 
65
63
  ^
66
64
 
67
- ![](.topwrite/assets/9865a42db031a5516b4caf79bf0f4bb.png =715)
65
+ ![](/.topwrite/assets/image_1780998919773.png)
68
66
 
69
67
  ^
70
68
 
@@ -78,26 +76,24 @@ In the initialized product environment, you may already have the following objec
78
76
  ^
79
77
 
80
78
  Figure 1 —— User
81
-
82
- ![](.topwrite/assets/image_1692348046212.png =354)
79
+ ![](/.topwrite/assets/image_1780998366942.png)
83
80
 
84
81
  ^
85
82
 
86
83
  Figure 2 —— Workspace: QuickStart\_WorkSpace
87
-
88
- ![](.topwrite/assets/image_1692586908866.png =512)
84
+ ![](/.topwrite/assets/image_1780998669158.png)
89
85
 
90
86
  ^
91
87
 
92
88
  Figure 3 —— Schema: Public
93
89
 
94
- ![](.topwrite/assets/image_1692583856135.png =730)
90
+ ![](/.topwrite/assets/image_1780998800756.png)
95
91
 
96
92
  ^
97
93
 
98
94
  Figure 4 —— Computing Cluster: Default
99
95
 
100
- ![](.topwrite/assets/image_1692586859163.png =728)
96
+ ![](/.topwrite/assets/image_1780998850270.png)
101
97
 
102
98
  ###
103
99
 
@@ -117,34 +113,21 @@ Studio provides two ways to create a new data source:
117
113
  ^
118
114
 
119
115
  Figure 1 —— Method 1
120
- ![](.topwrite/assets/image_1692588245122.png =785)
116
+ ![](/.topwrite/assets/image_1780999019336.png)
121
117
 
122
118
  ^
123
119
 
124
120
  Figure 2 —— Method 2
125
- ![](.topwrite/assets/image_1692588445515.png =719)
126
-
127
- ^
128
-
129
- ![](.topwrite/assets/image_1692589881885.png =676)
121
+ ![](/.topwrite/assets/image_1780999067659.png)
130
122
 
131
123
  ^
132
124
 
133
125
  Select the MySQL type data source on the new data source page and click Next.
134
126
 
135
- ![](.topwrite/assets/image_1692605359674.png =399)
136
-
137
- ^
138
-
139
127
  Enter the database connection information and click connectivity test. If the configuration is correct, a green \[Connection Successful] will be displayed. If the connection test fails, you need to verify the configuration information or change the database's access whitelist policy. \*If you need to add specific IP whitelist entries, please contact Singdata customer service or your account manager.
140
128
 
141
- ![](.topwrite/assets/image_1692605303319.png =553)
142
-
143
- ^
144
-
145
129
  After successful creation, the data source can be seen in the list.
146
130
 
147
- ![](.topwrite/assets/image_1692605636158.png =733)
148
131
 
149
132
  ^
150
133
 
@@ -21,23 +21,21 @@ Before reading this guide, it is recommended to complete reading and understandi
21
21
 
22
22
  1. Click the button as shown below to enter the Lakehouse service instance:
23
23
 
24
- ![](.topwrite/assets/image_1747991184372.png)
24
+ :-: ![](/.topwrite/assets/image_1780975475741.png)
25
25
 
26
26
  2. Navigate to Management > Workspace page:
27
27
 
28
- ![](.topwrite/assets/image_1747991196958.png)
28
+ :-: ![](/.topwrite/assets/image_1780975507979.png)
29
29
 
30
30
  3. Click the "New" button, fill in the information according to the interface prompts, and complete the creation:
31
31
 
32
32
  * Note that the workspace name must be unique within the service instance and has naming constraints. Please follow the guidance prompts on the page.
33
33
  * "Storage Encryption" refers to whether tables under the workspace are physically stored with encryption enabled. This is an advanced configuration feature, enable as needed.
34
- ![](.topwrite/assets/image_1747991206223.png)
35
34
 
36
- 4. After the workspace is created, you may potentially perform the following operations:
37
35
 
38
- * Use this workspace in product modules such as task development. The workspace switching entry is located at the top right corner of the page, as shown below:
36
+ 4. After the workspace is created, you may potentially perform the following operations:
39
37
 
40
- ![](.topwrite/assets/image_1747991250081.png)
38
+ * Use this workspace in product modules such as task development.
41
39
 
42
40
  * Add other users to the workspace for collaboration. For details, see: [How to Quickly Manage Users Under a Workspace](quick_start_workspace_user.md)
43
41
 
@@ -23,19 +23,19 @@ You can use the "Data Quality" feature provided by Lakehouse Studio to configure
23
23
 
24
24
  ### Steps
25
25
 
26
- 1. As shown below, click the button to enter the Lakehouse service instance:
26
+ 1. click the button to enter the Lakehouse service instance.
27
27
 
28
- ![](.topwrite/assets/image_1748337538227.png)
29
28
 
30
- 2. Navigate to "Data" > "Data Quality" page:
31
29
 
32
- ![](.topwrite/assets/image_1749449999835.png)
30
+ 2. Navigate to "Data" > "Data Quality" page
31
+
32
+
33
33
 
34
34
  3. On the "Quality Rules" tab, click the "Create Rule" button to open the page for creating a new quality rule. Please verify and ensure that the workspace in the upper right corner of the page is the workspace where the data table to be verified is located. If not, you can click to switch.
35
- ![](.topwrite/assets/image_1749450019542.png)
35
+
36
36
 
37
37
  4. On the Create Rule page, the workspace value will be automatically set to the workspace selected in the previous step [1]. Select the data object to verify. In this example, select the `test_json` table where data was written by the sync task in the previous ETL pipeline for verification [2]. When a quality rule is executed, it is actually converted to a Lakehouse SQL statement for execution, so an execution cluster is required. For simplicity, it is recommended to directly select the default GP-type cluster `DEFAULT` [3].
38
- ![](.topwrite/assets/image_1749450038105.png)
38
+
39
39
 
40
40
  5. Configure "Verification Method", "Trigger Method", and "Save" the rule.
41
41
 
@@ -45,10 +45,10 @@ You can use the "Data Quality" feature provided by Lakehouse Studio to configure
45
45
 
46
46
  * Other configuration items can keep default values or be left blank. Finally, click the "Save" [6] button to complete the creation of the quality rule.
47
47
 
48
- ![](.topwrite/assets/image_1749450069308.png)
48
+
49
49
 
50
50
  6. After creation, you can see the newly added rule in the quality rule list page.
51
- ![](.topwrite/assets/image_1749450081238.png)
51
+
52
52
 
53
53
  7. You can click the "Trial Run" button to test the configuration and verification of the quality rule. On the "Verification Results" tab, you can view the specific results, as shown below: the quality rule was triggered to run, the verification result matches expectations, and everything is normal.
54
54
  ![](.topwrite/assets/image_1749450092151.png)
@@ -22,25 +22,23 @@ Users with `workspace_admin` or `workspace_dev` role permissions are required to
22
22
 
23
23
  ### Creating a SQL Task
24
24
 
25
- 1. Use the operation entry shown below to create a SQL task:
25
+ 1. Use the operation entry to create a SQL task.
26
26
 
27
- ![](.topwrite/assets/image_1748425848352.png)
28
27
 
29
28
  2. In the task creation dialog, name the task "SQL_DWS_Aggregation" and create a dedicated folder named "Data Processing".
30
29
 
31
- ![](.topwrite/assets/image_1748425859150.png)
30
+
32
31
 
33
32
  3. After the SQL task is created, as shown below, you can write specific SQL code in the editor area.
34
33
 
35
- ![](.topwrite/assets/image_1748425869532.png)
34
+
36
35
 
37
36
  4. Previously, through the data sync task, MySQL data has been synced to the test_json table in Lakehouse. In the SQL task, perform aggregation processing based on this table's data, such as summing the c2_tinyint_column and c3_smallint_column fields respectively. Navigate to the "Data" tab, locate the target table test_json, and click "Data Query" in the action bar. This will automatically insert a SELECT code template into the editor, as shown below, helping to improve code writing efficiency.
38
37
 
39
- ![](.topwrite/assets/image_1748425911494.png)
40
38
 
41
39
  5. Modify the above code template to the desired processing logic, then save. This is just for demonstration purposes, simplified processing, and the aggregation results are not written to a new table.
42
40
 
43
- ![](.topwrite/assets/image_1748425934078.png)
41
+
44
42
 
45
43
  ```SQL
46
44
  SELECT SUM(c2_tinyint_column),
@@ -54,44 +52,42 @@ After completing the creation of the sync task and SQL task, to build a complete
54
52
 
55
53
  1. Open the sync task and click the "Schedule" button on the page to open the scheduling configuration.
56
54
 
57
- ![](.topwrite/assets/image_1748426012421.png =633)
55
+
58
56
 
59
57
  2. Configure Scheduling Time: Configure to schedule daily, run multiple times, once every hour, as shown below. Use "Preview Schedule Time" to view the specific scheduled times corresponding to the configuration.
60
58
 
61
- ![](.topwrite/assets/image_1748426023159.png =722)
62
59
 
63
- ![](.topwrite/assets/image_1748426030471.png =397)
64
60
 
65
61
  3. Configure Instance Information: The main thing to configure here is "Instance Rerun Mode". Since this task does not have data idempotency issues when rerunning, it can be rerun. Therefore select "Can be rerun regardless of success or failure". Other properties can use default values.
66
62
 
67
- ![](.topwrite/assets/image_1748426041609.png =386)
63
+
68
64
 
69
65
  4. Configure Scheduling Dependencies: The sync task is the first task in the pipeline and has no upstream dependencies, so leave this blank.
70
66
 
71
- ![](.topwrite/assets/image_1748426049779.png =386)
67
+
72
68
 
73
69
  5. Configure Task Output: Task output is used to describe which table this task writes to, so that downstream tasks consuming this table can intelligently identify the corresponding upstream task. Click the "Smart Parse" button, and the system will automatically resolve the current task's output table through the task configuration and backfill it into the configuration.
74
70
 
75
- ![](.topwrite/assets/image_1748426056766.png =386)
71
+
76
72
 
77
73
  6. After completing the above scheduling configuration, click the "OK" button at the bottom right of the page to save the configuration. Return to the task page, and as shown below, the "Submit" button will become clickable.
78
74
 
79
- ![](.topwrite/assets/image_1748426062758.png)
75
+
80
76
 
81
77
  7. Click the "Submit" button, verify the information again in the popup dialog, then click OK. The sync task will be submitted to the production environment for periodic scheduled execution.
82
78
 
83
- ![](.topwrite/assets/image_1748426068998.png)
79
+
84
80
 
85
81
  8. Switch to the SQL task, and click the "Schedule" button on the page to open the scheduling configuration. The properties to configure are the same as for the sync task, i.e.:
86
82
 
87
83
  1. Configure to schedule multiple times per day, once every hour.
88
84
  2. Configure the rerun property as "Can be rerun regardless of success or failure".
89
85
  3. Pay special attention to configuring the SQL task's dependency on the sync task. Click the "Smart Parse" button on the page to automatically identify the sync task that the SQL task depends on and backfill it automatically; you can also add it manually.
90
- ![](.topwrite/assets/image_1748426078453.png =386)
86
+
91
87
 
92
88
  9. Similarly, after the SQL task's scheduling configuration is complete, click the "OK" button at the bottom right of the page to save the configuration. Return to the task page, and click the "Submit" button to also submit the SQL task for scheduled execution.
93
89
 
94
- ![](.topwrite/assets/image_1748426087176.png)
90
+
95
91
 
96
92
  10. Enter "Task Operations" to view the actual results. There are two ways to enter:
97
93
 
@@ -99,19 +95,19 @@ After completing the creation of the sync task and SQL task, to build a complete
99
95
 
100
96
  * Method 2: Click the "Operations" button directly on the task to go directly to the task's details page in the Operations Center. This method is recommended.
101
97
 
102
- ![](.topwrite/assets/image_1748426094142.png)
98
+
103
99
 
104
100
  11. View the task details, as shown below. As expected, the SQL task depends on the sync task:
105
101
 
106
- ![](.topwrite/assets/image_1748426100418.png)
102
+
107
103
 
108
104
  12. Click the "Task Instances" tab to see the list of specific instances corresponding to the task. Instances have been generated according to the configured scheduled time (only instances after the task submission time are generated):
109
105
 
110
- ![](.topwrite/assets/image_1748426139524.png)
106
+
111
107
 
112
108
  13. Click an instance ID to enter the instance details page for viewing. When the scheduled time arrives, the upstream sync task instance runs first. After it runs successfully, the downstream SQL task instance starts running. Two conditions must be simultaneously met for an instance to be triggered to run (necessary and sufficient conditions): the instance's own scheduled time has arrived, AND the upstream instance is in a successful state.
113
109
 
114
- ![](.topwrite/assets/image_1748426146577.png)
110
+
115
111
 
116
112
  14. At this point, a complete ETL pipeline has been orchestrated, built, and submitted for periodic scheduling and execution.
117
113
 
@@ -24,11 +24,10 @@ Users with `workspace_admin`, `workspace_dev`, or `workspace_sre` role permissio
24
24
 
25
25
  #### Entering the Monitoring and Alerting Module
26
26
 
27
- 1. As shown below, click the button to enter the Lakehouse service instance:
28
- ![](.topwrite/assets/image_1748337538227.png)
27
+ 1. click the button to enter the Lakehouse service instance.
28
+ ![](/.topwrite/assets/image_1780975925233.png =470)
29
29
 
30
30
  2. Navigate to "Operations Monitoring" > "Monitoring and Alerting" page:
31
- ![](.topwrite/assets/image_1749455648524.png)
32
31
 
33
32
  #### Using Built-in Rules
34
33
 
@@ -36,19 +35,18 @@ As mentioned above, the product has built-in global monitoring rules available f
36
35
 
37
36
  1. As shown below, there are mainly two types of built-in monitoring rules: "Periodic Task Instance Execution Failed" and "Data Quality Check Failed":
38
37
 
39
- ![](.topwrite/assets/image_1749455660655.png)
38
+ :-:   ![](.topwrite/assets/image_1749455660655.png)
40
39
 
41
40
  2. Click a specific monitoring rule to view its detailed configuration definition. Taking "Data Quality Check Failed - Strong Rule" as an example, the following figure shows its core information such as monitoring items, alert notification methods, and notification recipients.
42
- ![](.topwrite/assets/image_1749455672982.png)
43
41
 
44
42
  * Monitoring Item: Strong blocking scheduled quality rule verification failed.
45
43
  * Alert Notification: For critical-level rules, according to the notification policy definition (not expanded here, see related documents for details), phone alerts will be pushed.
46
44
  * Notification Recipients: By default, the object owner will be notified. For data quality rules, the rule creator is notified by default.
47
45
 
48
46
  3. Enable built-in global alert rules and subscriptions, continuing with "Data Quality Check Failed - Strong Rule" as an example:
49
- ![](.topwrite/assets/image_1749455707588.png)
50
- * Click "Enable" to activate this rule [1]. According to the rule definition, this alert will be sent to the object owner, i.e., the creator of the quality rule.
51
- * If you are not the object owner (e.g., not the creator of the quality rule) but also want to follow this alert, you can click the "Subscribe" button [2].
47
+
48
+ * Click "Enable" to activate this rule \[1]. According to the rule definition, this alert will be sent to the object owner, i.e., the creator of the quality rule.
49
+ * If you are not the object owner (e.g., not the creator of the quality rule) but also want to follow this alert, you can click the "Subscribe" button \[2].
52
50
 
53
51
  #### Custom Monitoring Rules
54
52
 
@@ -57,28 +55,22 @@ Built-in rules primarily provide overall monitoring from a global dimension, fac
57
55
  The following example will demonstrate how to monitor the instance execution failure of a specific periodic scheduling task and alert via phone. The main steps are as follows:
58
56
 
59
57
  1. In the "Monitoring Rules" list, click the "Create Rule" button.
60
- ![](.topwrite/assets/image_1749455842124.png)
61
58
 
62
59
  2. In the Create Rule dialog, fill in the required information for the rule and save.
63
60
  * Monitoring Item: Task instance execution failed. Use filters to **select the specific task name**.
64
61
  * Alert Notification: Set the level to "Warning" and use the "General Notification Policy" to send SMS alerts. The notification recipient defaults to the current operator.
65
- ![](.topwrite/assets/image_1749455860120.png)
66
- ![](.topwrite/assets/image_1749455865473.png)
67
62
 
68
63
  3. After the rule is created, a record will be displayed in the list:
69
- ![](.topwrite/assets/image_1749455912549.png)
70
64
 
71
65
  4. Observe how the monitoring rule works.
72
66
 
73
67
  * Here, we perform a simulated error change: modify the SQL logic of the monitored task, use an incorrect field name, then submit for scheduled execution to trigger a scheduling instance execution failure.
74
- ![](.topwrite/assets/image_1749455960285.png)
75
- ![](.topwrite/assets/image_1749456300165.png)
76
68
 
77
69
  * After the task is scheduled and executed and a failure occurs, you can observe the working status of the monitoring alert rule in "Monitoring and Alerting", which is as expected:
78
- * In "Alert Events", you can see a new alert event added:
79
- ![](.topwrite/assets/image_1749456335722.png)
80
- * In "Notification History", you can see the specific alert notification push status:
81
- ![](.topwrite/assets/image_1749456370821.png)
70
+ * In "Alert Events", you can see a new alert event added.
71
+
72
+ * In "Notification History", you can see the specific alert notification push status.
73
+
82
74
 
83
75
  At this point, the configuration of built-in and custom monitoring and alerting rules and the observation of their actual working results have been completed.
84
76
 
@@ -20,20 +20,18 @@ To quickly run a SQL query in the UI, use the Data Development module in Lakehou
20
20
 
21
21
  The product includes ready-to-use sample code and accompanying sample data. In the page navigation, click **Development** to enter the Data Development interface, where you will see sample code files under the `Tpch_100g` folder. These samples demonstrate how to write SQL queries for quick analysis based on the Tpch_100g sample data, as shown below:
22
22
 
23
- ![](.topwrite/assets/image_1747993124883.png)
23
+
24
24
 
25
25
  Double-click a sample code file to open it, then click the **Run** button in the upper-right corner of the page to trigger SQL execution. Once execution completes, you can view the results and logs in the lower-right area of the page.
26
26
 
27
- ![](.topwrite/assets/image_1747993372483.png)
27
+
28
28
 
29
29
  ^
30
30
 
31
31
  Pay special attention to the **Cluster** option in the upper-right corner of the page. "Cluster" stands for "Compute Cluster," which is the core concept of how Lakehouse provides compute power. See [this document](virtual-cluster.md) for detailed information. When a workspace is created, two clusters are initialized by default: a general-purpose cluster named `DEFAULT` and an analytics cluster named `DEFAULT_AP`. These two types of clusters are optimized for different workloads:
32
32
 
33
33
  * **General Purpose (GP)**: Suitable for offline job processing. Jobs share compute resources, and new and old jobs are scheduled fairly. Suitable for periodic scheduling tasks to process large volumes of data.
34
- * **Analytics Purpose (AP)**: Features multiple compute instances and auto-scaling, suitable for online and high-concurrency jobs. Choose this cluster type if you want a better query performance experience. In addition, AP clusters perform intelligent data caching. After the first query, subsequent queries run faster. The following diagram illustrates this difference:
35
-
36
- ![](.topwrite/assets/image_1748326696659.png)
34
+ * **Analytics Purpose (AP)**: Features multiple compute instances and auto-scaling, suitable for online and high-concurrency jobs. Choose this cluster type if you want a better query performance experience. In addition, AP clusters perform intelligent data caching. After the first query, subsequent queries run faster.
37
35
 
38
36
  ^
39
37
 
@@ -43,7 +41,7 @@ You can also learn more about query analysis using sample data by reading [Quick
43
41
 
44
42
  In addition to using sample code and sample data, you can also write and run your own SQL. In the page navigation bar, click **Development** to enter the Data Development interface. Under **Tasks**, create a SQL task file by selecting **SQL Script** from the new menu.
45
43
 
46
- ![](.topwrite/assets/image_1721484292583.png)
44
+
47
45
 
48
46
  In the task file, follow these steps to write and run SQL:
49
47
 
@@ -55,15 +53,15 @@ In the task file, follow these steps to write and run SQL:
55
53
 
56
54
  4. Click the run button on the left or the run button in the upper-right corner to execute the code. The left button only executes the code block where the cursor is located. The upper-right button executes all code by default; you can also select a portion of code first, then click the upper-right run button to execute only the selected portion.
57
55
 
58
- ![](.topwrite/assets/image_1721484303315.png)
56
+
59
57
 
60
58
  5. After execution completes, you can view the results, duration, and run logs in the area at the bottom of the page:
61
59
 
62
- ![](.topwrite/assets/image_1721484312151.png)
60
+
63
61
 
64
62
  6. While writing code in the editor, you can also switch to the **Data** tab to quickly browse and use data. After finding the desired table, you can quickly insert the table name, field names, or directly generate a sample query SQL from the action menu:
65
63
 
66
- ![](.topwrite/assets/image_1721484321409.png)
64
+
67
65
 
68
66
  ### Other Common Operations
69
67
 
@@ -76,7 +74,6 @@ In addition to the **Run** operation, the system provides the following features
76
74
  5. Find: Search for code snippets within the current file by keyword
77
75
  6. Shortcuts: Display supported common shortcuts
78
76
 
79
- ![](.topwrite/assets/image_1721531293556.png)
80
77
 
81
78
  ## Limitations
82
79
 
@@ -30,17 +30,15 @@ You can add data to Lakehouse tables through the "Data Upload" feature available
30
30
  2. You can click "Upload Data" in any of the following locations:
31
31
 
32
32
  * Instance Homepage
33
- ![](.topwrite/assets/image_1747999086635.png)
33
+
34
34
  * Development -> Data Tree
35
- ![](.topwrite/assets/image_1749035410382.png)
35
+
36
36
  * Data Asset Map
37
- ![](.topwrite/assets/image_1749035355497.png)
37
+
38
38
  * Data Asset Map -> Data Management
39
- ![](.topwrite/assets/image_1749035495163.png)
40
39
 
41
- 3. After clicking, the following dialog will appear. You can add local files by dragging and dropping, or by clicking to browse files on the local system. Only one file can be added at a time, and the size must not exceed 2GiB. You can use this sample file to try uploading: :attachment[walmart.csv]{src=".topwrite/assets/walmart.csv" size="363.73 kB"}.
42
40
 
43
- ![](.topwrite/assets/image_1749035813956.png =380)
41
+ 3. After clicking, the following dialog will appear. You can add local files by dragging and dropping, or by clicking to browse files on the local system. Only one file can be added at a time, and the size must not exceed 2GiB. You can use this sample file to try uploading: :attachment[walmart.csv]{src=".topwrite/assets/walmart.csv" size="363.73 kB"}.
44
42
 
45
43
  4. Schema: Choose to create the table under a certain schema.
46
44
 
@@ -51,7 +49,7 @@ You can add data to Lakehouse tables through the "Data Upload" feature available
51
49
  7. Data Import Mode: Supports append write and truncate-then-write modes for importing data into the new table.
52
50
 
53
51
  8. After confirming all information, click "Next". The system will automatically parse the field information from the uploaded file, as shown below.
54
- ![](.topwrite/assets/image_1749035692218.png =380)
52
+
55
53
 
56
54
  9. Check and determine whether the automatically parsed field names and field types meet expectations. After confirming correctness, click "Confirm" to complete the table creation and data upload.
57
55
  * If you find issues with field parsing, you can modify the **File Properties** configuration items to re-trigger automatic parsing of field names, field types, etc. Or you can manually modify field names or field types.
@@ -19,15 +19,15 @@ Before reading this guide, we recommend you review and understand the following
19
19
 
20
20
  1. After logging in, you will be directed to the "Admin Center" account home page by default, as shown below:
21
21
 
22
- ![](.topwrite/assets/image_1747990064729.png)
22
+
23
23
 
24
24
  2. In the Admin Center's left navigation bar, go to "Account Management > User Management" to access the user management page, as shown below:
25
25
 
26
- ![](.topwrite/assets/image_1747990075720.png)
26
+
27
27
 
28
28
  3. Click the "Create" button in the upper-right corner and select "Create User" to begin creating a user account.
29
29
 
30
- ![](.topwrite/assets/image_1747990090897.png =297)
30
+
31
31
 
32
32
  > Note: "Custom Service User" is an identity created for automation tools, tasks, and applications. It cannot log in via the web UI. You can ignore this for now. For more details, see: [Service User Management](account_user_management.md)
33
33
 
@@ -35,24 +35,24 @@ Before reading this guide, we recommend you review and understand the following
35
35
 
36
36
  * Remember the password you set here, as you will need to provide the username and password to the user later.
37
37
  * The phone number must be the user's mobile number so that alerts and notifications can be delivered accurately.
38
- ![](.topwrite/assets/image_1747990274287.png)
38
+
39
39
 
40
40
  5. After creating the new user account, provide the following two pieces of information to the user:
41
41
 
42
42
  * Username and password.
43
43
  * Account login URL in the format: `<account-name>.accounts.singdata.com`. You can also copy the browser URL shown in the screenshot below and send it to the user.
44
44
 
45
- ![](.topwrite/assets/image_1747990303813.png)
45
+
46
46
 
47
47
  6. After the user logs in with the username and password, they can change the initial password by navigating to "Account Management > User Management" in the left sidebar, finding their account, and selecting "Change Password" from the actions menu.
48
48
 
49
- ![](.topwrite/assets/image_1747990312625.png)
49
+
50
50
 
51
51
  ## Limitations
52
52
 
53
- * Permission Note: Only users with the account administrator (`account_admin`) role can create and manage users. This role is identified as follows:
53
+ * Permission Note: Only users with the account administrator (`account_admin`) role can create and manage users.
54
+
54
55
 
55
- ![](.topwrite/assets/image_1747990332688.png =446)
56
56
 
57
57
  ## Related Documents
58
58
 
@@ -8,7 +8,6 @@ To achieve both isolation and ease of data exchange within a service instance, p
8
8
 
9
9
  When a user has permissions for data objects within a workspace, they can perform cross-space queries or other operations within the scope of their permissions on these data objects in other workspaces.
10
10
 
11
- :-: ![](.topwrite/assets/workspace_1735992503899.png =814)
12
11
 
13
12
  As shown in the figure above, multiple workspaces can be created within a Lakehouse service instance. A service instance user can be added to multiple workspaces simultaneously and be granted permissions for objects within those workspaces.
14
13
 
@@ -37,11 +36,9 @@ After the service instance is activated, the system will create a workspace name
37
36
 
38
37
  In the "Account Home" of the control center, click on the activated service instance to enter the homepage of the service instance.
39
38
 
40
- :-: ![](.topwrite/assets/image_1721463116737.png =745)
41
39
 
42
40
  On the homepage of the service instance, click on any function in the left function menu such as "Development", "Computing", "Operations Monitoring", etc. The workspaces that the current account has permission to access will be listed in the upper right corner of the page, supporting switching. When using a single workspace, it defaults to the only workspace within the service instance. At this time, all task scripts and scheduling jobs are within this workspace.
43
41
 
44
- :-: ![](.topwrite/assets/image_1721463152612.png =743)
45
42
 
46
43
  ## Creating and Using Multiple Workspaces
47
44
 
@@ -55,7 +52,6 @@ The instance administrator (instance\_admin) role of the service instance can cr
55
52
 
56
53
  Enter the "Management - Workspace" menu, click "New Space" on the workspace management page, fill in the required information, and create it.
57
54
 
58
- :-: ![](.topwrite/assets/image_1721463203358.png =794)
59
55
 
60
56
  ^
61
57
 
@@ -65,7 +61,6 @@ The user who creates the new workspace will be granted the workspace administrat
65
61
 
66
62
  When using multiple workspaces, you can switch between different workspace environments through the workspace button in the upper right corner of the "Development", "Computing", "Operations Monitoring" and other function pages.
67
63
 
68
- :-: ![](.topwrite/assets/image_1736089880260.png =785)
69
64
 
70
65
  ^
71
66