@clickzetta/cz-cli-darwin-arm64 0.5.16 → 0.5.18
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/bin/cz-cli +0 -0
- package/bin/skills/lakehouse-doc-en/SKILL.md +6 -11
- package/bin/skills/lakehouse-doc-en/references/AIGateway.md +58 -13
- package/bin/skills/lakehouse-doc-en/references/Computation.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/DataSource_Amazon_DocumentDB.md +3 -1
- package/bin/skills/lakehouse-doc-en/references/Foreach.md +14 -14
- package/bin/skills/lakehouse-doc-en/references/JDBC-Driver.md +0 -1
- package/bin/skills/lakehouse-doc-en/references/LakehouseAI-overview.md +21 -8
- package/bin/skills/lakehouse-doc-en/references/LakehouseDataGPT-tour.md +4 -9
- package/bin/skills/lakehouse-doc-en/references/LakehouseStudio-tour.md +14 -19
- package/bin/skills/lakehouse-doc-en/references/Lakehouse_Zilliz_MakeDataReadyforBIandAI.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/Logstash.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/Migrate_Spark_DataEngineeringBestPractices_Project_to_Lakehouse.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/Notebook.md +17 -17
- package/bin/skills/lakehouse-doc-en/references/RemoteFunction-as-udf.md +14 -14
- package/bin/skills/lakehouse-doc-en/references/SQL_External_Catalog_Guide.md +1 -9
- package/bin/skills/lakehouse-doc-en/references/SUMMARY.md +59 -29
- package/bin/skills/lakehouse-doc-en/references/WINDOWFUNCTION.md +99 -57
- package/bin/skills/lakehouse-doc-en/references/Zettapark_Data_Engineering_Demo.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/access-control-configuration.md +1 -8
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-2-5-1.0.md +16 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-3-29-1.0.2.md +14 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-3-8-1.0.1.md +16 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-4-28-1.1.md +29 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-5-12-1.1.1.md +18 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-5-15-1.2.md +9 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-5-21-1.3.md +9 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-5-28-1.4.md +10 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-6-3-1.5.md +9 -0
- package/bin/skills/lakehouse-doc-en/references/alicloud-arn-externalid.md +0 -5
- package/bin/skills/lakehouse-doc-en/references/answer-accuracy-improve.md +120 -103
- package/bin/skills/lakehouse-doc-en/references/application-list.md +1 -3
- package/bin/skills/lakehouse-doc-en/references/approval-list.md +16 -17
- package/bin/skills/lakehouse-doc-en/references/batch-load-parquet-file-into-lakehouse.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/batch_sync.md +9 -9
- package/bin/skills/lakehouse-doc-en/references/batch_sync_Sop.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/batchloadparquetfileintoLakehouse.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/bulkloadv1-python-sdk.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/chart-auto-refresh-guide.md +12 -6
- package/bin/skills/lakehouse-doc-en/references/clickzetta-sample-data.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/code_approval.md +1 -5
- package/bin/skills/lakehouse-doc-en/references/composite_task.md +31 -42
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_environment_and_data_generate.md +6 -9
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_javasdk_bulkload_realtime.md +4 -10
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_kafka_realtime_sync.md +1 -10
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_local_file_into_table_by_studio.md +0 -6
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_studio_batchload_public_network.md +0 -5
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_studio_python_node.md +2 -7
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_studio_realtime_cdc_public_network.md +13 -18
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_studio_sql_insert.md +0 -1
- package/bin/skills/lakehouse-doc-en/references/concepts.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/config-datasource.md +5 -7
- package/bin/skills/lakehouse-doc-en/references/connect-with-cli.md +116 -72
- package/bin/skills/lakehouse-doc-en/references/connect-with-cz-cli.md +151 -0
- package/bin/skills/lakehouse-doc-en/references/continue-job.md +9 -17
- package/bin/skills/lakehouse-doc-en/references/create-api-connection.md +315 -286
- package/bin/skills/lakehouse-doc-en/references/create-catalog-connection.md +1 -0
- package/bin/skills/lakehouse-doc-en/references/create-dynamic-table.md +4 -4
- package/bin/skills/lakehouse-doc-en/references/create-external-catalog.md +85 -22
- package/bin/skills/lakehouse-doc-en/references/create-table-ddl.md +45 -0
- package/bin/skills/lakehouse-doc-en/references/creating_alicloud_privatelinkendpoint.md +4 -6
- package/bin/skills/lakehouse-doc-en/references/creating_alicloud_privatelinkservice.md +4 -7
- package/bin/skills/lakehouse-doc-en/references/creating_tencentcloud_privatelinkendpoint.md +2 -7
- package/bin/skills/lakehouse-doc-en/references/creating_tencentcloud_privatelinkservice.md +1 -5
- package/bin/skills/lakehouse-doc-en/references/cz-cli-agent.md +15 -10
- package/bin/skills/lakehouse-doc-en/references/cz-cli-datasource.md +0 -8
- package/bin/skills/lakehouse-doc-en/references/cz-cli-sql.md +2 -45
- package/bin/skills/lakehouse-doc-en/references/cz-cli.md +53 -42
- package/bin/skills/lakehouse-doc-en/references/dashboard-version-management-guide.md +12 -4
- package/bin/skills/lakehouse-doc-en/references/data-integration-intro.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/data-integration.md +29 -27
- package/bin/skills/lakehouse-doc-en/references/data-load-summary.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/data-quality.md +25 -25
- package/bin/skills/lakehouse-doc-en/references/data-sharing.md +31 -54
- package/bin/skills/lakehouse-doc-en/references/data-sources.md +45 -45
- package/bin/skills/lakehouse-doc-en/references/data_catalog.md +23 -25
- package/bin/skills/lakehouse-doc-en/references/data_privacy.md +5 -2
- package/bin/skills/lakehouse-doc-en/references/data_sharing_between_accounts_guide.md +0 -4
- package/bin/skills/lakehouse-doc-en/references/data_visualization.md +4 -15
- package/bin/skills/lakehouse-doc-en/references/dataagent.md +39 -7
- package/bin/skills/lakehouse-doc-en/references/databricks-delta-to-lakehouse-migration.md +168 -0
- package/bin/skills/lakehouse-doc-en/references/databricks-dlt-to-lakehouse-migration.md +331 -0
- package/bin/skills/lakehouse-doc-en/references/databricks-external-catalog-practice.md +367 -0
- package/bin/skills/lakehouse-doc-en/references/databricks-jobs-to-studio-migration.md +199 -0
- package/bin/skills/lakehouse-doc-en/references/databricks-notebook-to-studio-migration.md +350 -0
- package/bin/skills/lakehouse-doc-en/references/databricks-uc-governance-to-lakehouse-migration.md +327 -0
- package/bin/skills/lakehouse-doc-en/references/datagpt-model-config.md +34 -0
- package/bin/skills/lakehouse-doc-en/references/datagpt_data_source.md +50 -37
- package/bin/skills/lakehouse-doc-en/references/datagpt_introduction.md +55 -79
- package/bin/skills/lakehouse-doc-en/references/datagpt_quickstart.md +50 -64
- package/bin/skills/lakehouse-doc-en/references/datalake-acceleration.md +75 -2
- package/bin/skills/lakehouse-doc-en/references/dbt-databricks-to-clickzetta-migration.md +242 -0
- package/bin/skills/lakehouse-doc-en/references/dynamic-mask.md +30 -30
- package/bin/skills/lakehouse-doc-en/references/dynamic-table-bestpractice.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/dynamic-table-introduce.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/dynamic_table_summary.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/eco_integration/streamlit.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/eco_integration/superset.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/ecosystem-all.md +1 -3
- package/bin/skills/lakehouse-doc-en/references/ecosystem.md +145 -0
- package/bin/skills/lakehouse-doc-en/references/external-catalog-summary.md +33 -38
- package/bin/skills/lakehouse-doc-en/references/external-function-combo-practice.md +466 -0
- package/bin/skills/lakehouse-doc-en/references/f6fc6447ee.md +7 -9
- package/bin/skills/lakehouse-doc-en/references/federation-query.md +56 -6
- package/bin/skills/lakehouse-doc-en/references/finebi-mysql.md +2 -0
- package/bin/skills/lakehouse-doc-en/references/get-started-with-sample-data.md +10 -11
- package/bin/skills/lakehouse-doc-en/references/gitfolder.md +2 -3
- package/bin/skills/lakehouse-doc-en/references/grant-privileges.md +2 -0
- package/bin/skills/lakehouse-doc-en/references/iceberg-rest-catalog-databricks.md +166 -0
- package/bin/skills/lakehouse-doc-en/references/ide.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/if_else_task.md +59 -57
- package/bin/skills/lakehouse-doc-en/references/input_output.md +10 -7
- package/bin/skills/lakehouse-doc-en/references/jobprofile-bestpractices.md +60 -64
- package/bin/skills/lakehouse-doc-en/references/kafka-connection.md +0 -1
- package/bin/skills/lakehouse-doc-en/references/key-concepts.md +146 -117
- package/bin/skills/lakehouse-doc-en/references/lakehouse-ai-gateway-cz-cli.md +317 -0
- package/bin/skills/lakehouse-doc-en/references/lakehouse-ai-sql-analysis.md +345 -0
- package/bin/skills/lakehouse-doc-en/references/lakehouse-dqc-guide.md +300 -0
- package/bin/skills/lakehouse-doc-en/references/lakehouse-medallion-sql-dt-guide.md +543 -0
- package/bin/skills/lakehouse-doc-en/references/lakehouse-multi-cloud-acceleration.md +274 -0
- package/bin/skills/lakehouse-doc-en/references/lakehouse-multimodal-ai-pipeline.md +198 -0
- package/bin/skills/lakehouse-doc-en/references/lakehouse-quick-experience_guide.md +49 -52
- package/bin/skills/lakehouse-doc-en/references/lakehouse-volume-pipe-acceleration-guide.md +380 -0
- package/bin/skills/lakehouse-doc-en/references/langchain-plug-installation.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/management.md +4 -9
- package/bin/skills/lakehouse-doc-en/references/medallion-lakehouse-from-scratch.md +2 -1
- package/bin/skills/lakehouse-doc-en/references/metrics_answer_build.md +58 -21
- package/bin/skills/lakehouse-doc-en/references/migrate-spark-data-engineering-best-practices-to-lakehouse.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/mindsdb.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/monitoring_and_alerting.md +65 -60
- package/bin/skills/lakehouse-doc-en/references/monitoring_item_specification.md +33 -33
- package/bin/skills/lakehouse-doc-en/references/multitable_batch_sync.md +16 -16
- package/bin/skills/lakehouse-doc-en/references/multitable_realtime_sync.md +65 -72
- package/bin/skills/lakehouse-doc-en/references/multitable_realtime_sync_sop.md +54 -52
- package/bin/skills/lakehouse-doc-en/references/navicat-mysql.md +2 -0
- package/bin/skills/lakehouse-doc-en/references/om-dynamic-table.md +71 -66
- package/bin/skills/lakehouse-doc-en/references/om-vcluster.md +2 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-create-session.md +79 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-generate-auth-token.md +63 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-overview.md +96 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-quick-start.md +286 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-response-guide.md +264 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-safe-question-poll.md +201 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-text2insight-query.md +99 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-text2insight-stop.md +74 -0
- package/bin/skills/lakehouse-doc-en/references/overview.md +6 -7
- package/bin/skills/lakehouse-doc-en/references/permission-application.md +5 -5
- package/bin/skills/lakehouse-doc-en/references/pipe-introduction.md +1 -0
- package/bin/skills/lakehouse-doc-en/references/pipe-kafka-table-stream.md +72 -70
- package/bin/skills/lakehouse-doc-en/references/pipe-kafka.md +105 -110
- package/bin/skills/lakehouse-doc-en/references/pipe-overview.md +40 -40
- package/bin/skills/lakehouse-doc-en/references/pipe-storage-object.md +43 -48
- package/bin/skills/lakehouse-doc-en/references/pipe-summary.md +14 -4
- package/bin/skills/lakehouse-doc-en/references/pipe-syntax.md +58 -151
- package/bin/skills/lakehouse-doc-en/references/practice_python_task.md +4 -4
- package/bin/skills/lakehouse-doc-en/references/pricing-ai-gateway.md +181 -0
- package/bin/skills/lakehouse-doc-en/references/pricing-lakehouse.md +316 -0
- package/bin/skills/lakehouse-doc-en/references/pricing.md +44 -288
- package/bin/skills/lakehouse-doc-en/references/private-link-general.md +0 -2
- package/bin/skills/lakehouse-doc-en/references/pyspark-to-zettapark-migration-f1.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/python-igs.md +7 -3
- package/bin/skills/lakehouse-doc-en/references/python-sample-put-github-rt-events.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/python-task.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/python_reference/connector.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/python_reference/connector_advanced.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/python_reference/connector_examples.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/python_sdk_guide.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/python_shell_datasource.md +11 -9
- package/bin/skills/lakehouse-doc-en/references/quick_start_batch_sync_data.md +9 -18
- package/bin/skills/lakehouse-doc-en/references/quick_start_bi_analysis.md +8 -25
- package/bin/skills/lakehouse-doc-en/references/quick_start_create_workspace.md +4 -6
- package/bin/skills/lakehouse-doc-en/references/quick_start_data_quality.md +8 -8
- package/bin/skills/lakehouse-doc-en/references/quick_start_etl.md +16 -20
- package/bin/skills/lakehouse-doc-en/references/quick_start_monitoring_and_alerting.md +10 -18
- package/bin/skills/lakehouse-doc-en/references/quick_start_sql_query.md +7 -10
- package/bin/skills/lakehouse-doc-en/references/quick_start_upload_data.md +5 -7
- package/bin/skills/lakehouse-doc-en/references/quick_start_user_management.md +8 -8
- package/bin/skills/lakehouse-doc-en/references/quick_start_workspace.md +0 -5
- package/bin/skills/lakehouse-doc-en/references/quick_start_workspace_user.md +8 -8
- package/bin/skills/lakehouse-doc-en/references/quickstart.md +69 -56
- package/bin/skills/lakehouse-doc-en/references/quickstart_datashare_between_companies.md +0 -5
- package/bin/skills/lakehouse-doc-en/references/quickstart_envirment_for_team.md +0 -24
- package/bin/skills/lakehouse-doc-en/references/realtime-pipeline-selection-guide.md +1 -2
- package/bin/skills/lakehouse-doc-en/references/realtime-sales-dashboard-with-dynamic-table.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/realtime_sync.md +0 -1
- package/bin/skills/lakehouse-doc-en/references/release-note-2026-05-19.md +5 -3
- package/bin/skills/lakehouse-doc-en/references/revoke-privileges.md +3 -1
- package/bin/skills/lakehouse-doc-en/references/roles.md +2 -3
- package/bin/skills/lakehouse-doc-en/references/row-filter.md +165 -0
- package/bin/skills/lakehouse-doc-en/references/row_level_permission.md +30 -19
- package/bin/skills/lakehouse-doc-en/references/scheduled_task.md +28 -21
- package/bin/skills/lakehouse-doc-en/references/security_overview.md +99 -21
- package/bin/skills/lakehouse-doc-en/references/set-command.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/setup.md +13 -15
- package/bin/skills/lakehouse-doc-en/references/show-grants.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/snowflake-dynamic-tables-to-lakehouse.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/spark-connector-summary.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/sql_functions/context_functions/current_vcluster.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/sso-configuration.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/streaming_pipeline_with_dynamic_table.md +0 -1
- package/bin/skills/lakehouse-doc-en/references/studio-incremental-sync-practice.md +27 -23
- package/bin/skills/lakehouse-doc-en/references/studio-shell-task.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/supported-cloud-platforms.md +32 -0
- package/bin/skills/lakehouse-doc-en/references/table_rendering.md +18 -12
- package/bin/skills/lakehouse-doc-en/references/task-develop.md +89 -91
- package/bin/skills/lakehouse-doc-en/references/task_development.md +19 -17
- package/bin/skills/lakehouse-doc-en/references/task_group.md +16 -14
- package/bin/skills/lakehouse-doc-en/references/task_instance.md +21 -21
- package/bin/skills/lakehouse-doc-en/references/task_param.md +38 -35
- package/bin/skills/lakehouse-doc-en/references/task_param_reference.md +81 -79
- package/bin/skills/lakehouse-doc-en/references/task_scheduling_dependency.md +20 -21
- package/bin/skills/lakehouse-doc-en/references/tencentcloud_arn_and_externalid.md +1 -5
- package/bin/skills/lakehouse-doc-en/references/trial-account-quotas-and-limits.md +1 -3
- package/bin/skills/lakehouse-doc-en/references/tutorial_connect_to_lakehouse.md +69 -0
- package/bin/skills/lakehouse-doc-en/references/tutorials.md +4 -1
- package/bin/skills/lakehouse-doc-en/references/unique-key.md +167 -0
- package/bin/skills/lakehouse-doc-en/references/usageandbillingview.md +138 -0
- package/bin/skills/lakehouse-doc-en/references/use-dbt-dev.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/use-java-sdk-realtime-uploaddata.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/use-java-sdk-upload-data-local.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/use-models.md +128 -0
- package/bin/skills/lakehouse-doc-en/references/use-mysql-client.md +81 -81
- package/bin/skills/lakehouse-doc-en/references/use-python-sdk-upload-data.md +10 -12
- package/bin/skills/lakehouse-doc-en/references/user-identification.md +2 -3
- package/bin/skills/lakehouse-doc-en/references/user_permission_grand_guide.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/using-udf-in-dynamic-table.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/vc_cache.md +18 -22
- package/bin/skills/lakehouse-doc-en/references/vcluster_size_description.md +33 -31
- package/bin/skills/lakehouse-doc-en/references/virtual-cluster.md +43 -45
- package/bin/skills/lakehouse-doc-en/references/web-job-history.md +94 -108
- package/bin/skills/lakehouse-doc-en/references/web_search.md +16 -7
- package/bin/skills/lakehouse-doc-en/references/zettapark-data-engineering-demo.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/zettapark-dataframe-guide.md +144 -70
- package/bin/skills/lakehouse-doc-en/references/zettapark-dynamic-table-guide.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/zettapark-etl-guide.md +73 -33
- package/bin/skills/lakehouse-doc-en/references/zettapark-feature-engineering.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/zettapark-functions-guide.md +75 -46
- package/bin/skills/lakehouse-doc-en/references/zettapark-quick-start.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/zettapark-stream-guide.md +4 -4
- package/bin/skills/lakehouse-doc-en/references/zettapark-volume-guide.md +93 -29
- package/package.json +1 -1
- package/bin/skills/lakehouse-doc-en/references/CLAUDE.md +0 -606
- package/bin/skills/lakehouse-doc-en/references/modelprice.md +0 -155
|
@@ -9,9 +9,10 @@ An account is the contractual entity between your company and Singdata, equivale
|
|
|
9
9
|
An account is the business relationship entity of Singdata Lakehouse, representing the organization or individual that has established a partnership with Singdata.
|
|
10
10
|
|
|
11
11
|
**Core Responsibilities**:
|
|
12
|
-
|
|
13
|
-
|
|
14
|
-
|
|
12
|
+
|
|
13
|
+
* The account is responsible for recharging, issuing bills, paying fees, and ordering/modifying Singdata products
|
|
14
|
+
* All service instances and their resource objects belong to a specific account
|
|
15
|
+
* The account is the highest level of permissions and billing management
|
|
15
16
|
|
|
16
17
|
**Account URL**: Each account has a unique access URL in the format `<account_name>.accounts.clickzetta.com`.
|
|
17
18
|
|
|
@@ -22,9 +23,10 @@ A user is a specific operator under an account, similar to an employee account i
|
|
|
22
23
|
A user is a specific operator under an account. An account can create multiple users, and different users are assigned access to data and resources through permission controls.
|
|
23
24
|
|
|
24
25
|
**Relationship with Account**:
|
|
25
|
-
|
|
26
|
-
|
|
27
|
-
|
|
26
|
+
|
|
27
|
+
* Users belong to an account and cannot cross accounts
|
|
28
|
+
* Users need to join a workspace to use its objects
|
|
29
|
+
* Permissions can be granted to users or roles
|
|
28
30
|
|
|
29
31
|
## Lakehouse Instance
|
|
30
32
|
|
|
@@ -33,10 +35,11 @@ A lakehouse instance is a complete Lakehouse environment you deploy in a cloud r
|
|
|
33
35
|
A lakehouse instance is the carrier of Singdata Lakehouse product services, containing all resources including compute, storage, and metadata.
|
|
34
36
|
|
|
35
37
|
**Key Features**:
|
|
36
|
-
|
|
37
|
-
|
|
38
|
-
|
|
39
|
-
|
|
38
|
+
|
|
39
|
+
* One account can create one or more lakehouse instances
|
|
40
|
+
* Instances have a regional attribute; compute, data, and other service resources reside within the region of the cloud service provider
|
|
41
|
+
* Different instances are isolated from each other by default
|
|
42
|
+
* Within an instance, unified metadata management governs data objects, compute resources, and job tasks
|
|
40
43
|
|
|
41
44
|
## Workspace
|
|
42
45
|
|
|
@@ -45,10 +48,11 @@ A workspace is a team's independent development environment, similar to differen
|
|
|
45
48
|
A workspace is a logical container for organizing Lakehouse resource objects (data objects, compute resources, users, etc.) and provides supporting data development capabilities.
|
|
46
49
|
|
|
47
50
|
**Core Capabilities**:
|
|
48
|
-
|
|
49
|
-
|
|
50
|
-
|
|
51
|
-
|
|
51
|
+
|
|
52
|
+
* Organize and manage data objects such as Schemas, tables, and views
|
|
53
|
+
* Provide tools for data integration, development scheduling, and operations monitoring
|
|
54
|
+
* Workspaces are isolated from each other by default; users must join a workspace to use its objects
|
|
55
|
+
* Cross-workspace authorization enables sharing of objects between different workspaces within the same instance
|
|
52
56
|
|
|
53
57
|
**Relationship with Workflow**: One instance can have multiple workspaces, each with an independent development environment and scheduling system.
|
|
54
58
|
|
|
@@ -57,25 +61,27 @@ A workspace is a logical container for organizing Lakehouse resource objects (da
|
|
|
57
61
|
This is one of the most commonly confused concepts in Lakehouse.
|
|
58
62
|
|
|
59
63
|
**Workspace** is a native Lakehouse concept with two layers of meaning:
|
|
60
|
-
|
|
61
|
-
|
|
64
|
+
|
|
65
|
+
* **Platform layer**: The top-level namespace for data objects, equivalent to a Database in traditional databases (three-level structure: `workspace.schema.table`)
|
|
66
|
+
* **Studio layer**: An isolated unit for the data development environment, containing independent users, roles, VClusters, Studio task scheduling, and more
|
|
62
67
|
|
|
63
68
|
**Catalog** is a more general term introduced with federation queries to uniformly describe "top-level namespaces":
|
|
64
69
|
|
|
65
|
-
| Category
|
|
66
|
-
|
|
67
|
-
| `MANAGED`
|
|
68
|
-
| `EXTERNAL` | External Catalog mapping external data sources (Hive/Databricks/Iceberg, etc.) | `CREATE EXTERNAL CATALOG`
|
|
69
|
-
| `SHARED`
|
|
70
|
+
| Category | Description | How to create |
|
|
71
|
+
| ---------- | ------------------------------------------------------------------------------ | --------------------------------- |
|
|
72
|
+
| `MANAGED` | Native Workspace with both platform-layer and Studio-layer capabilities | Create a Workspace in the console |
|
|
73
|
+
| `EXTERNAL` | External Catalog mapping external data sources (Hive/Databricks/Iceberg, etc.) | `CREATE EXTERNAL CATALOG` |
|
|
74
|
+
| `SHARED` | System-shared datasets (e.g., TPC-H, TPC-DS benchmark data) | System built-in |
|
|
70
75
|
|
|
71
|
-
|
|
72
|
-
|
|
73
|
-
|
|
76
|
+
* `SHOW WORKSPACES` and `SHOW CATALOGS` return the same results
|
|
77
|
+
* `current_workspace()` and `current_catalog()` return the same value
|
|
78
|
+
* Three-level naming supports both `workspace.schema.table` and `catalog.schema.table`
|
|
74
79
|
|
|
75
80
|
**Non-MANAGED types do not support write operations**: EXTERNAL, SHARED, and the system built-in `sys` namespace are all read-only. Attempting to create tables or execute DML in them will raise permission errors:
|
|
76
|
-
|
|
77
|
-
|
|
78
|
-
|
|
81
|
+
|
|
82
|
+
* SHARED: `NoPermission: Only read actions are allowed on shared object`
|
|
83
|
+
* SYS: `NoPermission: Workspace sys is readonly, AT_CREATE_TABLE operation is not allowed`
|
|
84
|
+
* EXTERNAL: Depends on the external data source type; typically write operations are also not supported
|
|
79
85
|
|
|
80
86
|
These three namespace types can be queried via three-level naming (`catalog.schema.table`), but cannot be used as write targets and have no Studio layer (no VCluster, user management, or task scheduling).
|
|
81
87
|
|
|
@@ -83,11 +89,11 @@ These three namespace types can be queried via three-level naming (`catalog.sche
|
|
|
83
89
|
|
|
84
90
|
For users familiar with traditional databases (PostgreSQL, MySQL, Snowflake, etc.), Workspace is the **Database** in ClickZetta:
|
|
85
91
|
|
|
86
|
-
| Traditional Database
|
|
87
|
-
|
|
88
|
-
| Database
|
|
89
|
-
| Schema
|
|
90
|
-
| Table
|
|
92
|
+
| Traditional Database | ClickZetta Lakehouse |
|
|
93
|
+
| ----------------------- | ------------------------ |
|
|
94
|
+
| Database | Workspace |
|
|
95
|
+
| Schema | Schema |
|
|
96
|
+
| Table | Table |
|
|
91
97
|
| `database.schema.table` | `workspace.schema.table` |
|
|
92
98
|
|
|
93
99
|
The two are fully equivalent at the SQL level with the same three-level naming structure. The main difference is that Workspace, in addition to serving as a namespace like a Database, also includes the Studio development environment (VCluster, user management, task scheduling, etc.) — making it a heavier concept.
|
|
@@ -102,17 +108,18 @@ A Virtual Cluster consists of multi-instance virtual compute clusters and the co
|
|
|
102
108
|
|
|
103
109
|
**Three Types**:
|
|
104
110
|
|
|
105
|
-
| Type
|
|
106
|
-
|
|
107
|
-
| **General (GP VC / GENERAL)
|
|
108
|
-
| **Analytics (AP VC / ANALYTICS)
|
|
109
|
-
| **Sync (Integration VC / SYNC)
|
|
111
|
+
| Type | Use Case | Characteristics |
|
|
112
|
+
| --------------------------------- | ----------------------------------------- | ----------------------------------------------- |
|
|
113
|
+
| **General (GP VC / GENERAL**) | Offline ETL, data development | Jobs share resources, fair scheduling |
|
|
114
|
+
| **Analytics (AP VC / ANALYTICS**) | Online queries, high-concurrency analysis | Multiple compute instances, automatic scaling |
|
|
115
|
+
| **Sync (Integration VC / SYNC**) | Data sync jobs | Optimized specifically for data synchronization |
|
|
110
116
|
|
|
111
117
|
**Billing Method**: Charged by CRU (Compute Resource Unit) × hours; different cluster types have different CRU step sizes.
|
|
112
118
|
|
|
113
119
|
**Elasticity**:
|
|
114
|
-
|
|
115
|
-
|
|
120
|
+
|
|
121
|
+
* Analytics clusters support automatic scaling, adjusting compute instances based on concurrency
|
|
122
|
+
* All clusters support automatic suspension and resumption, pausing automatically when idle to save costs
|
|
116
123
|
|
|
117
124
|
## Schema
|
|
118
125
|
|
|
@@ -121,9 +128,10 @@ A Schema is a namespace within a workspace used to organize tables, views, dynam
|
|
|
121
128
|
A Schema is a namespace for a group of data objects within a workspace, including tables, views, dynamic tables, materialized views, and more.
|
|
122
129
|
|
|
123
130
|
**Relationship with Workspace**:
|
|
124
|
-
|
|
125
|
-
|
|
126
|
-
|
|
131
|
+
|
|
132
|
+
* One workspace can contain multiple Schemas
|
|
133
|
+
* A Schema is the direct container for objects such as tables
|
|
134
|
+
* Full three-level naming: `workspace.schema.table` (similar to `database.schema.table` in PostgreSQL/Snowflake)
|
|
127
135
|
|
|
128
136
|
## Table
|
|
129
137
|
|
|
@@ -142,18 +150,21 @@ A dynamic table is a data table that updates automatically. You simply define th
|
|
|
142
150
|
A dynamic table is a data object that refreshes automatically and incrementally based on a query definition. At creation, the data processing logic is defined through a SQL query; during refresh, it automatically retrieves incremental data from the source table and processes it using incremental algorithms.
|
|
143
151
|
|
|
144
152
|
**Core Advantages**:
|
|
145
|
-
|
|
146
|
-
|
|
147
|
-
|
|
153
|
+
|
|
154
|
+
* **Incremental Computation**: Only processes data that has changed since the last refresh, significantly reducing compute resource consumption
|
|
155
|
+
* **Automatic Refresh**: Configurable refresh interval (minutes/hours/days), no manual triggering required
|
|
156
|
+
* **Version Management**: Supports Time Travel for querying historical versions and UNDROP for recovering accidental deletions
|
|
148
157
|
|
|
149
158
|
**Use Cases**:
|
|
150
|
-
|
|
151
|
-
|
|
152
|
-
|
|
159
|
+
|
|
160
|
+
* DWD/DWS/ADS layer data processing
|
|
161
|
+
* Metric aggregation and report wide tables
|
|
162
|
+
* Replacing traditional periodic full-refresh ETL tasks
|
|
153
163
|
|
|
154
164
|
**Difference from Materialized Views**:
|
|
155
|
-
|
|
156
|
-
|
|
165
|
+
|
|
166
|
+
* Dynamic tables focus on data processing and do not rely on the query optimizer's query rewriting
|
|
167
|
+
* Materialized views focus on query acceleration; the optimizer automatically identifies and uses pre-stored results for query rewriting
|
|
157
168
|
|
|
158
169
|
## Materialized View
|
|
159
170
|
|
|
@@ -162,9 +173,10 @@ A materialized view stores pre-computed results of commonly used queries. Querie
|
|
|
162
173
|
A materialized view is a special view that pre-computes and stores query results. Unlike regular views, materialized views physically exist in the Lakehouse and consume storage resources.
|
|
163
174
|
|
|
164
175
|
**Core Features**:
|
|
165
|
-
|
|
166
|
-
|
|
167
|
-
|
|
176
|
+
|
|
177
|
+
* The query optimizer automatically identifies and uses materialized views for query rewriting
|
|
178
|
+
* Uses periodic refresh mechanisms to keep data up to date
|
|
179
|
+
* Suitable for scenarios requiring pre-computed and reusable query results
|
|
168
180
|
|
|
169
181
|
## View
|
|
170
182
|
|
|
@@ -173,8 +185,9 @@ A view is a saved query shortcut that does not store data itself. It executes th
|
|
|
173
185
|
A view is a virtual table that does not store actual data, only saving the query definition. The underlying SQL is executed dynamically at query time.
|
|
174
186
|
|
|
175
187
|
**Use Cases**:
|
|
176
|
-
|
|
177
|
-
|
|
188
|
+
|
|
189
|
+
* Simplifying complex queries and providing a logical abstraction layer
|
|
190
|
+
* Scenarios with low query complexity that do not involve heavy data processing
|
|
178
191
|
|
|
179
192
|
## Table Stream
|
|
180
193
|
|
|
@@ -183,23 +196,26 @@ A Table Stream is the Lakehouse's Change Data Capture (CDC) mechanism, equivalen
|
|
|
183
196
|
A Table Stream is the Lakehouse's Change Data Capture (CDC) mechanism used to capture change data from table objects.
|
|
184
197
|
|
|
185
198
|
**How It Works**:
|
|
186
|
-
|
|
187
|
-
|
|
188
|
-
|
|
199
|
+
|
|
200
|
+
* A Table Stream **does not store actual data**; it only records and maintains the data version offset of the source table
|
|
201
|
+
* When queried, it returns all change records from the initial offset to the current latest version
|
|
202
|
+
* When consumed through DML operations (INSERT/DELETE/UPDATE/MERGE), the offset updates automatically
|
|
189
203
|
|
|
190
204
|
**Two Types**:
|
|
191
205
|
|
|
192
|
-
| Type
|
|
193
|
-
|
|
194
|
-
| **STANDARD**
|
|
195
|
-
| **
|
|
206
|
+
| Type | Tracking Scope | Use Case |
|
|
207
|
+
| ---------------- | ---------------------------------------- | ---------------------------------------------------- |
|
|
208
|
+
| **STANDARD** | All DML changes (INSERT, UPDATE, DELETE) | ETL scenarios requiring complete change data capture |
|
|
209
|
+
| **APPEND\_ONLY** | INSERT operations only | Log/event scenarios with append-only data |
|
|
196
210
|
|
|
197
211
|
**Relationship with Dynamic Tables**:
|
|
198
|
-
|
|
199
|
-
|
|
200
|
-
|
|
212
|
+
|
|
213
|
+
* Table Stream is the underlying CDC mechanism responsible for capturing changes
|
|
214
|
+
* Dynamic tables are advanced data processing features that perform data transformation based on incremental computation
|
|
215
|
+
* The two can work together: Table Stream captures changes → Dynamic Table performs transformation and aggregation
|
|
201
216
|
|
|
202
217
|
**Typical Operations**:
|
|
218
|
+
|
|
203
219
|
```sql
|
|
204
220
|
-- Create a Table Stream
|
|
205
221
|
CREATE TABLE STREAM my_stream ON TABLE source_table
|
|
@@ -216,22 +232,24 @@ A Pipe is a continuously running data ingestion pipeline, similar to a water pip
|
|
|
216
232
|
A Pipe is the Lakehouse's continuous data ingestion pipeline object, used to continuously ingest data from Kafka or object storage (OSS/S3/COS) into tables.
|
|
217
233
|
|
|
218
234
|
**Core Features**:
|
|
219
|
-
|
|
220
|
-
|
|
221
|
-
|
|
235
|
+
|
|
236
|
+
* A Pipe is a **SQL object** created and managed through DDL
|
|
237
|
+
* After creation it runs continuously, automatically reading data from the source and writing to the target table
|
|
238
|
+
* No need to configure Cron scheduling; the Pipe itself is a continuously running streaming task
|
|
222
239
|
|
|
223
240
|
**Difference from Studio Sync Tasks**:
|
|
224
241
|
|
|
225
|
-
| Dimension
|
|
226
|
-
|
|
227
|
-
| Creation Method
|
|
228
|
-
| Management Method | SQL commands
|
|
229
|
-
| Data Sources
|
|
230
|
-
| Use Case
|
|
242
|
+
| Dimension | Pipe | Studio Sync Task |
|
|
243
|
+
| ----------------- | ----------------------- | ------------------------------------------- |
|
|
244
|
+
| Creation Method | SQL DDL | Studio visual interface |
|
|
245
|
+
| Management Method | SQL commands | Studio interface + cz-cli |
|
|
246
|
+
| Data Sources | Kafka, object storage | Relational databases, Kafka, object storage |
|
|
247
|
+
| Use Case | Users familiar with SQL | Users preferring visual configuration |
|
|
231
248
|
|
|
232
249
|
**Two Types**:
|
|
233
|
-
|
|
234
|
-
|
|
250
|
+
|
|
251
|
+
* **Kafka Pipe**: Continuously consumes data from Kafka topics and writes to Lakehouse tables
|
|
252
|
+
* **Object Storage Pipe**: Continuously scans new files from OSS/S3/COS and ingests them
|
|
235
253
|
|
|
236
254
|
## Volume
|
|
237
255
|
|
|
@@ -241,19 +259,21 @@ A Volume is the Lakehouse's object storage mount point, used to access files in
|
|
|
241
259
|
|
|
242
260
|
**Four Types**:
|
|
243
261
|
|
|
244
|
-
| Type
|
|
245
|
-
|
|
246
|
-
| **External Volume** | Mounts user-owned object storage (OSS/COS/S3), data stays in place
|
|
247
|
-
| **Managed Volume**
|
|
248
|
-
| **User Volume**
|
|
249
|
-
| **Table Volume**
|
|
262
|
+
| Type | Description | Creation Method | Storage Location |
|
|
263
|
+
| ------------------- | ----------------------------------------------------------------------- | ------------------------------------- | -------------------------- |
|
|
264
|
+
| **External Volume** | Mounts user-owned object storage (OSS/COS/S3), data stays in place | `CREATE EXTERNAL VOLUME` | User-owned cloud storage |
|
|
265
|
+
| **Managed Volume** | Lakehouse-managed internal storage, platform handles storage management | `CREATE VOLUME` | Lakehouse internal storage |
|
|
266
|
+
| **User Volume** | Per-user file space for uploading temporary files, import/export | Created automatically by the system | Lakehouse internal storage |
|
|
267
|
+
| **Table Volume** | Per-table file space storing the table's data files | Created automatically (one per table) | Lakehouse internal storage |
|
|
250
268
|
|
|
251
269
|
**Relationship with Tables**:
|
|
252
|
-
|
|
253
|
-
|
|
254
|
-
|
|
270
|
+
|
|
271
|
+
* Volume manages **files**; Table manages **structured data**
|
|
272
|
+
* Volume is the channel for data entering the lake; Table is the target of data processing
|
|
273
|
+
* Use `COPY INTO` to import file data from Volume into Table
|
|
255
274
|
|
|
256
275
|
**Typical Operations**:
|
|
276
|
+
|
|
257
277
|
```sql
|
|
258
278
|
-- View file list in an External/Managed Volume
|
|
259
279
|
SELECT * FROM DIRECTORY(VOLUME schema_name.vol_name);
|
|
@@ -278,19 +298,21 @@ Time Travel lets you look back at historical data like a "time machine" — you
|
|
|
278
298
|
Time Travel is the Lakehouse's historical data access feature that allows users to access data at any point in time within a defined time range.
|
|
279
299
|
|
|
280
300
|
**Core Mechanism**:
|
|
281
|
-
|
|
282
|
-
|
|
283
|
-
|
|
301
|
+
|
|
302
|
+
* Based on MVCC (Multi-Version Concurrency Control), each data change generates a new version
|
|
303
|
+
* Retains 1 day of historical data by default, configurable from 0 to 90 days
|
|
304
|
+
* Supports querying historical versions, recovering accidentally dropped tables (UNDROP), and rolling back data (RESTORE)
|
|
284
305
|
|
|
285
306
|
**Three Capabilities**:
|
|
286
307
|
|
|
287
|
-
| Capability
|
|
288
|
-
|
|
289
|
-
| Historical Query
|
|
290
|
-
| Recover Dropped Table | `UNDROP TABLE table_name`
|
|
291
|
-
| Rollback Data
|
|
308
|
+
| Capability | Command | Use Case |
|
|
309
|
+
| --------------------- | --------------------------------------------------- | -------------------------------------------------- |
|
|
310
|
+
| Historical Query | `SELECT * FROM table TIMESTAMP AS OF '...'` | Compare data changes at different points in time |
|
|
311
|
+
| Recover Dropped Table | `UNDROP TABLE table_name` | Recover a table after it has been DROPped |
|
|
312
|
+
| Rollback Data | `RESTORE TABLE table_name TO TIMESTAMP AS OF '...'` | Rollback after data is mistakenly modified/deleted |
|
|
292
313
|
|
|
293
314
|
**Typical Operations**:
|
|
315
|
+
|
|
294
316
|
```sql
|
|
295
317
|
-- Query data at a specific point in time (TIMESTAMP AS OF only accepts literals, not expressions)
|
|
296
318
|
SELECT * FROM orders TIMESTAMP AS OF '2024-01-15 09:00:00';
|
|
@@ -309,8 +331,9 @@ Data Lifecycle is a mechanism that sets an "expiration date" on data. Data that
|
|
|
309
331
|
Data Lifecycle is the Lakehouse's automatic data cleanup mechanism; expired data that has not been updated is automatically reclaimed.
|
|
310
332
|
|
|
311
333
|
**Difference from Time Travel**:
|
|
312
|
-
|
|
313
|
-
|
|
334
|
+
|
|
335
|
+
* Time Travel: Retains historical versions for querying and recovery
|
|
336
|
+
* Data Lifecycle: Automatically cleans up expired data for storage cost control
|
|
314
337
|
|
|
315
338
|
## External Catalog
|
|
316
339
|
|
|
@@ -319,20 +342,22 @@ An External Catalog allows you to query tables in external systems without movin
|
|
|
319
342
|
An External Catalog is the Lakehouse's federated query feature for accessing data in external data sources (Hive, Databricks, Snowflake Iceberg, etc.) without needing to copy the data.
|
|
320
343
|
|
|
321
344
|
**Core Features**:
|
|
322
|
-
|
|
323
|
-
|
|
324
|
-
|
|
345
|
+
|
|
346
|
+
* **Read-Only Access**: INSERT/UPDATE/DELETE operations are not supported
|
|
347
|
+
* **No Data Copy**: Data remains in the external system; the Lakehouse only reads metadata and data files
|
|
348
|
+
* **Unified Entry Point**: Query external data through standard SQL just like querying local tables
|
|
325
349
|
|
|
326
350
|
**Supported Data Sources**:
|
|
327
351
|
|
|
328
|
-
| Data Source
|
|
329
|
-
|
|
330
|
-
| **Apache Hive**
|
|
331
|
-
| **Databricks Unity Catalog** | Databricks API
|
|
332
|
-
| **Iceberg REST Catalog**
|
|
333
|
-
| **Snowflake Open Catalog**
|
|
352
|
+
| Data Source | Connection Method | Description |
|
|
353
|
+
| ---------------------------- | ------------------------ | ---------------------------------------------------------------------- |
|
|
354
|
+
| **Apache Hive** | Hive Metastore URIs | Access Hive tables through Hive Metastore |
|
|
355
|
+
| **Databricks Unity Catalog** | Databricks API | Access tables in Databricks |
|
|
356
|
+
| **Iceberg REST Catalog** | Iceberg REST API | Access any data catalog compatible with the Iceberg REST protocol |
|
|
357
|
+
| **Snowflake Open Catalog** | Iceberg REST API + OAuth | Snowflake's managed catalog service based on the Iceberg REST protocol |
|
|
334
358
|
|
|
335
359
|
**Typical Operations**:
|
|
360
|
+
|
|
336
361
|
```sql
|
|
337
362
|
-- Query a table in an external Catalog
|
|
338
363
|
SELECT * FROM ext_catalog.ext_schema.ext_table;
|
|
@@ -350,11 +375,13 @@ Data Share lets you "grant" tables or views to other lakehouse instances. The re
|
|
|
350
375
|
Data Share is the Lakehouse's cross-instance data sharing feature that allows real-time sharing of tables or views with other lakehouse instances without copying data.
|
|
351
376
|
|
|
352
377
|
**Core Features**:
|
|
353
|
-
|
|
354
|
-
|
|
355
|
-
|
|
378
|
+
|
|
379
|
+
* **No Copy**: The consumer reads the provider's original data directly when querying
|
|
380
|
+
* **Real-Time Sync**: Changes on the provider side are immediately visible to the consumer
|
|
381
|
+
* **Read-Only Access**: Consumers can only query; they cannot modify, delete, or re-share
|
|
356
382
|
|
|
357
383
|
**Operation Flow**:
|
|
384
|
+
|
|
358
385
|
```
|
|
359
386
|
Provider: CREATE SHARE → GRANT TO SHARE → ALTER SHARE ADD INSTANCE
|
|
360
387
|
↓
|
|
@@ -362,6 +389,7 @@ Consumer: SHOW SHARES → DESC SHARE → CREATE SCHEMA FROM SHARE → SELECT que
|
|
|
362
389
|
```
|
|
363
390
|
|
|
364
391
|
**Typical Operations**:
|
|
392
|
+
|
|
365
393
|
```sql
|
|
366
394
|
-- Provider: Create Share and grant privileges
|
|
367
395
|
CREATE SHARE my_share;
|
|
@@ -380,15 +408,16 @@ Lakehouse Studio is the web-based operational interface of Singdata Lakehouse, e
|
|
|
380
408
|
Lakehouse Studio is the web-based graphical interface provided by Singdata Lakehouse. It is a **unified data development and governance platform** that integrates data integration, development scheduling, operations monitoring, data catalog, and other capabilities.
|
|
381
409
|
|
|
382
410
|
**Main Modules**:
|
|
383
|
-
|
|
384
|
-
|
|
385
|
-
|
|
386
|
-
|
|
387
|
-
|
|
388
|
-
|
|
389
|
-
|
|
390
|
-
|
|
391
|
-
|
|
392
|
-
|
|
411
|
+
|
|
412
|
+
* **Data Sync**: Configure offline/real-time data sync tasks
|
|
413
|
+
* **Task Development**: Web IDE for SQL/Python/Shell task development
|
|
414
|
+
* **Task Scheduling**: Configure Cron expressions and task dependencies
|
|
415
|
+
* **Operations Monitoring**: View task execution status, logs, and alerts
|
|
416
|
+
* **Data Catalog**: Global search and filter for table metadata
|
|
417
|
+
* **Data Quality**: Configure data quality check rules
|
|
418
|
+
* **Compute Management**: Manage compute clusters
|
|
419
|
+
* **Agent**: AI Agent integration, supporting conversational data analysis and MCP Server management
|
|
420
|
+
|
|
421
|
+
***
|
|
393
422
|
|
|
394
423
|
See the [Product Object Model](object_model_design.md) for detailed product concepts.
|