@clickzetta/cz-cli-darwin-x64 0.5.16 → 0.5.18
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/bin/cz-cli +0 -0
- package/bin/skills/lakehouse-doc-en/SKILL.md +6 -11
- package/bin/skills/lakehouse-doc-en/references/AIGateway.md +58 -13
- package/bin/skills/lakehouse-doc-en/references/Computation.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/DataSource_Amazon_DocumentDB.md +3 -1
- package/bin/skills/lakehouse-doc-en/references/Foreach.md +14 -14
- package/bin/skills/lakehouse-doc-en/references/JDBC-Driver.md +0 -1
- package/bin/skills/lakehouse-doc-en/references/LakehouseAI-overview.md +21 -8
- package/bin/skills/lakehouse-doc-en/references/LakehouseDataGPT-tour.md +4 -9
- package/bin/skills/lakehouse-doc-en/references/LakehouseStudio-tour.md +14 -19
- package/bin/skills/lakehouse-doc-en/references/Lakehouse_Zilliz_MakeDataReadyforBIandAI.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/Logstash.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/Migrate_Spark_DataEngineeringBestPractices_Project_to_Lakehouse.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/Notebook.md +17 -17
- package/bin/skills/lakehouse-doc-en/references/RemoteFunction-as-udf.md +14 -14
- package/bin/skills/lakehouse-doc-en/references/SQL_External_Catalog_Guide.md +1 -9
- package/bin/skills/lakehouse-doc-en/references/SUMMARY.md +59 -29
- package/bin/skills/lakehouse-doc-en/references/WINDOWFUNCTION.md +99 -57
- package/bin/skills/lakehouse-doc-en/references/Zettapark_Data_Engineering_Demo.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/access-control-configuration.md +1 -8
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-2-5-1.0.md +16 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-3-29-1.0.2.md +14 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-3-8-1.0.1.md +16 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-4-28-1.1.md +29 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-5-12-1.1.1.md +18 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-5-15-1.2.md +9 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-5-21-1.3.md +9 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-5-28-1.4.md +10 -0
- package/bin/skills/lakehouse-doc-en/references/aigw-2026-6-3-1.5.md +9 -0
- package/bin/skills/lakehouse-doc-en/references/alicloud-arn-externalid.md +0 -5
- package/bin/skills/lakehouse-doc-en/references/answer-accuracy-improve.md +120 -103
- package/bin/skills/lakehouse-doc-en/references/application-list.md +1 -3
- package/bin/skills/lakehouse-doc-en/references/approval-list.md +16 -17
- package/bin/skills/lakehouse-doc-en/references/batch-load-parquet-file-into-lakehouse.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/batch_sync.md +9 -9
- package/bin/skills/lakehouse-doc-en/references/batch_sync_Sop.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/batchloadparquetfileintoLakehouse.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/bulkloadv1-python-sdk.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/chart-auto-refresh-guide.md +12 -6
- package/bin/skills/lakehouse-doc-en/references/clickzetta-sample-data.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/code_approval.md +1 -5
- package/bin/skills/lakehouse-doc-en/references/composite_task.md +31 -42
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_environment_and_data_generate.md +6 -9
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_javasdk_bulkload_realtime.md +4 -10
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_kafka_realtime_sync.md +1 -10
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_local_file_into_table_by_studio.md +0 -6
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_studio_batchload_public_network.md +0 -5
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_studio_python_node.md +2 -7
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_studio_realtime_cdc_public_network.md +13 -18
- package/bin/skills/lakehouse-doc-en/references/comprehensive_guide_to_ingesting_studio_sql_insert.md +0 -1
- package/bin/skills/lakehouse-doc-en/references/concepts.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/config-datasource.md +5 -7
- package/bin/skills/lakehouse-doc-en/references/connect-with-cli.md +116 -72
- package/bin/skills/lakehouse-doc-en/references/connect-with-cz-cli.md +151 -0
- package/bin/skills/lakehouse-doc-en/references/continue-job.md +9 -17
- package/bin/skills/lakehouse-doc-en/references/create-api-connection.md +315 -286
- package/bin/skills/lakehouse-doc-en/references/create-catalog-connection.md +1 -0
- package/bin/skills/lakehouse-doc-en/references/create-dynamic-table.md +4 -4
- package/bin/skills/lakehouse-doc-en/references/create-external-catalog.md +85 -22
- package/bin/skills/lakehouse-doc-en/references/create-table-ddl.md +45 -0
- package/bin/skills/lakehouse-doc-en/references/creating_alicloud_privatelinkendpoint.md +4 -6
- package/bin/skills/lakehouse-doc-en/references/creating_alicloud_privatelinkservice.md +4 -7
- package/bin/skills/lakehouse-doc-en/references/creating_tencentcloud_privatelinkendpoint.md +2 -7
- package/bin/skills/lakehouse-doc-en/references/creating_tencentcloud_privatelinkservice.md +1 -5
- package/bin/skills/lakehouse-doc-en/references/cz-cli-agent.md +15 -10
- package/bin/skills/lakehouse-doc-en/references/cz-cli-datasource.md +0 -8
- package/bin/skills/lakehouse-doc-en/references/cz-cli-sql.md +2 -45
- package/bin/skills/lakehouse-doc-en/references/cz-cli.md +53 -42
- package/bin/skills/lakehouse-doc-en/references/dashboard-version-management-guide.md +12 -4
- package/bin/skills/lakehouse-doc-en/references/data-integration-intro.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/data-integration.md +29 -27
- package/bin/skills/lakehouse-doc-en/references/data-load-summary.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/data-quality.md +25 -25
- package/bin/skills/lakehouse-doc-en/references/data-sharing.md +31 -54
- package/bin/skills/lakehouse-doc-en/references/data-sources.md +45 -45
- package/bin/skills/lakehouse-doc-en/references/data_catalog.md +23 -25
- package/bin/skills/lakehouse-doc-en/references/data_privacy.md +5 -2
- package/bin/skills/lakehouse-doc-en/references/data_sharing_between_accounts_guide.md +0 -4
- package/bin/skills/lakehouse-doc-en/references/data_visualization.md +4 -15
- package/bin/skills/lakehouse-doc-en/references/dataagent.md +39 -7
- package/bin/skills/lakehouse-doc-en/references/databricks-delta-to-lakehouse-migration.md +168 -0
- package/bin/skills/lakehouse-doc-en/references/databricks-dlt-to-lakehouse-migration.md +331 -0
- package/bin/skills/lakehouse-doc-en/references/databricks-external-catalog-practice.md +367 -0
- package/bin/skills/lakehouse-doc-en/references/databricks-jobs-to-studio-migration.md +199 -0
- package/bin/skills/lakehouse-doc-en/references/databricks-notebook-to-studio-migration.md +350 -0
- package/bin/skills/lakehouse-doc-en/references/databricks-uc-governance-to-lakehouse-migration.md +327 -0
- package/bin/skills/lakehouse-doc-en/references/datagpt-model-config.md +34 -0
- package/bin/skills/lakehouse-doc-en/references/datagpt_data_source.md +50 -37
- package/bin/skills/lakehouse-doc-en/references/datagpt_introduction.md +55 -79
- package/bin/skills/lakehouse-doc-en/references/datagpt_quickstart.md +50 -64
- package/bin/skills/lakehouse-doc-en/references/datalake-acceleration.md +75 -2
- package/bin/skills/lakehouse-doc-en/references/dbt-databricks-to-clickzetta-migration.md +242 -0
- package/bin/skills/lakehouse-doc-en/references/dynamic-mask.md +30 -30
- package/bin/skills/lakehouse-doc-en/references/dynamic-table-bestpractice.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/dynamic-table-introduce.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/dynamic_table_summary.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/eco_integration/streamlit.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/eco_integration/superset.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/ecosystem-all.md +1 -3
- package/bin/skills/lakehouse-doc-en/references/ecosystem.md +145 -0
- package/bin/skills/lakehouse-doc-en/references/external-catalog-summary.md +33 -38
- package/bin/skills/lakehouse-doc-en/references/external-function-combo-practice.md +466 -0
- package/bin/skills/lakehouse-doc-en/references/f6fc6447ee.md +7 -9
- package/bin/skills/lakehouse-doc-en/references/federation-query.md +56 -6
- package/bin/skills/lakehouse-doc-en/references/finebi-mysql.md +2 -0
- package/bin/skills/lakehouse-doc-en/references/get-started-with-sample-data.md +10 -11
- package/bin/skills/lakehouse-doc-en/references/gitfolder.md +2 -3
- package/bin/skills/lakehouse-doc-en/references/grant-privileges.md +2 -0
- package/bin/skills/lakehouse-doc-en/references/iceberg-rest-catalog-databricks.md +166 -0
- package/bin/skills/lakehouse-doc-en/references/ide.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/if_else_task.md +59 -57
- package/bin/skills/lakehouse-doc-en/references/input_output.md +10 -7
- package/bin/skills/lakehouse-doc-en/references/jobprofile-bestpractices.md +60 -64
- package/bin/skills/lakehouse-doc-en/references/kafka-connection.md +0 -1
- package/bin/skills/lakehouse-doc-en/references/key-concepts.md +146 -117
- package/bin/skills/lakehouse-doc-en/references/lakehouse-ai-gateway-cz-cli.md +317 -0
- package/bin/skills/lakehouse-doc-en/references/lakehouse-ai-sql-analysis.md +345 -0
- package/bin/skills/lakehouse-doc-en/references/lakehouse-dqc-guide.md +300 -0
- package/bin/skills/lakehouse-doc-en/references/lakehouse-medallion-sql-dt-guide.md +543 -0
- package/bin/skills/lakehouse-doc-en/references/lakehouse-multi-cloud-acceleration.md +274 -0
- package/bin/skills/lakehouse-doc-en/references/lakehouse-multimodal-ai-pipeline.md +198 -0
- package/bin/skills/lakehouse-doc-en/references/lakehouse-quick-experience_guide.md +49 -52
- package/bin/skills/lakehouse-doc-en/references/lakehouse-volume-pipe-acceleration-guide.md +380 -0
- package/bin/skills/lakehouse-doc-en/references/langchain-plug-installation.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/management.md +4 -9
- package/bin/skills/lakehouse-doc-en/references/medallion-lakehouse-from-scratch.md +2 -1
- package/bin/skills/lakehouse-doc-en/references/metrics_answer_build.md +58 -21
- package/bin/skills/lakehouse-doc-en/references/migrate-spark-data-engineering-best-practices-to-lakehouse.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/mindsdb.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/monitoring_and_alerting.md +65 -60
- package/bin/skills/lakehouse-doc-en/references/monitoring_item_specification.md +33 -33
- package/bin/skills/lakehouse-doc-en/references/multitable_batch_sync.md +16 -16
- package/bin/skills/lakehouse-doc-en/references/multitable_realtime_sync.md +65 -72
- package/bin/skills/lakehouse-doc-en/references/multitable_realtime_sync_sop.md +54 -52
- package/bin/skills/lakehouse-doc-en/references/navicat-mysql.md +2 -0
- package/bin/skills/lakehouse-doc-en/references/om-dynamic-table.md +71 -66
- package/bin/skills/lakehouse-doc-en/references/om-vcluster.md +2 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-create-session.md +79 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-generate-auth-token.md +63 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-overview.md +96 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-quick-start.md +286 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-response-guide.md +264 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-safe-question-poll.md +201 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-text2insight-query.md +99 -0
- package/bin/skills/lakehouse-doc-en/references/open-api-text2insight-stop.md +74 -0
- package/bin/skills/lakehouse-doc-en/references/overview.md +6 -7
- package/bin/skills/lakehouse-doc-en/references/permission-application.md +5 -5
- package/bin/skills/lakehouse-doc-en/references/pipe-introduction.md +1 -0
- package/bin/skills/lakehouse-doc-en/references/pipe-kafka-table-stream.md +72 -70
- package/bin/skills/lakehouse-doc-en/references/pipe-kafka.md +105 -110
- package/bin/skills/lakehouse-doc-en/references/pipe-overview.md +40 -40
- package/bin/skills/lakehouse-doc-en/references/pipe-storage-object.md +43 -48
- package/bin/skills/lakehouse-doc-en/references/pipe-summary.md +14 -4
- package/bin/skills/lakehouse-doc-en/references/pipe-syntax.md +58 -151
- package/bin/skills/lakehouse-doc-en/references/practice_python_task.md +4 -4
- package/bin/skills/lakehouse-doc-en/references/pricing-ai-gateway.md +181 -0
- package/bin/skills/lakehouse-doc-en/references/pricing-lakehouse.md +316 -0
- package/bin/skills/lakehouse-doc-en/references/pricing.md +44 -288
- package/bin/skills/lakehouse-doc-en/references/private-link-general.md +0 -2
- package/bin/skills/lakehouse-doc-en/references/pyspark-to-zettapark-migration-f1.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/python-igs.md +7 -3
- package/bin/skills/lakehouse-doc-en/references/python-sample-put-github-rt-events.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/python-task.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/python_reference/connector.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/python_reference/connector_advanced.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/python_reference/connector_examples.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/python_sdk_guide.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/python_shell_datasource.md +11 -9
- package/bin/skills/lakehouse-doc-en/references/quick_start_batch_sync_data.md +9 -18
- package/bin/skills/lakehouse-doc-en/references/quick_start_bi_analysis.md +8 -25
- package/bin/skills/lakehouse-doc-en/references/quick_start_create_workspace.md +4 -6
- package/bin/skills/lakehouse-doc-en/references/quick_start_data_quality.md +8 -8
- package/bin/skills/lakehouse-doc-en/references/quick_start_etl.md +16 -20
- package/bin/skills/lakehouse-doc-en/references/quick_start_monitoring_and_alerting.md +10 -18
- package/bin/skills/lakehouse-doc-en/references/quick_start_sql_query.md +7 -10
- package/bin/skills/lakehouse-doc-en/references/quick_start_upload_data.md +5 -7
- package/bin/skills/lakehouse-doc-en/references/quick_start_user_management.md +8 -8
- package/bin/skills/lakehouse-doc-en/references/quick_start_workspace.md +0 -5
- package/bin/skills/lakehouse-doc-en/references/quick_start_workspace_user.md +8 -8
- package/bin/skills/lakehouse-doc-en/references/quickstart.md +69 -56
- package/bin/skills/lakehouse-doc-en/references/quickstart_datashare_between_companies.md +0 -5
- package/bin/skills/lakehouse-doc-en/references/quickstart_envirment_for_team.md +0 -24
- package/bin/skills/lakehouse-doc-en/references/realtime-pipeline-selection-guide.md +1 -2
- package/bin/skills/lakehouse-doc-en/references/realtime-sales-dashboard-with-dynamic-table.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/realtime_sync.md +0 -1
- package/bin/skills/lakehouse-doc-en/references/release-note-2026-05-19.md +5 -3
- package/bin/skills/lakehouse-doc-en/references/revoke-privileges.md +3 -1
- package/bin/skills/lakehouse-doc-en/references/roles.md +2 -3
- package/bin/skills/lakehouse-doc-en/references/row-filter.md +165 -0
- package/bin/skills/lakehouse-doc-en/references/row_level_permission.md +30 -19
- package/bin/skills/lakehouse-doc-en/references/scheduled_task.md +28 -21
- package/bin/skills/lakehouse-doc-en/references/security_overview.md +99 -21
- package/bin/skills/lakehouse-doc-en/references/set-command.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/setup.md +13 -15
- package/bin/skills/lakehouse-doc-en/references/show-grants.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/snowflake-dynamic-tables-to-lakehouse.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/spark-connector-summary.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/sql_functions/context_functions/current_vcluster.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/sso-configuration.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/streaming_pipeline_with_dynamic_table.md +0 -1
- package/bin/skills/lakehouse-doc-en/references/studio-incremental-sync-practice.md +27 -23
- package/bin/skills/lakehouse-doc-en/references/studio-shell-task.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/supported-cloud-platforms.md +32 -0
- package/bin/skills/lakehouse-doc-en/references/table_rendering.md +18 -12
- package/bin/skills/lakehouse-doc-en/references/task-develop.md +89 -91
- package/bin/skills/lakehouse-doc-en/references/task_development.md +19 -17
- package/bin/skills/lakehouse-doc-en/references/task_group.md +16 -14
- package/bin/skills/lakehouse-doc-en/references/task_instance.md +21 -21
- package/bin/skills/lakehouse-doc-en/references/task_param.md +38 -35
- package/bin/skills/lakehouse-doc-en/references/task_param_reference.md +81 -79
- package/bin/skills/lakehouse-doc-en/references/task_scheduling_dependency.md +20 -21
- package/bin/skills/lakehouse-doc-en/references/tencentcloud_arn_and_externalid.md +1 -5
- package/bin/skills/lakehouse-doc-en/references/trial-account-quotas-and-limits.md +1 -3
- package/bin/skills/lakehouse-doc-en/references/tutorial_connect_to_lakehouse.md +69 -0
- package/bin/skills/lakehouse-doc-en/references/tutorials.md +4 -1
- package/bin/skills/lakehouse-doc-en/references/unique-key.md +167 -0
- package/bin/skills/lakehouse-doc-en/references/usageandbillingview.md +138 -0
- package/bin/skills/lakehouse-doc-en/references/use-dbt-dev.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/use-java-sdk-realtime-uploaddata.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/use-java-sdk-upload-data-local.md +3 -3
- package/bin/skills/lakehouse-doc-en/references/use-models.md +128 -0
- package/bin/skills/lakehouse-doc-en/references/use-mysql-client.md +81 -81
- package/bin/skills/lakehouse-doc-en/references/use-python-sdk-upload-data.md +10 -12
- package/bin/skills/lakehouse-doc-en/references/user-identification.md +2 -3
- package/bin/skills/lakehouse-doc-en/references/user_permission_grand_guide.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/using-udf-in-dynamic-table.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/vc_cache.md +18 -22
- package/bin/skills/lakehouse-doc-en/references/vcluster_size_description.md +33 -31
- package/bin/skills/lakehouse-doc-en/references/virtual-cluster.md +43 -45
- package/bin/skills/lakehouse-doc-en/references/web-job-history.md +94 -108
- package/bin/skills/lakehouse-doc-en/references/web_search.md +16 -7
- package/bin/skills/lakehouse-doc-en/references/zettapark-data-engineering-demo.md +1 -1
- package/bin/skills/lakehouse-doc-en/references/zettapark-dataframe-guide.md +144 -70
- package/bin/skills/lakehouse-doc-en/references/zettapark-dynamic-table-guide.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/zettapark-etl-guide.md +73 -33
- package/bin/skills/lakehouse-doc-en/references/zettapark-feature-engineering.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/zettapark-functions-guide.md +75 -46
- package/bin/skills/lakehouse-doc-en/references/zettapark-quick-start.md +2 -2
- package/bin/skills/lakehouse-doc-en/references/zettapark-stream-guide.md +4 -4
- package/bin/skills/lakehouse-doc-en/references/zettapark-volume-guide.md +93 -29
- package/package.json +1 -1
- package/bin/skills/lakehouse-doc-en/references/CLAUDE.md +0 -606
- package/bin/skills/lakehouse-doc-en/references/modelprice.md +0 -155
|
@@ -1,314 +1,70 @@
|
|
|
1
|
-
#
|
|
1
|
+
# Pricing and Billing
|
|
2
2
|
|
|
3
|
-
Singdata Lakehouse is
|
|
3
|
+
Singdata bills by "product + resource type". Lakehouse is billed by three resource types — compute (CRU), storage, and network data transfer. AI Gateway is billed by tokens, with unit prices varying by model. Analytics Agent is a separate paid product with its own subscription-based pricing; for details please contact Singdata sales. The bills of each product are independent and can be viewed separately in the Billing Center of the console.
|
|
4
4
|
|
|
5
|
-
|
|
5
|
+
<table style="width:100%; table-layout:auto;">
|
|
6
|
+
<tr>
|
|
7
|
+
<td style="width:50%; vertical-align:top; padding:0 16px 16px 0; overflow-wrap:break-word;">
|
|
6
8
|
|
|
7
|
-
|
|
8
|
-
* **Storage Resources**: The billing unit for storage resources is **GiB**, and billing is based on the actual storage capacity you use on Singdata Lakehouse. The following scenarios will occupy storage capacity: 1) Data stored in Lakehouse in the form of tables, materialized views, etc.; 2) Data deleted but not yet cleaned up within the lifecycle of the data table; 3) Cached query results. Items 2 and 3 are currently only measured and temporarily free of charge.
|
|
9
|
-
* **Data Transmission**: The billing unit for data transmission is **GB**, and billing is based on the actual amount of data transmitted. The following scenarios will incur data transmission fees: 1) Data queries through the public network, full download of query results; 2) Data transmission between Singdata Lakehouse and other data sources; 3) Network connectivity through the Internet, cross-VPC connections, dedicated lines, or other methods. For Internet network traffic, only the data transmission volume flowing out of Singdata Lakehouse is measured; uploading data to Singdata Lakehouse is free of charge.
|
|
9
|
+
**Lakehouse**
|
|
10
10
|
|
|
11
|
-
|
|
11
|
+
Pay-as-you-go billing for compute clusters, storage, and network data transfer.
|
|
12
12
|
|
|
13
|
-
|
|
13
|
+
[View Lakehouse Pricing →](pricing-lakehouse.md)
|
|
14
14
|
|
|
15
|
-
|
|
15
|
+
</td>
|
|
16
|
+
<td style="width:50%; vertical-align:top; padding:0 0 16px 16px; overflow-wrap:break-word;">
|
|
16
17
|
|
|
17
|
-
|
|
18
|
-
| ------------------- | ----------------------------------- | ---------------- |
|
|
19
|
-
| Computing Resources | Metered by the second, in CRU | Every hour |
|
|
20
|
-
| Storage Resources | Sampled 24 hours a day, averaged | Every day |
|
|
21
|
-
| Data Transmission | Metered by actual traffic generated | Every hour |
|
|
18
|
+
**AI Gateway**
|
|
22
19
|
|
|
23
|
-
|
|
20
|
+
Token-based billing for unified access to mainstream LLMs (Anthropic Claude, OpenAI GPT, Qwen, DeepSeek, GLM, Kimi, MiniMax, and more).
|
|
24
21
|
|
|
25
|
-
|
|
22
|
+
[View AI Gateway Pricing →](pricing-ai-gateway.md)
|
|
26
23
|
|
|
27
|
-
|
|
24
|
+
</td>
|
|
25
|
+
</tr>
|
|
26
|
+
</table>
|
|
28
27
|
|
|
29
|
-
##
|
|
28
|
+
## FAQ
|
|
30
29
|
|
|
31
|
-
|
|
30
|
+
| Question | Documentation |
|
|
31
|
+
|------|---------|
|
|
32
|
+
| What are the trial account quotas | [Trial Account Quotas and Limits](trial-account-quotas-and-limits.md) |
|
|
33
|
+
| How do I top up and check balance | [Account Funds](account-funds.md) |
|
|
34
|
+
| How do I view bill details | [Billing](billing.md) |
|
|
35
|
+
| How do I configure cost anomaly alerts | [Lakehouse Billing Anomaly Alert Configuration Guide](lakehouse_billing_anomaly_alert_configuration_guide.md) |
|
|
36
|
+
| How do I manage usage and cost | [Cost Management](cost_management.md) |
|
|
32
37
|
|
|
33
|
-
|
|
38
|
+
## Next Steps
|
|
34
39
|
|
|
35
|
-
|
|
40
|
+
<table style="width:100%; table-layout:auto;">
|
|
41
|
+
<tr>
|
|
42
|
+
<td style="width:33%; vertical-align:top; text-align:center; padding:12px; overflow-wrap:break-word;">
|
|
36
43
|
|
|
37
|
-
|
|
44
|
+
**Try Before You Decide**
|
|
38
45
|
|
|
39
|
-
|
|
46
|
+
Sign up for a free trial account and evaluate the cost after experiencing core features.
|
|
40
47
|
|
|
41
|
-
|
|
42
|
-
> General-purpose Computing Cluster = Runtime (hours) × Cluster Specification (CRU) × CRU Unit Price (RMB/CRU\*hour)
|
|
48
|
+
[Sign Up for Trial →](logging-in.md)
|
|
43
49
|
|
|
44
|
-
|
|
50
|
+
</td>
|
|
51
|
+
<td style="width:33%; vertical-align:top; text-align:center; padding:12px; overflow-wrap:break-word;">
|
|
45
52
|
|
|
46
|
-
|
|
47
|
-
| --------------------- | ---------------------------------- |
|
|
48
|
-
| 1 | 1 |
|
|
49
|
-
| 2 | 2 |
|
|
50
|
-
| 3 | 3 |
|
|
51
|
-
| 4 | 4 |
|
|
52
|
-
| 5 | 5 |
|
|
53
|
-
| ... | ... |
|
|
54
|
-
| 256 | 256 |
|
|
53
|
+
**On-Demand Subscription**
|
|
55
54
|
|
|
56
|
-
|
|
55
|
+
Top up balance, pay for actual consumption, stop anytime.
|
|
57
56
|
|
|
58
|
-
|
|
57
|
+
[Open Service Instance →](logging-in.md)
|
|
59
58
|
|
|
60
|
-
|
|
59
|
+
</td>
|
|
60
|
+
<td style="width:33%; vertical-align:top; text-align:center; padding:12px; overflow-wrap:break-word;">
|
|
61
61
|
|
|
62
|
-
|
|
63
|
-
> Analytical Computing Cluster = Runtime (hours) × Number of Instances × Cluster Specification (CRU) × CRU Unit Price (RMB/CRU\*hour)
|
|
62
|
+
**Annual Enterprise Procurement**
|
|
64
63
|
|
|
65
|
-
|
|
64
|
+
Annual prepayment with discounts; private deployment supported.
|
|
66
65
|
|
|
67
|
-
|
|
68
|
-
| --------------------- | ----------------------------- | ------------------------------ | ------------------------------ | ------------------------------ | ------------------------------ |
|
|
69
|
-
| 1 | 1 CRU\*hour | 2 CRU\*hour | 3 CRU\*hour | 4 CRU\*hour | 5 CRU\*hour |
|
|
70
|
-
| 2 | 2 CRU\*hour | 4 CRU\*hour | 6 CRU\*hour | 8 CRU\*hour | 10 CRU\*hour |
|
|
71
|
-
| 4 | 4 CRU\*hour | 8 CRU\*hour | 12 CRU\*hour | 16 CRU\*hour | 20 CRU\*hour |
|
|
72
|
-
| 8 | 8 CRU\*hour | 16 CRU\*hour | 24 CRU\*hour | 32 CRU\*hour | 40 CRU\*hour |
|
|
73
|
-
| 16 | 16 CRU\*hour | 32 CRU\*hour | 48 CRU\*hour | 64 CRU\*hour | 80 CRU\*hour |
|
|
74
|
-
| 32 | 32 CRU\*hour | 64 CRU\*hour | 96 CRU\*hour | 128 CRU\*hour | 160 CRU\*hour |
|
|
75
|
-
| 64 | 64 CRU\*hour | 128 CRU\*hour | 192 CRU\*hour | 256 CRU\*hour | 320 CRU\*hour |
|
|
76
|
-
| 128 | 128 CRU\*hour | 256 CRU\*hour | 384 CRU\*hour | 512 CRU\*hour | 640 CRU\*hour |
|
|
77
|
-
| 256 | 256 CRU\*hour | 512 CRU\*hour | 768 CRU\*hour | 1024 CRU\*hour | 1280 CRU\*hour |
|
|
66
|
+
[Contact Sales →](https://www.singdata.com/reservation)
|
|
78
67
|
|
|
79
|
-
|
|
80
|
-
|
|
81
|
-
|
|
82
|
-
|
|
83
|
-
> 🗒️ **Billing Formula**: 
|
|
84
|
-
> Synchronous Computing Cluster = Runtime (hours) × Cluster Specification (CRU) × CRU Unit Price (RMB/CRU\*hour)
|
|
85
|
-
|
|
86
|
-
Note: **The synchronous computing cluster is currently in trial operation**.During this period, to help you manage and account for offline and real-time business costs more precisely, the system will record billing details separately under the "Offline Integration" and "Real-time Integration" billing items on a per-job basis according to actual resource consumption. The CRU\*hour unit price remains unchanged under this billing model. When creating a synchronous cluster, you can use the "[Specification Estimation](https://www.singdata.com/documents/virtual-cluster)" feature to help determine the appropriate size.
|
|
87
|
-
|
|
88
|
-
Offline integration tasks can automatically wake up the synchronous computing cluster and automatically stop it after the task is completed; real-time integration tasks require their synchronous computing cluster to remain in the "running" state.
|
|
89
|
-
|
|
90
|
-
> 🗒️ **Billing Formulas during Trial Operation**: 
|
|
91
|
-
> Offline Integration = Runtime (hours) × CRU consumed by offline integration (CRU) × CRU Unit Price (RMB/CRU\*hour)
|
|
92
|
-
>
|
|
93
|
-
> Real-time Integration = Runtime (hours) × CRU consumed by real-time integration (CRU) × CRU Unit Price (RMB/CRU\*hour)
|
|
94
|
-
|
|
95
|
-
After the trial operation ends, data integration fees will be merged into the "Synchronous Computing Cluster" billing item. When the new billing model changes, we will notify you one month in advance to ensure you have sufficient time for business evaluation.
|
|
96
|
-
|
|
97
|
-
After official operation, the synchronous computing cluster will have specification restrictions: minimum specification of 0.25 CRU, maximum of 256 CRU, with no fixed step size restriction and support for any specification value. The hourly CRU consumption equals the cluster specification, for example:
|
|
98
|
-
|
|
99
|
-
| Cluster Specification | Hourly CRU Consumption |
|
|
100
|
-
| --------------------- | ---------------------- |
|
|
101
|
-
| 0.25 | 0.25 CRU\*hour |
|
|
102
|
-
| 0.26 | 0.26 CRU\*hour |
|
|
103
|
-
| 0.27 | 0.27 CRU\*hour |
|
|
104
|
-
| ... | ... |
|
|
105
|
-
| 256 | 256 CRU\*hour |
|
|
106
|
-
|
|
107
|
-
#### Task Scheduling
|
|
108
|
-
|
|
109
|
-
Task scheduling billing mainly covers two types of scenarios: one is the scheduling computing resource consumption generated when Python, Shell, and other script tasks are executed; the other is the small amount of computing resource consumption generated during the job submission and scheduling management process of offline and real-time integration tasks.
|
|
110
|
-
|
|
111
|
-
Task scheduling has no fixed minimum specification or step size restrictions. In all scenarios, the actual resource consumption from task scheduling will generate billing in CRU\*hour units.
|
|
112
|
-
|
|
113
|
-
For Python, Shell, and other script tasks, the system will meter based on the computing resources allocated to the task and the actual runtime. The metering period starts when the task execution begins and ends when the task execution completes.
|
|
114
|
-
|
|
115
|
-
For offline integration tasks, Singdata Lakehouse provides a small amount of computing resources for job submission and scheduling management. These resources begin metering after the offline integration task starts, do not consume during queue waiting, and persist throughout task execution.
|
|
116
|
-
|
|
117
|
-
For real-time integration tasks, Singdata Lakehouse similarly provides a small amount of computing resources for job submission and scheduling management. These resources begin metering after the real-time integration task starts and end after the task is officially running. Computing resource consumption during this period will be metered.
|
|
118
|
-
|
|
119
|
-
> 🗒️ **Billing Formula**: 
|
|
120
|
-
> Task Scheduling = Runtime (hours) × Cluster Specification (CRU) × CRU Unit Price (RMB/CRU\*hour)
|
|
121
|
-
|
|
122
|
-
#### Serverless Jobs
|
|
123
|
-
|
|
124
|
-
Serverless jobs refer to jobs that do not require users to actively create computing cluster instances, but are handled by the public computing resources provided by Singdata Lakehouse. This includes query job scheduling, data compression, automatic materialized views, etc.
|
|
125
|
-
|
|
126
|
-
The current CRU\*hour unit price for serverless jobs is the same as that of general-purpose computing clusters.
|
|
127
|
-
|
|
128
|
-
> 🗒️ **Billing Formula**: 
|
|
129
|
-
> Serverless Jobs = Runtime (hours) × Cluster Specification (CRU) × CRU Unit Price (RMB/CRU\*hour)
|
|
130
|
-
|
|
131
|
-
### 2. Storage Capacity Billing
|
|
132
|
-
|
|
133
|
-
Storage fees are calculated based on the actual storage capacity you use on the Lakehouse platform. The billing cycle for storage **is measured in days**.
|
|
134
|
-
|
|
135
|
-
When you write data into the Lakehouse data warehouse, the written data and some of its metadata information will occupy storage capacity in Lakehouse. Lakehouse measures your actual data storage usage by sampling multiple times within a day and **uses the average value of the sampled storage capacity** as the storage capacity measurement value for that day for billing.
|
|
136
|
-
|
|
137
|
-
When you use the [Time Travel ](https://www.singdata.com/documents/timetravel-summary)feature of Lakehouse, to ensure data multi-version and recoverability, Lakehouse will automatically back up your data in multiple versions. The multi-version backup data generated will incur corresponding storage fees, charged at the storage capacity unit price.
|
|
138
|
-
|
|
139
|
-
When you perform SQL queries, to reduce the consumption of computing resources for repeated queries, the query results will be cached, exchanging storage costs for computing resource savings. This part of the storage usage will be included in "[Result Cache](https://www.singdata.com/documents/result_cache)" and charged at the storage capacity unit price.
|
|
140
|
-
|
|
141
|
-
**Time Travel and Result Cache are currently free of charge**. You will be notified one month in advance when the billing status changes.
|
|
142
|
-
|
|
143
|
-
> 🗒️ **Billing Formula**: 
|
|
144
|
-
> Storage = Storage Duration (days) / 30 (days) × Daily Average Storage (GiB) × Storage Unit Price (RMB/GiB/month)
|
|
145
|
-
|
|
146
|
-
### 3. Data Transmission Billing
|
|
147
|
-
|
|
148
|
-
When you use Lakehouse as a data source for outbound network data transmission, such as downloading or exporting data through the public network, data transmission fees will be incurred. Data transmission is metered based on the actual amount of data transferred, with a billing cycle **measured in hours**.
|
|
149
|
-
|
|
150
|
-
When you use other data sources to transfer data into Lakehouse through the Internet, the network transfer traffic used will not incur fees.
|
|
151
|
-
|
|
152
|
-
When you use dedicated lines, Private Link, or other network products to achieve cross-cloud vendor, cross-region, or cross-VPC network connectivity, the network connectivity itself will incur data transmission fees. These fees may be charged by multiple parties due to different network connectivity methods. Data transmission fees generated on the Singdata Lakehouse side are charged by Singdata, while data transmission fees generated in your cloud platform account are charged directly by the cloud platform.
|
|
153
|
-
|
|
154
|
-
> 🗒️ **Billing Formula**: 
|
|
155
|
-
> Data Transmission = Data Transfer Volume (GB) × Data Transmission Unit Price (RMB/GB)
|
|
156
|
-
|
|
157
|
-
### 4. Other Cloud Resource Billing
|
|
158
|
-
|
|
159
|
-
When Singdata Lakehouse performs metadata management, parses SQL statements, generates query plans, schedules and allocates query tasks, and merges and cleans data files, it will consume cloud resources. Lakehouse will meter the consumption of these cloud resources, which are currently free for a limited time. You will be notified one month in advance when the billing status changes.
|
|
160
|
-
|
|
161
|
-
## Pricing
|
|
162
|
-
|
|
163
|
-
### 1. CRU Hour Price
|
|
164
|
-
|
|
165
|
-
**Standard Edition**:
|
|
166
|
-
|
|
167
|
-
| Cloud Provider | Region | Version | Unit Price |
|
|
168
|
-
| -------------- | --------- | ---------------- | ------------------- |
|
|
169
|
-
| Alibaba Cloud | Shanghai | Standard Edition | 3.5 RMB/CRU\* hour |
|
|
170
|
-
| | Beijing | Standard Edition | 3.5 RMB/CRU\* hour |
|
|
171
|
-
| | Hangzhou | Standard Edition | 3.5 RMB/CRU\* hour |
|
|
172
|
-
| | Singapore | Standard Edition | 0.8 USD/CRU\* hour |
|
|
173
|
-
| Tencent Cloud | Beijing | Standard Edition | 3.5 RMB/CRU\* hour |
|
|
174
|
-
| | Shanghai | Standard Edition | 3.5 RMB/CRU\* hour |
|
|
175
|
-
| | Guangzhou | Standard Edition | 3.5 RMB/CRU\* hour |
|
|
176
|
-
| AWS | Beijing | Standard Edition | 9.95 RMB/CRU\* hour |
|
|
177
|
-
| | Singapore | Standard Edition | 1.24 USD/CRU\* hour |
|
|
178
|
-
|
|
179
|
-
**Enterprise Edition**:
|
|
180
|
-
|
|
181
|
-
| Cloud Provider | Region | Version | Unit Price |
|
|
182
|
-
| -------------- | --------- | ------------------ | ------------------- |
|
|
183
|
-
| Alibaba Cloud | Shanghai | Enterprise Edition | 5.25 RMB/CRU\* hour |
|
|
184
|
-
| | Beijing | Enterprise Edition | 5.25 RMB/CRU\* hour |
|
|
185
|
-
| | Hangzhou | Enterprise Edition | 5.25 RMB/CRU\* hour |
|
|
186
|
-
| | Singapore | Enterprise Edition | 1.2 USD/CRU\* hour |
|
|
187
|
-
| Tencent Cloud | Beijing | Enterprise Edition | 5.25 RMB/CRU\* hour |
|
|
188
|
-
| | Shanghai | Enterprise Edition | 5.25 RMB/CRU\* hour |
|
|
189
|
-
| | Guangzhou | Enterprise Edition | 5.25 RMB/CRU\* hour |
|
|
190
|
-
| AWS | Beijing | Enterprise Edition | 15 RMB/CRU\* hour |
|
|
191
|
-
| | Singapore | Enterprise Edition | 1.86 USD/CRU\* hour |
|
|
192
|
-
|
|
193
|
-
Note: In addition to the Standard Edition, the platform also offers an Enterprise Edition with enhanced data governance and security capabilities. The CRU hour unit price for the Enterprise Edition is higher than that of the Standard Edition. For a detailed comparison of features between the two editions, please refer to the product documentation at [Editions Overview](editionsoverview.md).
|
|
194
|
-
|
|
195
|
-
### 2.Storage Capacity Price
|
|
196
|
-
|
|
197
|
-
| Cloud Provider | Region | Version | Storage Capacity Price |
|
|
198
|
-
| -------------- | --------- | ------------------------------------- | ---------------------- |
|
|
199
|
-
| Alibaba Cloud | Shanghai | Enterprise Edition & Standard Edition | 0.12 RMB/GiB/month |
|
|
200
|
-
| | Singapore | Enterprise Edition & Standard Edition | 0.017 USD/GiB/month |
|
|
201
|
-
| Tencent Cloud | Beijing | Enterprise Edition & Standard Edition | 0.12 RMB/GiB/month |
|
|
202
|
-
| | Shanghai | Enterprise Edition & Standard Edition | 0.12 RMB/GiB/month |
|
|
203
|
-
| | Guangzhou | Enterprise Edition & Standard Edition | 0.12 RMB/GiB/month |
|
|
204
|
-
| AWS | Beijing | Enterprise Edition & Standard Edition | 0.195 RMB/GiB/month |
|
|
205
|
-
| | Singapore | Enterprise Edition & Standard Edition | 0.025 USD/GiB/month |
|
|
206
|
-
|
|
207
|
-
Note: Since the billing cycle for storage is measured in days, the monthly unit price shown above is prorated on a 30-day basis for daily deductions.
|
|
208
|
-
|
|
209
|
-
### 3. Data Transmission Pricing
|
|
210
|
-
|
|
211
|
-
| Cloud Provider | Region | Edition | Internet Data Transfer Price |
|
|
212
|
-
| -------------- | --------- | ------------------------------------- | ---------------------------- |
|
|
213
|
-
| Alibaba Cloud | Shanghai | Enterprise Edition & Standard Edition | 0.8 RMB/GB |
|
|
214
|
-
| | Singapore | Enterprise Edition & Standard Edition | 0.081 USD/GB |
|
|
215
|
-
| Tencent Cloud | Beijing | Enterprise Edition & Standard Edition | 0.8 RMB/GB |
|
|
216
|
-
| | Shanghai | Enterprise Edition & Standard Edition | 0.8 RMB/GB |
|
|
217
|
-
| | Guangzhou | Enterprise Edition & Standard Edition | 0.8 RMB/GB |
|
|
218
|
-
| AWS | Beijing | Enterprise Edition & Standard Edition | 0.933 RMB/GB |
|
|
219
|
-
| | Singapore | Enterprise Edition & Standard Edition | 0.12 USD/GB |
|
|
220
|
-
|
|
221
|
-
## Cost Examples in Common Scenarios
|
|
222
|
-
|
|
223
|
-
### General-purpose Computing Cluster Cost Example
|
|
224
|
-
|
|
225
|
-
Taking an AWS Singapore Standard Edition service instance in SaaS mode as an example:
|
|
226
|
-
|
|
227
|
-
* A general-purpose computing cluster with a specification of 2 CRU, running for 1 hour, with a unit price of 1.24 USD per CRU\*hour, the cost is:
|
|
228
|
-
|
|
229
|
-
* 1 hour × 2 CRU × 1.24 USD/CRU\*hour = **2.48 USD**
|
|
230
|
-
* A general-purpose computing cluster with a specification of 1 CRU, running for 1 minute and 20 seconds (approximately 1.33 minutes), with a unit price of 1.24 USD per CRU\*hour, the cost is:
|
|
231
|
-
|
|
232
|
-
* 1.33/60 minutes × 1 CRU × 1.24 USD/CRU\*hour = **0.027 USD**
|
|
233
|
-
* A general-purpose computing cluster with a specification of 1 CRU running from 10:00-10:02 for 2 minutes, and another general-purpose computing cluster with a specification of 2 CRU running from 10:00-10:10 for 10 minutes, with a unit price of 1.24 USD per CRU\*hour, the cost is:
|
|
234
|
-
|
|
235
|
-
* (2/60 minutes × 1 CRU × 1.24 USD/CRU\*hour) + (10/60 minutes × 2 CRU × 1.24 USD/CRU\*hour) = 0.041 USD + 0.413 USD = **0.455 USD**
|
|
236
|
-
|
|
237
|
-
### Analytical Computing Cluster Cost Example
|
|
238
|
-
|
|
239
|
-
Taking an AWS Singapore Standard Edition service instance in SaaS mode as an example:
|
|
240
|
-
|
|
241
|
-
* An analytical cluster with a specification of 1 CRU, running for 30 minutes with 1 instance, and then running for 30 minutes with 2 instances, with a unit price of 1.24 USD per CRU\*hour, the cost is:
|
|
242
|
-
* (30/60 minutes × 1 instance × 1 CRU × 1.24 USD/CRU\*hour) + (30/60 minutes × 2 instances × 1 CRU × 1.24 USD/CRU\*hour) = 0.62 USD + 1.24 USD = **1.86 USD**
|
|
243
|
-
|
|
244
|
-
### Offline Integration Task Cost Example
|
|
245
|
-
|
|
246
|
-
During the current trial operation period, offline integration tasks are not charged separately; only the running costs of the synchronous computing cluster to which the tasks are submitted are charged. Offline integration tasks can automatically wake up the synchronous computing cluster.
|
|
247
|
-
|
|
248
|
-
An offline integration task requires computing resources for scheduling and concurrent execution. A single offline task typically requires at least approximately 0.05 CRU of scheduling resources, with a total consumption of at least approximately 0.1 CRU (0.05 CRU + 1 × 0.05 CRU). Based on this estimate, 5 single-concurrent offline integration tasks can fully utilize a synchronous computing cluster with a specification of 0.5 CRU.
|
|
249
|
-
|
|
250
|
-
> 🗒️ **Estimation Formula**: 
|
|
251
|
-
> Offline Integration Task Resource Consumption ≈ Scheduling Resource Specification (CRU) + Concurrency × Scheduling Resource Specification (CRU)
|
|
252
|
-
|
|
253
|
-
Taking an AWS Singapore Standard Edition service instance in SaaS mode as an example:
|
|
254
|
-
|
|
255
|
-
* A single-concurrent offline integration task running for 10 minutes, with actual hourly computing resource consumption of 0.1 CRU, and a unit price of 1.24 USD per CRU\*hour, the cost is:
|
|
256
|
-
|
|
257
|
-
* 10/60 minutes × 0.1 CRU × 1.24 USD/CRU\*hour = **0.021 USD**
|
|
258
|
-
* A single-concurrent offline integration task running from 10:00-10:10 for 10 minutes with actual hourly consumption of 0.1 CRU, and another 5-concurrent offline integration task running from 10:05-10:25 for 20 minutes with actual hourly consumption of 0.3 CRU, with a unit price of 1.24 USD per CRU\*hour, the cost is:
|
|
259
|
-
|
|
260
|
-
* (5/60 minutes × 0.1 CRU × 1.24 USD/CRU\*hour) + (5/60 minutes × 0.4 CRU × 1.24 USD/CRU\*hour) + (15/60 minutes × 0.3 CRU × 1.24 USD/CRU\*hour) = 0.010 USD + 0.041 USD + 0.093 USD = **0.145 USD**
|
|
261
|
-
|
|
262
|
-
### Real-time Integration Task Cost Example
|
|
263
|
-
|
|
264
|
-
During the trial operation period, in addition to offline integration tasks, the computing resource consumption of real-time integration tasks in the synchronous computing cluster is also metered separately.
|
|
265
|
-
|
|
266
|
-
Unlike offline integration tasks, real-time integration tasks run continuously after startup and perform real-time data caching and state management in memory. Therefore, the execution resource consumption of real-time tasks does not have a simple linear relationship with concurrency, but mainly depends on the complexity of data processing and the required state cache size. A single-concurrent real-time integration task will incur at least approximately 0.05 CRU of scheduling resource consumption and approximately 0.0625 CRU of execution consumption, totaling at least approximately 0.1125 CRU per hour.
|
|
267
|
-
|
|
268
|
-
Taking an AWS Singapore Standard Edition service instance in SaaS mode as an example:
|
|
269
|
-
|
|
270
|
-
* A single-concurrent real-time integration task running for 24 hours, with actual hourly resource consumption of 0.1125 CRU, requiring a minimum cluster specification of 0.25 CRU, and a unit price of 1.24 USD per CRU\*hour, the cost is:
|
|
271
|
-
* 24 hours × 0.1125 CRU × 1.24 USD/CRU\*hour = **3.348 USD**
|
|
272
|
-
* A multi-concurrent real-time integration task consuming 1 CRU per hour running from January 1-5 for 5 days, and another multi-concurrent real-time integration task consuming 2 CRU per hour running from January 3-10 for 8 days, with a unit price of 1.24 USD per CRU\*hour, the cost is:
|
|
273
|
-
* (2 × 24 hours × 1 CRU × 1.24 USD/CRU\*hour) + (3 × 24 hours × 3 CRU × 1.24 USD/CRU\*hour) + (5 × 24 hours × 2 CRU × 1.24 USD/CRU\*hour) = 59.52 USD + 267.84 USD + 297.60 USD = **624.96 USD**
|
|
274
|
-
|
|
275
|
-
### Synchronous Computing Cluster Cost Example
|
|
276
|
-
|
|
277
|
-
After the trial operation ends, synchronous computing clusters will be billed according to this standard.
|
|
278
|
-
|
|
279
|
-
Taking an AWS Singapore Standard Edition service instance in SaaS mode as an example:
|
|
280
|
-
|
|
281
|
-
* A synchronous cluster with a specification of 2 CRU, running for 1 hour, with a unit price of 1.24 USD per CRU\*hour, the cost is:
|
|
282
|
-
|
|
283
|
-
* 1 hour × 2 CRU × 1.24 USD/CRU\*hour = **2.48 USD**
|
|
284
|
-
* A real-time integration task consuming 0.2 CRU per hour running from January 1-5 for 5 days, with an additional offline integration task consuming 0.1 CRU running for 1 hour on January 2 from 0:00-1:00, with a unit price of 1.24 USD per CRU\*hour, the cost is:
|
|
285
|
-
|
|
286
|
-
* "**Fixed" mode** total cost: 5 × 24 hours × 0.5 CRU × 1.24 USD/CRU\*hour = **74.40 USD**
|
|
287
|
-
* "**Elastic Scaling" mode** total cost: (1 × 24 hours × 0.25 CRU × 1.24 USD/CRU\*hour) + (1 hour × 0.5 CRU × 1.24 USD/CRU\*hour) + ((23 + 3×24) hours × 0.25 CRU × 1.24 USD/CRU\*hour) = 7.44 USD + 0.62 USD + 29.45 USD = **37.51 USD**
|
|
288
|
-
|
|
289
|
-
As shown in the examples above, to better save synchronous computing resource costs, it is recommended to reuse synchronous computing cluster resources as much as possible and avoid using overly large specifications.
|
|
290
|
-
|
|
291
|
-
### Task Scheduling - Python Script Task Cost Example
|
|
292
|
-
|
|
293
|
-
When executing Python script tasks, the cost is calculated based on the task execution time and the computing resources consumed. Generally, when a Python script runs for 1 hour, the computing resources used are 0.125 CRU.
|
|
294
|
-
|
|
295
|
-
Taking an AWS Singapore Standard Edition service instance in SaaS mode as an example:
|
|
296
|
-
|
|
297
|
-
* A Python script task with an execution time of 10 minutes, with a unit price of 1.24 USD per CRU\*hour, the cost is:
|
|
298
|
-
* 10/60 minutes × 0.125 CRU × 1.24 USD/CRU\*hour = **0.026 USD**
|
|
299
|
-
|
|
300
|
-
### Storage Capacity Cost Example
|
|
301
|
-
|
|
302
|
-
Taking an AWS Singapore Standard Edition service instance in SaaS mode as an example:
|
|
303
|
-
|
|
304
|
-
* A workspace with a daily storage capacity low point of 910 GiB, high point of 1100 GiB, and daily average of 1000 GiB, with a monthly storage unit price of 0.025 USD/GiB/month (calculated on a 30-day basis), the storage cost for that day is:
|
|
305
|
-
* 1/30 month × 1000 GiB × 0.025 USD/GiB/month = **0.833 USD**
|
|
306
|
-
|
|
307
|
-
### Data Transmission Cost Example
|
|
308
|
-
|
|
309
|
-
Taking an AWS Singapore Standard Edition service instance in SaaS mode as an example:
|
|
310
|
-
|
|
311
|
-
* A task generating 10 GB of outbound network data transmission traffic, with a data transmission unit price of 0.12 USD/GB, the data transmission cost is:
|
|
312
|
-
* 10 GB × 0.12 USD/GB = **1.20 USD**
|
|
313
|
-
|
|
314
|
-
^
|
|
68
|
+
</td>
|
|
69
|
+
</tr>
|
|
70
|
+
</table>
|
|
@@ -9,7 +9,6 @@ In the **Lakehouse** platform, the application scenarios of Private Link mainly
|
|
|
9
9
|
**1. User VPC → Lakehouse (Inbound)**
|
|
10
10
|
Within the same region and availability zone of the cloud vendor, access Lakehouse (JDBC gateway, IGS, etc.) services from the user's VPC through the cloud vendor's Private Link service.
|
|
11
11
|
|
|
12
|
-
:-: 
|
|
13
12
|
|
|
14
13
|
For example:
|
|
15
14
|
|
|
@@ -22,7 +21,6 @@ At this time, the Lakehouse Private Link feature is needed to establish an endpo
|
|
|
22
21
|
**2. Lakehouse → User VPC (Outbound)**
|
|
23
22
|
When it is necessary to connect from Lakehouse (located in Singdata VPC) to user-defined services (such as a self-built MySQL database within the user VPC), Private Link is also used for private network access.
|
|
24
23
|
|
|
25
|
-
:-: 
|
|
26
24
|
|
|
27
25
|
For example:
|
|
28
26
|
A financial company chooses to use Lakehouse for unified data storage and analysis, but its core business database is stored within a private VPC and has strict security policies prohibiting the exposure of database ports to the public internet. Lakehouse needs to read data in real-time for subsequent analysis and risk control model training.
|
|
@@ -108,7 +108,7 @@ session = Session.builder.configs({
|
|
|
108
108
|
"instance": os.environ["CLICKZETTA_INSTANCE"],
|
|
109
109
|
"workspace": os.environ["CLICKZETTA_WORKSPACE"],
|
|
110
110
|
"schema": "f1_processed",
|
|
111
|
-
"vcluster": os.environ.get("CLICKZETTA_VCLUSTER", "
|
|
111
|
+
"vcluster": os.environ.get("CLICKZETTA_VCLUSTER", "DEFAULT_AP"),
|
|
112
112
|
}).create()
|
|
113
113
|
|
|
114
114
|
df = session.read.option("header", "true").csv("vol://f1_raw.formula1_raw_vol/raw/circuits.csv")
|
|
@@ -1,3 +1,7 @@
|
|
|
1
|
+
# Python SDK Real-time Write
|
|
2
|
+
|
|
3
|
+
## Singdata Lakehouse Python SDK Real-time Write
|
|
4
|
+
|
|
1
5
|
## Installation
|
|
2
6
|
|
|
3
7
|
1. **Uninstall Old Versions**
|
|
@@ -11,7 +15,7 @@
|
|
|
11
15
|
|
|
12
16
|
2. **Install clickzetta connector**
|
|
13
17
|
|
|
14
|
-
Install the ingestion package, which requires Python version 3.
|
|
18
|
+
Install the ingestion package, which requires Python version 3.10 or higher:
|
|
15
19
|
|
|
16
20
|
```python
|
|
17
21
|
pip install clickzetta-connector
|
|
@@ -232,7 +236,7 @@ with connect(username='your_username',
|
|
|
232
236
|
instance='your_instance',
|
|
233
237
|
workspace='your_workspace',
|
|
234
238
|
schema='your_schema',
|
|
235
|
-
vcluster='
|
|
239
|
+
vcluster='DEFAULT') as conn:
|
|
236
240
|
|
|
237
241
|
# Create a primary key table
|
|
238
242
|
cursor = conn.cursor()
|
|
@@ -308,6 +312,6 @@ with connect(username='your_username',
|
|
|
308
312
|
|
|
309
313
|
## Summary
|
|
310
314
|
|
|
311
|
-
The real-time write feature of the
|
|
315
|
+
The real-time write feature of the Singdata Python SDK provides an efficient and flexible way to write data, supporting various data types and operation modes. By configuring parameters appropriately, you can optimize write performance for different scenarios.
|
|
312
316
|
|
|
313
317
|
For primary key tables and regular tables, different operation modes and row operation types are required. Primary key tables must use CDC mode and can only use UPSERT and DELETE_IGNORE operations; regular tables typically use APPEND_ONLY mode and INSERT operations.
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
# Python Task
|
|
2
2
|
|
|
3
|
-
> [Preview Release] This feature is currently in the invite-only preview release phase. To use it, please contact our technical support team for assistance.
|
|
3
|
+
> \[Preview Release] This feature is currently in the invite-only preview release phase. To use it, please contact our technical support team for assistance.
|
|
4
4
|
|
|
5
5
|
In many data analysis and processing scenarios, especially in BI+AI analysis scenarios, combining Python and SQL can greatly improve the efficiency of data analysis and processing. In Singdata Lakehouse, we provide a Python script task type for running Python code.
|
|
6
6
|
|
|
@@ -1,4 +1,4 @@
|
|
|
1
|
-
#
|
|
1
|
+
# ClickZetta Connector Python SDK
|
|
2
2
|
|
|
3
3
|
`clickzetta-connector` is the official Python SDK for Singdata Lakehouse. It follows the PEP-249 specification and provides a SQL call interface compliant with the Python Database API style, supporting queries, writes, bulk inserts, and asynchronous execution.
|
|
4
4
|
|
|
@@ -18,7 +18,7 @@
|
|
|
18
18
|
pip install clickzetta-connector
|
|
19
19
|
```
|
|
20
20
|
|
|
21
|
-
Python version >= 3.
|
|
21
|
+
Python version >= 3.10 is required.
|
|
22
22
|
|
|
23
23
|
If an older version is installed, uninstall it first to avoid conflicts:
|
|
24
24
|
|
|
@@ -40,7 +40,7 @@ conn = connect(
|
|
|
40
40
|
instance='your_instance', # Instance name
|
|
41
41
|
workspace='your_workspace', # Workspace name
|
|
42
42
|
schema='public', # Default schema
|
|
43
|
-
vcluster='
|
|
43
|
+
vcluster='DEFAULT' # Compute cluster name
|
|
44
44
|
)
|
|
45
45
|
```
|
|
46
46
|
|
|
@@ -17,7 +17,7 @@ conn = connect(
|
|
|
17
17
|
instance='your_instance',
|
|
18
18
|
workspace='your_workspace',
|
|
19
19
|
schema='public',
|
|
20
|
-
vcluster='
|
|
20
|
+
vcluster='DEFAULT'
|
|
21
21
|
)
|
|
22
22
|
cursor = conn.cursor()
|
|
23
23
|
```
|
|
@@ -195,7 +195,7 @@ conn = connect(
|
|
|
195
195
|
instance='your_instance',
|
|
196
196
|
workspace='your_workspace',
|
|
197
197
|
schema='public',
|
|
198
|
-
vcluster='
|
|
198
|
+
vcluster='DEFAULT'
|
|
199
199
|
)
|
|
200
200
|
cursor = conn.cursor()
|
|
201
201
|
|
|
@@ -2,7 +2,7 @@
|
|
|
2
2
|
|
|
3
3
|
This page provides complete, runnable examples of `clickzetta-connector` for common business scenarios.
|
|
4
4
|
|
|
5
|
-
For connection configuration and basic usage, see [
|
|
5
|
+
For connection configuration and basic usage, see [ClickZetta Connector Python SDK](connector.md).
|
|
6
6
|
|
|
7
7
|
---
|
|
8
8
|
|
|
@@ -21,7 +21,7 @@ conn = connect(
|
|
|
21
21
|
instance='your_instance',
|
|
22
22
|
workspace='your_workspace',
|
|
23
23
|
schema='public',
|
|
24
|
-
vcluster='
|
|
24
|
+
vcluster='DEFAULT'
|
|
25
25
|
)
|
|
26
26
|
cursor = conn.cursor()
|
|
27
27
|
```
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
# Python SDK
|
|
2
2
|
|
|
3
|
-
`clickzetta-connector` is the official Python SDK for Singdata Lakehouse. It follows the PEP 249 specification and provides four integration methods: SQL queries, SQLAlchemy ORM, bulk writes (Bulkload), and real-time streaming writes. Python 3.
|
|
3
|
+
`clickzetta-connector` is the official Python SDK for Singdata Lakehouse. It follows the PEP 249 specification and provides four integration methods: SQL queries, SQLAlchemy ORM, bulk writes (Bulkload), and real-time streaming writes. Python 3.10 and above is supported.
|
|
4
4
|
|
|
5
5
|
---
|
|
6
6
|
|
|
@@ -16,9 +16,9 @@ Currently supported data source types:
|
|
|
16
16
|
|
|
17
17
|
In the configuration panel of a Python/Shell task, you can select one or more data sources to use (make sure the data source has already been created and connection-tested under Management → Data Sources). This configuration applies to both direct runs and scheduled runs of the task:
|
|
18
18
|
|
|
19
|
-
|
|
19
|
+
^
|
|
20
20
|
|
|
21
|
-
*Note: The default Lakehouse data source for the current workspace is accessible in code without needing to be added here
|
|
21
|
+
*Note: The default Lakehouse data source for the current workspace is accessible in code without needing to be added here*.
|
|
22
22
|
|
|
23
23
|
### Accessing a Data Source in Code
|
|
24
24
|
|
|
@@ -144,7 +144,7 @@ import pandas as pd
|
|
|
144
144
|
|
|
145
145
|
from clickzetta_dbutils import get_active_lakehouse_engine
|
|
146
146
|
|
|
147
|
-
engine = get_active_lakehouse_engine(vcluster="
|
|
147
|
+
engine = get_active_lakehouse_engine(vcluster="DEFAULT",schema="brazilianecommerce")
|
|
148
148
|
```
|
|
149
149
|
|
|
150
150
|
Connect and run a query:
|
|
@@ -176,7 +176,7 @@ Sets the schema for the connection.
|
|
|
176
176
|
def use_schema(self, schema: str) -> 'DatabaseConnectionManager'
|
|
177
177
|
```
|
|
178
178
|
|
|
179
|
-
*Note: Due to SQLAlchemy's design, for PostgreSQL
|
|
179
|
+
*Note: Due to SQLAlchemy's design, for PostgreSQL*, \`\` *should be set to the database name*.
|
|
180
180
|
|
|
181
181
|
#### use\_vcluster
|
|
182
182
|
|
|
@@ -194,7 +194,7 @@ Sets additional connection options.
|
|
|
194
194
|
def use_options(self, options: dict) -> 'DatabaseConnectionManager'
|
|
195
195
|
```
|
|
196
196
|
|
|
197
|
-
*Note: Due to SQLAlchemy's design, the PostgreSQL schema should be set to `undefined"})
|
|
197
|
+
*Note: Due to SQLAlchemy's design, the PostgreSQL schema should be set to* `undefined"})`
|
|
198
198
|
|
|
199
199
|
#### use\_query
|
|
200
200
|
|
|
@@ -306,21 +306,21 @@ from clickzetta_dbutils import get_active_engine
|
|
|
306
306
|
|
|
307
307
|
```
|
|
308
308
|
|
|
309
|
-
Option 1: Using
|
|
309
|
+
Option 1: Using get\_active\_engine:
|
|
310
310
|
|
|
311
311
|
```py
|
|
312
312
|
engine = get_active_engine("LAKEHOUSE_source_name",
|
|
313
|
-
vcluster="
|
|
313
|
+
vcluster="DEFAULT",
|
|
314
314
|
workspace="test-workspace",
|
|
315
315
|
schema="public")
|
|
316
316
|
|
|
317
317
|
```
|
|
318
318
|
|
|
319
|
-
Option 2: Using
|
|
319
|
+
Option 2: Using get\_active\_lakehouse\_engine:
|
|
320
320
|
|
|
321
321
|
```py
|
|
322
322
|
from clickzetta_dbutils import get_active_lakehouse_engine
|
|
323
|
-
engine = get_active_lakehouse_engine(vcluster="
|
|
323
|
+
engine = get_active_lakehouse_engine(vcluster="DEFAULT",
|
|
324
324
|
workspace="test-workspace")
|
|
325
325
|
with engine.connect() as conn:
|
|
326
326
|
results = conn.execute(text("select 1"))
|
|
@@ -354,3 +354,5 @@ python /tmp/db_utils_demo.py
|
|
|
354
354
|
3. When using a Lakehouse data source, the `vcluster` parameter is required. The Lakehouse data source uses the built-in Lakehouse data source visible under Management → Data Sources.
|
|
355
355
|
4. Data source connection details are handled securely to prevent plaintext password exposure.
|
|
356
356
|
5. Multiple data sources of different types can be used within the same node.
|
|
357
|
+
|
|
358
|
+
^
|