@clickzetta/cz-cli-darwin-x64 0.3.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/bin/cz-cli +0 -0
- package/bin/skills/cz-cli/SKILL.md +58 -0
- package/bin/skills/cz-cli/references/profile-setup.md +88 -0
- package/bin/skills/cz-cli-inner/SKILL.md +96 -0
- package/bin/skills/dt-creator/SKILL.md +15 -0
- package/bin/skills/dt-creator/references/dt-declaration-strategy.md +185 -0
- package/bin/skills/dt-creator/references/incremental-config-reference.md +429 -0
- package/bin/skills/dt-creator/references/refresh-history-guide.md +268 -0
- package/bin/skills/dt-creator/references/sql-limitations.md +80 -0
- package/bin/skills/dynamic-table-alter/SKILL.md +190 -0
- package/bin/skills/lakehouse-doc/SKILL.md +107 -0
- package/bin/skills/lakehouse-doc/references/.gitattributes +1 -0
- package/bin/skills/lakehouse-doc/references/.gitlab-ci.yml +11 -0
- package/bin/skills/lakehouse-doc/references/702bc8f656.md +387 -0
- package/bin/skills/lakehouse-doc/references/774c65e217.md +136 -0
- package/bin/skills/lakehouse-doc/references/9164fed65a.md +1 -0
- package/bin/skills/lakehouse-doc/references/AIGateway.md +3 -0
- package/bin/skills/lakehouse-doc/references/AI_COMPLETE.md +157 -0
- package/bin/skills/lakehouse-doc/references/AI_EMBEDDING.md +70 -0
- package/bin/skills/lakehouse-doc/references/AI_Gateway.md +255 -0
- package/bin/skills/lakehouse-doc/references/AI_eco.md +1 -0
- package/bin/skills/lakehouse-doc/references/AI_function_in_SQL.md +25 -0
- package/bin/skills/lakehouse-doc/references/AI_function_overview.md +25 -0
- package/bin/skills/lakehouse-doc/references/ALTER-EXTERNAL-TABLE.md +78 -0
- package/bin/skills/lakehouse-doc/references/ALTER-SCHEMA.md +85 -0
- package/bin/skills/lakehouse-doc/references/ALTER-TABLE-COLUMN.md +223 -0
- package/bin/skills/lakehouse-doc/references/ALTERTABLE.md +92 -0
- package/bin/skills/lakehouse-doc/references/ARRAY.md +99 -0
- package/bin/skills/lakehouse-doc/references/Account.md +2 -0
- package/bin/skills/lakehouse-doc/references/Analysis.md +1 -0
- package/bin/skills/lakehouse-doc/references/AnalyticsModernDataStack.md +390 -0
- package/bin/skills/lakehouse-doc/references/Application_list.md +26 -0
- package/bin/skills/lakehouse-doc/references/Approval.md +1 -0
- package/bin/skills/lakehouse-doc/references/Approval_list.md +61 -0
- package/bin/skills/lakehouse-doc/references/BIGINT.md +49 -0
- package/bin/skills/lakehouse-doc/references/BINARY.md +104 -0
- package/bin/skills/lakehouse-doc/references/BOOLEAN.md +47 -0
- package/bin/skills/lakehouse-doc/references/BP_AI_Function_Image2text.md +203 -0
- package/bin/skills/lakehouse-doc/references/BluepipeOracleLakehouse_DataSync.md +244 -0
- package/bin/skills/lakehouse-doc/references/CHAR.md +38 -0
- package/bin/skills/lakehouse-doc/references/CONNECTION.md +1 -0
- package/bin/skills/lakehouse-doc/references/COPY-INTO-Location.md +404 -0
- package/bin/skills/lakehouse-doc/references/COPY_INTO_Location.md +371 -0
- package/bin/skills/lakehouse-doc/references/CREAREUSER.md +42 -0
- package/bin/skills/lakehouse-doc/references/CREATE-BLOOMFILTER-INDEX.md +138 -0
- package/bin/skills/lakehouse-doc/references/CREATECONNECTION.md +11 -0
- package/bin/skills/lakehouse-doc/references/CREATEEXTERNAlLSCHEMA.md +290 -0
- package/bin/skills/lakehouse-doc/references/CREATEMATERIALIZEDVIEW.md +518 -0
- package/bin/skills/lakehouse-doc/references/CREATEROLE.md +71 -0
- package/bin/skills/lakehouse-doc/references/CREATESCHEMA.md +40 -0
- package/bin/skills/lakehouse-doc/references/CREATEVIEW.md +63 -0
- package/bin/skills/lakehouse-doc/references/CREATE_EXTERNATL_FUNCTION.md +219 -0
- package/bin/skills/lakehouse-doc/references/CTERevenueCohort.md +275 -0
- package/bin/skills/lakehouse-doc/references/ComputeResourceDDL.md +1 -0
- package/bin/skills/lakehouse-doc/references/Concepts.md +1 -0
- package/bin/skills/lakehouse-doc/references/Create_Embeding_Function.md +236 -0
- package/bin/skills/lakehouse-doc/references/Create_LLM_Function.md +242 -0
- package/bin/skills/lakehouse-doc/references/CreditScoringwithZettaparkandPythonMLlibraryNew.md +873 -0
- package/bin/skills/lakehouse-doc/references/DATE.md +50 -0
- package/bin/skills/lakehouse-doc/references/DDL.md +1 -0
- package/bin/skills/lakehouse-doc/references/DECIMAL.md +27 -0
- package/bin/skills/lakehouse-doc/references/DELETE.md +48 -0
- package/bin/skills/lakehouse-doc/references/DESC-INDEX.md +41 -0
- package/bin/skills/lakehouse-doc/references/DESC-JOB.md +31 -0
- package/bin/skills/lakehouse-doc/references/DESCCONNECTION.md +39 -0
- package/bin/skills/lakehouse-doc/references/DESCMATERIALIZEDVIEW.md +31 -0
- package/bin/skills/lakehouse-doc/references/DESCSCHEMAS.md +59 -0
- package/bin/skills/lakehouse-doc/references/DESCTABLE.md +105 -0
- package/bin/skills/lakehouse-doc/references/DESCVIEW.md +66 -0
- package/bin/skills/lakehouse-doc/references/DOUBLE.md +58 -0
- package/bin/skills/lakehouse-doc/references/DQL.md +1 -0
- package/bin/skills/lakehouse-doc/references/DROP-INDEX.md +29 -0
- package/bin/skills/lakehouse-doc/references/DROPCONNECTION.md +32 -0
- package/bin/skills/lakehouse-doc/references/DROPMATERIALIZEDVIEW.md +42 -0
- package/bin/skills/lakehouse-doc/references/DROPROLE.md +56 -0
- package/bin/skills/lakehouse-doc/references/DROPSCHEMA.md +37 -0
- package/bin/skills/lakehouse-doc/references/DROPTABLE.md +46 -0
- package/bin/skills/lakehouse-doc/references/DROPUSER.md +34 -0
- package/bin/skills/lakehouse-doc/references/DROPVIEW.md +33 -0
- package/bin/skills/lakehouse-doc/references/DataQuality.md +99 -0
- package/bin/skills/lakehouse-doc/references/DataSourceConfigGuide.md +1 -0
- package/bin/skills/lakehouse-doc/references/DataSource_ADBMySQL.md +35 -0
- package/bin/skills/lakehouse-doc/references/DataSource_ADB_PostgreSQL.md +36 -0
- package/bin/skills/lakehouse-doc/references/DataSource_AMQP.md +37 -0
- package/bin/skills/lakehouse-doc/references/DataSource_Amazon_DocumentDB.md +115 -0
- package/bin/skills/lakehouse-doc/references/DataSource_Amazon_OpenSearch.md +42 -0
- package/bin/skills/lakehouse-doc/references/DataSource_Aurora_MySQL.md +35 -0
- package/bin/skills/lakehouse-doc/references/DataSource_Aurora_PostgreSQL.md +36 -0
- package/bin/skills/lakehouse-doc/references/DataSource_AutoMQ.md +124 -0
- package/bin/skills/lakehouse-doc/references/DataSource_COS.md +31 -0
- package/bin/skills/lakehouse-doc/references/DataSource_ClickHouse.md +36 -0
- package/bin/skills/lakehouse-doc/references/DataSource_DB2.md +36 -0
- package/bin/skills/lakehouse-doc/references/DataSource_DM.md +35 -0
- package/bin/skills/lakehouse-doc/references/DataSource_Databricks.md +38 -0
- package/bin/skills/lakehouse-doc/references/DataSource_Doris.md +34 -0
- package/bin/skills/lakehouse-doc/references/DataSource_DynamoDB.md +37 -0
- package/bin/skills/lakehouse-doc/references/DataSource_ElasticSearch.md +30 -0
- package/bin/skills/lakehouse-doc/references/DataSource_Greenplum.md +36 -0
- package/bin/skills/lakehouse-doc/references/DataSource_HANA.md +53 -0
- package/bin/skills/lakehouse-doc/references/DataSource_HBase.md +29 -0
- package/bin/skills/lakehouse-doc/references/DataSource_Hive.md +52 -0
- package/bin/skills/lakehouse-doc/references/DataSource_Hologres.md +36 -0
- package/bin/skills/lakehouse-doc/references/DataSource_Kafka.md +32 -0
- package/bin/skills/lakehouse-doc/references/DataSource_MariaDB.md +36 -0
- package/bin/skills/lakehouse-doc/references/DataSource_MaxCompute.md +32 -0
- package/bin/skills/lakehouse-doc/references/DataSource_MongoDB.md +36 -0
- package/bin/skills/lakehouse-doc/references/DataSource_MySQL.md +36 -0
- package/bin/skills/lakehouse-doc/references/DataSource_OSS.md +31 -0
- package/bin/skills/lakehouse-doc/references/DataSource_Oracle.md +35 -0
- package/bin/skills/lakehouse-doc/references/DataSource_PorarDB.md +37 -0
- package/bin/skills/lakehouse-doc/references/DataSource_PostgreSQL.md +36 -0
- package/bin/skills/lakehouse-doc/references/DataSource_Redis.md +55 -0
- package/bin/skills/lakehouse-doc/references/DataSource_Redshift.md +49 -0
- package/bin/skills/lakehouse-doc/references/DataSource_RestApi.md +30 -0
- package/bin/skills/lakehouse-doc/references/DataSource_S3.md +25 -0
- package/bin/skills/lakehouse-doc/references/DataSource_SLS.md +31 -0
- package/bin/skills/lakehouse-doc/references/DataSource_StarRocks.md +35 -0
- package/bin/skills/lakehouse-doc/references/DataSource_TiDB.md +36 -0
- package/bin/skills/lakehouse-doc/references/Datalake_StorageConnection.md +12 -0
- package/bin/skills/lakehouse-doc/references/Datasource_SQLServer.md +36 -0
- package/bin/skills/lakehouse-doc/references/Datus_Lakehouse_Integrated_Guide.md +3 -0
- package/bin/skills/lakehouse-doc/references/Datus_Lakehouse_MCPServer.md +111 -0
- package/bin/skills/lakehouse-doc/references/Dify_Integreated_with_LakehouseMCPServer.md +71 -0
- package/bin/skills/lakehouse-doc/references/ELTModernDataStack.md +497 -0
- package/bin/skills/lakehouse-doc/references/ELT_practice.md +1 -0
- package/bin/skills/lakehouse-doc/references/EXPLAIN.md +92 -0
- package/bin/skills/lakehouse-doc/references/EXTERNALFUNCITON.md +1 -0
- package/bin/skills/lakehouse-doc/references/EXTERNALFUNCTION.md +0 -0
- package/bin/skills/lakehouse-doc/references/EXTERNALFUNCTION/345/274/200/345/217/221/346/214/207/345/215/227.md +142 -0
- package/bin/skills/lakehouse-doc/references/EXTERNALSCHEMA.md +1 -0
- package/bin/skills/lakehouse-doc/references/EXTERNALSCHMEA.md +94 -0
- package/bin/skills/lakehouse-doc/references/ExternalFunctionDevGuideJava.md +556 -0
- package/bin/skills/lakehouse-doc/references/FLOAT.md +33 -0
- package/bin/skills/lakehouse-doc/references/FeatureEngineeringForExpandingCustomerFeatureswithZettapark.md +427 -0
- package/bin/skills/lakehouse-doc/references/FileCommand.md +1 -0
- package/bin/skills/lakehouse-doc/references/FileFunction.md +1 -0
- package/bin/skills/lakehouse-doc/references/FineBI.md +195 -0
- package/bin/skills/lakehouse-doc/references/Full_Text_Search.md +1 -0
- package/bin/skills/lakehouse-doc/references/GET.md +63 -0
- package/bin/skills/lakehouse-doc/references/GET_PRESIGNED_URL.md +91 -0
- package/bin/skills/lakehouse-doc/references/GrantPriveleges.md +113 -0
- package/bin/skills/lakehouse-doc/references/Hive_connection.md +50 -0
- package/bin/skills/lakehouse-doc/references/IDENTITY-Column.md +74 -0
- package/bin/skills/lakehouse-doc/references/INSERT.md +186 -0
- package/bin/skills/lakehouse-doc/references/INT.md +36 -0
- package/bin/skills/lakehouse-doc/references/INTERVAL.md +143 -0
- package/bin/skills/lakehouse-doc/references/Ingesting_Data_from_Alibaba_Cloud_Data_Lake_into_Lakehouse.md +976 -0
- package/bin/skills/lakehouse-doc/references/Ingestion.md +1 -0
- package/bin/skills/lakehouse-doc/references/JDBC-Driver.md +67 -0
- package/bin/skills/lakehouse-doc/references/JDBC_MindsDB_ML_LLM.md +237 -0
- package/bin/skills/lakehouse-doc/references/JOIN.md +204 -0
- package/bin/skills/lakehouse-doc/references/JSON.md +423 -0
- package/bin/skills/lakehouse-doc/references/JSON_DataType.md +49 -0
- package/bin/skills/lakehouse-doc/references/KAFKA_Storage_connection.md +1 -0
- package/bin/skills/lakehouse-doc/references/Kafka_connection.md +36 -0
- package/bin/skills/lakehouse-doc/references/Key_Concepts.md +112 -0
- package/bin/skills/lakehouse-doc/references/LATERALVIEW.md +78 -0
- package/bin/skills/lakehouse-doc/references/Lakehouse-client-repository.md +11 -0
- package/bin/skills/lakehouse-doc/references/LakehouseAI.md +0 -0
- package/bin/skills/lakehouse-doc/references/LakehouseAI_overview.md +16 -0
- package/bin/skills/lakehouse-doc/references/LakehouseAI/346/246/202/350/277/260.md +0 -0
- package/bin/skills/lakehouse-doc/references/LakehouseDataGPTTour.md +64 -0
- package/bin/skills/lakehouse-doc/references/LakehouseMCPServer.md +1 -0
- package/bin/skills/lakehouse-doc/references/LakehouseMCPServer_intro.md +493 -0
- package/bin/skills/lakehouse-doc/references/LakehousePythonZettapark.md +1 -0
- package/bin/skills/lakehouse-doc/references/LakehouseStudioTour.md +185 -0
- package/bin/skills/lakehouse-doc/references/Lakehouse_Index_Best_Practice.md +681 -0
- package/bin/skills/lakehouse-doc/references/Lakehouse_Insight.md +104 -0
- package/bin/skills/lakehouse-doc/references/Lakehouse_Platform_Release_Note.md +1 -0
- package/bin/skills/lakehouse-doc/references/Lakehouse_Studio_101.md +1 -0
- package/bin/skills/lakehouse-doc/references/Lakehouse_Studio_Release_Note.md +1 -0
- package/bin/skills/lakehouse-doc/references/Lakehouse_Zilliz_MakeDataReadyforBIandAI.md +228 -0
- package/bin/skills/lakehouse-doc/references/Langchain_plug_installation.md +244 -0
- package/bin/skills/lakehouse-doc/references/Langchain_plug_quick_start.md +225 -0
- package/bin/skills/lakehouse-doc/references/Langchain_plugins_overview.md +406 -0
- package/bin/skills/lakehouse-doc/references/Limitation.md +8 -0
- package/bin/skills/lakehouse-doc/references/LoggingIn.md +67 -0
- package/bin/skills/lakehouse-doc/references/Logstash.md +172 -0
- package/bin/skills/lakehouse-doc/references/MAP.md +42 -0
- package/bin/skills/lakehouse-doc/references/MATERIALIZEDVIEW.md +112 -0
- package/bin/skills/lakehouse-doc/references/MCPServers.md +267 -0
- package/bin/skills/lakehouse-doc/references/MERGE.md +498 -0
- package/bin/skills/lakehouse-doc/references/ManageAccounts.md +184 -0
- package/bin/skills/lakehouse-doc/references/ManagingFilesonDatalakeVolumewithZettapark.md +145 -0
- package/bin/skills/lakehouse-doc/references/MigrateSnowflakeRealtimeETLPipelinetoClickzettaLakehouse.md +865 -0
- package/bin/skills/lakehouse-doc/references/Migrate_Spark_DataEngineeringBestPractices_Project_to_Lakehouse.md +292 -0
- package/bin/skills/lakehouse-doc/references/ModernDataStackWithEcosystemTools.md +1 -0
- package/bin/skills/lakehouse-doc/references/N8N_AI_Workflow_Integration.md +1 -0
- package/bin/skills/lakehouse-doc/references/N8N_Integrated_with_LakehouseMCPServer.md +128 -0
- package/bin/skills/lakehouse-doc/references/Notebook.md +109 -0
- package/bin/skills/lakehouse-doc/references/NotesandGuidelinesforUsingPartitionTables.md +1627 -0
- package/bin/skills/lakehouse-doc/references/OPTIMIZE.md +80 -0
- package/bin/skills/lakehouse-doc/references/OptimizingComputingResources.md +1 -0
- package/bin/skills/lakehouse-doc/references/Overview.md +1 -0
- package/bin/skills/lakehouse-doc/references/PUT.md +70 -0
- package/bin/skills/lakehouse-doc/references/PerformingVectorandScalarRetrievalinheSameTableinLakehouse.md +84 -0
- package/bin/skills/lakehouse-doc/references/Permission_application.md +43 -0
- package/bin/skills/lakehouse-doc/references/PowerBI.md +113 -0
- package/bin/skills/lakehouse-doc/references/PythonSDKVersionHistory.md +24 -0
- package/bin/skills/lakehouse-doc/references/PythonSample_put_gharchive2oss.md +153 -0
- package/bin/skills/lakehouse-doc/references/PythonSample_put_github_rt_events.md +336 -0
- package/bin/skills/lakehouse-doc/references/PythonSqlAlchemyVersionHistory.md +23 -0
- package/bin/skills/lakehouse-doc/references/PythonTaskDev.md +1 -0
- package/bin/skills/lakehouse-doc/references/Python_Task.md +28 -0
- package/bin/skills/lakehouse-doc/references/Query_SnowflakeOpenCatalog_Icebergtable.md +114 -0
- package/bin/skills/lakehouse-doc/references/QuickStartwithCopycommand.md +79 -0
- package/bin/skills/lakehouse-doc/references/README.md +1 -0
- package/bin/skills/lakehouse-doc/references/REFRESH.md +37 -0
- package/bin/skills/lakehouse-doc/references/REMOTEFUNCTION.md +1 -0
- package/bin/skills/lakehouse-doc/references/RN_2023-08-07.md +67 -0
- package/bin/skills/lakehouse-doc/references/RN_2023-09-05.md +75 -0
- package/bin/skills/lakehouse-doc/references/RN_2023-09-18.md +50 -0
- package/bin/skills/lakehouse-doc/references/RN_2023-09-20.md +55 -0
- package/bin/skills/lakehouse-doc/references/RN_2023-10-25.md +102 -0
- package/bin/skills/lakehouse-doc/references/RN_2023-11-09.md +84 -0
- package/bin/skills/lakehouse-doc/references/RN_2023-12-25.md +84 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-01-05.md +78 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-02-05.md +87 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-03-22.md +76 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-04-10.md +61 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-04-16.md +38 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-05-10.md +47 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-05-15.md +43 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-05-24.md +143 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-06-06.md +59 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-06-07.md +71 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-06-27.md +55 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-07-22.md +121 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-07-24.md +58 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-08-07.md +42 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-09-26.md +106 -0
- package/bin/skills/lakehouse-doc/references/RN_2024-10-15.md +49 -0
- package/bin/skills/lakehouse-doc/references/RN_2024_11_11.md +50 -0
- package/bin/skills/lakehouse-doc/references/RN_2024_12_12.md +52 -0
- package/bin/skills/lakehouse-doc/references/RN_2024_12_25.md +40 -0
- package/bin/skills/lakehouse-doc/references/RN_2025-03-05.md +68 -0
- package/bin/skills/lakehouse-doc/references/RN_2025-04-01.md +74 -0
- package/bin/skills/lakehouse-doc/references/RN_2025-05-20.md +90 -0
- package/bin/skills/lakehouse-doc/references/RN_2025-07-03.md +100 -0
- package/bin/skills/lakehouse-doc/references/RN_2025-08-25.md +106 -0
- package/bin/skills/lakehouse-doc/references/RN_2025_03_03.md +141 -0
- package/bin/skills/lakehouse-doc/references/RN_2025_04_22.md +110 -0
- package/bin/skills/lakehouse-doc/references/RN_2025_07_15.md +60 -0
- package/bin/skills/lakehouse-doc/references/RN_2025_10_23.md +85 -0
- package/bin/skills/lakehouse-doc/references/RN_2025_10_30.md +68 -0
- package/bin/skills/lakehouse-doc/references/RN_2025_12_17.md +71 -0
- package/bin/skills/lakehouse-doc/references/RN_2026_1_30-2.0.0.md +43 -0
- package/bin/skills/lakehouse-doc/references/RN_LH_2025_12_30.md +73 -0
- package/bin/skills/lakehouse-doc/references/RN_LH_2026_03_13.md +47 -0
- package/bin/skills/lakehouse-doc/references/Refactor_ELT_practice.md +241 -0
- package/bin/skills/lakehouse-doc/references/RemoteFunctionAsUDF.md +1 -0
- package/bin/skills/lakehouse-doc/references/RemoteFunctionBestPractice.md +350 -0
- package/bin/skills/lakehouse-doc/references/RemoteFunctionDevGuidePython3.md +571 -0
- package/bin/skills/lakehouse-doc/references/RemoteFunctionOnACR.md +249 -0
- package/bin/skills/lakehouse-doc/references/RemoteFunctionintro.md +54 -0
- package/bin/skills/lakehouse-doc/references/RemoteFunction/344/273/213/347/273/215.md +1 -0
- package/bin/skills/lakehouse-doc/references/RemoteFunction/345/274/200/345/217/221/346/214/207/345/215/227Python3.md +1 -0
- package/bin/skills/lakehouse-doc/references/RemoteFunction/346/234/200/344/275/263/345/256/236/350/267/265.md +1 -0
- package/bin/skills/lakehouse-doc/references/RevokePriveleges.md +98 -0
- package/bin/skills/lakehouse-doc/references/SCHEMA.md +48 -0
- package/bin/skills/lakehouse-doc/references/SCHEMADDL.md +0 -0
- package/bin/skills/lakehouse-doc/references/SHOW-INDEX.md +22 -0
- package/bin/skills/lakehouse-doc/references/SHOWCONNECTIONS.md +44 -0
- package/bin/skills/lakehouse-doc/references/SHOWFUNCTIONS.md +38 -0
- package/bin/skills/lakehouse-doc/references/SHOWGRANTS.md +62 -0
- package/bin/skills/lakehouse-doc/references/SHOWROLES.md +59 -0
- package/bin/skills/lakehouse-doc/references/SHOWTABLES.md +46 -0
- package/bin/skills/lakehouse-doc/references/SHOWUSERS.md +26 -0
- package/bin/skills/lakehouse-doc/references/SMALLINT.md +48 -0
- package/bin/skills/lakehouse-doc/references/SQL_CREATE_TABLE_GUIDE.md +1210 -0
- package/bin/skills/lakehouse-doc/references/SQL_DML_Considerations.md +601 -0
- package/bin/skills/lakehouse-doc/references/SQL_Join_Guide.md +655 -0
- package/bin/skills/lakehouse-doc/references/SQL_SELECT_Considerations.md +1818 -0
- package/bin/skills/lakehouse-doc/references/SQL_With_CTE_Guide.md +1510 -0
- package/bin/skills/lakehouse-doc/references/SQL_customers.md +74 -0
- package/bin/skills/lakehouse-doc/references/SQL_revenue.md +31 -0
- package/bin/skills/lakehouse-doc/references/STRING.md +80 -0
- package/bin/skills/lakehouse-doc/references/STRUCT.md +33 -0
- package/bin/skills/lakehouse-doc/references/SUMMARY.md +1279 -0
- package/bin/skills/lakehouse-doc/references/Security_system_inventory_and_optimization_based_Information_Schema.md +412 -0
- package/bin/skills/lakehouse-doc/references/Server_data_for_AI.md +15 -0
- package/bin/skills/lakehouse-doc/references/SlowlyChangingDimensionsInLakehouseUsingStreamsandTasks.md +616 -0
- package/bin/skills/lakehouse-doc/references/Spark_Lakehouse_iceberg_REST.md +151 -0
- package/bin/skills/lakehouse-doc/references/StudioDI_PrivateLinkVPC_fromRDS.md +105 -0
- package/bin/skills/lakehouse-doc/references/Supported_Cloud_Platforms.md +40 -0
- package/bin/skills/lakehouse-doc/references/TABLE.md +49 -0
- package/bin/skills/lakehouse-doc/references/TIMESTAMP.md +56 -0
- package/bin/skills/lakehouse-doc/references/TIMETRAVEL.md +207 -0
- package/bin/skills/lakehouse-doc/references/TINYINT.md +63 -0
- package/bin/skills/lakehouse-doc/references/TPC-H100G_experience.md +49 -0
- package/bin/skills/lakehouse-doc/references/TRUNCATE.md +144 -0
- package/bin/skills/lakehouse-doc/references/TableDesign.md +270 -0
- package/bin/skills/lakehouse-doc/references/TableauConnectToLakehouse.md +64 -0
- package/bin/skills/lakehouse-doc/references/Tutorials.md +1 -0
- package/bin/skills/lakehouse-doc/references/UNDROP-TABLE.md +163 -0
- package/bin/skills/lakehouse-doc/references/UPDATE.md +70 -0
- package/bin/skills/lakehouse-doc/references/USESCHEMA.md +53 -0
- package/bin/skills/lakehouse-doc/references/UnifiedWorkflowIntro.md +31 -0
- package/bin/skills/lakehouse-doc/references/UnifiedWorkflow_demo.md +175 -0
- package/bin/skills/lakehouse-doc/references/Unstructured_io.md +735 -0
- package/bin/skills/lakehouse-doc/references/VARCHARleghth.md +42 -0
- package/bin/skills/lakehouse-doc/references/VIEW.md +47 -0
- package/bin/skills/lakehouse-doc/references/Volume_LIST.md +52 -0
- package/bin/skills/lakehouse-doc/references/WINDOWFUNCTION.md +561 -0
- package/bin/skills/lakehouse-doc/references/WITH.md +41 -0
- package/bin/skills/lakehouse-doc/references/ZettaparkQuickStart.md +453 -0
- package/bin/skills/lakehouse-doc/references/Zettapark_Data_Engineering_Demo.md +348 -0
- package/bin/skills/lakehouse-doc/references/a_comprehensive_guide_to_ingesting_data_into_clickzetta_lakehouse.md +66 -0
- package/bin/skills/lakehouse-doc/references/access-control-configration.md +249 -0
- package/bin/skills/lakehouse-doc/references/access-control-general.md +82 -0
- package/bin/skills/lakehouse-doc/references/access-control.md +240 -0
- package/bin/skills/lakehouse-doc/references/account_user_management.md +105 -0
- package/bin/skills/lakehouse-doc/references/accountfunds.md +87 -0
- package/bin/skills/lakehouse-doc/references/agg_function.md +1 -0
- package/bin/skills/lakehouse-doc/references/ai_ready_data_overview.md +13 -0
- package/bin/skills/lakehouse-doc/references/airbyte.md +95 -0
- package/bin/skills/lakehouse-doc/references/alert.md +143 -0
- package/bin/skills/lakehouse-doc/references/alicloud-arn-externalid.md +51 -0
- package/bin/skills/lakehouse-doc/references/alicloud_byos_configration.md +129 -0
- package/bin/skills/lakehouse-doc/references/aliyun_storage_connection.md +135 -0
- package/bin/skills/lakehouse-doc/references/alter-dynamic-table.md +375 -0
- package/bin/skills/lakehouse-doc/references/alter-external-schema.md +20 -0
- package/bin/skills/lakehouse-doc/references/alter-materialzied-view.md +238 -0
- package/bin/skills/lakehouse-doc/references/alter-share.md +43 -0
- package/bin/skills/lakehouse-doc/references/alter-user.md +13 -0
- package/bin/skills/lakehouse-doc/references/alter-vcluster.md +134 -0
- package/bin/skills/lakehouse-doc/references/alter-worksapce.md +55 -0
- package/bin/skills/lakehouse-doc/references/alter.md +35 -0
- package/bin/skills/lakehouse-doc/references/analysis_internet_data_nyc_green_data.md +449 -0
- package/bin/skills/lakehouse-doc/references/analytics_cluster_best_practices.md +377 -0
- package/bin/skills/lakehouse-doc/references/analyze-table.md +58 -0
- package/bin/skills/lakehouse-doc/references/array_size.md +34 -0
- package/bin/skills/lakehouse-doc/references/authentication.md +53 -0
- package/bin/skills/lakehouse-doc/references/authoritymanagement.md +1 -0
- package/bin/skills/lakehouse-doc/references/auto-index.md +57 -0
- package/bin/skills/lakehouse-doc/references/aws_storage_connection.md +114 -0
- package/bin/skills/lakehouse-doc/references/backfilling_data.md +60 -0
- package/bin/skills/lakehouse-doc/references/batch_sync.md +54 -0
- package/bin/skills/lakehouse-doc/references/batch_sync_Sop.md +135 -0
- package/bin/skills/lakehouse-doc/references/batchloadparquertfileintoLakehouse.md +79 -0
- package/bin/skills/lakehouse-doc/references/bestpractice_bazhuanyu.md +1 -0
- package/bin/skills/lakehouse-doc/references/billing.md +62 -0
- package/bin/skills/lakehouse-doc/references/bitmap-type.md +524 -0
- package/bin/skills/lakehouse-doc/references/bitmap_uba_guide.md +1190 -0
- package/bin/skills/lakehouse-doc/references/bloomfilter-summary.md +164 -0
- package/bin/skills/lakehouse-doc/references/book.json +17 -0
- package/bin/skills/lakehouse-doc/references/bring_your_own_storage.md +1 -0
- package/bin/skills/lakehouse-doc/references/build-inverted-index.md +27 -0
- package/bin/skills/lakehouse-doc/references/build_rag_with_langchain.md +616 -0
- package/bin/skills/lakehouse-doc/references/bulkload-summary.md +37 -0
- package/bin/skills/lakehouse-doc/references/bulkloadv1-java-sdk.md +178 -0
- package/bin/skills/lakehouse-doc/references/bulkloadv1-python-sdk.md +169 -0
- package/bin/skills/lakehouse-doc/references/byos_general.md +165 -0
- package/bin/skills/lakehouse-doc/references/byos_tencentcloud_configration.md +138 -0
- package/bin/skills/lakehouse-doc/references/cache-command.md +39 -0
- package/bin/skills/lakehouse-doc/references/cancel-job.md +51 -0
- package/bin/skills/lakehouse-doc/references/cardinality_array.md +45 -0
- package/bin/skills/lakehouse-doc/references/charge_analysis_with_lakehouse_mcp_server.md +393 -0
- package/bin/skills/lakehouse-doc/references/clone-doc.md +111 -0
- package/bin/skills/lakehouse-doc/references/cloud_object_storage.md +1 -0
- package/bin/skills/lakehouse-doc/references/cluster-table-guide.md +68 -0
- package/bin/skills/lakehouse-doc/references/cluster-table.md +64 -0
- package/bin/skills/lakehouse-doc/references/composite_task.md +178 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_3rd_tools.md +11 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_dbv_sql_put.md +48 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_environment_and_data_generate.md +627 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_javasdk_buckload_realtime.md +740 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_kafka_realtime_sync.md +71 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_local_file_into_table_by_studio.md +64 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_overview.md +66 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_pipe_kafka.md +7 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_pipe_oss.md +7 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_studio_batchload_public_network.md +52 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_studio_python_node.md +111 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_studio_realtime_cdc_public_network.md +249 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_studio_sql_insert.md +180 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_zettapark_put_file_to_lake.md +206 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_zettapark_save_as_table.md +79 -0
- package/bin/skills/lakehouse-doc/references/comprehensive_guide_to_ingesting_zettapark_sql_insert.md +113 -0
- package/bin/skills/lakehouse-doc/references/computation.md +6 -0
- package/bin/skills/lakehouse-doc/references/concurrency_scaling.md +57 -0
- package/bin/skills/lakehouse-doc/references/config-datasource.md +79 -0
- package/bin/skills/lakehouse-doc/references/config_volume_dify_storage.md +254 -0
- package/bin/skills/lakehouse-doc/references/connect-with-cli.md +155 -0
- package/bin/skills/lakehouse-doc/references/connect_to_Lakehouse.md +1 -0
- package/bin/skills/lakehouse-doc/references/connection-guide.md +61 -0
- package/bin/skills/lakehouse-doc/references/continue-job.md +260 -0
- package/bin/skills/lakehouse-doc/references/conversational_analytics_datagpt.md +1 -0
- package/bin/skills/lakehouse-doc/references/copy-into-table.md +398 -0
- package/bin/skills/lakehouse-doc/references/cos_storage_connection.md +73 -0
- package/bin/skills/lakehouse-doc/references/cos_volume_creation.md +39 -0
- package/bin/skills/lakehouse-doc/references/cost_management.md +1 -0
- package/bin/skills/lakehouse-doc/references/create-api-connection.md +363 -0
- package/bin/skills/lakehouse-doc/references/create-catalog-connection.md +220 -0
- package/bin/skills/lakehouse-doc/references/create-dynamic-table.md +910 -0
- package/bin/skills/lakehouse-doc/references/create-external-catalog.md +305 -0
- package/bin/skills/lakehouse-doc/references/create-external-table.md +78 -0
- package/bin/skills/lakehouse-doc/references/create-hive-catalog.md +77 -0
- package/bin/skills/lakehouse-doc/references/create-inverted-index.md +163 -0
- package/bin/skills/lakehouse-doc/references/create-kafka-external.md +300 -0
- package/bin/skills/lakehouse-doc/references/create-schema-from-share.md +45 -0
- package/bin/skills/lakehouse-doc/references/create-share.md +46 -0
- package/bin/skills/lakehouse-doc/references/create-sql-function.md +120 -0
- package/bin/skills/lakehouse-doc/references/create-storage-connection.md +346 -0
- package/bin/skills/lakehouse-doc/references/create-synonym.md +75 -0
- package/bin/skills/lakehouse-doc/references/create-table-ddl.md +405 -0
- package/bin/skills/lakehouse-doc/references/create-table-stream.md +226 -0
- package/bin/skills/lakehouse-doc/references/create-vector-index.md +115 -0
- package/bin/skills/lakehouse-doc/references/create.md +46 -0
- package/bin/skills/lakehouse-doc/references/create_cluster.md +121 -0
- package/bin/skills/lakehouse-doc/references/creating_alicloud_privatelinkendpoint.md +37 -0
- package/bin/skills/lakehouse-doc/references/creating_alicloud_privatelinkservice.md +31 -0
- package/bin/skills/lakehouse-doc/references/creating_tencentcloud_privatelinkendpoint.md +33 -0
- package/bin/skills/lakehouse-doc/references/creating_tencentcloud_privatelinkservice.md +19 -0
- package/bin/skills/lakehouse-doc/references/czguide-intro-to-cdc-using-clickzetta-rtsync-dynamic-tables.md +717 -0
- package/bin/skills/lakehouse-doc/references/data-catalog.md +1 -0
- package/bin/skills/lakehouse-doc/references/data-integration-intro.md +60 -0
- package/bin/skills/lakehouse-doc/references/data-integration.md +10 -0
- package/bin/skills/lakehouse-doc/references/data-lifecycle.md +46 -0
- package/bin/skills/lakehouse-doc/references/data-load-summary.md +71 -0
- package/bin/skills/lakehouse-doc/references/data-mamager-tool.md +1 -0
- package/bin/skills/lakehouse-doc/references/data-recover.md +52 -0
- package/bin/skills/lakehouse-doc/references/data-type.md +1 -0
- package/bin/skills/lakehouse-doc/references/data-types-timestamp-ntz.md +139 -0
- package/bin/skills/lakehouse-doc/references/data.md +1 -0
- package/bin/skills/lakehouse-doc/references/data_catalog.md +106 -0
- package/bin/skills/lakehouse-doc/references/data_clean_with_sql.md +406 -0
- package/bin/skills/lakehouse-doc/references/data_ecosystem.md +1 -0
- package/bin/skills/lakehouse-doc/references/data_ops.md +7 -0
- package/bin/skills/lakehouse-doc/references/data_org.md +1 -0
- package/bin/skills/lakehouse-doc/references/data_privacy.md +50 -0
- package/bin/skills/lakehouse-doc/references/data_result_profile.md +22 -0
- package/bin/skills/lakehouse-doc/references/data_security.md +1 -0
- package/bin/skills/lakehouse-doc/references/data_sharing_between_accounts_guide.md +331 -0
- package/bin/skills/lakehouse-doc/references/data_transfer_datalake.md +1 -0
- package/bin/skills/lakehouse-doc/references/data_visualization.md +96 -0
- package/bin/skills/lakehouse-doc/references/databricks_yunqi_integration_guide_v2.md +811 -0
- package/bin/skills/lakehouse-doc/references/datagpt_bestpractice.md +1 -0
- package/bin/skills/lakehouse-doc/references/datagpt_data_source.md +58 -0
- package/bin/skills/lakehouse-doc/references/datagpt_get_accurate_answers.md +34 -0
- package/bin/skills/lakehouse-doc/references/datagpt_intro.md +1 -0
- package/bin/skills/lakehouse-doc/references/datagpt_quickstart.md +94 -0
- package/bin/skills/lakehouse-doc/references/datagpt_tutorial.md +1 -0
- package/bin/skills/lakehouse-doc/references/datalake_FAQ.md +54 -0
- package/bin/skills/lakehouse-doc/references/datalake_overview.md +17 -0
- package/bin/skills/lakehouse-doc/references/datalake_privilege.md +55 -0
- package/bin/skills/lakehouse-doc/references/datalake_query_ingest.md +18 -0
- package/bin/skills/lakehouse-doc/references/datalake_unstructure_data.md +3 -0
- package/bin/skills/lakehouse-doc/references/datalake_volume.md +92 -0
- package/bin/skills/lakehouse-doc/references/datalake_volume_anlytics.md +1 -0
- package/bin/skills/lakehouse-doc/references/datalake_volume_object.md +1 -0
- package/bin/skills/lakehouse-doc/references/dataops_practice.md +105 -0
- package/bin/skills/lakehouse-doc/references/datasharing.md +322 -0
- package/bin/skills/lakehouse-doc/references/datasharing_catalog.md +1 -0
- package/bin/skills/lakehouse-doc/references/datasource_ip_whitelist.md +93 -0
- package/bin/skills/lakehouse-doc/references/datasources.md +62 -0
- package/bin/skills/lakehouse-doc/references/datatype-cast.md +105 -0
- package/bin/skills/lakehouse-doc/references/datatype-conversion.md +85 -0
- package/bin/skills/lakehouse-doc/references/datetime_patterns.md +61 -0
- package/bin/skills/lakehouse-doc/references/datus_lakehouse_installation.md +376 -0
- package/bin/skills/lakehouse-doc/references/datus_lakehouse_solution_overview.md +148 -0
- package/bin/skills/lakehouse-doc/references/db_dw_connection.md +1 -0
- package/bin/skills/lakehouse-doc/references/default-value.md +89 -0
- package/bin/skills/lakehouse-doc/references/delta-lake.md +185 -0
- package/bin/skills/lakehouse-doc/references/desc-catalog-table.md +33 -0
- package/bin/skills/lakehouse-doc/references/desc-catalog.md +31 -0
- package/bin/skills/lakehouse-doc/references/desc-dynamic-table.md +62 -0
- package/bin/skills/lakehouse-doc/references/desc-external-schemas.md +66 -0
- package/bin/skills/lakehouse-doc/references/desc-external-table.md +70 -0
- package/bin/skills/lakehouse-doc/references/desc-function.md +16 -0
- package/bin/skills/lakehouse-doc/references/desc-history-dynamic-table.md +50 -0
- package/bin/skills/lakehouse-doc/references/desc-history-table.md +73 -0
- package/bin/skills/lakehouse-doc/references/desc-history.md +73 -0
- package/bin/skills/lakehouse-doc/references/desc-share.md +59 -0
- package/bin/skills/lakehouse-doc/references/desc-table-stream.md +44 -0
- package/bin/skills/lakehouse-doc/references/desc-vcluster.md +42 -0
- package/bin/skills/lakehouse-doc/references/describe.md +38 -0
- package/bin/skills/lakehouse-doc/references/dify_config_lakehouse_as_vectordb.md +286 -0
- package/bin/skills/lakehouse-doc/references/dify_yunqilakehouse_integration_overview.md +188 -0
- package/bin/skills/lakehouse-doc/references/discovery_analysis_data_in_json_file_on_external_volume.md +625 -0
- package/bin/skills/lakehouse-doc/references/discovery_analysis_data_in_parquert_file_on_external_volume.md +599 -0
- package/bin/skills/lakehouse-doc/references/download-data.md +1 -0
- package/bin/skills/lakehouse-doc/references/drop-dynamic-table.md +46 -0
- package/bin/skills/lakehouse-doc/references/drop-external-schema.md +44 -0
- package/bin/skills/lakehouse-doc/references/drop-external-table.md +43 -0
- package/bin/skills/lakehouse-doc/references/drop-function.md +36 -0
- package/bin/skills/lakehouse-doc/references/drop-share.md +43 -0
- package/bin/skills/lakehouse-doc/references/drop-synonym.md +35 -0
- package/bin/skills/lakehouse-doc/references/drop-table-stream.md +42 -0
- package/bin/skills/lakehouse-doc/references/drop-vcluster.md +52 -0
- package/bin/skills/lakehouse-doc/references/drop.md +32 -0
- package/bin/skills/lakehouse-doc/references/dynamic-mask.md +201 -0
- package/bin/skills/lakehouse-doc/references/dynamic-table-incre.md +62 -0
- package/bin/skills/lakehouse-doc/references/dynamic-table-introduce.md +339 -0
- package/bin/skills/lakehouse-doc/references/dynamicTable-DML-sql.md +52 -0
- package/bin/skills/lakehouse-doc/references/dynamicTable-dml.md +48 -0
- package/bin/skills/lakehouse-doc/references/dynamicTable-parmaters.md +425 -0
- package/bin/skills/lakehouse-doc/references/dynamic_table_summary.md +366 -0
- package/bin/skills/lakehouse-doc/references/dynamic_table_task.md +73 -0
- package/bin/skills/lakehouse-doc/references/dynamic_table_using_studio.md +159 -0
- package/bin/skills/lakehouse-doc/references/dynamictable.md +56 -0
- package/bin/skills/lakehouse-doc/references/eco_integration/Zeppelin.md +84 -0
- package/bin/skills/lakehouse-doc/references/eco_integration/airbyte.md +75 -0
- package/bin/skills/lakehouse-doc/references/eco_integration/datagrip-lakehouse.md +56 -0
- package/bin/skills/lakehouse-doc/references/eco_integration/datax.md +154 -0
- package/bin/skills/lakehouse-doc/references/eco_integration/dbeaver-lakehouse.md +67 -0
- package/bin/skills/lakehouse-doc/references/eco_integration/dbt.md +139 -0
- package/bin/skills/lakehouse-doc/references/eco_integration/rath.md +87 -0
- package/bin/skills/lakehouse-doc/references/eco_integration/sqlline.md +82 -0
- package/bin/skills/lakehouse-doc/references/eco_integration/sqlworkbench-j-lakehouse.md +54 -0
- package/bin/skills/lakehouse-doc/references/eco_integration/streamlit.md +117 -0
- package/bin/skills/lakehouse-doc/references/eco_integration/superset.md +109 -0
- package/bin/skills/lakehouse-doc/references/eco_integration/trino.md +75 -0
- package/bin/skills/lakehouse-doc/references/ecosystem-all.md +24 -0
- package/bin/skills/lakehouse-doc/references/export_data_with_data-integration.md +3 -0
- package/bin/skills/lakehouse-doc/references/external-Volume.md +10 -0
- package/bin/skills/lakehouse-doc/references/external-catalog-summary.md +42 -0
- package/bin/skills/lakehouse-doc/references/external-function-summary.md +0 -0
- package/bin/skills/lakehouse-doc/references/external-hudi-table.md +187 -0
- package/bin/skills/lakehouse-doc/references/external-table-guide.md +96 -0
- package/bin/skills/lakehouse-doc/references/external_object_user_guide.md +298 -0
- package/bin/skills/lakehouse-doc/references/external_volume.md +1 -0
- package/bin/skills/lakehouse-doc/references/f6fc6447ee.md +151 -0
- package/bin/skills/lakehouse-doc/references/federation-query.md +1 -0
- package/bin/skills/lakehouse-doc/references/finebi-mysql.md +104 -0
- package/bin/skills/lakehouse-doc/references/flink-write-connector.md +695 -0
- package/bin/skills/lakehouse-doc/references/from_lakehouse_to_volume.md +98 -0
- package/bin/skills/lakehouse-doc/references/from_volume_to_table.md +45 -0
- package/bin/skills/lakehouse-doc/references/fulltext_indexes_guide.md +1180 -0
- package/bin/skills/lakehouse-doc/references/generated-column.md +113 -0
- package/bin/skills/lakehouse-doc/references/generated_columns_guide.md +847 -0
- package/bin/skills/lakehouse-doc/references/geospatial_analysis.md +558 -0
- package/bin/skills/lakehouse-doc/references/get-started-with-sample-data.md +83 -0
- package/bin/skills/lakehouse-doc/references/getting_started_with_vcluster_for_processing_analytics.md +471 -0
- package/bin/skills/lakehouse-doc/references/grant-to-share.md +55 -0
- package/bin/skills/lakehouse-doc/references/grant-user-privileges.md +100 -0
- package/bin/skills/lakehouse-doc/references/groupby.md +1260 -0
- package/bin/skills/lakehouse-doc/references/guides-overview-connecting.md +46 -0
- package/bin/skills/lakehouse-doc/references/ide.md +2 -0
- package/bin/skills/lakehouse-doc/references/ifnull.md +72 -0
- package/bin/skills/lakehouse-doc/references/ilike.md +89 -0
- package/bin/skills/lakehouse-doc/references/import_data_with_data-integration.md +3 -0
- package/bin/skills/lakehouse-doc/references/importdatabypythonintoLakehouse.md +134 -0
- package/bin/skills/lakehouse-doc/references/index2.md +1 -0
- package/bin/skills/lakehouse-doc/references/instance-informaiton-schema-summary.md +51 -0
- package/bin/skills/lakehouse-doc/references/instance-informaiton-schema.md +278 -0
- package/bin/skills/lakehouse-doc/references/instance-information_schema.md +1 -0
- package/bin/skills/lakehouse-doc/references/internal_volume.md +271 -0
- package/bin/skills/lakehouse-doc/references/intro-supported-features.md +48 -0
- package/bin/skills/lakehouse-doc/references/inverted-index.md +445 -0
- package/bin/skills/lakehouse-doc/references/inverted_idx_bm25_param.md +251 -0
- package/bin/skills/lakehouse-doc/references/inverted_idx_multi-match.md +89 -0
- package/bin/skills/lakehouse-doc/references/is-null.md +59 -0
- package/bin/skills/lakehouse-doc/references/it-operation-management.md +1 -0
- package/bin/skills/lakehouse-doc/references/java_reference/client.md +49 -0
- package/bin/skills/lakehouse-doc/references/java_reference/java-sdk-release-notes.md +32 -0
- package/bin/skills/lakehouse-doc/references/java_reference/java-sdk-summary.md +138 -0
- package/bin/skills/lakehouse-doc/references/java_reference/jdbc.md +211 -0
- package/bin/skills/lakehouse-doc/references/java_reference/realtime-upload.md +295 -0
- package/bin/skills/lakehouse-doc/references/jdbc_task.md +37 -0
- package/bin/skills/lakehouse-doc/references/job-manage.md +1 -0
- package/bin/skills/lakehouse-doc/references/job_history_analysis_with_information_schema.md +597 -0
- package/bin/skills/lakehouse-doc/references/jobprofile-bestpractices.md +104 -0
- package/bin/skills/lakehouse-doc/references/json_analyze.md +422 -0
- package/bin/skills/lakehouse-doc/references/json_data_process_guide.md +881 -0
- package/bin/skills/lakehouse-doc/references/json_guide_for_complex_biz_cases.md +1899 -0
- package/bin/skills/lakehouse-doc/references/kafka-external-table.md +103 -0
- package/bin/skills/lakehouse-doc/references/lakehouse-ai.md +1 -0
- package/bin/skills/lakehouse-doc/references/lakehouse-quick-experience_guide.md +964 -0
- package/bin/skills/lakehouse-doc/references/lakehouse-table-stream-best-practices.md +500 -0
- package/bin/skills/lakehouse-doc/references/lakehouse_billing_anomaly_alert_configuration_guide.md +226 -0
- package/bin/skills/lakehouse-doc/references/lakehouse_instance_overview.md +39 -0
- package/bin/skills/lakehouse-doc/references/lakehouse_table_design_guide.md +2676 -0
- package/bin/skills/lakehouse-doc/references/langchain.md +71 -0
- package/bin/skills/lakehouse-doc/references/langchain_basic_samples.md +606 -0
- package/bin/skills/lakehouse-doc/references/langchain_integration.md +1 -0
- package/bin/skills/lakehouse-doc/references/left.md +51 -0
- package/bin/skills/lakehouse-doc/references/like.md +115 -0
- package/bin/skills/lakehouse-doc/references/list-partition.md +121 -0
- package/bin/skills/lakehouse-doc/references/llama-index.md +57 -0
- package/bin/skills/lakehouse-doc/references/llms-full.txt +1286 -0
- package/bin/skills/lakehouse-doc/references/llms.txt +71 -0
- package/bin/skills/lakehouse-doc/references/load-data-local.md +82 -0
- package/bin/skills/lakehouse-doc/references/load-data-oss.md +174 -0
- package/bin/skills/lakehouse-doc/references/management.md +5 -0
- package/bin/skills/lakehouse-doc/references/managing-instance.md +67 -0
- package/bin/skills/lakehouse-doc/references/mapjoin.md +62 -0
- package/bin/skills/lakehouse-doc/references/materialized_ddl.md +1 -0
- package/bin/skills/lakehouse-doc/references/meta-objects-and-privileges.md +271 -0
- package/bin/skills/lakehouse-doc/references/metabase.md +73 -0
- package/bin/skills/lakehouse-doc/references/metadata_show_desc_command_guide.md +711 -0
- package/bin/skills/lakehouse-doc/references/metrics_answer_build.md +46 -0
- package/bin/skills/lakehouse-doc/references/mindsdb.md +269 -0
- package/bin/skills/lakehouse-doc/references/monitoring_and_alerting.md +177 -0
- package/bin/skills/lakehouse-doc/references/monitoring_item_specification.md +44 -0
- package/bin/skills/lakehouse-doc/references/multi_cloud_instance_manage_with_mcp_server.md +281 -0
- package/bin/skills/lakehouse-doc/references/multitable_batch_sync.md +463 -0
- package/bin/skills/lakehouse-doc/references/multitable_realtime_sync.md +412 -0
- package/bin/skills/lakehouse-doc/references/multitable_realtime_sync_sop.md +593 -0
- package/bin/skills/lakehouse-doc/references/n8n_Integreated_with_lakehouse_mcp_server.md +494 -0
- package/bin/skills/lakehouse-doc/references/navicat-mysql.md +65 -0
- package/bin/skills/lakehouse-doc/references/network_policy.md +281 -0
- package/bin/skills/lakehouse-doc/references/nyc_green_taxi_data_clean_transform_with_mcp_server.md +315 -0
- package/bin/skills/lakehouse-doc/references/object-model-overview.md +70 -0
- package/bin/skills/lakehouse-doc/references/object_identifier.md +259 -0
- package/bin/skills/lakehouse-doc/references/object_model_design.md +1 -0
- package/bin/skills/lakehouse-doc/references/opensource/travel.md +134 -0
- package/bin/skills/lakehouse-doc/references/operation-maintenance.md +172 -0
- package/bin/skills/lakehouse-doc/references/oss_volume_creation.md +39 -0
- package/bin/skills/lakehouse-doc/references/partition_table.md +344 -0
- package/bin/skills/lakehouse-doc/references/partition_table_guide.md +340 -0
- package/bin/skills/lakehouse-doc/references/performance_optimization.md +1 -0
- package/bin/skills/lakehouse-doc/references/performence_test.md +1 -0
- package/bin/skills/lakehouse-doc/references/permissions-of-built-in-workspace-level-roles.md +131 -0
- package/bin/skills/lakehouse-doc/references/pipe-kafka-bestpractice-1.md +431 -0
- package/bin/skills/lakehouse-doc/references/pipe-kafka-table-stream.md +180 -0
- package/bin/skills/lakehouse-doc/references/pipe-kafka.md +210 -0
- package/bin/skills/lakehouse-doc/references/pipe-storage-object.md +247 -0
- package/bin/skills/lakehouse-doc/references/pipe-summary.md +114 -0
- package/bin/skills/lakehouse-doc/references/pipe-syntax.md +200 -0
- package/bin/skills/lakehouse-doc/references/practice_data_analysis.md +1 -0
- package/bin/skills/lakehouse-doc/references/practice_data_import_and_export.md +1 -0
- package/bin/skills/lakehouse-doc/references/practice_python_task.md +157 -0
- package/bin/skills/lakehouse-doc/references/pricing.md +225 -0
- package/bin/skills/lakehouse-doc/references/primary key.md +86 -0
- package/bin/skills/lakehouse-doc/references/primary-key.md +187 -0
- package/bin/skills/lakehouse-doc/references/privacy-policy.md +364 -0
- package/bin/skills/lakehouse-doc/references/private-link-general.md +68 -0
- package/bin/skills/lakehouse-doc/references/private_link.md +1 -0
- package/bin/skills/lakehouse-doc/references/product-trial-agreement.md +99 -0
- package/bin/skills/lakehouse-doc/references/product_concept.md +1 -0
- package/bin/skills/lakehouse-doc/references/put-get.md +1 -0
- package/bin/skills/lakehouse-doc/references/put_get_volume.md +3 -0
- package/bin/skills/lakehouse-doc/references/python-igs.md +297 -0
- package/bin/skills/lakehouse-doc/references/python_package_install_import_guide.md +53 -0
- package/bin/skills/lakehouse-doc/references/python_reference/connector.md +281 -0
- package/bin/skills/lakehouse-doc/references/python_reference/python-sdk-summary.md +13 -0
- package/bin/skills/lakehouse-doc/references/python_reference/sqlalchemy.md +77 -0
- package/bin/skills/lakehouse-doc/references/python_shell_datasource.md +334 -0
- package/bin/skills/lakehouse-doc/references/query-json-sy.md +47 -0
- package/bin/skills/lakehouse-doc/references/query-syntax.md +234 -0
- package/bin/skills/lakehouse-doc/references/quick_start_batch_sync_data.md +116 -0
- package/bin/skills/lakehouse-doc/references/quick_start_bi_analysis.md +589 -0
- package/bin/skills/lakehouse-doc/references/quick_start_create_workspace.md +58 -0
- package/bin/skills/lakehouse-doc/references/quick_start_data_quality.md +75 -0
- package/bin/skills/lakehouse-doc/references/quick_start_etl.md +131 -0
- package/bin/skills/lakehouse-doc/references/quick_start_monitoring_and_alerting.md +93 -0
- package/bin/skills/lakehouse-doc/references/quick_start_sql_query.md +93 -0
- package/bin/skills/lakehouse-doc/references/quick_start_upload_data.md +69 -0
- package/bin/skills/lakehouse-doc/references/quick_start_user_management.md +73 -0
- package/bin/skills/lakehouse-doc/references/quick_start_workspace.md +72 -0
- package/bin/skills/lakehouse-doc/references/quick_start_workspace_user.md +67 -0
- package/bin/skills/lakehouse-doc/references/quickstart_datashare_between_companies.md +249 -0
- package/bin/skills/lakehouse-doc/references/quickstart_envirment_for_team.md +271 -0
- package/bin/skills/lakehouse-doc/references/quickstart_local_csv.md +99 -0
- package/bin/skills/lakehouse-doc/references/realtime_sync.md +36 -0
- package/bin/skills/lakehouse-doc/references/realtime_sync_and_analysis_practice.md +187 -0
- package/bin/skills/lakehouse-doc/references/realtimesync_m.md +190 -0
- package/bin/skills/lakehouse-doc/references/refresh-history.md +63 -0
- package/bin/skills/lakehouse-doc/references/regexp-statement.md +80 -0
- package/bin/skills/lakehouse-doc/references/releasenotes.md +1 -0
- package/bin/skills/lakehouse-doc/references/releasenotesupdata.md +1 -0
- package/bin/skills/lakehouse-doc/references/remove-volume.md +32 -0
- package/bin/skills/lakehouse-doc/references/restore-dynamic-table.md +126 -0
- package/bin/skills/lakehouse-doc/references/restore.md +127 -0
- package/bin/skills/lakehouse-doc/references/result_cache.md +102 -0
- package/bin/skills/lakehouse-doc/references/revoke-from-share.md +48 -0
- package/bin/skills/lakehouse-doc/references/revoke-user-privileges.md +91 -0
- package/bin/skills/lakehouse-doc/references/right.md +84 -0
- package/bin/skills/lakehouse-doc/references/rlike.md +78 -0
- package/bin/skills/lakehouse-doc/references/rn_2024_11_12.md +63 -0
- package/bin/skills/lakehouse-doc/references/role-privlilige-manage.md +1 -0
- package/bin/skills/lakehouse-doc/references/roles.md +123 -0
- package/bin/skills/lakehouse-doc/references/rom_lakehouse_to_volume.md +1 -0
- package/bin/skills/lakehouse-doc/references/s3_volume_creation.md +37 -0
- package/bin/skills/lakehouse-doc/references/sample-data-using.md +768 -0
- package/bin/skills/lakehouse-doc/references/security_compliance_audit_guide.md +1 -0
- package/bin/skills/lakehouse-doc/references/security_overview.md +41 -0
- package/bin/skills/lakehouse-doc/references/select-catalog-table.md +26 -0
- package/bin/skills/lakehouse-doc/references/semantic_view.md +711 -0
- package/bin/skills/lakehouse-doc/references/setup.md +33 -0
- package/bin/skills/lakehouse-doc/references/share-ddl.md +1 -0
- package/bin/skills/lakehouse-doc/references/show-cached-status.md +34 -0
- package/bin/skills/lakehouse-doc/references/show-catalog-schema.md +48 -0
- package/bin/skills/lakehouse-doc/references/show-catalog-table.md +22 -0
- package/bin/skills/lakehouse-doc/references/show-catalog.md +26 -0
- package/bin/skills/lakehouse-doc/references/show-columns.md +75 -0
- package/bin/skills/lakehouse-doc/references/show-create-dynamic-table.md +44 -0
- package/bin/skills/lakehouse-doc/references/show-create-external-table.md +45 -0
- package/bin/skills/lakehouse-doc/references/show-create-materialized-view.md +43 -0
- package/bin/skills/lakehouse-doc/references/show-create-table.md +107 -0
- package/bin/skills/lakehouse-doc/references/show-dynamic-table.md +68 -0
- package/bin/skills/lakehouse-doc/references/show-external-schemas.md +35 -0
- package/bin/skills/lakehouse-doc/references/show-external-table.md +38 -0
- package/bin/skills/lakehouse-doc/references/show-finctions.md +25 -0
- package/bin/skills/lakehouse-doc/references/show-functions.md +44 -0
- package/bin/skills/lakehouse-doc/references/show-grants-user.md +41 -0
- package/bin/skills/lakehouse-doc/references/show-jobs.md +48 -0
- package/bin/skills/lakehouse-doc/references/show-materialized-view.md +42 -0
- package/bin/skills/lakehouse-doc/references/show-schemas.md +41 -0
- package/bin/skills/lakehouse-doc/references/show-shares.md +94 -0
- package/bin/skills/lakehouse-doc/references/show-synonyms.md +29 -0
- package/bin/skills/lakehouse-doc/references/show-table-streams.md +53 -0
- package/bin/skills/lakehouse-doc/references/show-tables-history.md +91 -0
- package/bin/skills/lakehouse-doc/references/show-tables.md +50 -0
- package/bin/skills/lakehouse-doc/references/show-users.md +46 -0
- package/bin/skills/lakehouse-doc/references/show-vclusters.md +59 -0
- package/bin/skills/lakehouse-doc/references/show-views.md +31 -0
- package/bin/skills/lakehouse-doc/references/show-volume.md +57 -0
- package/bin/skills/lakehouse-doc/references/show.md +168 -0
- package/bin/skills/lakehouse-doc/references/simpletosimple_bazhuayu_datagpt.md +152 -0
- package/bin/skills/lakehouse-doc/references/small_file_optimization.md +101 -0
- package/bin/skills/lakehouse-doc/references/spark-connector-summary.md +329 -0
- package/bin/skills/lakehouse-doc/references/spark-connector-use.md +233 -0
- package/bin/skills/lakehouse-doc/references/sql-parmaters.md +594 -0
- package/bin/skills/lakehouse-doc/references/sql-qualify.md +236 -0
- package/bin/skills/lakehouse-doc/references/sql-reference.md +1 -0
- package/bin/skills/lakehouse-doc/references/sql_data_transfom_NestedDataTypes.md +451 -0
- package/bin/skills/lakehouse-doc/references/sql_data_transform.md +1 -0
- package/bin/skills/lakehouse-doc/references/sql_data_transform_basic.md +576 -0
- package/bin/skills/lakehouse-doc/references/sql_data_transform_cte.md +177 -0
- package/bin/skills/lakehouse-doc/references/sql_data_transform_tips.md +407 -0
- package/bin/skills/lakehouse-doc/references/sql_data_transform_windows.md +430 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/any_value.md +64 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/approx_count_distinct.md +45 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/approx_histogram.md +56 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/approx_percentile.md +65 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/approx_top_k.md +62 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/avg.md +68 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/bit_and.md +81 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/bit_or.md +78 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/bit_xor.md +79 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/bool_and.md +85 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/bool_or.md +86 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/collect_list.md +95 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/collect_list_on_array.md +64 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/collect_set.md +85 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/collect_set_on_array.md +80 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/corr.md +103 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/count.md +96 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/count_distinct.md +96 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/count_if.md +62 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/covar_pop.md +89 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/covar_samp.md +113 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/first_value.md +122 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/group_bitmap.md +42 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/group_bitmap_and.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/group_bitmap_and_state.md +47 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/group_bitmap_merge.md +37 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/group_bitmap_merge_state.md +29 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/group_bitmap_or.md +44 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/group_bitmap_or_state.md +64 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/group_bitmap_state.md +27 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/group_bitmap_xor.md +45 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/group_bitmap_xor_state.md +99 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/group_concat.md +53 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/last_value.md +100 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/map_agg.md +79 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/max.md +102 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/max_by.md +67 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/median.md +60 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/min.md +89 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/min_by.md +99 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/percentile.md +69 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/percentile_approx.md +33 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/percentile_rank.md +36 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/std.md +47 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/stddev.md +68 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/stddev_pop.md +67 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/stddev_samp.md +67 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/sum.md +67 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/var_pop.md +65 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/var_samp.md +65 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/variance.md +47 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/aggregate_functions/wm_concat.md +79 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/context_functions/current_instance_id.md +16 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/context_functions/current_schema.md +29 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/context_functions/current_session_id.md +30 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/context_functions/current_user.md +29 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/context_functions/current_user_id.md +21 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/context_functions/current_vcluster.md +40 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/context_functions/current_workspace.md +19 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/context_functions/current_workspace_id.md +24 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/binary_to_bitmap.md +29 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_and.md +39 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_and_cardinality.md +48 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_andnot.md +61 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_andnot_cardinality.md +60 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_build.md +58 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_cardinality.md +43 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_contains.md +50 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_count.md +45 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_empty.md +52 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_has_all.md +49 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_has_any.md +65 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_hash.md +52 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_max.md +26 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_min.md +33 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_or.md +61 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_or_cardinality.md +27 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_remove.md +42 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_subset_in_range.md +60 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_subset_limit.md +36 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_to_array.md +24 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_to_binary.md +28 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_to_string.md +41 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_transform.md +42 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_xor.md +59 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/bitmap_xor_cardinality.md +30 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/string_to_bitmap.md +56 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/sub_bitmap.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitmap_functions/to_bitmap.md +78 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitwise_functions/bit_count.md +43 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/bitwise_functions/bitnot.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/conditional_functions/assert_true.md +44 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/conditional_functions/between.md +52 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/conditional_functions/case_when.md +99 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/conditional_functions/coalesce.md +51 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/conditional_functions/decode.md +45 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/conditional_functions/if.md +56 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/conditional_functions/in.md +33 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/conditional_functions/is_false.md +63 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/conditional_functions/is_not_null.md +40 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/conditional_functions/is_null.md +44 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/conditional_functions/is_true.md +63 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/conditional_functions/multiif.md +54 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/conditional_functions/nvl.md +39 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/conditional_functions/raise_error.md +52 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/add_days.md +65 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/add_months.md +38 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/add_years.md +61 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/adddate.md +53 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/convert_timezone.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/current_date.md +56 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/current_timestamp.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/date.md +42 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/date_add.md +35 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/date_format.md +48 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/date_format_mysql.md +58 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/date_format_pg.md +54 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/date_sub.md +58 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/date_trunc.md +61 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/dateadd.md +60 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/datediff.md +50 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/datetime_patterns.md +61 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/day.md +53 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/dayofmonth.md +36 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/dayofweek.md +31 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/dayofweek_iso.md +56 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/dayofyear.md +40 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/days.md +21 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/extract.md +49 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/from_unixtime.md +43 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/from_utc_timestamp.md +45 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/hour.md +49 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/hours.md +21 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/last_day.md +35 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/localtimestamp.md +19 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/makde_date.md +20 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/make_date.md +20 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/make_dt_interval.md +66 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/make_ym_interval.md +53 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/minute.md +49 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/month.md +39 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/months.md +21 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/months_between.md +18 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/next_day.md +16 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/now.md +53 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/quarter.md +52 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/second.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/str_to_date_mysql.md +42 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/sub_days.md +66 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/timestamp_micros.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/timestamp_millis.md +54 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/timestamp_seconds.md +62 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/timestampadd.md +59 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/timestampdiff.md +78 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/to_date.md +43 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/to_start_of_interval.md +25 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/to_timestamp.md +66 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/to_timestamp_ntz.md +52 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/to_unix_timestamp.md +59 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/to_unix_timestamp_ms.md +45 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/to_unix_timestamp_us.md +40 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/to_utc_timestamp.md +62 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/toyyyymmdd.md +69 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/trunc.md +38 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/unix_timestamp.md +96 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/week.md +31 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/weekday.md +51 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/weekofyear.md +29 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/year.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/yearofweek.md +64 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/datetime_functions/years.md +21 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/geo_functions/st_geohash.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/geo_functions/st_latfromgeohash.md +59 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/geo_functions/st_longfromgeohash.md +53 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/hash_functions/bucket.md +33 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/hash_functions/general_hash.md +49 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/hash_functions/hash_combine.md +37 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/hash_functions/hash_combine_commutative.md +54 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/hash_functions/murmurhash.md +36 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/high_order_functions/array_sort_by_key.md +42 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/high_order_functions/element_at.md +59 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/high_order_functions/exists.md +48 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/high_order_functions/filter.md +37 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/high_order_functions/forall.md +68 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/high_order_functions/high_order_functions.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/high_order_functions/map_filter.md +25 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/high_order_functions/map_zip_with.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/high_order_functions/transform.md +48 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/high_order_functions/transform_keys.md +48 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/high_order_functions/transform_values.md +36 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/high_order_functions/zip_with.md +38 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/ip_functions/get_ip_info.md +199 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/ip_functions/ipv4_num_to_string.md +29 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/ip_functions/ipv4_string_to_num.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/ip_functions/ipv6_num_to_string.md +35 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/ip_functions/ipv6_string_to_num.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/ip_functions/is_ip_address_in_range.md +42 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/json_functions/from_json.md +86 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/json_functions/get_json_object.md +83 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/json_functions/json_array.md +30 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/json_functions/json_contains.md +86 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/json_functions/json_extract.md +64 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/json_functions/json_minify.md +28 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/json_functions/json_normalize.md +36 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/json_functions/json_object.md +37 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/json_functions/json_parse.md +59 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/json_functions/json_remove.md +36 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/json_functions/json_type.md +44 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/json_functions/json_valid.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/json_functions/schema_of_json.md +79 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/json_functions/to_json.md +68 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/abs.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/acos.md +30 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/acosh.md +39 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/asin.md +39 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/asinh.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/atan.md +27 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/atan2.md +43 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/atanh.md +24 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/bround.md +43 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/cbrt.md +56 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/ceil.md +45 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/ceilling.md +47 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/cos.md +41 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/cosh.md +41 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/cot.md +49 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/csc.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/degrees.md +42 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/div.md +28 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/e.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/exp.md +32 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/exp2.md +36 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/expm1.md +54 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/floor.md +41 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/greatest.md +36 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/hypot.md +37 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/isnan.md +27 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/least.md +38 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/ln.md +57 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/log.md +39 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/log10.md +47 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/log1p.md +48 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/log2.md +28 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/median.md +25 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/mod.md +35 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/monotonically_increasing_id.md +81 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/negative.md +15 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/operators.md +427 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/pi.md +41 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/pmod.md +31 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/positive.md +15 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/pow.md +39 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/radians.md +30 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/rand.md +39 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/randn.md +26 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/random.md +67 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/round.md +48 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/shiftleft.md +67 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/shiftright.md +70 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/shiftrightunsigned.md +70 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/sign.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/sin.md +67 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/sinh.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/sqrt.md +40 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/tan.md +42 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/math_functions/tanh.md +38 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_append.md +26 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_compact.md +29 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_contains.md +38 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_distinct.md +43 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_except.md +35 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_intersect.md +39 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_join.md +51 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_max.md +57 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_min.md +60 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_position.md +50 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_prepend.md +26 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_remove.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_repeat.md +51 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_size.md +32 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_sort.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_sort_reverse.md +31 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/array_union.md +36 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/arrays_overlap.md +41 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/arrays_zip.md +50 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/cardinality.md +45 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/concat.md +49 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/concat_ws.md +73 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/element_at.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/flatten.md +62 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/map.md +44 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/map_concat.md +38 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/map_contains_key.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/map_entries.md +44 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/map_equal.md +33 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/map_except.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/map_from_arrays.md +28 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/map_from_entries.md +52 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/map_keys.md +37 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/map_values.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/multimap_from_entries.md +47 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/named_struct.md +55 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/sequence.md +35 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/size.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/slice.md +43 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/sort_array.md +22 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/struct.md +35 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/struct_insert.md +54 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/struct_update.md +42 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/nested_functions/trans_array.md +147 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/partition/max_pt.md +41 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/search_functions/match_all.md +56 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/search_functions/match_any.md +50 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/search_functions/match_phrase.md +65 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/search_functions/match_phrase_prefix.md +36 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/search_functions/match_regexp.md +30 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/search_functions/tokenize.md +57 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/aes_decrypt.md +40 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/aes_decrypt_mysql.md +30 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/aes_encrypt.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/aes_encrypt_mysql.md +53 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/ascii.md +36 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/base64.md +27 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/binary.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/btrim.md +38 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/char.md +55 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/char_length.md +52 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/character_length.md +52 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/chr.md +26 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/collation_sort_key.md +58 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/concat.md +75 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/concat_ws.md +72 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/contains.md +31 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/conv.md +50 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/endswith.md +70 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/find_in_set.md +19 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/format_string.md +53 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/hex.md +45 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/instr.md +41 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/is_ascii.md +27 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/is_utf8.md +27 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/lcase.md +45 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/left.md +35 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/length.md +33 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/lengthb.md +49 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/like.md +63 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/locate.md +42 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/lower.md +61 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/lpad.md +45 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/ltrim.md +48 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/mask.md +37 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/md5.md +71 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/octet_length.md +47 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/parse_url.md +78 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/position.md +35 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/regexp_count.md +115 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/regexp_extract.md +37 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/regexp_extract_all.md +31 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/regexp_instr.md +152 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/regexp_replace.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/repeat.md +44 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/replace.md +37 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/reverse.md +70 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/right.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/rlike.md +64 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/rpad.md +53 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/rtrim.md +37 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/sha1.md +67 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/space.md +34 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/split.md +61 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/split_part.md +42 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/startswith.md +70 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/str_to_map.md +60 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/strpos.md +60 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/substr.md +43 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/substring.md +53 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/substring_index.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/translate.md +43 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/trim.md +54 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/typeof.md +54 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/ucase.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/unbase64.md +54 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/unhex.md +46 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/upper.md +51 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/url_decode.md +32 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/url_encode.md +33 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/string_functions/uuid.md +33 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/vector_functions/binary_quantize.md +51 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/vector_functions/cosine_distance.md +53 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/vector_functions/dot_product.md +54 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/vector_functions/hamming_distance.md +57 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/vector_functions/jaccard_distance.md +55 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/vector_functions/l2_distance.md +53 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/vector_functions/l2_norm.md +52 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/vector_functions/l2_normalize.md +54 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/vector_functions/print_vector_bits.md +56 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/vector_functions/vector.md +70 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/scalar_functions/vector_functions/vector_add_scalar.md +57 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/table_functions/explode.md +71 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/table_functions/inline.md +48 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/table_functions/json_tuple.md +44 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/table_functions/load_history.md +17 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/table_functions/posexplode.md +89 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/table_functions/read_kafka.md +85 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/table_functions/stack.md +69 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/table_functions/table_changes.md +136 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/table_functions/unnset.md +106 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/avg.md +91 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/count.md +88 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/cume_dist.md +104 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/dense_rank.md +119 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/first.md +159 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/first_value.md +133 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/lag.md +72 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/last.md +166 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/last_value.md +160 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/lead.md +49 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/max.md +167 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/min.md +138 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/nth_value.md +58 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/ntile.md +57 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/percent_rank.md +58 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/rank.md +139 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/row_number.md +141 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/sum.md +105 -0
- package/bin/skills/lakehouse-doc/references/sql_functions/window_functions/window_clause.md +91 -0
- package/bin/skills/lakehouse-doc/references/sql_practice.md +1 -0
- package/bin/skills/lakehouse-doc/references/sql_rfm.md +181 -0
- package/bin/skills/lakehouse-doc/references/sqlalchemy.md +82 -0
- package/bin/skills/lakehouse-doc/references/ssb-benchmark.md +224 -0
- package/bin/skills/lakehouse-doc/references/sso-configuration.md +157 -0
- package/bin/skills/lakehouse-doc/references/storage_encryption.md +81 -0
- package/bin/skills/lakehouse-doc/references/streaming_data_pipeline_overview.md +20 -0
- package/bin/skills/lakehouse-doc/references/streaming_data_pipeline_overview1.md +1 -0
- package/bin/skills/lakehouse-doc/references/streaming_pipeline_with_dynamic_table.md +66 -0
- package/bin/skills/lakehouse-doc/references/structure_data_analysis.md +229 -0
- package/bin/skills/lakehouse-doc/references/studio_manual.md +1 -0
- package/bin/skills/lakehouse-doc/references/studio_overview.md +71 -0
- package/bin/skills/lakehouse-doc/references/synonym.md +139 -0
- package/bin/skills/lakehouse-doc/references/table-stream-title.md +1 -0
- package/bin/skills/lakehouse-doc/references/table-stream.md +1 -0
- package/bin/skills/lakehouse-doc/references/table-summary.md +1 -0
- package/bin/skills/lakehouse-doc/references/table_funciotn.md +1 -0
- package/bin/skills/lakehouse-doc/references/table_stream.md +118 -0
- package/bin/skills/lakehouse-doc/references/tablesample.md +474 -0
- package/bin/skills/lakehouse-doc/references/tablestream_summary.md +515 -0
- package/bin/skills/lakehouse-doc/references/task-instance-maintenance.md +207 -0
- package/bin/skills/lakehouse-doc/references/task_development.md +56 -0
- package/bin/skills/lakehouse-doc/references/task_group.md +151 -0
- package/bin/skills/lakehouse-doc/references/task_param.md +978 -0
- package/bin/skills/lakehouse-doc/references/task_scheduling.md +1 -0
- package/bin/skills/lakehouse-doc/references/task_scheduling_dependency.md +74 -0
- package/bin/skills/lakehouse-doc/references/taskdevelop.md +268 -0
- package/bin/skills/lakehouse-doc/references/tencentcloud_arn_and_externalid.md +29 -0
- package/bin/skills/lakehouse-doc/references/time-function.md +67 -0
- package/bin/skills/lakehouse-doc/references/timetravel-summary.md +47 -0
- package/bin/skills/lakehouse-doc/references/tools_AI.md +1 -0
- package/bin/skills/lakehouse-doc/references/tools_BI.md +1 -0
- package/bin/skills/lakehouse-doc/references/tpcds-benchmark.md +754 -0
- package/bin/skills/lakehouse-doc/references/tpch-benchmark.md +887 -0
- package/bin/skills/lakehouse-doc/references/transformt-dt.md +291 -0
- package/bin/skills/lakehouse-doc/references/trial-account-quotas-and-limits.md +81 -0
- package/bin/skills/lakehouse-doc/references/tutorial_DataGPT.md +1 -0
- package/bin/skills/lakehouse-doc/references/tutorial_connect_to_lakehouse.md +1 -0
- package/bin/skills/lakehouse-doc/references/tutorial_data_transformation.md +1 -0
- package/bin/skills/lakehouse-doc/references/tutorial_migration.md +1 -0
- package/bin/skills/lakehouse-doc/references/tutorial_virtual_cluster.md +1 -0
- package/bin/skills/lakehouse-doc/references/tutorial_work_with_workspace.md +1 -0
- package/bin/skills/lakehouse-doc/references/tutorial_zettapark.md +1 -0
- package/bin/skills/lakehouse-doc/references/tutorials-streaming-data-pipeline-with_dynamic-table.md +124 -0
- package/bin/skills/lakehouse-doc/references/undrop-dynamic-table.md +79 -0
- package/bin/skills/lakehouse-doc/references/undrop-materialized-view.md +80 -0
- package/bin/skills/lakehouse-doc/references/unifiedWorkflow.md +1 -0
- package/bin/skills/lakehouse-doc/references/unloa-data-summary.md +17 -0
- package/bin/skills/lakehouse-doc/references/unload-data-local.md +72 -0
- package/bin/skills/lakehouse-doc/references/unstructure_data_analysis.md +1 -0
- package/bin/skills/lakehouse-doc/references/unstructured_etl_pipeline_notebook.md +12 -0
- package/bin/skills/lakehouse-doc/references/unstructured_etl_pipeline_user_guide.md +949 -0
- package/bin/skills/lakehouse-doc/references/unstructured_etl_python_api.md +896 -0
- package/bin/skills/lakehouse-doc/references/upload-data.md +1 -0
- package/bin/skills/lakehouse-doc/references/upload_data.md +123 -0
- package/bin/skills/lakehouse-doc/references/use-dbt-dev.md +441 -0
- package/bin/skills/lakehouse-doc/references/use-external-schema.md +42 -0
- package/bin/skills/lakehouse-doc/references/use-java-sdk-releatime-uploaddata.md +168 -0
- package/bin/skills/lakehouse-doc/references/use-java-sdk-upload-dta-local.md +140 -0
- package/bin/skills/lakehouse-doc/references/use-mysql-client.md +189 -0
- package/bin/skills/lakehouse-doc/references/use-python-sdk-upload-data.md +99 -0
- package/bin/skills/lakehouse-doc/references/use-schema.md +49 -0
- package/bin/skills/lakehouse-doc/references/use-vcluster.md +38 -0
- package/bin/skills/lakehouse-doc/references/user-aggrement.md +229 -0
- package/bin/skills/lakehouse-doc/references/user-external-funciton.md +1 -0
- package/bin/skills/lakehouse-doc/references/user-identification.md +58 -0
- package/bin/skills/lakehouse-doc/references/user_permission_grand_guide.md +322 -0
- package/bin/skills/lakehouse-doc/references/using-google-authenticator.md +48 -0
- package/bin/skills/lakehouse-doc/references/using-udf-in-dynamic-table.md +162 -0
- package/bin/skills/lakehouse-doc/references/using_mcp_solute_data_pipeline_issue.md +343 -0
- package/bin/skills/lakehouse-doc/references/uuid.md +47 -0
- package/bin/skills/lakehouse-doc/references/validate_schema_evolution.md +167 -0
- package/bin/skills/lakehouse-doc/references/vc-job.md +1 -0
- package/bin/skills/lakehouse-doc/references/vc_cache.md +71 -0
- package/bin/skills/lakehouse-doc/references/vcluster_size_description.md +98 -0
- package/bin/skills/lakehouse-doc/references/vector-search.md +144 -0
- package/bin/skills/lakehouse-doc/references/vector-type.md +52 -0
- package/bin/skills/lakehouse-doc/references/vector_data_process_guide.md +952 -0
- package/bin/skills/lakehouse-doc/references/vector_search_ai.md +423 -0
- package/bin/skills/lakehouse-doc/references/version-update.md +21 -0
- package/bin/skills/lakehouse-doc/references/virtual-cluster.md +221 -0
- package/bin/skills/lakehouse-doc/references/volume_best_practices.md +1141 -0
- package/bin/skills/lakehouse-doc/references/web-job-history.md +163 -0
- package/bin/skills/lakehouse-doc/references/what_is_clickzetta_lakehouse.md +92 -0
- package/bin/skills/lakehouse-doc/references/window-function-summary.md +134 -0
- package/bin/skills/lakehouse-doc/references/windowframe.md +139 -0
- package/bin/skills/lakehouse-doc/references/working_with_Vclusters.md +171 -0
- package/bin/skills/lakehouse-doc/references/working_with_cache.md +102 -0
- package/bin/skills/lakehouse-doc/references/worksapce-informaiton_schema-views.md +207 -0
- package/bin/skills/lakehouse-doc/references/worksheet.md +15 -0
- package/bin/skills/lakehouse-doc/references/workspace-introduction.md +41 -0
- package/bin/skills/lakehouse-doc/references/worskapce-infroamtionschema-summary.md +56 -0
- package/package.json +13 -0
|
@@ -0,0 +1,471 @@
|
|
|
1
|
+
# 使用虚拟集群加工和分析数据
|
|
2
|
+
|
|
3
|
+
## 教程概述
|
|
4
|
+
|
|
5
|
+
通过本教程,您将了解到如何使用虚拟集群(Virtual Cluster)对纽约出租车公开数据集 Fhvhv trips 原始数据进行清洗转换、聚合加工,并对结果数据进行多并发查询。
|
|
6
|
+
|
|
7
|
+
教程案例如下图所示:
|
|
8
|
+

|
|
9
|
+
|
|
10
|
+
本教程包含以下步骤:
|
|
11
|
+
|
|
12
|
+
* 环境准备:通过样例数据集检查原始数据,创建计算集群和目标 Schema
|
|
13
|
+
* 数据转换:通过通用型集群清洗、聚合数据用于后续分析
|
|
14
|
+
* Ad-hoc分析:使用Studio Web环境进行单并发SQL查询分析
|
|
15
|
+
* 并发分析:通过Python任务模拟来自Dashboard的连续多并发查询
|
|
16
|
+
|
|
17
|
+
### 入门知识
|
|
18
|
+
|
|
19
|
+
什么是虚拟计算集群(Virtual Cluster)?
|
|
20
|
+
|
|
21
|
+
虚拟计算集群(Virtual Cluster,简称 VC 或集群)是云器 Lakehouse 提供数据处理和分析的计算资源对象。虚拟计算集群提供在Lakehouse中执行SQL作业所需的CPU、内存、本地临时存储(SSD介质)等资源。集群具备快速创建/销毁、扩容/缩容、暂停/恢复等特点,按照资源规格大小以及使用时长进行收费,暂停或删除后不产生费用。
|
|
22
|
+
|
|
23
|
+
虚拟计算集群针对 ETL 和分析场景,提供通用型和分析型两种集群类型,以满足不同负载之间的隔离和优化需求。
|
|
24
|
+
|
|
25
|
+
如下图所示:
|
|
26
|
+

|
|
27
|
+
建议使用通用型集群进行 ETL 数据加工,使用分析型集群进行查询分析或支持数据产品应用。通用型集群支持纵向伸缩,满足不同规模的 ETL Pipeline 任务需要。分析型集群支持集群内多副本(Replica)的横向伸缩,以满足并发查询的弹性需求。
|
|
28
|
+
|
|
29
|
+
本教程将分别使用通用型集群进行数据清洗转换,使用分析型集群进行低延迟的并发分析。
|
|
30
|
+
|
|
31
|
+
### 教程目标
|
|
32
|
+
|
|
33
|
+
* 创建和使用虚拟计算集群用于不同业务负载
|
|
34
|
+
* 了解和使用分析型集群的弹性并发功能
|
|
35
|
+
|
|
36
|
+
## Step01 检查原始数据
|
|
37
|
+
|
|
38
|
+
1. 创建虚拟集群
|
|
39
|
+
|
|
40
|
+
分别创建通用型(GENERAL PURPOSE)和分析型(ANALYTICS)集群,用于 ETL 加工和查询分析,实现负载隔离。
|
|
41
|
+
|
|
42
|
+
```sql
|
|
43
|
+
-- 1.1 创建面向ETL处理的虚拟集群
|
|
44
|
+
CREATE VCLUSTER ETL_VC
|
|
45
|
+
VCLUSTER_SIZE = MEDIUM
|
|
46
|
+
VCLUSTER_TYPE = GENERAL
|
|
47
|
+
AUTO_SUSPEND_IN_SECOND = 60
|
|
48
|
+
AUTO_RESUME = TRUE;
|
|
49
|
+
|
|
50
|
+
-- 1.2 创建面向BI分析的虚拟集群,设置弹性并发以支持多并发查询
|
|
51
|
+
CREATE VCLUSTER REPORTING_VC
|
|
52
|
+
VCLUSTER_SIZE = XSMALL
|
|
53
|
+
VCLUSTER_TYPE = ANALYTICS
|
|
54
|
+
MIN_REPLICAS = 1
|
|
55
|
+
MAX_REPLICAS = 4
|
|
56
|
+
MAX_CONCURRENCY = 8
|
|
57
|
+
AUTO_SUSPEND_IN_SECOND = 300
|
|
58
|
+
AUTO_RESUME = TRUE ;
|
|
59
|
+
|
|
60
|
+
-- 1.3 查看集群资源
|
|
61
|
+
show vclusters ;
|
|
62
|
+
|
|
63
|
+
-- 1.4 切换当前Session下使用的虚拟集群,要和执行的SQL一起选中执行才会生效
|
|
64
|
+
USE VCLUSTER REPORTING_VC;
|
|
65
|
+
```
|
|
66
|
+
|
|
67
|
+

|
|
68
|
+
|
|
69
|
+
> 注:计算集群的 `vcluster_size` 参数同时支持 T-shirt size(XSMALL、SMALL、LARGE 等)和数字(1, 2, 4, 16 等)两种表达方式,以提供更丰富的计算集群规格,满足不同场景的需要。更多信息详见:[计算集群规格代码变更说明](vcluster_size_description.md)
|
|
70
|
+
|
|
71
|
+
^
|
|
72
|
+
|
|
73
|
+
2. 查看公共数据集中的原始数据
|
|
74
|
+
|
|
75
|
+
2.1 查看原始数据的字段信息。
|
|
76
|
+
|
|
77
|
+
```sql
|
|
78
|
+
--Describes New York City For-Hire-Vehicle trips.
|
|
79
|
+
desc clickzetta_sample_data.nyc_taxi_tripdata.fhvhv_tripdata;
|
|
80
|
+
```
|
|
81
|
+
|
|
82
|
+

|
|
83
|
+
|
|
84
|
+
2.2 预览数据明细
|
|
85
|
+
|
|
86
|
+
```sql
|
|
87
|
+
--Sample Of Trip Record Data
|
|
88
|
+
select * from clickzetta_sample_data.nyc_taxi_tripdata.fhvhv_tripdata limit 10;
|
|
89
|
+
```
|
|
90
|
+
|
|
91
|
+

|
|
92
|
+
|
|
93
|
+
2.3 查看数据集的记录数
|
|
94
|
+
|
|
95
|
+
```sql
|
|
96
|
+
--1.49 billion rows
|
|
97
|
+
select count(*) from clickzetta_sample_data.nyc_taxi_tripdata.fhvhv_tripdata;
|
|
98
|
+
```
|
|
99
|
+
|
|
100
|
+
## Step02 使用通用型集群清洗转换数据
|
|
101
|
+
|
|
102
|
+
1. 指定使用 `ETL_VC` 进行数据加工,同时创建目标表所在的 Schema
|
|
103
|
+
|
|
104
|
+
```sql
|
|
105
|
+
--要和执行的SQL一起选中执行才会生效
|
|
106
|
+
use vcluster ETL_VC;
|
|
107
|
+
create schema tutorial;
|
|
108
|
+
use tutorial;
|
|
109
|
+
```
|
|
110
|
+
|
|
111
|
+
2. 通过 CTAS 对原始数据集进行清洗转换并写入新表
|
|
112
|
+
|
|
113
|
+
```sql
|
|
114
|
+
--2.对原始数据集进行清洗转换
|
|
115
|
+
CREATE table tutorial.int_fhvhv_tripdata
|
|
116
|
+
as
|
|
117
|
+
SELECT
|
|
118
|
+
hvfhs_license_num,
|
|
119
|
+
CASE
|
|
120
|
+
WHEN hvfhs_license_num = 'HV0002' THEN 'juno'
|
|
121
|
+
WHEN hvfhs_license_num = 'HV0003' THEN 'uber'
|
|
122
|
+
WHEN hvfhs_license_num = 'HV0004' THEN 'via'
|
|
123
|
+
WHEN hvfhs_license_num = 'HV0005' THEN 'lyft'
|
|
124
|
+
ELSE null
|
|
125
|
+
END AS company,
|
|
126
|
+
ltrim(rtrim(upper(dispatching_base_num))) dispatching_base_num,
|
|
127
|
+
ltrim(rtrim(upper(originating_base_num))) originating_base_num,
|
|
128
|
+
request_datetime,
|
|
129
|
+
on_scene_datetime,
|
|
130
|
+
pickup_datetime,
|
|
131
|
+
dropoff_datetime,
|
|
132
|
+
PULocationID,
|
|
133
|
+
DOLocationID,
|
|
134
|
+
trip_miles,
|
|
135
|
+
trip_time,
|
|
136
|
+
base_passenger_fare,
|
|
137
|
+
tolls,
|
|
138
|
+
bcf,
|
|
139
|
+
sales_tax,
|
|
140
|
+
congestion_surcharge,
|
|
141
|
+
airport_fee,
|
|
142
|
+
tips,
|
|
143
|
+
driver_pay,
|
|
144
|
+
CASE
|
|
145
|
+
WHEN shared_request_flag = 'Y' THEN true
|
|
146
|
+
WHEN shared_request_flag IN ('N', ' ') THEN false
|
|
147
|
+
ELSE null
|
|
148
|
+
END AS shared_request_flag,
|
|
149
|
+
CASE
|
|
150
|
+
WHEN shared_match_flag = 'Y' THEN true
|
|
151
|
+
WHEN shared_match_flag IN ('N', ' ') THEN false
|
|
152
|
+
ELSE null
|
|
153
|
+
END AS shared_match_flag,
|
|
154
|
+
CASE
|
|
155
|
+
WHEN access_a_ride_flag = 'Y' THEN true
|
|
156
|
+
WHEN access_a_ride_flag IN ('N', ' ') THEN false
|
|
157
|
+
ELSE null
|
|
158
|
+
END AS access_a_ride_flag,
|
|
159
|
+
CASE
|
|
160
|
+
WHEN wav_request_flag = 'Y' THEN true
|
|
161
|
+
WHEN wav_request_flag IN ('N', ' ') THEN false
|
|
162
|
+
ELSE null
|
|
163
|
+
END AS wav_request_flag,
|
|
164
|
+
CASE
|
|
165
|
+
WHEN wav_match_flag = 'Y' THEN true
|
|
166
|
+
WHEN wav_match_flag IN ('N', ' ') THEN false
|
|
167
|
+
ELSE null
|
|
168
|
+
END AS wav_match_flag
|
|
169
|
+
FROM clickzetta_sample_data.nyc_taxi_tripdata.fhvhv_tripdata;
|
|
170
|
+
```
|
|
171
|
+
|
|
172
|
+
验证加工后的数据
|
|
173
|
+
|
|
174
|
+
```sql
|
|
175
|
+
SELECT * FROM tutorial.int_fhvhv_tripdata LIMIT 10;
|
|
176
|
+
```
|
|
177
|
+
|
|
178
|
+

|
|
179
|
+
|
|
180
|
+
3. 对清洗后的数据按照分析主题分别进行聚合计算,生成用于分析的数据表。
|
|
181
|
+
|
|
182
|
+
```sql
|
|
183
|
+
--Scenario 1: Analyze taxi trip patterns by time of day
|
|
184
|
+
CREATE table tutorial.mart_trips_pattern_by_time
|
|
185
|
+
AS
|
|
186
|
+
SELECT
|
|
187
|
+
EXTRACT(HOUR FROM pickup_datetime) AS hour,
|
|
188
|
+
COUNT(*) AS trip_count
|
|
189
|
+
FROM tutorial.int_fhvhv_tripdata
|
|
190
|
+
GROUP BY hour;
|
|
191
|
+
|
|
192
|
+
--Scenario 2: Analyze taxi trip patterns by day of the week
|
|
193
|
+
CREATE table tutorial.mart_trips_pattern_by_dayofweek
|
|
194
|
+
AS
|
|
195
|
+
SELECT
|
|
196
|
+
EXTRACT(DAY FROM pickup_datetime) AS day_of_week,
|
|
197
|
+
COUNT(*) AS trip_count
|
|
198
|
+
FROM tutorial.int_fhvhv_tripdata
|
|
199
|
+
GROUP BY day_of_week;
|
|
200
|
+
|
|
201
|
+
--Scenario 3: Analyze taxi trip patterns by pickup location
|
|
202
|
+
CREATE table tutorial.mart_trips_pattern_by_pickup_location
|
|
203
|
+
AS
|
|
204
|
+
SELECT
|
|
205
|
+
PULocationID,
|
|
206
|
+
COUNT(*) AS trip_count
|
|
207
|
+
FROM tutorial.int_fhvhv_tripdata
|
|
208
|
+
GROUP BY PULocationID;
|
|
209
|
+
|
|
210
|
+
--Scenario 4: Analyze taxi trip patterns by dropoff location
|
|
211
|
+
CREATE table tutorial.mart_trips_pattern_by_dropoff_location
|
|
212
|
+
AS
|
|
213
|
+
SELECT
|
|
214
|
+
DOLocationID,
|
|
215
|
+
COUNT(*) AS trip_count
|
|
216
|
+
FROM tutorial.int_fhvhv_tripdata
|
|
217
|
+
GROUP BY DOLocationID;
|
|
218
|
+
|
|
219
|
+
--Scenario 5:Trips per day
|
|
220
|
+
CREATE table tutorial.mart_trips_per_day
|
|
221
|
+
AS
|
|
222
|
+
SELECT
|
|
223
|
+
pickup_datetime::date AS date,
|
|
224
|
+
sum(trip_miles) AS trip_miles
|
|
225
|
+
FROM tutorial.int_fhvhv_tripdata
|
|
226
|
+
GROUP BY date;
|
|
227
|
+
|
|
228
|
+
--Scenario 6:Total driver pay per company
|
|
229
|
+
CREATE table tutorial.mart_trips_driver_pay_per_company
|
|
230
|
+
AS
|
|
231
|
+
SELECT
|
|
232
|
+
CONCAT(YEAR(pickup_datetime), '-', MONTH(pickup_datetime)) AS year_month,
|
|
233
|
+
company,
|
|
234
|
+
sum(driver_pay) AS driver_pay
|
|
235
|
+
FROM tutorial.int_fhvhv_tripdata
|
|
236
|
+
GROUP BY year_month,company;
|
|
237
|
+
```
|
|
238
|
+
|
|
239
|
+
检查数据对象是否创建成功。
|
|
240
|
+
|
|
241
|
+
```sql
|
|
242
|
+
--检查新创建数据模型的状态
|
|
243
|
+
show tables in tutorial;
|
|
244
|
+
```
|
|
245
|
+
|
|
246
|
+

|
|
247
|
+
|
|
248
|
+
```sql
|
|
249
|
+
--检查新创建数据模型的数据
|
|
250
|
+
SELECT * FROM tutorial.mart_trips_driver_pay_per_company
|
|
251
|
+
WHERE substr(year_month,0,4)='2021'
|
|
252
|
+
ORDER BY year_month ASC;
|
|
253
|
+
```
|
|
254
|
+
|
|
255
|
+

|
|
256
|
+
|
|
257
|
+
## Step03 使用分析型集群单并发查询
|
|
258
|
+
|
|
259
|
+
1. 切换当前 Session 使用的虚拟集群为 REPORTING_VC。
|
|
260
|
+
|
|
261
|
+
```sql
|
|
262
|
+
-- 1.使用分析型VC进行加速查询分析,要和执行的SQL一起选中执行才会生效
|
|
263
|
+
USE VCLUSTER REPORTING_VC;
|
|
264
|
+
--设置查询作业标签,以便检索过滤,要和执行的SQL一起选中执行才会生效
|
|
265
|
+
SET QUERY_TAG = 'Tutorial02';
|
|
266
|
+
```
|
|
267
|
+
|
|
268
|
+
2. 串行执行 6 个业务分析查询。
|
|
269
|
+
|
|
270
|
+
```sql
|
|
271
|
+
--Scenario 1: Analyze taxi trip patterns by time of day
|
|
272
|
+
SELECT * FROM tutorial.mart_trips_pattern_by_time
|
|
273
|
+
ORDER BY HOUR ASC;
|
|
274
|
+
|
|
275
|
+
--Scenario 2: Analyze taxi trip patterns by day of the week
|
|
276
|
+
SELECT * FROM tutorial.mart_trips_pattern_by_dayofweek
|
|
277
|
+
ORDER BY day_of_week ASC;
|
|
278
|
+
|
|
279
|
+
--Scenario 3: Analyze taxi trip patterns by pickup location
|
|
280
|
+
SELECT * FROM tutorial.mart_trips_pattern_by_pickup_location
|
|
281
|
+
ORDER BY trip_count DESC
|
|
282
|
+
LIMIT 10;
|
|
283
|
+
|
|
284
|
+
--Scenario 4: Analyze taxi trip patterns by dropoff location
|
|
285
|
+
SELECT * FROM tutorial.mart_trips_pattern_by_dropoff_location
|
|
286
|
+
ORDER BY trip_count DESC
|
|
287
|
+
LIMIT 10;
|
|
288
|
+
|
|
289
|
+
--Scenario 5:Trips per day
|
|
290
|
+
SELECT * FROM tutorial.mart_trips_per_day
|
|
291
|
+
WHERE CONCAT(YEAR(date) , MONTH(date)) = '202110'
|
|
292
|
+
ORDER BY date;
|
|
293
|
+
|
|
294
|
+
--Scenario 6:Total driver pay per company
|
|
295
|
+
SELECT * FROM tutorial.mart_trips_driver_pay_per_company
|
|
296
|
+
WHERE substr(year_month,0,4)='2021'
|
|
297
|
+
ORDER BY year_month ASC;
|
|
298
|
+
```
|
|
299
|
+
|
|
300
|
+
3. 观察查询的 Latency 结果。
|
|
301
|
+
|
|
302
|
+
```sql
|
|
303
|
+
--清除QUERY_TAG
|
|
304
|
+
SET QUERY_TAG = '';
|
|
305
|
+
--查看运行的作业执行结果
|
|
306
|
+
SHOW JOBS WHERE QUERY_TAG='Tutorial02' LIMIT 10;
|
|
307
|
+
```
|
|
308
|
+
|
|
309
|
+
您还可以使用 Studio 页面的作业历史功能查看查询作业的执行情况。
|
|
310
|
+

|
|
311
|
+
|
|
312
|
+
## Step04 使用Python任务并发查询
|
|
313
|
+
|
|
314
|
+
通过Python任务进行并发查询测试,查看分析型集群在连续的动态并发查询下的性能表现以及弹性扩展能力。
|
|
315
|
+
|
|
316
|
+
1. 在 Studio 开发模块中,创建 Python 任务。
|
|
317
|
+

|
|
318
|
+
|
|
319
|
+
2. 通过 Lakehouse Python SDK 编写并发测试脚本
|
|
320
|
+
|
|
321
|
+
本教程的脚本实现了以下处理逻辑:
|
|
322
|
+
|
|
323
|
+
* 创建 Lakehouse 服务实例连接,指定工作空间、计算集群名称。
|
|
324
|
+
* 通过提交连续、梯度增加的并发查询,模拟多用户发起的 Dashboard 查询。
|
|
325
|
+
* 收集并打印并发查询下的 Latency 以及计算资源的弹性扩容状态变化。
|
|
326
|
+
|
|
327
|
+
```python
|
|
328
|
+
# Step 04: 使用Studio Python任务进行并发查询
|
|
329
|
+
# 操作步骤:
|
|
330
|
+
# 1.创建Lakehouse服务实例连接,指定工作空间、计算集群名称
|
|
331
|
+
# 2.通过提交连续、梯度增加并发查询来模拟多用户发起的Dashboard查询
|
|
332
|
+
# 3.观察连续并发查询下,分析型计算集群的动态弹性并发能力
|
|
333
|
+
#
|
|
334
|
+
from clickzetta import connect
|
|
335
|
+
import random
|
|
336
|
+
import time
|
|
337
|
+
import concurrent.futures
|
|
338
|
+
import threading
|
|
339
|
+
from queue import Queue
|
|
340
|
+
from datetime import datetime
|
|
341
|
+
|
|
342
|
+
# 建立连接
|
|
343
|
+
conn = connect(
|
|
344
|
+
username='xxx', # 替换为当前登录用户名
|
|
345
|
+
password='xxx', # 替换登录密码
|
|
346
|
+
service='region_id.api.clickzetta.com',
|
|
347
|
+
instance='xxx', # 替换当前服务实例名称。可查看浏览器域名地址,格式为:<instance-name>.<Region_ID>.app.clickzetta.com。例如: 19d58db8.cn-shanghai-alicloud.app.clickzetta.com中,19d58db8代表服务实例名称。
|
|
348
|
+
workspace='xxx', # 替换工作空间名称
|
|
349
|
+
schema='tutorial',
|
|
350
|
+
vcluster='reporting_vc'
|
|
351
|
+
)
|
|
352
|
+
|
|
353
|
+
queries = [
|
|
354
|
+
"""
|
|
355
|
+
SELECT * FROM tutorial.mart_trips_pattern_by_time ORDER BY HOUR ASC;
|
|
356
|
+
""",
|
|
357
|
+
"""
|
|
358
|
+
SELECT * FROM tutorial.mart_trips_pattern_by_dayofweek ORDER BY day_of_week ASC;
|
|
359
|
+
""",
|
|
360
|
+
"""
|
|
361
|
+
SELECT * FROM tutorial.mart_trips_pattern_by_pickup_location ORDER BY trip_count DESC LIMIT 10;
|
|
362
|
+
""",
|
|
363
|
+
"""
|
|
364
|
+
SELECT * FROM tutorial.mart_trips_pattern_by_dropoff_location ORDER BY trip_count DESC LIMIT 10;
|
|
365
|
+
""",
|
|
366
|
+
"""
|
|
367
|
+
SELECT * FROM tutorial.mart_trips_per_day WHERE CONCAT(YEAR(date) , MONTH(date)) = '202110' ORDER BY date;
|
|
368
|
+
""",
|
|
369
|
+
"""
|
|
370
|
+
SELECT * FROM tutorial.mart_trips_driver_pay_per_company WHERE substr(year_month,0,4)='2021' ORDER BY year_month ASC;
|
|
371
|
+
"""
|
|
372
|
+
]
|
|
373
|
+
# 提交查询并计算时延
|
|
374
|
+
def submit_query_and_measure_latency(query):
|
|
375
|
+
# 创建游标对象
|
|
376
|
+
cursor = conn.cursor()
|
|
377
|
+
start_time = time.time()
|
|
378
|
+
# 执行 SQL 查询
|
|
379
|
+
cursor.execute(query)
|
|
380
|
+
# 获取查询结果
|
|
381
|
+
results = cursor.fetchall()
|
|
382
|
+
latency = time.time() - start_time
|
|
383
|
+
return latency
|
|
384
|
+
|
|
385
|
+
# 查询任务
|
|
386
|
+
def query_task(barrier, query_queue, all_latencies):
|
|
387
|
+
while True:
|
|
388
|
+
# 等待所有线程准备好
|
|
389
|
+
barrier.wait()
|
|
390
|
+
|
|
391
|
+
# 提交查询任务
|
|
392
|
+
query = query_queue.get()
|
|
393
|
+
if query is None:
|
|
394
|
+
break
|
|
395
|
+
latency = submit_query_and_measure_latency(query)
|
|
396
|
+
all_latencies.append(latency)
|
|
397
|
+
query_queue.task_done()
|
|
398
|
+
|
|
399
|
+
# 查看计算集群的弹性并发配置动态变化
|
|
400
|
+
def check_cluster_concurrency_scaling():
|
|
401
|
+
cursor = conn.cursor()
|
|
402
|
+
# 执行 SQL 查询
|
|
403
|
+
cursor.execute('desc vcluster reporting_vc;')
|
|
404
|
+
# 获取查询结果
|
|
405
|
+
results = cursor.fetchall()
|
|
406
|
+
for row in results:
|
|
407
|
+
if row[0] == 'current_replicas':
|
|
408
|
+
print(row)
|
|
409
|
+
|
|
410
|
+
# 主函数
|
|
411
|
+
if __name__ == "__main__":
|
|
412
|
+
num_concurrent_list = [4, 8, 12, 16] # 不同并发量
|
|
413
|
+
rounds = 30
|
|
414
|
+
for num_threads in num_concurrent_list:
|
|
415
|
+
print(f"---Running with {num_threads} concurrent queries:---")
|
|
416
|
+
# 用于存储所有线程的结果的共享列表
|
|
417
|
+
all_latencies = []
|
|
418
|
+
|
|
419
|
+
# 创建查询队列
|
|
420
|
+
query_queue = Queue()
|
|
421
|
+
|
|
422
|
+
# 将查询任务放入队列
|
|
423
|
+
for _ in range(num_threads):
|
|
424
|
+
for _ in range(rounds):
|
|
425
|
+
query = random.choice(queries)
|
|
426
|
+
query_queue.put(query)
|
|
427
|
+
|
|
428
|
+
# 创建 Barrier,等待所有线程同时准备好
|
|
429
|
+
barrier = threading.Barrier(num_threads)
|
|
430
|
+
|
|
431
|
+
# 创建并启动线程
|
|
432
|
+
threads = []
|
|
433
|
+
results = []
|
|
434
|
+
start_times = []
|
|
435
|
+
for _ in range(num_threads):
|
|
436
|
+
thread = threading.Thread(target=query_task, args=(barrier, query_queue, all_latencies))
|
|
437
|
+
thread.start()
|
|
438
|
+
threads.append(thread)
|
|
439
|
+
|
|
440
|
+
# 等待所有查询任务完成
|
|
441
|
+
query_queue.join()
|
|
442
|
+
|
|
443
|
+
# 停止线程
|
|
444
|
+
for _ in range(num_threads):
|
|
445
|
+
query_queue.put(None)
|
|
446
|
+
for thread in threads:
|
|
447
|
+
thread.join()
|
|
448
|
+
|
|
449
|
+
# 计算指标
|
|
450
|
+
all_latencies.sort()
|
|
451
|
+
avg_latency = sum(all_latencies) / len(all_latencies)
|
|
452
|
+
p95_index = int(len(all_latencies) * 0.95)
|
|
453
|
+
p95_latency = all_latencies[p95_index]
|
|
454
|
+
p99_index = int(len(all_latencies) * 0.99)
|
|
455
|
+
p99_latency = all_latencies[p99_index]
|
|
456
|
+
qps = len(all_latencies) / sum(all_latencies)
|
|
457
|
+
|
|
458
|
+
# 打印结果
|
|
459
|
+
print("Totoal Queries:", len(all_latencies))
|
|
460
|
+
print("Average Latency:", avg_latency)
|
|
461
|
+
print("P95 Latency:", p95_latency)
|
|
462
|
+
print("P99 Latency:", p99_latency)
|
|
463
|
+
print("Queries per Second (QPS):", qps)
|
|
464
|
+
check_cluster_concurrency_scaling()
|
|
465
|
+
```
|
|
466
|
+
|
|
467
|
+
当设置 reporting_vc 的单 Replica 最大并发数为 4 时,打印结果示例如下:
|
|
468
|
+
|
|
469
|
+
* --Running with 4 concurrent queries:--- Total Queries: 120 Average Latency: 0.2201933761437734 P95 Latency: 0.43064022064208984 P99 Latency: 0.683488130569458 Queries per Second (QPS): 4.5414626793635176 ('current_replicas', '1') ---Running with 8 concurrent queries:--- Total Queries: 240 Average Latency: 0.20615292688210804 P95 Latency: 0.2397170066833496 P99 Latency: 0.4295358657836914 Queries per Second (QPS): 4.850767898977571 ('current_replicas', '2') ---Running with 12 concurrent queries:--- Total Queries: 360 Average Latency: 0.2232776681582133 P95 Latency: 0.27333879470825195 P99 Latency: 0.46774768829345703 Queries per Second (QPS): 4.478728250115035 ('current_replicas', '3') ---Running with 16 concurrent queries:--- Total Queries: 480 Average Latency: 0.23430742422739664 P95 Latency: 0.25676393508911133 P99 Latency: 0.4392051696777344 Queries per Second (QPS): 4.267897200856488 ('current_replicas', '4')
|
|
470
|
+
|
|
471
|
+
客户端分别模拟 4、8、12、16 四轮并发查询,每轮每个并发连续提交 30 次查询。可以观察到 `reporting_vc` 会根据客户端并发度动态增加副本(Replica)数量,在用户无感知集群动态扩容的前提下,保证不同并发数量下平均时延、P95、P99、QPS 指标保持稳定。
|
|
@@ -0,0 +1,55 @@
|
|
|
1
|
+
# GRANT TO SHARE 语句
|
|
2
|
+
|
|
3
|
+
## 功能描述
|
|
4
|
+
|
|
5
|
+
`GRANT TO SHARE` 语句的主要功能是将指定的表(table)或视图(view)添加到一个已存在的分享对象(share)中,并授予相应的权限。通过使用该语句,用户可以方便地对数据进行共享和管理,同时确保数据的安全性和可访问性。
|
|
6
|
+
|
|
7
|
+
仅支持将表(table)或视图(view)添加到类型(kind属性)为'OUTBOUND'(对外分享)的分享对象中。其他服务实例分享进入的分享对象(share)不可添加数据对象。
|
|
8
|
+
|
|
9
|
+
## 语法格式
|
|
10
|
+
|
|
11
|
+
```SQL
|
|
12
|
+
GRANT select, read metadata ON {TABLE <table_name> | VIEW <view_name>} TO SHARE <share_name>;
|
|
13
|
+
```
|
|
14
|
+
|
|
15
|
+
**参数说明**
|
|
16
|
+
|
|
17
|
+
1. **share_name**:需要操作的分享对象名称。
|
|
18
|
+
2. **table_name**:需要添加到分享对象中的表名称。
|
|
19
|
+
3. **view_name**:需要添加到分享对象中的视图名称。
|
|
20
|
+
4. **select, read metadata**:需要授予分享对象的权限点。`select` 权限允许对被分享的数据进行查询操作;`read metadata` 权限使得加入分享对象的表和视图的元数据对被分享方可见。当授予表或视图的 `read metadata` 权限时,其所属的模式(schema)的 `read metadata` 权限也将自动被授予至分享对象,以实现表和视图对被分享方的可见性。
|
|
21
|
+
|
|
22
|
+
## 使用示例
|
|
23
|
+
|
|
24
|
+
**示例 1:指定表进行分享**
|
|
25
|
+
|
|
26
|
+
假设我们有一个名为 `share_demo` 的分享对象,以及一个名为 `share_demo_table` 的表。我们希望将 `share_demo_table` 表添加到 `share_demo` 分享对象中,并授予 `select` 和 `read metadata` 权限。可以使用以下语句实现:
|
|
27
|
+
|
|
28
|
+
```SQL
|
|
29
|
+
GRANT select, read metadata ON TABLE share_demo_table TO SHARE share_demo;
|
|
30
|
+
```
|
|
31
|
+
|
|
32
|
+
**示例 2:指定视图进行分享**
|
|
33
|
+
|
|
34
|
+
在这个示例中,我们有一个名为 `share_demo` 的分享对象和一个名为 `share_demo_view` 的视图。我们希望将 `share_demo_view` 视图添加到 `share_demo` 分享对象中,并授予相应的权限。可以使用以下语句:
|
|
35
|
+
|
|
36
|
+
```SQL
|
|
37
|
+
GRANT select, read metadata ON VIEW share_demo_view TO SHARE share_demo;
|
|
38
|
+
```
|
|
39
|
+
|
|
40
|
+
**示例 3:同时分享多个表和视图**
|
|
41
|
+
|
|
42
|
+
有时,我们可能需要将多个表和视图添加到分享对象中。此时需要多次执行 GRANT 语句,每个 GRANT 语句将其中一个数据对象加入到指定的 share 对象中。以下示例展示了如何将 `share_demo_table1`、`share_demo_table2` 和 `share_demo_view` 添加到 `share_demo` 分享对象中,并授予相应的权限:
|
|
43
|
+
|
|
44
|
+
```SQL
|
|
45
|
+
GRANT select, read metadata ON TABLE share_demo_table1, share_demo_table2 TO SHARE share_demo;
|
|
46
|
+
GRANT select, read metadata ON VIEW share_demo_view TO SHARE share_demo;
|
|
47
|
+
```
|
|
48
|
+
|
|
49
|
+
## 注意事项
|
|
50
|
+
|
|
51
|
+
1. 在执行 `GRANT TO SHARE` 语句之前,请确保分享对象(share)已经存在。
|
|
52
|
+
2. 仅当您具备该对象的 select 和 read metadata 权限,并可将该权限做二次授权时,才可将该对象添加至数据分享对象中。
|
|
53
|
+
3. 当分享表或视图时,请确保充分考虑数据的安全性和可访问性,以避免不必要的风险。
|
|
54
|
+
|
|
55
|
+
^
|
|
@@ -0,0 +1,100 @@
|
|
|
1
|
+
## 功能
|
|
2
|
+
|
|
3
|
+
本文档介绍了如何在 Lakehouse SQL 中使用 GRANT 语句,将指定的权限授予某个用户或角色。通过使用 GRANT 语句,您可以对用户进行细粒度的权限控制,确保数据安全和合规性。
|
|
4
|
+
|
|
5
|
+
## 语法
|
|
6
|
+
|
|
7
|
+
### 1. 将指定权限授予某用户
|
|
8
|
+
|
|
9
|
+
```SQL
|
|
10
|
+
GRANT workspacePrivileges ON WORKSPACE workspace_name
|
|
11
|
+
| workspaceObjectPrivileges ON { ROLE | SCHEMA | VCLUSTER | FUNCTION } workspace_object_name
|
|
12
|
+
| schemaPrivileges ON SCHEMA schema_name
|
|
13
|
+
| schemaObjectPrivileges ON { TABLE | VIEW | MATERIALIZED VIEW } schema_object_name
|
|
14
|
+
TO USER username [ WITH GRANT OPTION];
|
|
15
|
+
--参数解释
|
|
16
|
+
workspacePriveleges ::=
|
|
17
|
+
CREATE { SCHEMA | VCLUSTER }
|
|
18
|
+
|
|
19
|
+
-- workspace下对象授权
|
|
20
|
+
workspaceObjectPriveleges ::=
|
|
21
|
+
-- SCHEMA
|
|
22
|
+
ALTER | DROP | READ METADATA | ALL [PRIVILEGES]
|
|
23
|
+
-- VCLUSTER
|
|
24
|
+
ALTER | DROP | USE | READ METADATA | ALL [PRIVILEGES]
|
|
25
|
+
--job
|
|
26
|
+
ALTER | CANCEL | READ METADATA | ALL [PRIVILEGES]
|
|
27
|
+
|
|
28
|
+
|
|
29
|
+
--schema授权
|
|
30
|
+
schemaPrivileges ::=
|
|
31
|
+
CREATE { TABLE | VIEW | MATERIALIZED VIEW } | ALL
|
|
32
|
+
|
|
33
|
+
--schema下对象授权
|
|
34
|
+
schemaObjectPriveleges ::=
|
|
35
|
+
-- table
|
|
36
|
+
ALTER | DROP | SELECT | INSERT | READ METADATA | ALL
|
|
37
|
+
-- view
|
|
38
|
+
ALTER | DROP | SELECT | ALL
|
|
39
|
+
-- MATERIALIZED VIEW
|
|
40
|
+
ALTER | DROP | SELECT | ALL
|
|
41
|
+
```
|
|
42
|
+
|
|
43
|
+
参数说明
|
|
44
|
+
|
|
45
|
+
**1.workspacePriveleges**
|
|
46
|
+
workspace下创建对象的权限如CREATE VCLUSTER
|
|
47
|
+
|
|
48
|
+
**2.workspaceObjectPriveleges**
|
|
49
|
+
workspace下对象的修改和show权限
|
|
50
|
+
|
|
51
|
+
**3.schemaPrivileges**
|
|
52
|
+
schema下创建对象的权限
|
|
53
|
+
|
|
54
|
+
**4.schemaObjectPriveleges**
|
|
55
|
+
schema下对象表修改、表删除、表查询等权限
|
|
56
|
+
|
|
57
|
+
### - 将指定权限授予某用户
|
|
58
|
+
|
|
59
|
+
```
|
|
60
|
+
GRANT ROLE role_name TO USER user_name;
|
|
61
|
+
```
|
|
62
|
+
|
|
63
|
+
## 参数说明
|
|
64
|
+
|
|
65
|
+
1. `workspacePrivileges`:在 workspace 下创建对象的权限,例如 `CREATE SCHEMA`、`CREATE VCLUSTER` 等。
|
|
66
|
+
2. `workspaceObjectPrivileges`:在 workspace 下对象的修改和查询权限,例如 `ALTER`、`DROP`、`READ METADATA` 等。
|
|
67
|
+
3. `schemaPrivileges`:在 schema 下创建对象的权限,例如 `CREATE TABLE`、`CREATE VIEW`、`CREATE MATERIALIZED VIEW` 等。
|
|
68
|
+
4. `schemaObjectPrivileges`:在 schema 下对象的修改、查询等权限,例如 `ALTER`、`DROP`、`SELECT` 等。
|
|
69
|
+
5. `role_name`:角色名称,支持自定义角色和系统默认角色。系统默认角色包括 `system_admin`、`user_admin`、`security_admin`、`audit_admin` 等。
|
|
70
|
+
6. `username`:用户名称。
|
|
71
|
+
7. `WITH GRANT OPTION`:表示被授权的用户可以将这些权限再授权给其他用户。
|
|
72
|
+
|
|
73
|
+
## 使用示例
|
|
74
|
+
|
|
75
|
+
1. 授权给用户 `uat_demo` 在 `lakehouse_public` workspace 下创建 `VIRTUAL CLUSTER` 权限:
|
|
76
|
+
```SQL
|
|
77
|
+
GRANT CREATE VCLUSTER ON WORKSPACE lakehouse_public TO USER uat_demo;
|
|
78
|
+
```
|
|
79
|
+
|
|
80
|
+
2. 授权给用户 `uat_demo` 修改名为 `default` 的 `VIRTUAL CLUSTER` 权限:
|
|
81
|
+
```SQL
|
|
82
|
+
GRANT ALTER VCLUSTER ON VCLUSTER default TO USER uat_demo;
|
|
83
|
+
```
|
|
84
|
+
|
|
85
|
+
3. 授权给用户 `uat_demo` 在 `public` schema 下创建表和视图的权限:
|
|
86
|
+
```SQL
|
|
87
|
+
GRANT CREATE TABLE, CREATE VIEW ON SCHEMA public TO USER uat_demo;
|
|
88
|
+
```
|
|
89
|
+
|
|
90
|
+
4. 授权给用户 `uat_demo` 查询 `public` schema 下所有表和视图的权限:
|
|
91
|
+
```SQL
|
|
92
|
+
GRANT SELECT ON ALL TABLES IN SCHEMA public TO USER uat_demo;
|
|
93
|
+
```
|
|
94
|
+
|
|
95
|
+
5. 授权给角色 `user_admin` 的用户 `uat_demo` 在 `lakehouse_public` workspace 下的 `security` schema 下创建表和视图的权限:
|
|
96
|
+
```SQL
|
|
97
|
+
GRANT CREATE TABLE, CREATE VIEW ON SCHEMA security TO ROLE user_admin;
|
|
98
|
+
```
|
|
99
|
+
|
|
100
|
+
通过以上示例,您可以根据实际需求灵活地为用户或角色分配相应的权限。请确保在授权时遵循最小权限原则,以降低安全风险。
|