dremiojs 1.0.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.eslintrc.json +14 -0
- package/.prettierrc +7 -0
- package/README.md +59 -0
- package/dremiodocs/dremio-cloud/cloud-api-reference.md +748 -0
- package/dremiodocs/dremio-cloud/dremio-cloud-about.md +225 -0
- package/dremiodocs/dremio-cloud/dremio-cloud-admin.md +3754 -0
- package/dremiodocs/dremio-cloud/dremio-cloud-bring-data.md +6098 -0
- package/dremiodocs/dremio-cloud/dremio-cloud-changelog.md +32 -0
- package/dremiodocs/dremio-cloud/dremio-cloud-developer.md +1147 -0
- package/dremiodocs/dremio-cloud/dremio-cloud-explore-analyze.md +2522 -0
- package/dremiodocs/dremio-cloud/dremio-cloud-get-started.md +300 -0
- package/dremiodocs/dremio-cloud/dremio-cloud-help-support.md +869 -0
- package/dremiodocs/dremio-cloud/dremio-cloud-manage-govern.md +800 -0
- package/dremiodocs/dremio-cloud/dremio-cloud-overview.md +36 -0
- package/dremiodocs/dremio-cloud/dremio-cloud-security.md +1844 -0
- package/dremiodocs/dremio-cloud/sql-docs.md +7180 -0
- package/dremiodocs/dremio-software/dremio-software-acceleration.md +1575 -0
- package/dremiodocs/dremio-software/dremio-software-admin.md +884 -0
- package/dremiodocs/dremio-software/dremio-software-client-applications.md +3277 -0
- package/dremiodocs/dremio-software/dremio-software-data-products.md +560 -0
- package/dremiodocs/dremio-software/dremio-software-data-sources.md +8701 -0
- package/dremiodocs/dremio-software/dremio-software-deploy-dremio.md +3446 -0
- package/dremiodocs/dremio-software/dremio-software-get-started.md +848 -0
- package/dremiodocs/dremio-software/dremio-software-monitoring.md +422 -0
- package/dremiodocs/dremio-software/dremio-software-reference.md +677 -0
- package/dremiodocs/dremio-software/dremio-software-security.md +2074 -0
- package/dremiodocs/dremio-software/dremio-software-v25-api.md +32637 -0
- package/dremiodocs/dremio-software/dremio-software-v26-api.md +36757 -0
- package/jest.config.js +10 -0
- package/package.json +25 -0
- package/src/api/catalog.ts +74 -0
- package/src/api/jobs.ts +105 -0
- package/src/api/reflection.ts +77 -0
- package/src/api/source.ts +61 -0
- package/src/api/user.ts +32 -0
- package/src/client/base.ts +66 -0
- package/src/client/cloud.ts +37 -0
- package/src/client/software.ts +73 -0
- package/src/index.ts +16 -0
- package/src/types/catalog.ts +31 -0
- package/src/types/config.ts +18 -0
- package/src/types/job.ts +18 -0
- package/src/types/reflection.ts +29 -0
- package/tests/integration_manual.ts +95 -0
- package/tsconfig.json +19 -0
|
@@ -0,0 +1,677 @@
|
|
|
1
|
+
# Dremio Software - Reference
|
|
2
|
+
|
|
3
|
+
|
|
4
|
+
|
|
5
|
+
---
|
|
6
|
+
|
|
7
|
+
# Source: https://docs.dremio.com/current/reference/
|
|
8
|
+
|
|
9
|
+
Version: current [26.x]
|
|
10
|
+
|
|
11
|
+
# Reference
|
|
12
|
+
|
|
13
|
+
This section contains details about using Dremio's REST API, SQL commands and functions, and security advisories.
|
|
14
|
+
|
|
15
|
+
* [**Admin CLI**](/current/reference/admin-cli/) - The reference documentation on the `dremio-admin` CLI commands.
|
|
16
|
+
* [**API Reference**](/current/reference/api/) - The reference documentation on the Dremio REST APIs.
|
|
17
|
+
* [**SQL Reference**](/current/reference/sql/) - The reference documentation on Dremio SQL to manage your data.
|
|
18
|
+
* [**Security Bulletins**](/current/reference/bulletins/) - Security bulletins that disclose vulnerabilities found in Dremio's supported products.
|
|
19
|
+
|
|
20
|
+
Was this page helpful?
|
|
21
|
+
|
|
22
|
+
[Previous
|
|
23
|
+
|
|
24
|
+
API Reference](/current/reference/api/)[Next
|
|
25
|
+
|
|
26
|
+
Admin CLI](/current/reference/admin-cli/)
|
|
27
|
+
|
|
28
|
+
---
|
|
29
|
+
|
|
30
|
+
# Source: https://docs.dremio.com/current/reference/admin-cli/
|
|
31
|
+
|
|
32
|
+
Version: current [26.x]
|
|
33
|
+
|
|
34
|
+
On this page
|
|
35
|
+
|
|
36
|
+
# Admin CLI
|
|
37
|
+
|
|
38
|
+
This topic summarizes the `dremio-admin` CLI commands.
|
|
39
|
+
|
|
40
|
+
## Syntax
|
|
41
|
+
|
|
42
|
+
Syntax for dremio-admin commands
|
|
43
|
+
|
|
44
|
+
```
|
|
45
|
+
dremio-admin [--config <conf-dir>] (encrypt|set-password|upgrade|recommend-reflections|delete-user-homespace|optimize-acls|export-profiles|remove-duplicate-users|clean|remove-duplicate-roles|reset-catalog-search|backup|delete-all-users|restore|repair-acls|nessie-maintenance) [args...]
|
|
46
|
+
```
|
|
47
|
+
|
|
48
|
+
## Options
|
|
49
|
+
|
|
50
|
+
| Option | Description |
|
|
51
|
+
| --- | --- |
|
|
52
|
+
| `--help, -h` | Displays usage information for the CLI commands. |
|
|
53
|
+
| `--config <conf-dir>` | Used when the configuration file location is different than the `/opt/dremio/conf` default directory. For example, if `dremio.conf`, `dremio-env`, `logbook.xml`, and `logbook-admin.xml` are located in `/etc/dremio`, you will have to run all of the `dremio-admin` commands as `./dremio-admin --config /etc/dremio <command> <arguments>`. |
|
|
54
|
+
|
|
55
|
+
## Commands
|
|
56
|
+
|
|
57
|
+
| Command | Description |
|
|
58
|
+
| --- | --- |
|
|
59
|
+
| `backup` | Backs up Dremio metadata and user-uploaded files. |
|
|
60
|
+
| `clean` | Cleans Dremio metadata. |
|
|
61
|
+
| `delete-all-users` | Deletes all internal Dremio users. |
|
|
62
|
+
| `delete-user-homespace` | Deletes the user's home space. |
|
|
63
|
+
| `encrypt` | [Encrypt](/current/reference/admin-cli/encryption/) a user-supplied string. |
|
|
64
|
+
| `export-pats` | Exports personal access tokens (PATs). |
|
|
65
|
+
| `export-profiles` | Exports profiles of jobs from Dremio. |
|
|
66
|
+
| `import-pats` | Imports personal access tokens (PATs). |
|
|
67
|
+
| `nessie-maintenance` | Runs embedded Nessie repository maintenance tasks. |
|
|
68
|
+
| `optimize-acls` | Optimizes access control lists of sources, spaces, and datasets. |
|
|
69
|
+
| `recommend-reflections` | Recommend Reflections. |
|
|
70
|
+
| `remove-duplicate-roles` | Removes duplicate roles from Dremio. |
|
|
71
|
+
| `remove-duplicate-users` | Removes duplicate users from Dremio. |
|
|
72
|
+
| `reset-catalog-search` | Resets index to recover catalog search. |
|
|
73
|
+
| `repair-acls` | Repairs access control lists of sources, spaces, and datasets. |
|
|
74
|
+
| `restore` | Restores Dremio metadata and user-uploaded files. |
|
|
75
|
+
| `set-password` | Sets passwords for Dremio users (non-LDAP). |
|
|
76
|
+
| `upgrade` | Upgrades the KV store version. There are no options available for this command. |
|
|
77
|
+
|
|
78
|
+
## Log Directory
|
|
79
|
+
|
|
80
|
+
The default value for `DREMIO_ADMIN_LOG_DIR` is null (not set). When this parameter is *not* set, log files are *not* created.
|
|
81
|
+
|
|
82
|
+
To set the log directory, provide the log directory path by running the following:
|
|
83
|
+
|
|
84
|
+
Set log directory
|
|
85
|
+
|
|
86
|
+
```
|
|
87
|
+
export DREMIO_ADMIN_LOG_DIR=<path>
|
|
88
|
+
```
|
|
89
|
+
|
|
90
|
+
note
|
|
91
|
+
|
|
92
|
+
The export option must be set and access must be available for the user running the `dremio-admin` command.
|
|
93
|
+
|
|
94
|
+
## Log Verbosity
|
|
95
|
+
|
|
96
|
+
Log verbosity is used in conjunction with `DREMIO_ADMIN_LOG_DIR`. Otherwise, all the output is printed to `stdout`; there is no control on setting verbosity for `stdout`.
|
|
97
|
+
|
|
98
|
+
Verbosity options include:
|
|
99
|
+
|
|
100
|
+
* TRACE
|
|
101
|
+
* DEBUG
|
|
102
|
+
* INFO (default)
|
|
103
|
+
* WARN
|
|
104
|
+
* ERROR
|
|
105
|
+
|
|
106
|
+
To set the log verbosity (default: INFO), provide the verbose level by running the following:
|
|
107
|
+
|
|
108
|
+
Set log verbosity
|
|
109
|
+
|
|
110
|
+
```
|
|
111
|
+
export DREMIO_ADMIN_LOG_VERBOSITY=<value>
|
|
112
|
+
```
|
|
113
|
+
|
|
114
|
+
## For More Information
|
|
115
|
+
|
|
116
|
+
* [Backup](/current/reference/admin-cli/backup/)
|
|
117
|
+
* [Clean Metadata](/current/reference/admin-cli/metadata-cleanup/)
|
|
118
|
+
* [Encrypt Credentials](/current/reference/admin-cli/encryption/)
|
|
119
|
+
* [Export and Import Personal Access Tokens (PATs)](/current/reference/admin-cli/export-import-pat/)
|
|
120
|
+
* [Export Profiles](/current/reference/admin-cli/export-profiles/)
|
|
121
|
+
* [Perform Nessie Maintenance](/current/reference/admin-cli/nessie-maintenance/)
|
|
122
|
+
* [Remove Duplicate Roles](/current/reference/admin-cli/remove-roles/)
|
|
123
|
+
* [Repair ACLs](/current/reference/admin-cli/repair-acls/)
|
|
124
|
+
* [Restore](/current/reference/admin-cli/restore/)
|
|
125
|
+
* [Reset Password](/current/reference/admin-cli/reset-password/)
|
|
126
|
+
* [Upgrade KV Store](/current/reference/admin-cli/upgrade-KVstore/)
|
|
127
|
+
|
|
128
|
+
Was this page helpful?
|
|
129
|
+
|
|
130
|
+
[Previous
|
|
131
|
+
|
|
132
|
+
Dremio on Kubernetes](/current/admin/admin-dremio-kubernetes/)[Next
|
|
133
|
+
|
|
134
|
+
Back up Dremio](/current/reference/admin-cli/backup)
|
|
135
|
+
|
|
136
|
+
* Syntax
|
|
137
|
+
* Options
|
|
138
|
+
* Commands
|
|
139
|
+
* Log Directory
|
|
140
|
+
* Log Verbosity
|
|
141
|
+
* For More Information
|
|
142
|
+
|
|
143
|
+
---
|
|
144
|
+
|
|
145
|
+
# Source: https://docs.dremio.com/current/reference/api/
|
|
146
|
+
|
|
147
|
+
Version: current [26.x]
|
|
148
|
+
|
|
149
|
+
On this page
|
|
150
|
+
|
|
151
|
+
# API Reference
|
|
152
|
+
|
|
153
|
+
The Dremio REST API is organized by resource types such as `sources` and is designed around RESTful principles.
|
|
154
|
+
|
|
155
|
+
* `GET` is used to retrieve existing resources
|
|
156
|
+
* `POST` creates new resources
|
|
157
|
+
* `PUT` updates resources
|
|
158
|
+
* `DELETE` removes resources
|
|
159
|
+
|
|
160
|
+
## Base URL
|
|
161
|
+
|
|
162
|
+
All API URLs referenced in this documentation have the following base URL unless otherwise specified:
|
|
163
|
+
|
|
164
|
+
Base URL
|
|
165
|
+
|
|
166
|
+
```
|
|
167
|
+
{hostname}/api/v3
|
|
168
|
+
```
|
|
169
|
+
|
|
170
|
+
Versions prior to `v3` are considered internal and are subject to change without notice.
|
|
171
|
+
|
|
172
|
+
In this documentation, curly braces (`{}`) are used to indicate sections of URLs where you have to supply a value. For example:
|
|
173
|
+
|
|
174
|
+
User-supplied values in URLs
|
|
175
|
+
|
|
176
|
+
```
|
|
177
|
+
/api/v3/source/{id}
|
|
178
|
+
```
|
|
179
|
+
|
|
180
|
+
## Authentication
|
|
181
|
+
|
|
182
|
+
Each REST request requires an authorization header with a Dremio access token to authenticate the requester unless otherwise indicated. Dremio accepts three types of access tokens for authenticating REST requests.
|
|
183
|
+
|
|
184
|
+
* **OAuth access tokens** are created in Dremio using the Dremio REST API.
|
|
185
|
+
* **Personal access tokens** are created in the Dremio console or with REST.
|
|
186
|
+
* **Authentication tokens** are generated from a username and password using the Dremio v2 API.
|
|
187
|
+
|
|
188
|
+
All Dremio access tokens are Bearer tokens and can be used in the REST authorization header of each REST request.
|
|
189
|
+
|
|
190
|
+
Example Dremio REST request
|
|
191
|
+
|
|
192
|
+
```
|
|
193
|
+
curl -X GET 'https://{hostname}/api/v3/{path_to_endpoint}' \
|
|
194
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
195
|
+
--header 'Content-Type: application/json'
|
|
196
|
+
```
|
|
197
|
+
|
|
198
|
+
### OAuth Access Tokens Enterprise
|
|
199
|
+
|
|
200
|
+
Users can create OAuth access tokens by exchanging a local or LDAP username and password, a PAT, or an external JWT using the `/oauth/token` REST API. Dremio provides [sample code](/current/reference/api/oauth-token) for each of these cases.
|
|
201
|
+
|
|
202
|
+
Dremio recommends OAuth access tokens to improve system security:
|
|
203
|
+
|
|
204
|
+
* OAuth access tokens are typically short-lived, reducing the window of opportunity for attackers if a token is compromised.
|
|
205
|
+
* Users must manually revoke compromised or suspected PATs, often leading to forgotten, unused tokens.
|
|
206
|
+
|
|
207
|
+
### Personal Access Tokens Enterprise
|
|
208
|
+
|
|
209
|
+
Any user can create personal access tokens (PATs) [in the Dremio console](/current/security/authentication/personal-access-tokens/#creating-a-pat) or [using REST](/current/reference/api/personal-access-token#creating-a-pat). Users can configure the lifetime of each personal access token, from 1 day to a maximum defined by the `auth.personal-access-token.max_lifetime_days` [support setting](/current/admin/support-settings#support-keys).
|
|
210
|
+
|
|
211
|
+
### Dremio Authentication Tokens
|
|
212
|
+
|
|
213
|
+
Users can generate authentication tokens from their Dremio username and password. Authentication tokens have a nonconfigurable lifetime of 30 hours.
|
|
214
|
+
|
|
215
|
+
caution
|
|
216
|
+
|
|
217
|
+
Generating an authentication token requires API v2. API versions prior to v3 are considered internal and are subject to change without notice.
|
|
218
|
+
|
|
219
|
+
To generate an authentication token:
|
|
220
|
+
|
|
221
|
+
* Send an API request to the login URL with your Dremio username and password in the request body.
|
|
222
|
+
|
|
223
|
+
### Example
|
|
224
|
+
|
|
225
|
+
Request
|
|
226
|
+
|
|
227
|
+
```
|
|
228
|
+
curl -X POST 'http://{hostname}/apiv2/login' \
|
|
229
|
+
--header 'Content-Type: application/json' \
|
|
230
|
+
--data-raw '{
|
|
231
|
+
"userName": "dremio",
|
|
232
|
+
"password": "dremio123"
|
|
233
|
+
}'
|
|
234
|
+
```
|
|
235
|
+
|
|
236
|
+
Response
|
|
237
|
+
|
|
238
|
+
```
|
|
239
|
+
{
|
|
240
|
+
"token": "4ksrt534vk7fkq64xh55g7776b",
|
|
241
|
+
"userName": "dremio",
|
|
242
|
+
"firstName": "Dre",
|
|
243
|
+
"lastName": "Mio",
|
|
244
|
+
"expires": 1686578200000,
|
|
245
|
+
"email": "dremio@dremio.test",
|
|
246
|
+
"userId": "5a679dd5-52d7-402a-871d-7fbee3fe8007",
|
|
247
|
+
"admin": true,
|
|
248
|
+
"clusterId": "7468ce46-58af-4dce-a42f-4c51048968f5",
|
|
249
|
+
"clusterCreatedAt": 1681311939728,
|
|
250
|
+
"version": "24.0.0-main-202305040803350903-2d5579e3",
|
|
251
|
+
"permissions": {
|
|
252
|
+
"canUploadProfiles": true,
|
|
253
|
+
"canDownloadProfiles": true,
|
|
254
|
+
"canEmailForSupport": true,
|
|
255
|
+
"canChatForSupport": false,
|
|
256
|
+
"canViewAllJobs": true,
|
|
257
|
+
"canCreateUser": true,
|
|
258
|
+
"canCreateRole": true,
|
|
259
|
+
"canCreateSource": true,
|
|
260
|
+
"canUploadFile": true,
|
|
261
|
+
"canManageNodeActivity": true,
|
|
262
|
+
"canManageEngines": true,
|
|
263
|
+
"canManageQueues": true,
|
|
264
|
+
"canManageEngineRouting": true,
|
|
265
|
+
"canManageSupportSettings": true
|
|
266
|
+
},
|
|
267
|
+
"userCreatedAt": 1681311939789
|
|
268
|
+
}
|
|
269
|
+
```
|
|
270
|
+
|
|
271
|
+
note
|
|
272
|
+
|
|
273
|
+
If your password includes single or double quotes, you may need to escape the quotes in your authentication token request. The required escapes vary depending on how you send the request. For example, if you use cURL and the password is `example'6852"`, the password value should be `example'\''6852\"` in the authentication token request.
|
|
274
|
+
|
|
275
|
+
* Use the `token` attribute of the JSON return object as a Bearer token, or append the prefix `_dremio` to compose a self-contained token as `_dremio<tokenstring>`.
|
|
276
|
+
|
|
277
|
+
Example: Request Using A Self-Contained Authorization Token
|
|
278
|
+
|
|
279
|
+
```
|
|
280
|
+
curl -X GET 'https://{hostname}/api/v3/catalog' \
|
|
281
|
+
--header 'Authorization: _dremio4ksrt534vk7fkq64xh55g7776b' \
|
|
282
|
+
--header 'Content-Type: application/json'
|
|
283
|
+
```
|
|
284
|
+
|
|
285
|
+
## Errors
|
|
286
|
+
|
|
287
|
+
Error messages will be sent back in the response body using the following format:
|
|
288
|
+
|
|
289
|
+
Error Messages Format
|
|
290
|
+
|
|
291
|
+
```
|
|
292
|
+
{
|
|
293
|
+
"errorMessage": "brief error message",
|
|
294
|
+
"moreInfo": "detailed error message"
|
|
295
|
+
}
|
|
296
|
+
```
|
|
297
|
+
|
|
298
|
+
## Query Parameters
|
|
299
|
+
|
|
300
|
+
Dremio supports query parameters for many API endpoints. The documentation for each API lists the supported query parameters for specific endpoints, along with any default and maximum values for the query parameters for that endpoint.
|
|
301
|
+
|
|
302
|
+
### pageToken Query Parameter
|
|
303
|
+
|
|
304
|
+
Use the `pageToken` query parameter to split large sets of results into multiple pages.
|
|
305
|
+
|
|
306
|
+
Endpoints may support the `pageToken` query parameter based on either a [built-in maximum](/current/reference/api/#built-in-maximum) number of results per page or a [user-specified maximum](/current/reference/api/#user-specified-maximum) that is established with a separate query parameter. The documentation for each API lists the built-in maximum or the query parameter to use to specify a maximum, as applicable.
|
|
307
|
+
|
|
308
|
+
note
|
|
309
|
+
|
|
310
|
+
Do not change any other query parameters included in the request URL when you use `pageToken`.
|
|
311
|
+
|
|
312
|
+
#### Built-in Maximum
|
|
313
|
+
|
|
314
|
+
If the endpoint has a built-in maximum number of results per page, responses automatically include a page token attribute when the response contains more results than the built-in maximum. Use the value for this token in the request URL as the `pageToken` value to retrieve the next page of results.
|
|
315
|
+
|
|
316
|
+
As an example, the [Reflection summary](/current/reference/api/reflections/reflection-summary/#retrieving-a-reflection-summary) endpoint supports the `pageToken` parameter. If the Reflection summary contains more than 50 results, the response will include the `nextPageToken` attribute. To retrieve the next 50 results, add `?pageToken={nextPageToken_value}` to the request URL:
|
|
317
|
+
|
|
318
|
+
Example Request with pageToken Query Parameter
|
|
319
|
+
|
|
320
|
+
```
|
|
321
|
+
curl -X GET 'https://{hostname}/api/v3/reflection-summary?pageToken=BhQxNjc0MjhlYi03OTM2LTRlYTItYTFmYi0yM2IxYWM2ZTk0NTQSAA==' \
|
|
322
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
323
|
+
--header 'Content-Type: application/json'
|
|
324
|
+
```
|
|
325
|
+
|
|
326
|
+
For subsequent requests, replace the `pageToken` value in the request URL with the token value from the previous response. If the response does not include a token attribute and value, you have retrieved the last page of available results.
|
|
327
|
+
|
|
328
|
+
#### User-Specified Maximum
|
|
329
|
+
|
|
330
|
+
For endpoints that require users to specify a maximum number of results per page with a separate query parameter, responses only include a page token attribute if your initial request URL includes the separate query parameter and the response contains more results than the maximum you specify. Add the value for this token to the request URL as the `pageToken` value, keeping the separate query parameter as well, to retrieve the next page of results.
|
|
331
|
+
|
|
332
|
+
Catalog API endpoints for retrieving non-filesystem [sources](/current/reference/api/catalog/source/#retrieving-a-source-by-id), [spaces](/current/reference/api/catalog/container-space#retrieving-a-space-by-id), and [folders](/current/reference/api/catalog/container-folder#retrieving-a-folder-by-id) by ID or path support the [`maxChildren` query parameter](/current/reference/api/#maxchildren-query-parameter) for specifying the maximum number of child objects to include in each response. If the response contains more than the specified number of child objects, the response includes the `nextPageToken` attribute. To retrieve the next page of results, add `?pageToken={nextPageToken_value}` to the request URL. This example shows a request URL that uses the `nextPageToken` query parameter with the `maxChildren` query parameter set to 25:
|
|
333
|
+
|
|
334
|
+
Example Request with maxChildren and pageToken Query Parameters
|
|
335
|
+
|
|
336
|
+
```
|
|
337
|
+
curl -X GET 'https://{hostname}/api/v3/catalog/2b1be882-7012-4a99-8d6c-82e32e4562e4?maxChildren=25&pageToken=BhQxNjc0MjhlYi03OTM2LTRlYTItYTFmYi0yM2IxYWM2ZTk0NTQSAA==' \
|
|
338
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
339
|
+
--header 'Content-Type: application/json'
|
|
340
|
+
```
|
|
341
|
+
|
|
342
|
+
For subsequent requests, replace the `pageToken` value in the request URL with the token value from the previous response. If the response does not include a token attribute and value, you have retrieved the last page of available results.
|
|
343
|
+
|
|
344
|
+
### maxResults Query Parameter
|
|
345
|
+
|
|
346
|
+
Use the `maxResults` query parameter to specify the maximum number of results to retrieve in each request.
|
|
347
|
+
|
|
348
|
+
For example, if you want to retrieve no more than 25 results for an endpoint that supports the `maxResults` query parameter, append `?maxResults=25` to the request URL:
|
|
349
|
+
|
|
350
|
+
Example Request with maxResults Query Parameter
|
|
351
|
+
|
|
352
|
+
```
|
|
353
|
+
curl -X GET 'https://{hostname}/api/v3/reflection-summary?maxResults=25' \
|
|
354
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
355
|
+
--header 'Content-Type: application/json'
|
|
356
|
+
```
|
|
357
|
+
|
|
358
|
+
### filter Query Parameter
|
|
359
|
+
|
|
360
|
+
Use the `filter` query parameter to filter responses so that they include only results with the specified attributes and values. The value for the `filter` query parameter is a URL-encoded JSON string that represents a JSON object that specifies the desired attributes and values.
|
|
361
|
+
|
|
362
|
+
As an example, the [Reflection summary](/current/reference/api/reflections/reflection-summary/#retrieving-a-reflection-summary) endpoint supports the `filter` query parameter for certain specific attributes. To retrieve only the raw Reflections that are refreshed manually or by schedule, are enabled, and apply to datasets with `samples.dremio.com` in their paths, the `filter` JSON object would look like this:
|
|
363
|
+
|
|
364
|
+
Example JSON Object for Filter
|
|
365
|
+
|
|
366
|
+
```
|
|
367
|
+
{
|
|
368
|
+
"reflectionType": ["RAW"],
|
|
369
|
+
"refreshStatus": ["MANUAL","SCHEDULED"],
|
|
370
|
+
"enabledFlag": true,
|
|
371
|
+
"reflectionNameOrDatasetPath": "samples.dremio.com"
|
|
372
|
+
}
|
|
373
|
+
```
|
|
374
|
+
|
|
375
|
+
To use the JSON object as the `filter` value, convert it to URL-encoded JSON and add it to the request URL:
|
|
376
|
+
|
|
377
|
+
Example Request with filter Query Parameter
|
|
378
|
+
|
|
379
|
+
```
|
|
380
|
+
curl -X GET 'https://{hostname}/api/v3/reflection-summary?filter=%7B%0A%20%20%22reflectionType%22%3A%20%5B%22RAW%22%5D%2C%0A%20%20%22refreshStatus%22%3A%20%5B%22MANUAL%22%2C%22SCHEDULED%22%5D%2C%0A%20%20%22enabledFlag%22%3A%20true%2C%0A%20%20%22reflectionNameOrDatasetPath%22%3A%20%22samples.dremio.com%22%0A%7D' \
|
|
381
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
382
|
+
--header 'Content-Type: application/json'
|
|
383
|
+
```
|
|
384
|
+
|
|
385
|
+
Read the endpoint-specific documentation to learn which attributes each endpoint supports for the `filter` query parameter.
|
|
386
|
+
|
|
387
|
+
### orderBy Query Parameter
|
|
388
|
+
|
|
389
|
+
Use the `orderBy` query parameter to organize the response in ascending or descending order based on the value of the specified attribute. The default is ascending order. To specify descending order, add a `-` character before the attribute name.
|
|
390
|
+
|
|
391
|
+
For example, the [Reflection summary](/current/reference/api/reflections/reflection-summary/#retrieving-a-reflection-summary) endpoint supports ordering the response by ReflectionName, datasetName, or reflectionType. To organize the response in ascending order by ReflectionName:
|
|
392
|
+
|
|
393
|
+
Example Request with orderBy Query Parameter (Ascending Order)
|
|
394
|
+
|
|
395
|
+
```
|
|
396
|
+
curl -X GET 'https://{hostname}/api/v3/reflection-summary?orderBy=reflectionName' \
|
|
397
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
398
|
+
--header 'Content-Type: application/json'
|
|
399
|
+
```
|
|
400
|
+
|
|
401
|
+
To organize the response in descending order, add a `-` before the attribute name:
|
|
402
|
+
|
|
403
|
+
Example Request with orderBy Query Parameter (Descending Order)
|
|
404
|
+
|
|
405
|
+
```
|
|
406
|
+
curl -X GET 'https://{hostname}/api/v3/reflection-summary?orderBy=-reflectionName' \
|
|
407
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
408
|
+
--header 'Content-Type: application/json'
|
|
409
|
+
```
|
|
410
|
+
|
|
411
|
+
Read the endpoint-specific documentation to learn which attributes each endpoint supports for the `orderBy` query parameter.
|
|
412
|
+
|
|
413
|
+
### limit and offset Query Parameters
|
|
414
|
+
|
|
415
|
+
The `limit` query parameter allows you to retrieve a specific number of results. For endpoints that support the `limit` query parameter, you can specify the number of results to retrieve. For example, if you only want to retrieve the first 10 available results, add `?limit=10` to the request URL:
|
|
416
|
+
|
|
417
|
+
Example Request for First 10 Results with Limit Query Parameter
|
|
418
|
+
|
|
419
|
+
```
|
|
420
|
+
curl -X GET 'https://{hostname}/api/v3/job/{id}/results?limit=10' \
|
|
421
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
422
|
+
--header 'Content-Type: application/json'
|
|
423
|
+
```
|
|
424
|
+
|
|
425
|
+
The `offset` query parameter allows you to skip a specific number of results in the response. When a response contains many results, you can use the `limit` and `offset` query parameters together to break the response into pages.
|
|
426
|
+
|
|
427
|
+
For example, consider a job result response object that contains 5000 results. The Job API allows you to retrieve a maximum of 500 results per request. To retrieve all 5000 results, start by adding `?limit=500` to the request URL to retrieve the first 500:
|
|
428
|
+
|
|
429
|
+
Example Request for First 500 Results with Limit Query Parameter
|
|
430
|
+
|
|
431
|
+
```
|
|
432
|
+
curl -X GET 'https://{hostname}/api/v3/job/{id}/results?limit=500' \
|
|
433
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
434
|
+
--header 'Content-Type: application/json'
|
|
435
|
+
```
|
|
436
|
+
|
|
437
|
+
In the next request, to retrieve the next 500 results (rows 501-1000), add `&offset=500` to the request URL:
|
|
438
|
+
|
|
439
|
+
Example Request for Results 501-1000 with limit and offset Query Parameters
|
|
440
|
+
|
|
441
|
+
```
|
|
442
|
+
curl -X GET 'https://{hostname}/api/v3/job/{id}/results?limit=500&offset=500' \
|
|
443
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
444
|
+
--header 'Content-Type: application/json'
|
|
445
|
+
```
|
|
446
|
+
|
|
447
|
+
To retrieve the next 500 results (rows 1001-1500), increment the `offset` parameter to 1000 in the next request:
|
|
448
|
+
|
|
449
|
+
Example Request for Results 1001-1500 with limit and offset Query Parameters
|
|
450
|
+
|
|
451
|
+
```
|
|
452
|
+
curl -X GET 'https://{hostname}/api/v3/job/{id}/results?limit=500&offset=1000' \
|
|
453
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
454
|
+
--header 'Content-Type: application/json'
|
|
455
|
+
```
|
|
456
|
+
|
|
457
|
+
Continue incrementing the `offset` parameter in requests until you have retrieved all 5000 results.
|
|
458
|
+
|
|
459
|
+
Read the documentation for each API to learn about endpoint-specific support for the `limit` and `offset` query parameters.
|
|
460
|
+
|
|
461
|
+
### type Query Parameter
|
|
462
|
+
|
|
463
|
+
Use the `type` query parameter to limit your request so that the response includes only results for the type you specify.
|
|
464
|
+
|
|
465
|
+
For example, if an endpoint supports the `type` query parameter, and the endpoint's list of valid values includes `SOURCE`, you can limit the response so that it includes only results for sources. Append `?type=SOURCE` to the request URL:
|
|
466
|
+
|
|
467
|
+
Example Request with type Query Parameter
|
|
468
|
+
|
|
469
|
+
```
|
|
470
|
+
curl -X GET 'https://{hostname}/api/v3/catalog/privileges?type=SOURCE' \
|
|
471
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
472
|
+
--header 'Content-Type: application/json'
|
|
473
|
+
```
|
|
474
|
+
|
|
475
|
+
Read the documentation for each API to learn about endpoint-specific support for the `type` query parameter, including lists of valid values.
|
|
476
|
+
|
|
477
|
+
### include and exclude Query Parameters
|
|
478
|
+
|
|
479
|
+
Some APIs exclude non-default attributes or include lengthy attributes in the default GET responses. These APIs support the `include` and `exclude` query parameters, which you can use to include or exclude certain attributes in the responses for GET endpoints.
|
|
480
|
+
|
|
481
|
+
The `include` query parameter allows you to include non-default attributes in the response. For example, in the Catalog API, you can include a catalog object's `permissions` array in the response:
|
|
482
|
+
|
|
483
|
+
Example Request with include Query Parameter
|
|
484
|
+
|
|
485
|
+
```
|
|
486
|
+
curl -X GET 'https://{hostname}/api/v3/catalog/ffbe8c1d-1db7-48d1-9c58-f452838fedc0?include=permissions' \
|
|
487
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
488
|
+
--header 'Content-Type: application/json'
|
|
489
|
+
```
|
|
490
|
+
|
|
491
|
+
The `exclude` query parameter allows you to exclude supported attributes from the response. For example, this Catalog API request excludes the object's `children` attribute from the response:
|
|
492
|
+
|
|
493
|
+
Example Request with exclude Query Parameter
|
|
494
|
+
|
|
495
|
+
```
|
|
496
|
+
curl -X GET 'https://{hostname}/api/v3/catalog/ffbe8c1d-1db7-48d1-9c58-f452838fedc0?exclude=children' \
|
|
497
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
498
|
+
--header 'Content-Type: application/json'
|
|
499
|
+
```
|
|
500
|
+
|
|
501
|
+
Read the documentation for each API to learn about endpoint-specific support for the `include` and `exclude` query parameters, including information about supported values.
|
|
502
|
+
|
|
503
|
+
### createdBy Query Parameter
|
|
504
|
+
|
|
505
|
+
Use the `createdBy` query parameter to limit the request to objects created by a specific user.
|
|
506
|
+
|
|
507
|
+
For example, this Scripts API request retrieves only scripts that were created by the user whose ID is `8be516f3-04c4-4d19-824d-5a70b3c4442e`:
|
|
508
|
+
|
|
509
|
+
Example Request with createdBy Query Parameter
|
|
510
|
+
|
|
511
|
+
```
|
|
512
|
+
curl -X GET 'https://{hostname}/api/v3/scripts?createdBy=8be516f3-04c4-4d19-824d-5a70b3c4442e' \
|
|
513
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
514
|
+
--header 'Content-Type: application/json'
|
|
515
|
+
```
|
|
516
|
+
|
|
517
|
+
### ownedBy Query Parameter
|
|
518
|
+
|
|
519
|
+
Use the `ownedBy` query parameter to limit the request to objects owned by a specific user.
|
|
520
|
+
|
|
521
|
+
For example, this Scripts API request retrieves only scripts that are owned by the user whose ID is `8be516f3-04c4-4d19-824d-5a70b3c4442e`:
|
|
522
|
+
|
|
523
|
+
Example Request with ownedBy Query Parameter
|
|
524
|
+
|
|
525
|
+
```
|
|
526
|
+
curl -X GET 'https://{hostname}/api/v3/scripts?ownedBy=8be516f3-04c4-4d19-824d-5a70b3c4442e' \
|
|
527
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
528
|
+
--header 'Content-Type: application/json'
|
|
529
|
+
```
|
|
530
|
+
|
|
531
|
+
### search Query Parameter
|
|
532
|
+
|
|
533
|
+
Use the `search` query parameter to limit the request to objects that contain values that include the search string.
|
|
534
|
+
|
|
535
|
+
For example, the Scripts API supports the `search` query parameter for the name attribute. This Scripts API request retrieves only scripts whose values for the name attribute include `dev`:
|
|
536
|
+
|
|
537
|
+
Example Request with search Query Parameter
|
|
538
|
+
|
|
539
|
+
```
|
|
540
|
+
curl -X GET 'https://{hostname}/api/v3/scripts?search=dev' \
|
|
541
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
542
|
+
--header 'Content-Type: application/json'
|
|
543
|
+
```
|
|
544
|
+
|
|
545
|
+
Read the documentation for each API to learn about endpoint-specific support for the `search` query parameter, including information about searchable attributes.
|
|
546
|
+
|
|
547
|
+
### maxChildren Query Parameter
|
|
548
|
+
|
|
549
|
+
The `maxChildren` query parameter allows you to specify the maximum number of child objects to include in each response. This example shows a request URL that uses the `nextPageToken` query parameter with the `maxChildren` query parameter set to 25:
|
|
550
|
+
|
|
551
|
+
Example Request with maxChildren Query Parameter
|
|
552
|
+
|
|
553
|
+
```
|
|
554
|
+
curl -X GET 'https://{hostname}/api/v3/catalog/2b1be882-7012-4a99-8d6c-82e32e4562e4?maxChildren=25' \
|
|
555
|
+
--header 'Authorization: Bearer <dremioAccessToken>' \
|
|
556
|
+
--header 'Content-Type: application/json'
|
|
557
|
+
```
|
|
558
|
+
|
|
559
|
+
Use the `maxChildren` query parameter in concert with the [`pageToken` query parameter](/current/reference/api/#user-specified-maximum) to split large sets of results into multiple pages.
|
|
560
|
+
|
|
561
|
+
## Response Headers
|
|
562
|
+
|
|
563
|
+
Dremio API responses include HTTP headers that provide additional information about responses. Each header includes a case-insensitive name and a value, separated by a colon.
|
|
564
|
+
|
|
565
|
+
The following response headers are common to Dremio API endpoints:
|
|
566
|
+
|
|
567
|
+
| Header Name | Example Value | Description |
|
|
568
|
+
| --- | --- | --- |
|
|
569
|
+
| Allow | GET,OPTIONS | Request methods the endpoint supports. |
|
|
570
|
+
| Cache-Control | no-cache, no-store | Caching instructions for browsers and shared caches. |
|
|
571
|
+
| Content-Length | 2188 | Size of the response body, in bytes. |
|
|
572
|
+
| Content-Type | application/json | MIME type of the object. |
|
|
573
|
+
| Date | Fri, 14 Apr 2023 19:39:53 GMT | Date and time when the response originated. |
|
|
574
|
+
| Vary | Accept-Encoding, User-Agent | Names of request headers that could have affected the response's generation. |
|
|
575
|
+
| x-content-type-options | nosniff | Instructions about following the MIME type in the content-type header. Blocks content sniffing. |
|
|
576
|
+
| x-xss-protection | 1; mode=block | Instructions used to stop pages from loading when a browser detects reflected cross-site scripting attacks. |
|
|
577
|
+
|
|
578
|
+
Was this page helpful?
|
|
579
|
+
|
|
580
|
+
[Previous
|
|
581
|
+
|
|
582
|
+
Admin CLI](/current/reference/admin-cli/)[Next
|
|
583
|
+
|
|
584
|
+
Catalog](/current/reference/api/catalog/)
|
|
585
|
+
|
|
586
|
+
* Base URL
|
|
587
|
+
* Authentication
|
|
588
|
+
+ OAuth Access Tokens Enterprise
|
|
589
|
+
+ Personal Access Tokens Enterprise
|
|
590
|
+
+ Dremio Authentication Tokens
|
|
591
|
+
+ Example
|
|
592
|
+
* Errors
|
|
593
|
+
* Query Parameters
|
|
594
|
+
+ pageToken Query Parameter
|
|
595
|
+
+ maxResults Query Parameter
|
|
596
|
+
+ filter Query Parameter
|
|
597
|
+
+ orderBy Query Parameter
|
|
598
|
+
+ limit and offset Query Parameters
|
|
599
|
+
+ type Query Parameter
|
|
600
|
+
+ include and exclude Query Parameters
|
|
601
|
+
+ createdBy Query Parameter
|
|
602
|
+
+ ownedBy Query Parameter
|
|
603
|
+
+ search Query Parameter
|
|
604
|
+
+ maxChildren Query Parameter
|
|
605
|
+
* Response Headers
|
|
606
|
+
|
|
607
|
+
---
|
|
608
|
+
|
|
609
|
+
# Source: https://docs.dremio.com/current/reference/sql/
|
|
610
|
+
|
|
611
|
+
Version: current [26.x]
|
|
612
|
+
|
|
613
|
+
On this page
|
|
614
|
+
|
|
615
|
+
# SQL Reference
|
|
616
|
+
|
|
617
|
+
Dremio provides comprehensive SQL access to your data, no matter where it is stored.
|
|
618
|
+
|
|
619
|
+
* [Data Types](/current/reference/sql/data-types/)
|
|
620
|
+
* [SQL Functions](/current/reference/sql/sql-functions/)
|
|
621
|
+
* [SQL Commands](/current/reference/sql/commands/)
|
|
622
|
+
* [Reserved Words](/current/reference/sql/reserved-keywords)
|
|
623
|
+
* [System Tables](/current/reference/sql/system-tables)
|
|
624
|
+
* [Table Functions](/current/reference/sql/table-functions)
|
|
625
|
+
* [Information Schema](/current/reference/sql/information-schema)
|
|
626
|
+
|
|
627
|
+
## Additional Resources
|
|
628
|
+
|
|
629
|
+
Find out more about using SQL by enrolling in the [SQL for Data Analysts course in Dremio University](https://university.dremio.com/course/sql-data-analysts).
|
|
630
|
+
|
|
631
|
+
Was this page helpful?
|
|
632
|
+
|
|
633
|
+
[Previous
|
|
634
|
+
|
|
635
|
+
API Reference](/current/reference/api/)[Next
|
|
636
|
+
|
|
637
|
+
Data Types](/current/reference/sql/data-types/)
|
|
638
|
+
|
|
639
|
+
* Additional Resources
|
|
640
|
+
|
|
641
|
+
---
|
|
642
|
+
|
|
643
|
+
# Source: https://docs.dremio.com/current/reference/bulletins/
|
|
644
|
+
|
|
645
|
+
Version: current [26.x]
|
|
646
|
+
|
|
647
|
+
# Security Bulletins
|
|
648
|
+
|
|
649
|
+
Dremio publishes security bulletins that disclose vulnerabilities found in our supported products to inform customers about risks that may be present in their production environments.
|
|
650
|
+
|
|
651
|
+
Security bulletins are usually published when fixes are available in the affected products. In some cases, we may disclose a vulnerability before the fix is available.
|
|
652
|
+
|
|
653
|
+
Security bulletins include the following information:
|
|
654
|
+
|
|
655
|
+
* Type
|
|
656
|
+
* Qualitative rating as determined by CVSSv3.1 analysis
|
|
657
|
+
* Issue description
|
|
658
|
+
* Issue impact
|
|
659
|
+
* Available mitigations or fixes
|
|
660
|
+
|
|
661
|
+
| Bulletin | Type | CVSS Rating | Subject | Description |
|
|
662
|
+
| --- | --- | --- | --- | --- |
|
|
663
|
+
| [2025-04-21-01](/current/reference/bulletins/2025-04-21-01) | Vulnerability | High | Security Update | An authenticated API endpoint allows arbitrary file deletion. |
|
|
664
|
+
| [2024-02-07-01](/current/reference/bulletins/2024-02-07-01) | Vulnerability | Medium | Security Update | The COPY INTO command does not verify users' SELECT privileges. |
|
|
665
|
+
| [2024-01-12-01](/current/reference/bulletins/2024-01-12-01) | Vulnerability | High | Security Update | Path traversal vulnerability bypassed folder-level role-based access control (RBAC). |
|
|
666
|
+
| [2024-01-09-01](/current/reference/bulletins/2024-01-09-01) | Vulnerability | High | Security Update | The Dremio-to-Dremio connector does not fully validate table-level access in certain cases. |
|
|
667
|
+
| [2023-07-22-03](/current/reference/bulletins/2023-07-22-03) | Vulnerability | Medium | Security Update | Potential unintended user access to restricted data as a result of previously cached view. |
|
|
668
|
+
| [2023-07-22-02](/current/reference/bulletins/2023-07-22-02) | Vulnerability | Medium | Security Update | Potential unintended user access to restricted data as a result of accelerated DML operation. |
|
|
669
|
+
| [2023-07-22-01](/current/reference/bulletins/2023-07-22-01) | Vulnerability | Medium | Security Update | Potential unintended user access to restricted data as a result of previously-executed cached plans. |
|
|
670
|
+
|
|
671
|
+
Was this page helpful?
|
|
672
|
+
|
|
673
|
+
[Previous
|
|
674
|
+
|
|
675
|
+
SQL Reference](/current/reference/sql/)[Next
|
|
676
|
+
|
|
677
|
+
2025-04-21-01](/current/reference/bulletins/2025-04-21-01)
|