aws-sdk-glue 1.84.0 → 1.89.0
Sign up to get free protection for your applications and to get access to all the features.
- checksums.yaml +4 -4
- data/CHANGELOG.md +469 -0
- data/LICENSE.txt +202 -0
- data/VERSION +1 -0
- data/lib/aws-sdk-glue.rb +2 -2
- data/lib/aws-sdk-glue/client.rb +317 -291
- data/lib/aws-sdk-glue/client_api.rb +11 -1
- data/lib/aws-sdk-glue/errors.rb +1 -1
- data/lib/aws-sdk-glue/resource.rb +1 -1
- data/lib/aws-sdk-glue/types.rb +449 -373
- metadata +9 -7
data/LICENSE.txt
ADDED
|
@@ -0,0 +1,202 @@
|
|
|
1
|
+
|
|
2
|
+
Apache License
|
|
3
|
+
Version 2.0, January 2004
|
|
4
|
+
http://www.apache.org/licenses/
|
|
5
|
+
|
|
6
|
+
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
|
7
|
+
|
|
8
|
+
1. Definitions.
|
|
9
|
+
|
|
10
|
+
"License" shall mean the terms and conditions for use, reproduction,
|
|
11
|
+
and distribution as defined by Sections 1 through 9 of this document.
|
|
12
|
+
|
|
13
|
+
"Licensor" shall mean the copyright owner or entity authorized by
|
|
14
|
+
the copyright owner that is granting the License.
|
|
15
|
+
|
|
16
|
+
"Legal Entity" shall mean the union of the acting entity and all
|
|
17
|
+
other entities that control, are controlled by, or are under common
|
|
18
|
+
control with that entity. For the purposes of this definition,
|
|
19
|
+
"control" means (i) the power, direct or indirect, to cause the
|
|
20
|
+
direction or management of such entity, whether by contract or
|
|
21
|
+
otherwise, or (ii) ownership of fifty percent (50%) or more of the
|
|
22
|
+
outstanding shares, or (iii) beneficial ownership of such entity.
|
|
23
|
+
|
|
24
|
+
"You" (or "Your") shall mean an individual or Legal Entity
|
|
25
|
+
exercising permissions granted by this License.
|
|
26
|
+
|
|
27
|
+
"Source" form shall mean the preferred form for making modifications,
|
|
28
|
+
including but not limited to software source code, documentation
|
|
29
|
+
source, and configuration files.
|
|
30
|
+
|
|
31
|
+
"Object" form shall mean any form resulting from mechanical
|
|
32
|
+
transformation or translation of a Source form, including but
|
|
33
|
+
not limited to compiled object code, generated documentation,
|
|
34
|
+
and conversions to other media types.
|
|
35
|
+
|
|
36
|
+
"Work" shall mean the work of authorship, whether in Source or
|
|
37
|
+
Object form, made available under the License, as indicated by a
|
|
38
|
+
copyright notice that is included in or attached to the work
|
|
39
|
+
(an example is provided in the Appendix below).
|
|
40
|
+
|
|
41
|
+
"Derivative Works" shall mean any work, whether in Source or Object
|
|
42
|
+
form, that is based on (or derived from) the Work and for which the
|
|
43
|
+
editorial revisions, annotations, elaborations, or other modifications
|
|
44
|
+
represent, as a whole, an original work of authorship. For the purposes
|
|
45
|
+
of this License, Derivative Works shall not include works that remain
|
|
46
|
+
separable from, or merely link (or bind by name) to the interfaces of,
|
|
47
|
+
the Work and Derivative Works thereof.
|
|
48
|
+
|
|
49
|
+
"Contribution" shall mean any work of authorship, including
|
|
50
|
+
the original version of the Work and any modifications or additions
|
|
51
|
+
to that Work or Derivative Works thereof, that is intentionally
|
|
52
|
+
submitted to Licensor for inclusion in the Work by the copyright owner
|
|
53
|
+
or by an individual or Legal Entity authorized to submit on behalf of
|
|
54
|
+
the copyright owner. For the purposes of this definition, "submitted"
|
|
55
|
+
means any form of electronic, verbal, or written communication sent
|
|
56
|
+
to the Licensor or its representatives, including but not limited to
|
|
57
|
+
communication on electronic mailing lists, source code control systems,
|
|
58
|
+
and issue tracking systems that are managed by, or on behalf of, the
|
|
59
|
+
Licensor for the purpose of discussing and improving the Work, but
|
|
60
|
+
excluding communication that is conspicuously marked or otherwise
|
|
61
|
+
designated in writing by the copyright owner as "Not a Contribution."
|
|
62
|
+
|
|
63
|
+
"Contributor" shall mean Licensor and any individual or Legal Entity
|
|
64
|
+
on behalf of whom a Contribution has been received by Licensor and
|
|
65
|
+
subsequently incorporated within the Work.
|
|
66
|
+
|
|
67
|
+
2. Grant of Copyright License. Subject to the terms and conditions of
|
|
68
|
+
this License, each Contributor hereby grants to You a perpetual,
|
|
69
|
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
|
70
|
+
copyright license to reproduce, prepare Derivative Works of,
|
|
71
|
+
publicly display, publicly perform, sublicense, and distribute the
|
|
72
|
+
Work and such Derivative Works in Source or Object form.
|
|
73
|
+
|
|
74
|
+
3. Grant of Patent License. Subject to the terms and conditions of
|
|
75
|
+
this License, each Contributor hereby grants to You a perpetual,
|
|
76
|
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
|
77
|
+
(except as stated in this section) patent license to make, have made,
|
|
78
|
+
use, offer to sell, sell, import, and otherwise transfer the Work,
|
|
79
|
+
where such license applies only to those patent claims licensable
|
|
80
|
+
by such Contributor that are necessarily infringed by their
|
|
81
|
+
Contribution(s) alone or by combination of their Contribution(s)
|
|
82
|
+
with the Work to which such Contribution(s) was submitted. If You
|
|
83
|
+
institute patent litigation against any entity (including a
|
|
84
|
+
cross-claim or counterclaim in a lawsuit) alleging that the Work
|
|
85
|
+
or a Contribution incorporated within the Work constitutes direct
|
|
86
|
+
or contributory patent infringement, then any patent licenses
|
|
87
|
+
granted to You under this License for that Work shall terminate
|
|
88
|
+
as of the date such litigation is filed.
|
|
89
|
+
|
|
90
|
+
4. Redistribution. You may reproduce and distribute copies of the
|
|
91
|
+
Work or Derivative Works thereof in any medium, with or without
|
|
92
|
+
modifications, and in Source or Object form, provided that You
|
|
93
|
+
meet the following conditions:
|
|
94
|
+
|
|
95
|
+
(a) You must give any other recipients of the Work or
|
|
96
|
+
Derivative Works a copy of this License; and
|
|
97
|
+
|
|
98
|
+
(b) You must cause any modified files to carry prominent notices
|
|
99
|
+
stating that You changed the files; and
|
|
100
|
+
|
|
101
|
+
(c) You must retain, in the Source form of any Derivative Works
|
|
102
|
+
that You distribute, all copyright, patent, trademark, and
|
|
103
|
+
attribution notices from the Source form of the Work,
|
|
104
|
+
excluding those notices that do not pertain to any part of
|
|
105
|
+
the Derivative Works; and
|
|
106
|
+
|
|
107
|
+
(d) If the Work includes a "NOTICE" text file as part of its
|
|
108
|
+
distribution, then any Derivative Works that You distribute must
|
|
109
|
+
include a readable copy of the attribution notices contained
|
|
110
|
+
within such NOTICE file, excluding those notices that do not
|
|
111
|
+
pertain to any part of the Derivative Works, in at least one
|
|
112
|
+
of the following places: within a NOTICE text file distributed
|
|
113
|
+
as part of the Derivative Works; within the Source form or
|
|
114
|
+
documentation, if provided along with the Derivative Works; or,
|
|
115
|
+
within a display generated by the Derivative Works, if and
|
|
116
|
+
wherever such third-party notices normally appear. The contents
|
|
117
|
+
of the NOTICE file are for informational purposes only and
|
|
118
|
+
do not modify the License. You may add Your own attribution
|
|
119
|
+
notices within Derivative Works that You distribute, alongside
|
|
120
|
+
or as an addendum to the NOTICE text from the Work, provided
|
|
121
|
+
that such additional attribution notices cannot be construed
|
|
122
|
+
as modifying the License.
|
|
123
|
+
|
|
124
|
+
You may add Your own copyright statement to Your modifications and
|
|
125
|
+
may provide additional or different license terms and conditions
|
|
126
|
+
for use, reproduction, or distribution of Your modifications, or
|
|
127
|
+
for any such Derivative Works as a whole, provided Your use,
|
|
128
|
+
reproduction, and distribution of the Work otherwise complies with
|
|
129
|
+
the conditions stated in this License.
|
|
130
|
+
|
|
131
|
+
5. Submission of Contributions. Unless You explicitly state otherwise,
|
|
132
|
+
any Contribution intentionally submitted for inclusion in the Work
|
|
133
|
+
by You to the Licensor shall be under the terms and conditions of
|
|
134
|
+
this License, without any additional terms or conditions.
|
|
135
|
+
Notwithstanding the above, nothing herein shall supersede or modify
|
|
136
|
+
the terms of any separate license agreement you may have executed
|
|
137
|
+
with Licensor regarding such Contributions.
|
|
138
|
+
|
|
139
|
+
6. Trademarks. This License does not grant permission to use the trade
|
|
140
|
+
names, trademarks, service marks, or product names of the Licensor,
|
|
141
|
+
except as required for reasonable and customary use in describing the
|
|
142
|
+
origin of the Work and reproducing the content of the NOTICE file.
|
|
143
|
+
|
|
144
|
+
7. Disclaimer of Warranty. Unless required by applicable law or
|
|
145
|
+
agreed to in writing, Licensor provides the Work (and each
|
|
146
|
+
Contributor provides its Contributions) on an "AS IS" BASIS,
|
|
147
|
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
|
148
|
+
implied, including, without limitation, any warranties or conditions
|
|
149
|
+
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
|
|
150
|
+
PARTICULAR PURPOSE. You are solely responsible for determining the
|
|
151
|
+
appropriateness of using or redistributing the Work and assume any
|
|
152
|
+
risks associated with Your exercise of permissions under this License.
|
|
153
|
+
|
|
154
|
+
8. Limitation of Liability. In no event and under no legal theory,
|
|
155
|
+
whether in tort (including negligence), contract, or otherwise,
|
|
156
|
+
unless required by applicable law (such as deliberate and grossly
|
|
157
|
+
negligent acts) or agreed to in writing, shall any Contributor be
|
|
158
|
+
liable to You for damages, including any direct, indirect, special,
|
|
159
|
+
incidental, or consequential damages of any character arising as a
|
|
160
|
+
result of this License or out of the use or inability to use the
|
|
161
|
+
Work (including but not limited to damages for loss of goodwill,
|
|
162
|
+
work stoppage, computer failure or malfunction, or any and all
|
|
163
|
+
other commercial damages or losses), even if such Contributor
|
|
164
|
+
has been advised of the possibility of such damages.
|
|
165
|
+
|
|
166
|
+
9. Accepting Warranty or Additional Liability. While redistributing
|
|
167
|
+
the Work or Derivative Works thereof, You may choose to offer,
|
|
168
|
+
and charge a fee for, acceptance of support, warranty, indemnity,
|
|
169
|
+
or other liability obligations and/or rights consistent with this
|
|
170
|
+
License. However, in accepting such obligations, You may act only
|
|
171
|
+
on Your own behalf and on Your sole responsibility, not on behalf
|
|
172
|
+
of any other Contributor, and only if You agree to indemnify,
|
|
173
|
+
defend, and hold each Contributor harmless for any liability
|
|
174
|
+
incurred by, or claims asserted against, such Contributor by reason
|
|
175
|
+
of your accepting any such warranty or additional liability.
|
|
176
|
+
|
|
177
|
+
END OF TERMS AND CONDITIONS
|
|
178
|
+
|
|
179
|
+
APPENDIX: How to apply the Apache License to your work.
|
|
180
|
+
|
|
181
|
+
To apply the Apache License to your work, attach the following
|
|
182
|
+
boilerplate notice, with the fields enclosed by brackets "[]"
|
|
183
|
+
replaced with your own identifying information. (Don't include
|
|
184
|
+
the brackets!) The text should be enclosed in the appropriate
|
|
185
|
+
comment syntax for the file format. We also recommend that a
|
|
186
|
+
file or class name and description of purpose be included on the
|
|
187
|
+
same "printed page" as the copyright notice for easier
|
|
188
|
+
identification within third-party archives.
|
|
189
|
+
|
|
190
|
+
Copyright [yyyy] [name of copyright owner]
|
|
191
|
+
|
|
192
|
+
Licensed under the Apache License, Version 2.0 (the "License");
|
|
193
|
+
you may not use this file except in compliance with the License.
|
|
194
|
+
You may obtain a copy of the License at
|
|
195
|
+
|
|
196
|
+
http://www.apache.org/licenses/LICENSE-2.0
|
|
197
|
+
|
|
198
|
+
Unless required by applicable law or agreed to in writing, software
|
|
199
|
+
distributed under the License is distributed on an "AS IS" BASIS,
|
|
200
|
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
201
|
+
See the License for the specific language governing permissions and
|
|
202
|
+
limitations under the License.
|
data/VERSION
ADDED
|
@@ -0,0 +1 @@
|
|
|
1
|
+
1.89.0
|
data/lib/aws-sdk-glue.rb
CHANGED
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
# WARNING ABOUT GENERATED CODE
|
|
4
4
|
#
|
|
5
5
|
# This file is generated. See the contributing guide for more information:
|
|
6
|
-
# https://github.com/aws/aws-sdk-ruby/blob/
|
|
6
|
+
# https://github.com/aws/aws-sdk-ruby/blob/version-3/CONTRIBUTING.md
|
|
7
7
|
#
|
|
8
8
|
# WARNING ABOUT GENERATED CODE
|
|
9
9
|
|
|
@@ -48,6 +48,6 @@ require_relative 'aws-sdk-glue/customizations'
|
|
|
48
48
|
# @!group service
|
|
49
49
|
module Aws::Glue
|
|
50
50
|
|
|
51
|
-
GEM_VERSION = '1.
|
|
51
|
+
GEM_VERSION = '1.89.0'
|
|
52
52
|
|
|
53
53
|
end
|
data/lib/aws-sdk-glue/client.rb
CHANGED
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
# WARNING ABOUT GENERATED CODE
|
|
4
4
|
#
|
|
5
5
|
# This file is generated. See the contributing guide for more information:
|
|
6
|
-
# https://github.com/aws/aws-sdk-ruby/blob/
|
|
6
|
+
# https://github.com/aws/aws-sdk-ruby/blob/version-3/CONTRIBUTING.md
|
|
7
7
|
#
|
|
8
8
|
# WARNING ABOUT GENERATED CODE
|
|
9
9
|
|
|
@@ -341,7 +341,7 @@ module Aws::Glue
|
|
|
341
341
|
#
|
|
342
342
|
# @option params [String] :catalog_id
|
|
343
343
|
# The ID of the catalog in which the partition is to be created.
|
|
344
|
-
# Currently, this should be the
|
|
344
|
+
# Currently, this should be the Amazon Web Services account ID.
|
|
345
345
|
#
|
|
346
346
|
# @option params [required, String] :database_name
|
|
347
347
|
# The name of the metadata database in which the partition is to be
|
|
@@ -449,7 +449,7 @@ module Aws::Glue
|
|
|
449
449
|
#
|
|
450
450
|
# @option params [String] :catalog_id
|
|
451
451
|
# The ID of the Data Catalog in which the connections reside. If none is
|
|
452
|
-
# provided, the
|
|
452
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
453
453
|
#
|
|
454
454
|
# @option params [required, Array<String>] :connection_name_list
|
|
455
455
|
# A list of names of the connections to delete.
|
|
@@ -487,7 +487,8 @@ module Aws::Glue
|
|
|
487
487
|
#
|
|
488
488
|
# @option params [String] :catalog_id
|
|
489
489
|
# The ID of the Data Catalog where the partition to be deleted resides.
|
|
490
|
-
# If none is provided, the
|
|
490
|
+
# If none is provided, the Amazon Web Services account ID is used by
|
|
491
|
+
# default.
|
|
491
492
|
#
|
|
492
493
|
# @option params [required, String] :database_name
|
|
493
494
|
# The name of the catalog database in which the table in question
|
|
@@ -537,8 +538,8 @@ module Aws::Glue
|
|
|
537
538
|
# Deletes multiple tables at once.
|
|
538
539
|
#
|
|
539
540
|
# <note markdown="1"> After completing this operation, you no longer have access to the
|
|
540
|
-
# table versions and partitions that belong to the deleted table.
|
|
541
|
-
#
|
|
541
|
+
# table versions and partitions that belong to the deleted table. Glue
|
|
542
|
+
# deletes these "orphaned" resources asynchronously in a timely
|
|
542
543
|
# manner, at the discretion of the service.
|
|
543
544
|
#
|
|
544
545
|
# To ensure the immediate deletion of all related resources, before
|
|
@@ -551,7 +552,7 @@ module Aws::Glue
|
|
|
551
552
|
#
|
|
552
553
|
# @option params [String] :catalog_id
|
|
553
554
|
# The ID of the Data Catalog where the table resides. If none is
|
|
554
|
-
# provided, the
|
|
555
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
555
556
|
#
|
|
556
557
|
# @option params [required, String] :database_name
|
|
557
558
|
# The name of the catalog database in which the tables to delete reside.
|
|
@@ -592,7 +593,7 @@ module Aws::Glue
|
|
|
592
593
|
#
|
|
593
594
|
# @option params [String] :catalog_id
|
|
594
595
|
# The ID of the Data Catalog where the tables reside. If none is
|
|
595
|
-
# provided, the
|
|
596
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
596
597
|
#
|
|
597
598
|
# @option params [required, String] :database_name
|
|
598
599
|
# The database in the catalog in which the table resides. For Hive
|
|
@@ -667,6 +668,7 @@ module Aws::Glue
|
|
|
667
668
|
# resp.crawlers[0].targets.s3_targets[0].exclusions #=> Array
|
|
668
669
|
# resp.crawlers[0].targets.s3_targets[0].exclusions[0] #=> String
|
|
669
670
|
# resp.crawlers[0].targets.s3_targets[0].connection_name #=> String
|
|
671
|
+
# resp.crawlers[0].targets.s3_targets[0].sample_size #=> Integer
|
|
670
672
|
# resp.crawlers[0].targets.jdbc_targets #=> Array
|
|
671
673
|
# resp.crawlers[0].targets.jdbc_targets[0].connection_name #=> String
|
|
672
674
|
# resp.crawlers[0].targets.jdbc_targets[0].path #=> String
|
|
@@ -849,7 +851,8 @@ module Aws::Glue
|
|
|
849
851
|
#
|
|
850
852
|
# @option params [String] :catalog_id
|
|
851
853
|
# The ID of the Data Catalog where the partitions in question reside. If
|
|
852
|
-
# none is supplied, the
|
|
854
|
+
# none is supplied, the Amazon Web Services account ID is used by
|
|
855
|
+
# default.
|
|
853
856
|
#
|
|
854
857
|
# @option params [required, String] :database_name
|
|
855
858
|
# The name of the catalog database where the partitions reside.
|
|
@@ -1228,7 +1231,7 @@ module Aws::Glue
|
|
|
1228
1231
|
#
|
|
1229
1232
|
# @option params [String] :catalog_id
|
|
1230
1233
|
# The ID of the catalog in which the partition is to be updated.
|
|
1231
|
-
# Currently, this should be the
|
|
1234
|
+
# Currently, this should be the Amazon Web Services account ID.
|
|
1232
1235
|
#
|
|
1233
1236
|
# @option params [required, String] :database_name
|
|
1234
1237
|
# The name of the metadata database in which the partition is to be
|
|
@@ -1336,10 +1339,10 @@ module Aws::Glue
|
|
|
1336
1339
|
end
|
|
1337
1340
|
|
|
1338
1341
|
# Cancels (stops) a task run. Machine learning task runs are
|
|
1339
|
-
# asynchronous tasks that
|
|
1340
|
-
#
|
|
1341
|
-
#
|
|
1342
|
-
#
|
|
1342
|
+
# asynchronous tasks that Glue runs on your behalf as part of various
|
|
1343
|
+
# machine learning workflows. You can cancel a machine learning task run
|
|
1344
|
+
# at any time by calling `CancelMLTaskRun` with a task run's parent
|
|
1345
|
+
# transform's `TransformID` and the task run's `TaskRunId`.
|
|
1343
1346
|
#
|
|
1344
1347
|
# @option params [required, String] :transform_id
|
|
1345
1348
|
# The unique identifier of the machine learning transform.
|
|
@@ -1381,8 +1384,8 @@ module Aws::Glue
|
|
|
1381
1384
|
# checks are performed.
|
|
1382
1385
|
#
|
|
1383
1386
|
# @option params [required, String] :data_format
|
|
1384
|
-
# The data format of the schema definition. Currently
|
|
1385
|
-
# supported.
|
|
1387
|
+
# The data format of the schema definition. Currently `AVRO` and `JSON`
|
|
1388
|
+
# are supported.
|
|
1386
1389
|
#
|
|
1387
1390
|
# @option params [required, String] :schema_definition
|
|
1388
1391
|
# The definition of the schema that has to be validated.
|
|
@@ -1395,7 +1398,7 @@ module Aws::Glue
|
|
|
1395
1398
|
# @example Request syntax with placeholder values
|
|
1396
1399
|
#
|
|
1397
1400
|
# resp = client.check_schema_version_validity({
|
|
1398
|
-
# data_format: "AVRO", # required, accepts AVRO
|
|
1401
|
+
# data_format: "AVRO", # required, accepts AVRO, JSON
|
|
1399
1402
|
# schema_definition: "SchemaDefinitionString", # required
|
|
1400
1403
|
# })
|
|
1401
1404
|
#
|
|
@@ -1473,7 +1476,7 @@ module Aws::Glue
|
|
|
1473
1476
|
#
|
|
1474
1477
|
# @option params [String] :catalog_id
|
|
1475
1478
|
# The ID of the Data Catalog in which to create the connection. If none
|
|
1476
|
-
# is provided, the
|
|
1479
|
+
# is provided, the Amazon Web Services account ID is used by default.
|
|
1477
1480
|
#
|
|
1478
1481
|
# @option params [required, Types::ConnectionInput] :connection_input
|
|
1479
1482
|
# A `ConnectionInput` object defining the connection to create.
|
|
@@ -1522,7 +1525,7 @@ module Aws::Glue
|
|
|
1522
1525
|
# new crawler to access customer resources.
|
|
1523
1526
|
#
|
|
1524
1527
|
# @option params [String] :database_name
|
|
1525
|
-
# The
|
|
1528
|
+
# The Glue database where results are written, such as:
|
|
1526
1529
|
# `arn:aws:daylight:us-east-1::database/sometable/*`.
|
|
1527
1530
|
#
|
|
1528
1531
|
# @option params [String] :description
|
|
@@ -1574,8 +1577,8 @@ module Aws::Glue
|
|
|
1574
1577
|
#
|
|
1575
1578
|
# @option params [Hash<String,String>] :tags
|
|
1576
1579
|
# The tags to use with this crawler request. You may use tags to limit
|
|
1577
|
-
# access to the crawler. For more information about tags in
|
|
1578
|
-
#
|
|
1580
|
+
# access to the crawler. For more information about tags in Glue, see
|
|
1581
|
+
# [Amazon Web Services Tags in Glue][1] in the developer guide.
|
|
1579
1582
|
#
|
|
1580
1583
|
#
|
|
1581
1584
|
#
|
|
@@ -1596,6 +1599,7 @@ module Aws::Glue
|
|
|
1596
1599
|
# path: "Path",
|
|
1597
1600
|
# exclusions: ["Path"],
|
|
1598
1601
|
# connection_name: "ConnectionName",
|
|
1602
|
+
# sample_size: 1,
|
|
1599
1603
|
# },
|
|
1600
1604
|
# ],
|
|
1601
1605
|
# jdbc_targets: [
|
|
@@ -1659,7 +1663,7 @@ module Aws::Glue
|
|
|
1659
1663
|
#
|
|
1660
1664
|
# @option params [String] :catalog_id
|
|
1661
1665
|
# The ID of the Data Catalog in which to create the database. If none is
|
|
1662
|
-
# provided, the
|
|
1666
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
1663
1667
|
#
|
|
1664
1668
|
# @option params [required, Types::DatabaseInput] :database_input
|
|
1665
1669
|
# The metadata for the database.
|
|
@@ -1736,8 +1740,8 @@ module Aws::Glue
|
|
|
1736
1740
|
# </note>
|
|
1737
1741
|
#
|
|
1738
1742
|
# @option params [Integer] :number_of_nodes
|
|
1739
|
-
# The number of
|
|
1740
|
-
#
|
|
1743
|
+
# The number of Glue Data Processing Units (DPUs) to allocate to this
|
|
1744
|
+
# `DevEndpoint`.
|
|
1741
1745
|
#
|
|
1742
1746
|
# @option params [String] :worker_type
|
|
1743
1747
|
# The type of predefined worker that is allocated to the development
|
|
@@ -1760,10 +1764,10 @@ module Aws::Glue
|
|
|
1760
1764
|
#
|
|
1761
1765
|
# @option params [String] :glue_version
|
|
1762
1766
|
# Glue version determines the versions of Apache Spark and Python that
|
|
1763
|
-
#
|
|
1764
|
-
#
|
|
1767
|
+
# Glue supports. The Python version indicates the version supported for
|
|
1768
|
+
# running your ETL scripts on development endpoints.
|
|
1765
1769
|
#
|
|
1766
|
-
# For more information about the available
|
|
1770
|
+
# For more information about the available Glue versions and
|
|
1767
1771
|
# corresponding Spark and Python versions, see [Glue version][1] in the
|
|
1768
1772
|
# developer guide.
|
|
1769
1773
|
#
|
|
@@ -1811,8 +1815,8 @@ module Aws::Glue
|
|
|
1811
1815
|
#
|
|
1812
1816
|
# @option params [Hash<String,String>] :tags
|
|
1813
1817
|
# The tags to use with this DevEndpoint. You may use tags to limit
|
|
1814
|
-
# access to the DevEndpoint. For more information about tags in
|
|
1815
|
-
#
|
|
1818
|
+
# access to the DevEndpoint. For more information about tags in Glue,
|
|
1819
|
+
# see [Amazon Web Services Tags in Glue][1] in the developer guide.
|
|
1816
1820
|
#
|
|
1817
1821
|
#
|
|
1818
1822
|
#
|
|
@@ -1921,21 +1925,21 @@ module Aws::Glue
|
|
|
1921
1925
|
# runs allowed for this job.
|
|
1922
1926
|
#
|
|
1923
1927
|
# @option params [required, Types::JobCommand] :command
|
|
1924
|
-
# The `JobCommand` that
|
|
1928
|
+
# The `JobCommand` that runs this job.
|
|
1925
1929
|
#
|
|
1926
1930
|
# @option params [Hash<String,String>] :default_arguments
|
|
1927
1931
|
# The default arguments for this job.
|
|
1928
1932
|
#
|
|
1929
1933
|
# You can specify arguments here that your own job-execution script
|
|
1930
|
-
# consumes, as well as arguments that
|
|
1934
|
+
# consumes, as well as arguments that Glue itself consumes.
|
|
1931
1935
|
#
|
|
1932
1936
|
# For information about how to specify and consume your own Job
|
|
1933
|
-
# arguments, see the [Calling
|
|
1937
|
+
# arguments, see the [Calling Glue APIs in Python][1] topic in the
|
|
1934
1938
|
# developer guide.
|
|
1935
1939
|
#
|
|
1936
|
-
# For information about the key-value pairs that
|
|
1937
|
-
#
|
|
1938
|
-
#
|
|
1940
|
+
# For information about the key-value pairs that Glue consumes to set up
|
|
1941
|
+
# your job, see the [Special Parameters Used by Glue][2] topic in the
|
|
1942
|
+
# developer guide.
|
|
1939
1943
|
#
|
|
1940
1944
|
#
|
|
1941
1945
|
#
|
|
@@ -1954,11 +1958,11 @@ module Aws::Glue
|
|
|
1954
1958
|
# @option params [Integer] :allocated_capacity
|
|
1955
1959
|
# This parameter is deprecated. Use `MaxCapacity` instead.
|
|
1956
1960
|
#
|
|
1957
|
-
# The number of
|
|
1958
|
-
#
|
|
1959
|
-
#
|
|
1960
|
-
#
|
|
1961
|
-
# [
|
|
1961
|
+
# The number of Glue data processing units (DPUs) to allocate to this
|
|
1962
|
+
# Job. You can allocate from 2 to 100 DPUs; the default is 10. A DPU is
|
|
1963
|
+
# a relative measure of processing power that consists of 4 vCPUs of
|
|
1964
|
+
# compute capacity and 16 GB of memory. For more information, see the
|
|
1965
|
+
# [Glue pricing page][1].
|
|
1962
1966
|
#
|
|
1963
1967
|
#
|
|
1964
1968
|
#
|
|
@@ -1970,11 +1974,11 @@ module Aws::Glue
|
|
|
1970
1974
|
# status. The default is 2,880 minutes (48 hours).
|
|
1971
1975
|
#
|
|
1972
1976
|
# @option params [Float] :max_capacity
|
|
1973
|
-
#
|
|
1974
|
-
#
|
|
1975
|
-
#
|
|
1976
|
-
#
|
|
1977
|
-
# page][1].
|
|
1977
|
+
# For Glue version 1.0 or earlier jobs, using the standard worker type,
|
|
1978
|
+
# the number of Glue data processing units (DPUs) that can be allocated
|
|
1979
|
+
# when this job runs. A DPU is a relative measure of processing power
|
|
1980
|
+
# that consists of 4 vCPUs of compute capacity and 16 GB of memory. For
|
|
1981
|
+
# more information, see the [Glue pricing page][1].
|
|
1978
1982
|
#
|
|
1979
1983
|
# Do not set `Max Capacity` if using `WorkerType` and `NumberOfWorkers`.
|
|
1980
1984
|
#
|
|
@@ -1991,6 +1995,10 @@ module Aws::Glue
|
|
|
1991
1995
|
# 100 DPUs. The default is 10 DPUs. This job type cannot have a
|
|
1992
1996
|
# fractional DPU allocation.
|
|
1993
1997
|
#
|
|
1998
|
+
# For Glue version 2.0 jobs, you cannot instead specify a `Maximum
|
|
1999
|
+
# capacity`. Instead, you should specify a `Worker type` and the `Number
|
|
2000
|
+
# of workers`.
|
|
2001
|
+
#
|
|
1994
2002
|
#
|
|
1995
2003
|
#
|
|
1996
2004
|
# [1]: https://aws.amazon.com/glue/pricing/
|
|
@@ -2001,8 +2009,8 @@ module Aws::Glue
|
|
|
2001
2009
|
#
|
|
2002
2010
|
# @option params [Hash<String,String>] :tags
|
|
2003
2011
|
# The tags to use with this job. You may use tags to limit access to the
|
|
2004
|
-
# job. For more information about tags in
|
|
2005
|
-
# Glue][1] in the developer guide.
|
|
2012
|
+
# job. For more information about tags in Glue, see [Amazon Web Services
|
|
2013
|
+
# Tags in Glue][1] in the developer guide.
|
|
2006
2014
|
#
|
|
2007
2015
|
#
|
|
2008
2016
|
#
|
|
@@ -2013,10 +2021,10 @@ module Aws::Glue
|
|
|
2013
2021
|
#
|
|
2014
2022
|
# @option params [String] :glue_version
|
|
2015
2023
|
# Glue version determines the versions of Apache Spark and Python that
|
|
2016
|
-
#
|
|
2017
|
-
#
|
|
2024
|
+
# Glue supports. The Python version indicates the version supported for
|
|
2025
|
+
# jobs of type Spark.
|
|
2018
2026
|
#
|
|
2019
|
-
# For more information about the available
|
|
2027
|
+
# For more information about the available Glue versions and
|
|
2020
2028
|
# corresponding Spark and Python versions, see [Glue version][1] in the
|
|
2021
2029
|
# developer guide.
|
|
2022
2030
|
#
|
|
@@ -2106,16 +2114,16 @@ module Aws::Glue
|
|
|
2106
2114
|
req.send_request(options)
|
|
2107
2115
|
end
|
|
2108
2116
|
|
|
2109
|
-
# Creates an
|
|
2110
|
-
#
|
|
2117
|
+
# Creates an Glue machine learning transform. This operation creates the
|
|
2118
|
+
# transform and all the necessary parameters to train it.
|
|
2111
2119
|
#
|
|
2112
2120
|
# Call this operation as the first step in the process of using a
|
|
2113
2121
|
# machine learning transform (such as the `FindMatches` transform) for
|
|
2114
2122
|
# deduplicating data. You can provide an optional `Description`, in
|
|
2115
2123
|
# addition to the parameters that you want to use for your algorithm.
|
|
2116
2124
|
#
|
|
2117
|
-
# You must also specify certain parameters for the tasks that
|
|
2118
|
-
#
|
|
2125
|
+
# You must also specify certain parameters for the tasks that Glue runs
|
|
2126
|
+
# on your behalf as part of learning from your data and creating a
|
|
2119
2127
|
# high-quality machine learning transform. These parameters include
|
|
2120
2128
|
# `Role`, and optionally, `AllocatedCapacity`, `Timeout`, and
|
|
2121
2129
|
# `MaxRetries`. For more information, see [Jobs][1].
|
|
@@ -2132,7 +2140,7 @@ module Aws::Glue
|
|
|
2132
2140
|
# The default is an empty string.
|
|
2133
2141
|
#
|
|
2134
2142
|
# @option params [required, Array<Types::GlueTable>] :input_record_tables
|
|
2135
|
-
# A list of
|
|
2143
|
+
# A list of Glue table definitions used by the transform.
|
|
2136
2144
|
#
|
|
2137
2145
|
# @option params [required, Types::TransformParameters] :parameters
|
|
2138
2146
|
# The algorithmic parameters that are specific to the transform type
|
|
@@ -2140,13 +2148,13 @@ module Aws::Glue
|
|
|
2140
2148
|
#
|
|
2141
2149
|
# @option params [required, String] :role
|
|
2142
2150
|
# The name or Amazon Resource Name (ARN) of the IAM role with the
|
|
2143
|
-
# required permissions. The required permissions include both
|
|
2144
|
-
# service role permissions to
|
|
2145
|
-
#
|
|
2151
|
+
# required permissions. The required permissions include both Glue
|
|
2152
|
+
# service role permissions to Glue resources, and Amazon S3 permissions
|
|
2153
|
+
# required by the transform.
|
|
2146
2154
|
#
|
|
2147
|
-
# * This role needs
|
|
2148
|
-
# resources in
|
|
2149
|
-
#
|
|
2155
|
+
# * This role needs Glue service role permissions to allow access to
|
|
2156
|
+
# resources in Glue. See [Attach a Policy to IAM Users That Access
|
|
2157
|
+
# Glue][1].
|
|
2150
2158
|
#
|
|
2151
2159
|
# * This role needs permission to your Amazon Simple Storage Service
|
|
2152
2160
|
# (Amazon S3) sources, targets, temporary directory, scripts, and any
|
|
@@ -2157,10 +2165,10 @@ module Aws::Glue
|
|
|
2157
2165
|
# [1]: https://docs.aws.amazon.com/glue/latest/dg/attach-policy-iam-user.html
|
|
2158
2166
|
#
|
|
2159
2167
|
# @option params [String] :glue_version
|
|
2160
|
-
# This value determines which version of
|
|
2168
|
+
# This value determines which version of Glue this machine learning
|
|
2161
2169
|
# transform is compatible with. Glue 1.0 is recommended for most
|
|
2162
2170
|
# customers. If the value is not set, the Glue compatibility defaults to
|
|
2163
|
-
# Glue 0.9. For more information, see [
|
|
2171
|
+
# Glue 0.9. For more information, see [Glue Versions][1] in the
|
|
2164
2172
|
# developer guide.
|
|
2165
2173
|
#
|
|
2166
2174
|
#
|
|
@@ -2168,11 +2176,11 @@ module Aws::Glue
|
|
|
2168
2176
|
# [1]: https://docs.aws.amazon.com/glue/latest/dg/release-notes.html#release-notes-versions
|
|
2169
2177
|
#
|
|
2170
2178
|
# @option params [Float] :max_capacity
|
|
2171
|
-
# The number of
|
|
2172
|
-
#
|
|
2173
|
-
#
|
|
2174
|
-
#
|
|
2175
|
-
#
|
|
2179
|
+
# The number of Glue data processing units (DPUs) that are allocated to
|
|
2180
|
+
# task runs for this transform. You can allocate from 2 to 100 DPUs; the
|
|
2181
|
+
# default is 10. A DPU is a relative measure of processing power that
|
|
2182
|
+
# consists of 4 vCPUs of compute capacity and 16 GB of memory. For more
|
|
2183
|
+
# information, see the [Glue pricing page][1].
|
|
2176
2184
|
#
|
|
2177
2185
|
# `MaxCapacity` is a mutually exclusive option with `NumberOfWorkers`
|
|
2178
2186
|
# and `WorkerType`.
|
|
@@ -2245,8 +2253,8 @@ module Aws::Glue
|
|
|
2245
2253
|
# @option params [Hash<String,String>] :tags
|
|
2246
2254
|
# The tags to use with this machine learning transform. You may use tags
|
|
2247
2255
|
# to limit access to the machine learning transform. For more
|
|
2248
|
-
# information about tags in
|
|
2249
|
-
# the developer guide.
|
|
2256
|
+
# information about tags in Glue, see [Amazon Web Services Tags in
|
|
2257
|
+
# Glue][1] in the developer guide.
|
|
2250
2258
|
#
|
|
2251
2259
|
#
|
|
2252
2260
|
#
|
|
@@ -2318,8 +2326,8 @@ module Aws::Glue
|
|
|
2318
2326
|
# Creates a new partition.
|
|
2319
2327
|
#
|
|
2320
2328
|
# @option params [String] :catalog_id
|
|
2321
|
-
# The
|
|
2322
|
-
# created.
|
|
2329
|
+
# The Amazon Web Services account ID of the catalog in which the
|
|
2330
|
+
# partition is to be created.
|
|
2323
2331
|
#
|
|
2324
2332
|
# @option params [required, String] :database_name
|
|
2325
2333
|
# The name of the metadata database in which the partition is to be
|
|
@@ -2463,8 +2471,8 @@ module Aws::Glue
|
|
|
2463
2471
|
# will not be any default value for this.
|
|
2464
2472
|
#
|
|
2465
2473
|
# @option params [Hash<String,String>] :tags
|
|
2466
|
-
#
|
|
2467
|
-
# command line, or API.
|
|
2474
|
+
# Amazon Web Services tags that contain a key value pair and may be
|
|
2475
|
+
# searched by console, command line, or API.
|
|
2468
2476
|
#
|
|
2469
2477
|
# @return [Types::CreateRegistryResponse] Returns a {Seahorse::Client::Response response} object which responds to the following methods:
|
|
2470
2478
|
#
|
|
@@ -2527,8 +2535,8 @@ module Aws::Glue
|
|
|
2527
2535
|
# mark. No whitespace.
|
|
2528
2536
|
#
|
|
2529
2537
|
# @option params [required, String] :data_format
|
|
2530
|
-
# The data format of the schema definition. Currently
|
|
2531
|
-
# supported.
|
|
2538
|
+
# The data format of the schema definition. Currently `AVRO` and `JSON`
|
|
2539
|
+
# are supported.
|
|
2532
2540
|
#
|
|
2533
2541
|
# @option params [String] :compatibility
|
|
2534
2542
|
# The compatibility mode of the schema. The possible values are:
|
|
@@ -2581,9 +2589,9 @@ module Aws::Glue
|
|
|
2581
2589
|
# there will not be any automatic default value for this.
|
|
2582
2590
|
#
|
|
2583
2591
|
# @option params [Hash<String,String>] :tags
|
|
2584
|
-
#
|
|
2585
|
-
# command line, or API. If specified, follows the
|
|
2586
|
-
# pattern.
|
|
2592
|
+
# Amazon Web Services tags that contain a key value pair and may be
|
|
2593
|
+
# searched by console, command line, or API. If specified, follows the
|
|
2594
|
+
# Amazon Web Services tags-on-create pattern.
|
|
2587
2595
|
#
|
|
2588
2596
|
# @option params [String] :schema_definition
|
|
2589
2597
|
# The schema definition using the `DataFormat` setting for `SchemaName`.
|
|
@@ -2613,7 +2621,7 @@ module Aws::Glue
|
|
|
2613
2621
|
# registry_arn: "GlueResourceArn",
|
|
2614
2622
|
# },
|
|
2615
2623
|
# schema_name: "SchemaRegistryNameString", # required
|
|
2616
|
-
# data_format: "AVRO", # required, accepts AVRO
|
|
2624
|
+
# data_format: "AVRO", # required, accepts AVRO, JSON
|
|
2617
2625
|
# compatibility: "NONE", # accepts NONE, DISABLED, BACKWARD, BACKWARD_ALL, FORWARD, FORWARD_ALL, FULL, FULL_ALL
|
|
2618
2626
|
# description: "DescriptionString",
|
|
2619
2627
|
# tags: {
|
|
@@ -2629,7 +2637,7 @@ module Aws::Glue
|
|
|
2629
2637
|
# resp.schema_name #=> String
|
|
2630
2638
|
# resp.schema_arn #=> String
|
|
2631
2639
|
# resp.description #=> String
|
|
2632
|
-
# resp.data_format #=> String, one of "AVRO"
|
|
2640
|
+
# resp.data_format #=> String, one of "AVRO", "JSON"
|
|
2633
2641
|
# resp.compatibility #=> String, one of "NONE", "DISABLED", "BACKWARD", "BACKWARD_ALL", "FORWARD", "FORWARD_ALL", "FULL", "FULL_ALL"
|
|
2634
2642
|
# resp.schema_checkpoint #=> Integer
|
|
2635
2643
|
# resp.latest_schema_version #=> Integer
|
|
@@ -2707,10 +2715,10 @@ module Aws::Glue
|
|
|
2707
2715
|
end
|
|
2708
2716
|
|
|
2709
2717
|
# Creates a new security configuration. A security configuration is a
|
|
2710
|
-
# set of security properties that can be used by
|
|
2718
|
+
# set of security properties that can be used by Glue. You can use a
|
|
2711
2719
|
# security configuration to encrypt data at rest. For information about
|
|
2712
|
-
# using security configurations in
|
|
2713
|
-
#
|
|
2720
|
+
# using security configurations in Glue, see [Encrypting Data Written by
|
|
2721
|
+
# Crawlers, Jobs, and Development Endpoints][1].
|
|
2714
2722
|
#
|
|
2715
2723
|
#
|
|
2716
2724
|
#
|
|
@@ -2767,7 +2775,7 @@ module Aws::Glue
|
|
|
2767
2775
|
#
|
|
2768
2776
|
# @option params [String] :catalog_id
|
|
2769
2777
|
# The ID of the Data Catalog in which to create the `Table`. If none is
|
|
2770
|
-
# supplied, the
|
|
2778
|
+
# supplied, the Amazon Web Services account ID is used by default.
|
|
2771
2779
|
#
|
|
2772
2780
|
# @option params [required, String] :database_name
|
|
2773
2781
|
# The catalog database in which to create the new table. For Hive
|
|
@@ -2924,8 +2932,8 @@ module Aws::Glue
|
|
|
2924
2932
|
#
|
|
2925
2933
|
# @option params [Hash<String,String>] :tags
|
|
2926
2934
|
# The tags to use with this trigger. You may use tags to limit access to
|
|
2927
|
-
# the trigger. For more information about tags in
|
|
2928
|
-
# Tags in
|
|
2935
|
+
# the trigger. For more information about tags in Glue, see [Amazon Web
|
|
2936
|
+
# Services Tags in Glue][1] in the developer guide.
|
|
2929
2937
|
#
|
|
2930
2938
|
#
|
|
2931
2939
|
#
|
|
@@ -2992,7 +3000,7 @@ module Aws::Glue
|
|
|
2992
3000
|
#
|
|
2993
3001
|
# @option params [String] :catalog_id
|
|
2994
3002
|
# The ID of the Data Catalog in which to create the function. If none is
|
|
2995
|
-
# provided, the
|
|
3003
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
2996
3004
|
#
|
|
2997
3005
|
# @option params [required, String] :database_name
|
|
2998
3006
|
# The name of the catalog database in which to create the function.
|
|
@@ -3114,7 +3122,8 @@ module Aws::Glue
|
|
|
3114
3122
|
#
|
|
3115
3123
|
# @option params [String] :catalog_id
|
|
3116
3124
|
# The ID of the Data Catalog where the partitions in question reside. If
|
|
3117
|
-
# none is supplied, the
|
|
3125
|
+
# none is supplied, the Amazon Web Services account ID is used by
|
|
3126
|
+
# default.
|
|
3118
3127
|
#
|
|
3119
3128
|
# @option params [required, String] :database_name
|
|
3120
3129
|
# The name of the catalog database where the partitions reside.
|
|
@@ -3156,7 +3165,8 @@ module Aws::Glue
|
|
|
3156
3165
|
#
|
|
3157
3166
|
# @option params [String] :catalog_id
|
|
3158
3167
|
# The ID of the Data Catalog where the partitions in question reside. If
|
|
3159
|
-
# none is supplied, the
|
|
3168
|
+
# none is supplied, the Amazon Web Services account ID is used by
|
|
3169
|
+
# default.
|
|
3160
3170
|
#
|
|
3161
3171
|
# @option params [required, String] :database_name
|
|
3162
3172
|
# The name of the catalog database where the partitions reside.
|
|
@@ -3191,7 +3201,7 @@ module Aws::Glue
|
|
|
3191
3201
|
#
|
|
3192
3202
|
# @option params [String] :catalog_id
|
|
3193
3203
|
# The ID of the Data Catalog in which the connection resides. If none is
|
|
3194
|
-
# provided, the
|
|
3204
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
3195
3205
|
#
|
|
3196
3206
|
# @option params [required, String] :connection_name
|
|
3197
3207
|
# The name of the connection to delete.
|
|
@@ -3214,7 +3224,7 @@ module Aws::Glue
|
|
|
3214
3224
|
req.send_request(options)
|
|
3215
3225
|
end
|
|
3216
3226
|
|
|
3217
|
-
# Removes a specified crawler from the
|
|
3227
|
+
# Removes a specified crawler from the Glue Data Catalog, unless the
|
|
3218
3228
|
# crawler state is `RUNNING`.
|
|
3219
3229
|
#
|
|
3220
3230
|
# @option params [required, String] :name
|
|
@@ -3241,8 +3251,8 @@ module Aws::Glue
|
|
|
3241
3251
|
#
|
|
3242
3252
|
# <note markdown="1"> After completing this operation, you no longer have access to the
|
|
3243
3253
|
# tables (and all table versions and partitions that might belong to the
|
|
3244
|
-
# tables) and the user-defined functions in the deleted database.
|
|
3245
|
-
#
|
|
3254
|
+
# tables) and the user-defined functions in the deleted database. Glue
|
|
3255
|
+
# deletes these "orphaned" resources asynchronously in a timely
|
|
3246
3256
|
# manner, at the discretion of the service.
|
|
3247
3257
|
#
|
|
3248
3258
|
# To ensure the immediate deletion of all related resources, before
|
|
@@ -3256,7 +3266,7 @@ module Aws::Glue
|
|
|
3256
3266
|
#
|
|
3257
3267
|
# @option params [String] :catalog_id
|
|
3258
3268
|
# The ID of the Data Catalog in which the database resides. If none is
|
|
3259
|
-
# provided, the
|
|
3269
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
3260
3270
|
#
|
|
3261
3271
|
# @option params [required, String] :name
|
|
3262
3272
|
# The name of the database to delete. For Hive compatibility, this must
|
|
@@ -3331,12 +3341,12 @@ module Aws::Glue
|
|
|
3331
3341
|
req.send_request(options)
|
|
3332
3342
|
end
|
|
3333
3343
|
|
|
3334
|
-
# Deletes an
|
|
3344
|
+
# Deletes an Glue machine learning transform. Machine learning
|
|
3335
3345
|
# transforms are a special type of transform that use machine learning
|
|
3336
3346
|
# to learn the details of the transformation to be performed by learning
|
|
3337
3347
|
# from examples provided by humans. These transformations are then saved
|
|
3338
|
-
# by
|
|
3339
|
-
# calling `DeleteMLTransforms`. However, any
|
|
3348
|
+
# by Glue. If you no longer need a transform, you can delete it by
|
|
3349
|
+
# calling `DeleteMLTransforms`. However, any Glue jobs that still
|
|
3340
3350
|
# reference the deleted transform will no longer succeed.
|
|
3341
3351
|
#
|
|
3342
3352
|
# @option params [required, String] :transform_id
|
|
@@ -3369,7 +3379,8 @@ module Aws::Glue
|
|
|
3369
3379
|
#
|
|
3370
3380
|
# @option params [String] :catalog_id
|
|
3371
3381
|
# The ID of the Data Catalog where the partition to be deleted resides.
|
|
3372
|
-
# If none is provided, the
|
|
3382
|
+
# If none is provided, the Amazon Web Services account ID is used by
|
|
3383
|
+
# default.
|
|
3373
3384
|
#
|
|
3374
3385
|
# @option params [required, String] :database_name
|
|
3375
3386
|
# The name of the catalog database in which the table in question
|
|
@@ -3440,7 +3451,7 @@ module Aws::Glue
|
|
|
3440
3451
|
# Delete the entire registry including schema and all of its versions.
|
|
3441
3452
|
# To get the status of the delete operation, you can call the
|
|
3442
3453
|
# `GetRegistry` API after the asynchronous call. Deleting a registry
|
|
3443
|
-
# will
|
|
3454
|
+
# will deactivate all online operations for the registry such as the
|
|
3444
3455
|
# `UpdateRegistry`, `CreateSchema`, `UpdateSchema`, and
|
|
3445
3456
|
# `RegisterSchemaVersion` APIs.
|
|
3446
3457
|
#
|
|
@@ -3484,8 +3495,7 @@ module Aws::Glue
|
|
|
3484
3495
|
# The hash value returned when this policy was set.
|
|
3485
3496
|
#
|
|
3486
3497
|
# @option params [String] :resource_arn
|
|
3487
|
-
# The ARN of the
|
|
3488
|
-
# deleted.
|
|
3498
|
+
# The ARN of the Glue resource for the resource policy to be deleted.
|
|
3489
3499
|
#
|
|
3490
3500
|
# @return [Struct] Returns an empty {Seahorse::Client::Response response}.
|
|
3491
3501
|
#
|
|
@@ -3508,7 +3518,7 @@ module Aws::Glue
|
|
|
3508
3518
|
# Deletes the entire schema set, including the schema set and all of its
|
|
3509
3519
|
# versions. To get the status of the delete operation, you can call
|
|
3510
3520
|
# `GetSchema` API after the asynchronous call. Deleting a registry will
|
|
3511
|
-
#
|
|
3521
|
+
# deactivate all online operations for the schema, such as the
|
|
3512
3522
|
# `GetSchemaByDefinition`, and `RegisterSchemaVersion` APIs.
|
|
3513
3523
|
#
|
|
3514
3524
|
# @option params [required, Types::SchemaId] :schema_id
|
|
@@ -3633,8 +3643,8 @@ module Aws::Glue
|
|
|
3633
3643
|
# Removes a table definition from the Data Catalog.
|
|
3634
3644
|
#
|
|
3635
3645
|
# <note markdown="1"> After completing this operation, you no longer have access to the
|
|
3636
|
-
# table versions and partitions that belong to the deleted table.
|
|
3637
|
-
#
|
|
3646
|
+
# table versions and partitions that belong to the deleted table. Glue
|
|
3647
|
+
# deletes these "orphaned" resources asynchronously in a timely
|
|
3638
3648
|
# manner, at the discretion of the service.
|
|
3639
3649
|
#
|
|
3640
3650
|
# To ensure the immediate deletion of all related resources, before
|
|
@@ -3647,7 +3657,7 @@ module Aws::Glue
|
|
|
3647
3657
|
#
|
|
3648
3658
|
# @option params [String] :catalog_id
|
|
3649
3659
|
# The ID of the Data Catalog where the table resides. If none is
|
|
3650
|
-
# provided, the
|
|
3660
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
3651
3661
|
#
|
|
3652
3662
|
# @option params [required, String] :database_name
|
|
3653
3663
|
# The name of the catalog database in which the table resides. For Hive
|
|
@@ -3680,7 +3690,7 @@ module Aws::Glue
|
|
|
3680
3690
|
#
|
|
3681
3691
|
# @option params [String] :catalog_id
|
|
3682
3692
|
# The ID of the Data Catalog where the tables reside. If none is
|
|
3683
|
-
# provided, the
|
|
3693
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
3684
3694
|
#
|
|
3685
3695
|
# @option params [required, String] :database_name
|
|
3686
3696
|
# The database in the catalog in which the table resides. For Hive
|
|
@@ -3747,7 +3757,8 @@ module Aws::Glue
|
|
|
3747
3757
|
#
|
|
3748
3758
|
# @option params [String] :catalog_id
|
|
3749
3759
|
# The ID of the Data Catalog where the function to be deleted is
|
|
3750
|
-
# located. If none is supplied, the
|
|
3760
|
+
# located. If none is supplied, the Amazon Web Services account ID is
|
|
3761
|
+
# used by default.
|
|
3751
3762
|
#
|
|
3752
3763
|
# @option params [required, String] :database_name
|
|
3753
3764
|
# The name of the catalog database where the function is located.
|
|
@@ -3805,8 +3816,8 @@ module Aws::Glue
|
|
|
3805
3816
|
# Retrieves the status of a migration operation.
|
|
3806
3817
|
#
|
|
3807
3818
|
# @option params [String] :catalog_id
|
|
3808
|
-
# The ID of the catalog to migrate. Currently, this should be the
|
|
3809
|
-
# account ID.
|
|
3819
|
+
# The ID of the catalog to migrate. Currently, this should be the Amazon
|
|
3820
|
+
# Web Services account ID.
|
|
3810
3821
|
#
|
|
3811
3822
|
# @return [Types::GetCatalogImportStatusResponse] Returns a {Seahorse::Client::Response response} object which responds to the following methods:
|
|
3812
3823
|
#
|
|
@@ -3961,7 +3972,8 @@ module Aws::Glue
|
|
|
3961
3972
|
#
|
|
3962
3973
|
# @option params [String] :catalog_id
|
|
3963
3974
|
# The ID of the Data Catalog where the partitions in question reside. If
|
|
3964
|
-
# none is supplied, the
|
|
3975
|
+
# none is supplied, the Amazon Web Services account ID is used by
|
|
3976
|
+
# default.
|
|
3965
3977
|
#
|
|
3966
3978
|
# @option params [required, String] :database_name
|
|
3967
3979
|
# The name of the catalog database where the partitions reside.
|
|
@@ -4046,7 +4058,8 @@ module Aws::Glue
|
|
|
4046
4058
|
#
|
|
4047
4059
|
# @option params [String] :catalog_id
|
|
4048
4060
|
# The ID of the Data Catalog where the partitions in question reside. If
|
|
4049
|
-
# none is supplied, the
|
|
4061
|
+
# none is supplied, the Amazon Web Services account ID is used by
|
|
4062
|
+
# default.
|
|
4050
4063
|
#
|
|
4051
4064
|
# @option params [required, String] :database_name
|
|
4052
4065
|
# The name of the catalog database where the partitions reside.
|
|
@@ -4124,7 +4137,7 @@ module Aws::Glue
|
|
|
4124
4137
|
#
|
|
4125
4138
|
# @option params [String] :catalog_id
|
|
4126
4139
|
# The ID of the Data Catalog in which the connection resides. If none is
|
|
4127
|
-
# provided, the
|
|
4140
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
4128
4141
|
#
|
|
4129
4142
|
# @option params [required, String] :name
|
|
4130
4143
|
# The name of the connection definition to retrieve.
|
|
@@ -4133,8 +4146,8 @@ module Aws::Glue
|
|
|
4133
4146
|
# Allows you to retrieve the connection metadata without returning the
|
|
4134
4147
|
# password. For instance, the AWS Glue console uses this flag to
|
|
4135
4148
|
# retrieve the connection, and does not display the password. Set this
|
|
4136
|
-
# parameter when the caller might not have permission to use the
|
|
4137
|
-
#
|
|
4149
|
+
# parameter when the caller might not have permission to use the KMS key
|
|
4150
|
+
# to decrypt the password, but it does have permission to access the
|
|
4138
4151
|
# rest of the connection properties.
|
|
4139
4152
|
#
|
|
4140
4153
|
# @return [Types::GetConnectionResponse] Returns a {Seahorse::Client::Response response} object which responds to the following methods:
|
|
@@ -4179,7 +4192,7 @@ module Aws::Glue
|
|
|
4179
4192
|
#
|
|
4180
4193
|
# @option params [String] :catalog_id
|
|
4181
4194
|
# The ID of the Data Catalog in which the connections reside. If none is
|
|
4182
|
-
# provided, the
|
|
4195
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
4183
4196
|
#
|
|
4184
4197
|
# @option params [Types::GetConnectionsFilter] :filter
|
|
4185
4198
|
# A filter that controls which connections are returned.
|
|
@@ -4188,8 +4201,8 @@ module Aws::Glue
|
|
|
4188
4201
|
# Allows you to retrieve the connection metadata without returning the
|
|
4189
4202
|
# password. For instance, the AWS Glue console uses this flag to
|
|
4190
4203
|
# retrieve the connection, and does not display the password. Set this
|
|
4191
|
-
# parameter when the caller might not have permission to use the
|
|
4192
|
-
#
|
|
4204
|
+
# parameter when the caller might not have permission to use the KMS key
|
|
4205
|
+
# to decrypt the password, but it does have permission to access the
|
|
4193
4206
|
# rest of the connection properties.
|
|
4194
4207
|
#
|
|
4195
4208
|
# @option params [String] :next_token
|
|
@@ -4270,6 +4283,7 @@ module Aws::Glue
|
|
|
4270
4283
|
# resp.crawler.targets.s3_targets[0].exclusions #=> Array
|
|
4271
4284
|
# resp.crawler.targets.s3_targets[0].exclusions[0] #=> String
|
|
4272
4285
|
# resp.crawler.targets.s3_targets[0].connection_name #=> String
|
|
4286
|
+
# resp.crawler.targets.s3_targets[0].sample_size #=> Integer
|
|
4273
4287
|
# resp.crawler.targets.jdbc_targets #=> Array
|
|
4274
4288
|
# resp.crawler.targets.jdbc_targets[0].connection_name #=> String
|
|
4275
4289
|
# resp.crawler.targets.jdbc_targets[0].path #=> String
|
|
@@ -4401,6 +4415,7 @@ module Aws::Glue
|
|
|
4401
4415
|
# resp.crawlers[0].targets.s3_targets[0].exclusions #=> Array
|
|
4402
4416
|
# resp.crawlers[0].targets.s3_targets[0].exclusions[0] #=> String
|
|
4403
4417
|
# resp.crawlers[0].targets.s3_targets[0].connection_name #=> String
|
|
4418
|
+
# resp.crawlers[0].targets.s3_targets[0].sample_size #=> Integer
|
|
4404
4419
|
# resp.crawlers[0].targets.jdbc_targets #=> Array
|
|
4405
4420
|
# resp.crawlers[0].targets.jdbc_targets[0].connection_name #=> String
|
|
4406
4421
|
# resp.crawlers[0].targets.jdbc_targets[0].path #=> String
|
|
@@ -4457,7 +4472,8 @@ module Aws::Glue
|
|
|
4457
4472
|
#
|
|
4458
4473
|
# @option params [String] :catalog_id
|
|
4459
4474
|
# The ID of the Data Catalog to retrieve the security configuration for.
|
|
4460
|
-
# If none is provided, the
|
|
4475
|
+
# If none is provided, the Amazon Web Services account ID is used by
|
|
4476
|
+
# default.
|
|
4461
4477
|
#
|
|
4462
4478
|
# @return [Types::GetDataCatalogEncryptionSettingsResponse] Returns a {Seahorse::Client::Response response} object which responds to the following methods:
|
|
4463
4479
|
#
|
|
@@ -4489,7 +4505,7 @@ module Aws::Glue
|
|
|
4489
4505
|
#
|
|
4490
4506
|
# @option params [String] :catalog_id
|
|
4491
4507
|
# The ID of the Data Catalog in which the database resides. If none is
|
|
4492
|
-
# provided, the
|
|
4508
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
4493
4509
|
#
|
|
4494
4510
|
# @option params [required, String] :name
|
|
4495
4511
|
# The name of the database to retrieve. For Hive compatibility, this
|
|
@@ -4535,7 +4551,7 @@ module Aws::Glue
|
|
|
4535
4551
|
#
|
|
4536
4552
|
# @option params [String] :catalog_id
|
|
4537
4553
|
# The ID of the Data Catalog from which to retrieve `Databases`. If none
|
|
4538
|
-
# is provided, the
|
|
4554
|
+
# is provided, the Amazon Web Services account ID is used by default.
|
|
4539
4555
|
#
|
|
4540
4556
|
# @option params [String] :next_token
|
|
4541
4557
|
# A continuation token, if this is a continuation call.
|
|
@@ -4639,9 +4655,9 @@ module Aws::Glue
|
|
|
4639
4655
|
# Retrieves information about a specified development endpoint.
|
|
4640
4656
|
#
|
|
4641
4657
|
# <note markdown="1"> When you create a development endpoint in a virtual private cloud
|
|
4642
|
-
# (VPC),
|
|
4658
|
+
# (VPC), Glue returns only a private IP address, and the public IP
|
|
4643
4659
|
# address field is not populated. When you create a non-VPC development
|
|
4644
|
-
# endpoint,
|
|
4660
|
+
# endpoint, Glue returns only a public IP address.
|
|
4645
4661
|
#
|
|
4646
4662
|
# </note>
|
|
4647
4663
|
#
|
|
@@ -4701,9 +4717,9 @@ module Aws::Glue
|
|
|
4701
4717
|
# Retrieves all the development endpoints in this AWS account.
|
|
4702
4718
|
#
|
|
4703
4719
|
# <note markdown="1"> When you create a development endpoint in a virtual private cloud
|
|
4704
|
-
# (VPC),
|
|
4720
|
+
# (VPC), Glue returns only a private IP address and the public IP
|
|
4705
4721
|
# address field is not populated. When you create a non-VPC development
|
|
4706
|
-
# endpoint,
|
|
4722
|
+
# endpoint, Glue returns only a public IP address.
|
|
4707
4723
|
#
|
|
4708
4724
|
# </note>
|
|
4709
4725
|
#
|
|
@@ -5046,8 +5062,8 @@ module Aws::Glue
|
|
|
5046
5062
|
end
|
|
5047
5063
|
|
|
5048
5064
|
# Gets details for a specific task run on a machine learning transform.
|
|
5049
|
-
# Machine learning task runs are asynchronous tasks that
|
|
5050
|
-
#
|
|
5065
|
+
# Machine learning task runs are asynchronous tasks that Glue runs on
|
|
5066
|
+
# your behalf as part of various machine learning workflows. You can
|
|
5051
5067
|
# check the stats of any task run by calling `GetMLTaskRun` with the
|
|
5052
5068
|
# `TaskRunID` and its parent transform's `TransformID`.
|
|
5053
5069
|
#
|
|
@@ -5107,8 +5123,8 @@ module Aws::Glue
|
|
|
5107
5123
|
end
|
|
5108
5124
|
|
|
5109
5125
|
# Gets a list of runs for a machine learning transform. Machine learning
|
|
5110
|
-
# task runs are asynchronous tasks that
|
|
5111
|
-
#
|
|
5126
|
+
# task runs are asynchronous tasks that Glue runs on your behalf as part
|
|
5127
|
+
# of various machine learning workflows. You can get a sortable,
|
|
5112
5128
|
# filterable list of machine learning task runs by calling
|
|
5113
5129
|
# `GetMLTaskRuns` with their parent transform's `TransformID` and other
|
|
5114
5130
|
# optional parameters as documented in this section.
|
|
@@ -5188,12 +5204,12 @@ module Aws::Glue
|
|
|
5188
5204
|
req.send_request(options)
|
|
5189
5205
|
end
|
|
5190
5206
|
|
|
5191
|
-
# Gets an
|
|
5207
|
+
# Gets an Glue machine learning transform artifact and all its
|
|
5192
5208
|
# corresponding metadata. Machine learning transforms are a special type
|
|
5193
5209
|
# of transform that use machine learning to learn the details of the
|
|
5194
5210
|
# transformation to be performed by learning from examples provided by
|
|
5195
|
-
# humans. These transformations are then saved by
|
|
5196
|
-
#
|
|
5211
|
+
# humans. These transformations are then saved by Glue. You can retrieve
|
|
5212
|
+
# their metadata by calling `GetMLTransform`.
|
|
5197
5213
|
#
|
|
5198
5214
|
# @option params [required, String] :transform_id
|
|
5199
5215
|
# The unique identifier of the transform, generated at the time that the
|
|
@@ -5281,11 +5297,11 @@ module Aws::Glue
|
|
|
5281
5297
|
req.send_request(options)
|
|
5282
5298
|
end
|
|
5283
5299
|
|
|
5284
|
-
# Gets a sortable, filterable list of existing
|
|
5300
|
+
# Gets a sortable, filterable list of existing Glue machine learning
|
|
5285
5301
|
# transforms. Machine learning transforms are a special type of
|
|
5286
5302
|
# transform that use machine learning to learn the details of the
|
|
5287
5303
|
# transformation to be performed by learning from examples provided by
|
|
5288
|
-
# humans. These transformations are then saved by
|
|
5304
|
+
# humans. These transformations are then saved by Glue, and you can
|
|
5289
5305
|
# retrieve their metadata by calling `GetMLTransforms`.
|
|
5290
5306
|
#
|
|
5291
5307
|
# @option params [String] :next_token
|
|
@@ -5466,7 +5482,8 @@ module Aws::Glue
|
|
|
5466
5482
|
#
|
|
5467
5483
|
# @option params [String] :catalog_id
|
|
5468
5484
|
# The ID of the Data Catalog where the partition in question resides. If
|
|
5469
|
-
# none is provided, the
|
|
5485
|
+
# none is provided, the Amazon Web Services account ID is used by
|
|
5486
|
+
# default.
|
|
5470
5487
|
#
|
|
5471
5488
|
# @option params [required, String] :database_name
|
|
5472
5489
|
# The name of the catalog database where the partition resides.
|
|
@@ -5479,7 +5496,7 @@ module Aws::Glue
|
|
|
5479
5496
|
#
|
|
5480
5497
|
# @return [Types::GetPartitionResponse] Returns a {Seahorse::Client::Response response} object which responds to the following methods:
|
|
5481
5498
|
#
|
|
5482
|
-
# * {Types::GetPartitionResponse#partition #partition} => Types::Partition
|
|
5499
|
+
# * {Types::GetPartitionResponse#partition #data.partition} => Types::Partition (This method conflicts with a method on Response, call it through the data member)
|
|
5483
5500
|
#
|
|
5484
5501
|
# @example Request syntax with placeholder values
|
|
5485
5502
|
#
|
|
@@ -5492,50 +5509,50 @@ module Aws::Glue
|
|
|
5492
5509
|
#
|
|
5493
5510
|
# @example Response structure
|
|
5494
5511
|
#
|
|
5495
|
-
# resp.partition.values #=> Array
|
|
5496
|
-
# resp.partition.values[0] #=> String
|
|
5497
|
-
# resp.partition.database_name #=> String
|
|
5498
|
-
# resp.partition.table_name #=> String
|
|
5499
|
-
# resp.partition.creation_time #=> Time
|
|
5500
|
-
# resp.partition.last_access_time #=> Time
|
|
5501
|
-
# resp.partition.storage_descriptor.columns #=> Array
|
|
5502
|
-
# resp.partition.storage_descriptor.columns[0].name #=> String
|
|
5503
|
-
# resp.partition.storage_descriptor.columns[0].type #=> String
|
|
5504
|
-
# resp.partition.storage_descriptor.columns[0].comment #=> String
|
|
5505
|
-
# resp.partition.storage_descriptor.columns[0].parameters #=> Hash
|
|
5506
|
-
# resp.partition.storage_descriptor.columns[0].parameters["KeyString"] #=> String
|
|
5507
|
-
# resp.partition.storage_descriptor.location #=> String
|
|
5508
|
-
# resp.partition.storage_descriptor.input_format #=> String
|
|
5509
|
-
# resp.partition.storage_descriptor.output_format #=> String
|
|
5510
|
-
# resp.partition.storage_descriptor.compressed #=> Boolean
|
|
5511
|
-
# resp.partition.storage_descriptor.number_of_buckets #=> Integer
|
|
5512
|
-
# resp.partition.storage_descriptor.serde_info.name #=> String
|
|
5513
|
-
# resp.partition.storage_descriptor.serde_info.serialization_library #=> String
|
|
5514
|
-
# resp.partition.storage_descriptor.serde_info.parameters #=> Hash
|
|
5515
|
-
# resp.partition.storage_descriptor.serde_info.parameters["KeyString"] #=> String
|
|
5516
|
-
# resp.partition.storage_descriptor.bucket_columns #=> Array
|
|
5517
|
-
# resp.partition.storage_descriptor.bucket_columns[0] #=> String
|
|
5518
|
-
# resp.partition.storage_descriptor.sort_columns #=> Array
|
|
5519
|
-
# resp.partition.storage_descriptor.sort_columns[0].column #=> String
|
|
5520
|
-
# resp.partition.storage_descriptor.sort_columns[0].sort_order #=> Integer
|
|
5521
|
-
# resp.partition.storage_descriptor.parameters #=> Hash
|
|
5522
|
-
# resp.partition.storage_descriptor.parameters["KeyString"] #=> String
|
|
5523
|
-
# resp.partition.storage_descriptor.skewed_info.skewed_column_names #=> Array
|
|
5524
|
-
# resp.partition.storage_descriptor.skewed_info.skewed_column_names[0] #=> String
|
|
5525
|
-
# resp.partition.storage_descriptor.skewed_info.skewed_column_values #=> Array
|
|
5526
|
-
# resp.partition.storage_descriptor.skewed_info.skewed_column_values[0] #=> String
|
|
5527
|
-
# resp.partition.storage_descriptor.skewed_info.skewed_column_value_location_maps #=> Hash
|
|
5528
|
-
# resp.partition.storage_descriptor.skewed_info.skewed_column_value_location_maps["ColumnValuesString"] #=> String
|
|
5529
|
-
# resp.partition.storage_descriptor.stored_as_sub_directories #=> Boolean
|
|
5530
|
-
# resp.partition.storage_descriptor.schema_reference.schema_id.schema_arn #=> String
|
|
5531
|
-
# resp.partition.storage_descriptor.schema_reference.schema_id.schema_name #=> String
|
|
5532
|
-
# resp.partition.storage_descriptor.schema_reference.schema_id.registry_name #=> String
|
|
5533
|
-
# resp.partition.storage_descriptor.schema_reference.schema_version_id #=> String
|
|
5534
|
-
# resp.partition.storage_descriptor.schema_reference.schema_version_number #=> Integer
|
|
5535
|
-
# resp.partition.parameters #=> Hash
|
|
5536
|
-
# resp.partition.parameters["KeyString"] #=> String
|
|
5537
|
-
# resp.partition.last_analyzed_time #=> Time
|
|
5538
|
-
# resp.partition.catalog_id #=> String
|
|
5512
|
+
# resp.data.partition.values #=> Array
|
|
5513
|
+
# resp.data.partition.values[0] #=> String
|
|
5514
|
+
# resp.data.partition.database_name #=> String
|
|
5515
|
+
# resp.data.partition.table_name #=> String
|
|
5516
|
+
# resp.data.partition.creation_time #=> Time
|
|
5517
|
+
# resp.data.partition.last_access_time #=> Time
|
|
5518
|
+
# resp.data.partition.storage_descriptor.columns #=> Array
|
|
5519
|
+
# resp.data.partition.storage_descriptor.columns[0].name #=> String
|
|
5520
|
+
# resp.data.partition.storage_descriptor.columns[0].type #=> String
|
|
5521
|
+
# resp.data.partition.storage_descriptor.columns[0].comment #=> String
|
|
5522
|
+
# resp.data.partition.storage_descriptor.columns[0].parameters #=> Hash
|
|
5523
|
+
# resp.data.partition.storage_descriptor.columns[0].parameters["KeyString"] #=> String
|
|
5524
|
+
# resp.data.partition.storage_descriptor.location #=> String
|
|
5525
|
+
# resp.data.partition.storage_descriptor.input_format #=> String
|
|
5526
|
+
# resp.data.partition.storage_descriptor.output_format #=> String
|
|
5527
|
+
# resp.data.partition.storage_descriptor.compressed #=> Boolean
|
|
5528
|
+
# resp.data.partition.storage_descriptor.number_of_buckets #=> Integer
|
|
5529
|
+
# resp.data.partition.storage_descriptor.serde_info.name #=> String
|
|
5530
|
+
# resp.data.partition.storage_descriptor.serde_info.serialization_library #=> String
|
|
5531
|
+
# resp.data.partition.storage_descriptor.serde_info.parameters #=> Hash
|
|
5532
|
+
# resp.data.partition.storage_descriptor.serde_info.parameters["KeyString"] #=> String
|
|
5533
|
+
# resp.data.partition.storage_descriptor.bucket_columns #=> Array
|
|
5534
|
+
# resp.data.partition.storage_descriptor.bucket_columns[0] #=> String
|
|
5535
|
+
# resp.data.partition.storage_descriptor.sort_columns #=> Array
|
|
5536
|
+
# resp.data.partition.storage_descriptor.sort_columns[0].column #=> String
|
|
5537
|
+
# resp.data.partition.storage_descriptor.sort_columns[0].sort_order #=> Integer
|
|
5538
|
+
# resp.data.partition.storage_descriptor.parameters #=> Hash
|
|
5539
|
+
# resp.data.partition.storage_descriptor.parameters["KeyString"] #=> String
|
|
5540
|
+
# resp.data.partition.storage_descriptor.skewed_info.skewed_column_names #=> Array
|
|
5541
|
+
# resp.data.partition.storage_descriptor.skewed_info.skewed_column_names[0] #=> String
|
|
5542
|
+
# resp.data.partition.storage_descriptor.skewed_info.skewed_column_values #=> Array
|
|
5543
|
+
# resp.data.partition.storage_descriptor.skewed_info.skewed_column_values[0] #=> String
|
|
5544
|
+
# resp.data.partition.storage_descriptor.skewed_info.skewed_column_value_location_maps #=> Hash
|
|
5545
|
+
# resp.data.partition.storage_descriptor.skewed_info.skewed_column_value_location_maps["ColumnValuesString"] #=> String
|
|
5546
|
+
# resp.data.partition.storage_descriptor.stored_as_sub_directories #=> Boolean
|
|
5547
|
+
# resp.data.partition.storage_descriptor.schema_reference.schema_id.schema_arn #=> String
|
|
5548
|
+
# resp.data.partition.storage_descriptor.schema_reference.schema_id.schema_name #=> String
|
|
5549
|
+
# resp.data.partition.storage_descriptor.schema_reference.schema_id.registry_name #=> String
|
|
5550
|
+
# resp.data.partition.storage_descriptor.schema_reference.schema_version_id #=> String
|
|
5551
|
+
# resp.data.partition.storage_descriptor.schema_reference.schema_version_number #=> Integer
|
|
5552
|
+
# resp.data.partition.parameters #=> Hash
|
|
5553
|
+
# resp.data.partition.parameters["KeyString"] #=> String
|
|
5554
|
+
# resp.data.partition.last_analyzed_time #=> Time
|
|
5555
|
+
# resp.data.partition.catalog_id #=> String
|
|
5539
5556
|
#
|
|
5540
5557
|
# @see http://docs.aws.amazon.com/goto/WebAPI/glue-2017-03-31/GetPartition AWS API Documentation
|
|
5541
5558
|
#
|
|
@@ -5606,7 +5623,8 @@ module Aws::Glue
|
|
|
5606
5623
|
#
|
|
5607
5624
|
# @option params [String] :catalog_id
|
|
5608
5625
|
# The ID of the Data Catalog where the partitions in question reside. If
|
|
5609
|
-
# none is provided, the
|
|
5626
|
+
# none is provided, the Amazon Web Services account ID is used by
|
|
5627
|
+
# default.
|
|
5610
5628
|
#
|
|
5611
5629
|
# @option params [required, String] :database_name
|
|
5612
5630
|
# The name of the catalog database where the partitions reside.
|
|
@@ -5695,7 +5713,7 @@ module Aws::Glue
|
|
|
5695
5713
|
#
|
|
5696
5714
|
# * `decimal`
|
|
5697
5715
|
#
|
|
5698
|
-
# If an
|
|
5716
|
+
# If an type is encountered that is not valid, an exception is thrown.
|
|
5699
5717
|
#
|
|
5700
5718
|
# The following list shows the valid operators on each type. When you
|
|
5701
5719
|
# define a crawler, the `partitionKey` type is created as a `STRING`, to
|
|
@@ -5823,9 +5841,8 @@ module Aws::Glue
|
|
|
5823
5841
|
# Currently, these key-value pairs are supported:
|
|
5824
5842
|
#
|
|
5825
5843
|
# * `inferSchema` — Specifies whether to set `inferSchema` to true or
|
|
5826
|
-
# false for the default script generated by an
|
|
5827
|
-
#
|
|
5828
|
-
# pair:
|
|
5844
|
+
# false for the default script generated by an Glue job. For example,
|
|
5845
|
+
# to set `inferSchema` to true, pass the following key value pair:
|
|
5829
5846
|
#
|
|
5830
5847
|
# `--additional-plan-options-map '\{"inferSchema":"true"\}'`
|
|
5831
5848
|
#
|
|
@@ -5942,13 +5959,13 @@ module Aws::Glue
|
|
|
5942
5959
|
req.send_request(options)
|
|
5943
5960
|
end
|
|
5944
5961
|
|
|
5945
|
-
# Retrieves the
|
|
5946
|
-
#
|
|
5962
|
+
# Retrieves the resource policies set on individual resources by
|
|
5963
|
+
# Resource Access Manager during cross-account permission grants. Also
|
|
5964
|
+
# retrieves the Data Catalog resource policy.
|
|
5947
5965
|
#
|
|
5948
|
-
#
|
|
5949
|
-
#
|
|
5950
|
-
#
|
|
5951
|
-
# the Data Catalog resource policy.
|
|
5966
|
+
# If you enabled metadata encryption in Data Catalog settings, and you
|
|
5967
|
+
# do not have permission on the KMS key, the operation can't return the
|
|
5968
|
+
# Data Catalog resource policy.
|
|
5952
5969
|
#
|
|
5953
5970
|
# @option params [String] :next_token
|
|
5954
5971
|
# A continuation token, if this is a continuation request.
|
|
@@ -5991,13 +6008,14 @@ module Aws::Glue
|
|
|
5991
6008
|
# Retrieves a specified resource policy.
|
|
5992
6009
|
#
|
|
5993
6010
|
# @option params [String] :resource_arn
|
|
5994
|
-
# The ARN of the
|
|
5995
|
-
#
|
|
5996
|
-
#
|
|
6011
|
+
# The ARN of the Glue resource for which to retrieve the resource
|
|
6012
|
+
# policy. If not supplied, the Data Catalog resource policy is returned.
|
|
6013
|
+
# Use `GetResourcePolicies` to view all existing resource policies. For
|
|
6014
|
+
# more information see [Specifying Glue Resource ARNs][1].
|
|
5997
6015
|
#
|
|
5998
6016
|
#
|
|
5999
6017
|
#
|
|
6000
|
-
# [1]: https://docs.aws.amazon.com/glue/latest/dg/
|
|
6018
|
+
# [1]: https://docs.aws.amazon.com/glue/latest/dg/glue-specifying-resource-arns.html
|
|
6001
6019
|
#
|
|
6002
6020
|
# @return [Types::GetResourcePolicyResponse] Returns a {Seahorse::Client::Response response} object which responds to the following methods:
|
|
6003
6021
|
#
|
|
@@ -6074,7 +6092,7 @@ module Aws::Glue
|
|
|
6074
6092
|
# resp.schema_name #=> String
|
|
6075
6093
|
# resp.schema_arn #=> String
|
|
6076
6094
|
# resp.description #=> String
|
|
6077
|
-
# resp.data_format #=> String, one of "AVRO"
|
|
6095
|
+
# resp.data_format #=> String, one of "AVRO", "JSON"
|
|
6078
6096
|
# resp.compatibility #=> String, one of "NONE", "DISABLED", "BACKWARD", "BACKWARD_ALL", "FORWARD", "FORWARD_ALL", "FULL", "FULL_ALL"
|
|
6079
6097
|
# resp.schema_checkpoint #=> Integer
|
|
6080
6098
|
# resp.latest_schema_version #=> Integer
|
|
@@ -6135,7 +6153,7 @@ module Aws::Glue
|
|
|
6135
6153
|
#
|
|
6136
6154
|
# resp.schema_version_id #=> String
|
|
6137
6155
|
# resp.schema_arn #=> String
|
|
6138
|
-
# resp.data_format #=> String, one of "AVRO"
|
|
6156
|
+
# resp.data_format #=> String, one of "AVRO", "JSON"
|
|
6139
6157
|
# resp.status #=> String, one of "AVAILABLE", "PENDING", "FAILURE", "DELETING"
|
|
6140
6158
|
# resp.created_time #=> String
|
|
6141
6159
|
#
|
|
@@ -6200,7 +6218,7 @@ module Aws::Glue
|
|
|
6200
6218
|
#
|
|
6201
6219
|
# resp.schema_version_id #=> String
|
|
6202
6220
|
# resp.schema_definition #=> String
|
|
6203
|
-
# resp.data_format #=> String, one of "AVRO"
|
|
6221
|
+
# resp.data_format #=> String, one of "AVRO", "JSON"
|
|
6204
6222
|
# resp.schema_arn #=> String
|
|
6205
6223
|
# resp.version_number #=> Integer
|
|
6206
6224
|
# resp.status #=> String, one of "AVAILABLE", "PENDING", "FAILURE", "DELETING"
|
|
@@ -6362,7 +6380,7 @@ module Aws::Glue
|
|
|
6362
6380
|
#
|
|
6363
6381
|
# @option params [String] :catalog_id
|
|
6364
6382
|
# The ID of the Data Catalog where the table resides. If none is
|
|
6365
|
-
# provided, the
|
|
6383
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
6366
6384
|
#
|
|
6367
6385
|
# @option params [required, String] :database_name
|
|
6368
6386
|
# The name of the database in the catalog in which the table resides.
|
|
@@ -6460,7 +6478,7 @@ module Aws::Glue
|
|
|
6460
6478
|
#
|
|
6461
6479
|
# @option params [String] :catalog_id
|
|
6462
6480
|
# The ID of the Data Catalog where the tables reside. If none is
|
|
6463
|
-
# provided, the
|
|
6481
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
6464
6482
|
#
|
|
6465
6483
|
# @option params [required, String] :database_name
|
|
6466
6484
|
# The database in the catalog in which the table resides. For Hive
|
|
@@ -6565,7 +6583,7 @@ module Aws::Glue
|
|
|
6565
6583
|
#
|
|
6566
6584
|
# @option params [String] :catalog_id
|
|
6567
6585
|
# The ID of the Data Catalog where the tables reside. If none is
|
|
6568
|
-
# provided, the
|
|
6586
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
6569
6587
|
#
|
|
6570
6588
|
# @option params [required, String] :database_name
|
|
6571
6589
|
# The database in the catalog in which the table resides. For Hive
|
|
@@ -6678,7 +6696,7 @@ module Aws::Glue
|
|
|
6678
6696
|
#
|
|
6679
6697
|
# @option params [String] :catalog_id
|
|
6680
6698
|
# The ID of the Data Catalog where the tables reside. If none is
|
|
6681
|
-
# provided, the
|
|
6699
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
6682
6700
|
#
|
|
6683
6701
|
# @option params [required, String] :database_name
|
|
6684
6702
|
# The database in the catalog whose tables to list. For Hive
|
|
@@ -6932,7 +6950,8 @@ module Aws::Glue
|
|
|
6932
6950
|
#
|
|
6933
6951
|
# @option params [String] :catalog_id
|
|
6934
6952
|
# The ID of the Data Catalog where the function to be retrieved is
|
|
6935
|
-
# located. If none is provided, the
|
|
6953
|
+
# located. If none is provided, the Amazon Web Services account ID is
|
|
6954
|
+
# used by default.
|
|
6936
6955
|
#
|
|
6937
6956
|
# @option params [required, String] :database_name
|
|
6938
6957
|
# The name of the catalog database where the function is located.
|
|
@@ -6978,7 +6997,8 @@ module Aws::Glue
|
|
|
6978
6997
|
#
|
|
6979
6998
|
# @option params [String] :catalog_id
|
|
6980
6999
|
# The ID of the Data Catalog where the functions to be retrieved are
|
|
6981
|
-
# located. If none is provided, the
|
|
7000
|
+
# located. If none is provided, the Amazon Web Services account ID is
|
|
7001
|
+
# used by default.
|
|
6982
7002
|
#
|
|
6983
7003
|
# @option params [String] :database_name
|
|
6984
7004
|
# The name of the catalog database where the functions are located. If
|
|
@@ -7480,11 +7500,11 @@ module Aws::Glue
|
|
|
7480
7500
|
req.send_request(options)
|
|
7481
7501
|
end
|
|
7482
7502
|
|
|
7483
|
-
# Imports an existing Amazon Athena Data Catalog to
|
|
7503
|
+
# Imports an existing Amazon Athena Data Catalog to Glue.
|
|
7484
7504
|
#
|
|
7485
7505
|
# @option params [String] :catalog_id
|
|
7486
|
-
# The ID of the catalog to import. Currently, this should be the
|
|
7487
|
-
# account ID.
|
|
7506
|
+
# The ID of the catalog to import. Currently, this should be the Amazon
|
|
7507
|
+
# Web Services account ID.
|
|
7488
7508
|
#
|
|
7489
7509
|
# @return [Struct] Returns an empty {Seahorse::Client::Response response}.
|
|
7490
7510
|
#
|
|
@@ -7503,9 +7523,10 @@ module Aws::Glue
|
|
|
7503
7523
|
req.send_request(options)
|
|
7504
7524
|
end
|
|
7505
7525
|
|
|
7506
|
-
# Retrieves the names of all crawler resources in this
|
|
7507
|
-
# the resources with the specified tag. This
|
|
7508
|
-
# which resources are available in your
|
|
7526
|
+
# Retrieves the names of all crawler resources in this Amazon Web
|
|
7527
|
+
# Services account, or the resources with the specified tag. This
|
|
7528
|
+
# operation allows you to see which resources are available in your
|
|
7529
|
+
# account, and their names.
|
|
7509
7530
|
#
|
|
7510
7531
|
# This operation takes the optional `Tags` field, which you can use as a
|
|
7511
7532
|
# filter on the response so that tagged resources can be retrieved as a
|
|
@@ -7553,10 +7574,10 @@ module Aws::Glue
|
|
|
7553
7574
|
req.send_request(options)
|
|
7554
7575
|
end
|
|
7555
7576
|
|
|
7556
|
-
# Retrieves the names of all `DevEndpoint` resources in this
|
|
7557
|
-
# account, or the resources with the specified tag. This
|
|
7558
|
-
# allows you to see which resources are available in your
|
|
7559
|
-
# their names.
|
|
7577
|
+
# Retrieves the names of all `DevEndpoint` resources in this Amazon Web
|
|
7578
|
+
# Services account, or the resources with the specified tag. This
|
|
7579
|
+
# operation allows you to see which resources are available in your
|
|
7580
|
+
# account, and their names.
|
|
7560
7581
|
#
|
|
7561
7582
|
# This operation takes the optional `Tags` field, which you can use as a
|
|
7562
7583
|
# filter on the response so that tagged resources can be retrieved as a
|
|
@@ -7604,9 +7625,10 @@ module Aws::Glue
|
|
|
7604
7625
|
req.send_request(options)
|
|
7605
7626
|
end
|
|
7606
7627
|
|
|
7607
|
-
# Retrieves the names of all job resources in this
|
|
7608
|
-
# resources with the specified tag. This operation
|
|
7609
|
-
# which resources are available in your account, and
|
|
7628
|
+
# Retrieves the names of all job resources in this Amazon Web Services
|
|
7629
|
+
# account, or the resources with the specified tag. This operation
|
|
7630
|
+
# allows you to see which resources are available in your account, and
|
|
7631
|
+
# their names.
|
|
7610
7632
|
#
|
|
7611
7633
|
# This operation takes the optional `Tags` field, which you can use as a
|
|
7612
7634
|
# filter on the response so that tagged resources can be retrieved as a
|
|
@@ -7654,12 +7676,12 @@ module Aws::Glue
|
|
|
7654
7676
|
req.send_request(options)
|
|
7655
7677
|
end
|
|
7656
7678
|
|
|
7657
|
-
# Retrieves a sortable, filterable list of existing
|
|
7658
|
-
# learning transforms in this
|
|
7659
|
-
# specified tag. This operation takes the optional
|
|
7660
|
-
# you can use as a filter of the responses so that
|
|
7661
|
-
# be retrieved as a group. If you choose to use tag
|
|
7662
|
-
# resources with the tags are retrieved.
|
|
7679
|
+
# Retrieves a sortable, filterable list of existing Glue machine
|
|
7680
|
+
# learning transforms in this Amazon Web Services account, or the
|
|
7681
|
+
# resources with the specified tag. This operation takes the optional
|
|
7682
|
+
# `Tags` field, which you can use as a filter of the responses so that
|
|
7683
|
+
# tagged resources can be retrieved as a group. If you choose to use tag
|
|
7684
|
+
# filtering, only resources with the tags are retrieved.
|
|
7663
7685
|
#
|
|
7664
7686
|
# @option params [String] :next_token
|
|
7665
7687
|
# A continuation token, if this is a continuation request.
|
|
@@ -7894,9 +7916,10 @@ module Aws::Glue
|
|
|
7894
7916
|
req.send_request(options)
|
|
7895
7917
|
end
|
|
7896
7918
|
|
|
7897
|
-
# Retrieves the names of all trigger resources in this
|
|
7898
|
-
# the resources with the specified tag. This
|
|
7899
|
-
# which resources are available in your
|
|
7919
|
+
# Retrieves the names of all trigger resources in this Amazon Web
|
|
7920
|
+
# Services account, or the resources with the specified tag. This
|
|
7921
|
+
# operation allows you to see which resources are available in your
|
|
7922
|
+
# account, and their names.
|
|
7900
7923
|
#
|
|
7901
7924
|
# This operation takes the optional `Tags` field, which you can use as a
|
|
7902
7925
|
# filter on the response so that tagged resources can be retrieved as a
|
|
@@ -7993,7 +8016,8 @@ module Aws::Glue
|
|
|
7993
8016
|
#
|
|
7994
8017
|
# @option params [String] :catalog_id
|
|
7995
8018
|
# The ID of the Data Catalog to set the security configuration for. If
|
|
7996
|
-
# none is provided, the
|
|
8019
|
+
# none is provided, the Amazon Web Services account ID is used by
|
|
8020
|
+
# default.
|
|
7997
8021
|
#
|
|
7998
8022
|
# @option params [required, Types::DataCatalogEncryptionSettings] :data_catalog_encryption_settings
|
|
7999
8023
|
# The security configuration to set.
|
|
@@ -8031,13 +8055,7 @@ module Aws::Glue
|
|
|
8031
8055
|
# Contains the policy document to set, in JSON format.
|
|
8032
8056
|
#
|
|
8033
8057
|
# @option params [String] :resource_arn
|
|
8034
|
-
#
|
|
8035
|
-
# For more information about AWS Glue resource ARNs, see the [AWS Glue
|
|
8036
|
-
# ARN string pattern][1]
|
|
8037
|
-
#
|
|
8038
|
-
#
|
|
8039
|
-
#
|
|
8040
|
-
# [1]: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-api-common.html#aws-glue-api-regex-aws-glue-arn-id
|
|
8058
|
+
# Do not use. For internal use only.
|
|
8041
8059
|
#
|
|
8042
8060
|
# @option params [String] :policy_hash_condition
|
|
8043
8061
|
# The hash value returned when the previous policy was set using
|
|
@@ -8048,19 +8066,21 @@ module Aws::Glue
|
|
|
8048
8066
|
# @option params [String] :policy_exists_condition
|
|
8049
8067
|
# A value of `MUST_EXIST` is used to update a policy. A value of
|
|
8050
8068
|
# `NOT_EXIST` is used to create a new policy. If a value of `NONE` or a
|
|
8051
|
-
# null value is used, the call
|
|
8069
|
+
# null value is used, the call does not depend on the existence of a
|
|
8052
8070
|
# policy.
|
|
8053
8071
|
#
|
|
8054
8072
|
# @option params [String] :enable_hybrid
|
|
8055
|
-
#
|
|
8056
|
-
# account
|
|
8057
|
-
#
|
|
8058
|
-
#
|
|
8073
|
+
# If `'TRUE'`, indicates that you are using both methods to grant
|
|
8074
|
+
# cross-account access to Data Catalog resources:
|
|
8075
|
+
#
|
|
8076
|
+
# * By directly updating the resource policy with `PutResourePolicy`
|
|
8059
8077
|
#
|
|
8060
|
-
#
|
|
8061
|
-
#
|
|
8062
|
-
#
|
|
8063
|
-
#
|
|
8078
|
+
# * By using the **Grant permissions** command on the Management
|
|
8079
|
+
# Console.
|
|
8080
|
+
#
|
|
8081
|
+
# Must be set to `'TRUE'` if you have already used the Management
|
|
8082
|
+
# Console to grant cross-account access, otherwise the call fails.
|
|
8083
|
+
# Default is 'FALSE'.
|
|
8064
8084
|
#
|
|
8065
8085
|
# @return [Types::PutResourcePolicyResponse] Returns a {Seahorse::Client::Response response} object which responds to the following methods:
|
|
8066
8086
|
#
|
|
@@ -8247,6 +8267,9 @@ module Aws::Glue
|
|
|
8247
8267
|
# resp.metadata_info_map #=> Hash
|
|
8248
8268
|
# resp.metadata_info_map["MetadataKeyString"].metadata_value #=> String
|
|
8249
8269
|
# resp.metadata_info_map["MetadataKeyString"].created_time #=> String
|
|
8270
|
+
# resp.metadata_info_map["MetadataKeyString"].other_metadata_value_list #=> Array
|
|
8271
|
+
# resp.metadata_info_map["MetadataKeyString"].other_metadata_value_list[0].metadata_value #=> String
|
|
8272
|
+
# resp.metadata_info_map["MetadataKeyString"].other_metadata_value_list[0].created_time #=> String
|
|
8250
8273
|
# resp.schema_version_id #=> String
|
|
8251
8274
|
# resp.next_token #=> String
|
|
8252
8275
|
#
|
|
@@ -8729,10 +8752,10 @@ module Aws::Glue
|
|
|
8729
8752
|
# call and that ultimately results in improving the quality of your
|
|
8730
8753
|
# machine learning transform.
|
|
8731
8754
|
#
|
|
8732
|
-
# After the `StartMLLabelingSetGenerationTaskRun` finishes,
|
|
8733
|
-
#
|
|
8734
|
-
#
|
|
8735
|
-
#
|
|
8755
|
+
# After the `StartMLLabelingSetGenerationTaskRun` finishes, Glue machine
|
|
8756
|
+
# learning will have generated a series of questions for humans to
|
|
8757
|
+
# answer. (Answering these questions is often called 'labeling' in the
|
|
8758
|
+
# machine learning workflows). In the case of the `FindMatches`
|
|
8736
8759
|
# transform, these questions are of the form, “What is the correct way
|
|
8737
8760
|
# to group these rows together into groups composed entirely of matching
|
|
8738
8761
|
# records?” After the labeling process is finished, users upload their
|
|
@@ -8801,15 +8824,15 @@ module Aws::Glue
|
|
|
8801
8824
|
# replace the default arguments set in the job definition itself.
|
|
8802
8825
|
#
|
|
8803
8826
|
# You can specify arguments here that your own job-execution script
|
|
8804
|
-
# consumes, as well as arguments that
|
|
8827
|
+
# consumes, as well as arguments that Glue itself consumes.
|
|
8805
8828
|
#
|
|
8806
8829
|
# For information about how to specify and consume your own Job
|
|
8807
|
-
# arguments, see the [Calling
|
|
8830
|
+
# arguments, see the [Calling Glue APIs in Python][1] topic in the
|
|
8808
8831
|
# developer guide.
|
|
8809
8832
|
#
|
|
8810
|
-
# For information about the key-value pairs that
|
|
8811
|
-
#
|
|
8812
|
-
#
|
|
8833
|
+
# For information about the key-value pairs that Glue consumes to set up
|
|
8834
|
+
# your job, see the [Special Parameters Used by Glue][2] topic in the
|
|
8835
|
+
# developer guide.
|
|
8813
8836
|
#
|
|
8814
8837
|
#
|
|
8815
8838
|
#
|
|
@@ -8819,15 +8842,15 @@ module Aws::Glue
|
|
|
8819
8842
|
# @option params [Integer] :allocated_capacity
|
|
8820
8843
|
# This field is deprecated. Use `MaxCapacity` instead.
|
|
8821
8844
|
#
|
|
8822
|
-
# The number of
|
|
8823
|
-
#
|
|
8824
|
-
#
|
|
8825
|
-
#
|
|
8826
|
-
# [
|
|
8845
|
+
# The number of Glue data processing units (DPUs) to allocate to this
|
|
8846
|
+
# JobRun. From 2 to 100 DPUs can be allocated; the default is 10. A DPU
|
|
8847
|
+
# is a relative measure of processing power that consists of 4 vCPUs of
|
|
8848
|
+
# compute capacity and 16 GB of memory. For more information, see the
|
|
8849
|
+
# [Glue pricing page][1].
|
|
8827
8850
|
#
|
|
8828
8851
|
#
|
|
8829
8852
|
#
|
|
8830
|
-
# [1]: https://
|
|
8853
|
+
# [1]: https://aws.amazon.com/glue/pricing/
|
|
8831
8854
|
#
|
|
8832
8855
|
# @option params [Integer] :timeout
|
|
8833
8856
|
# The `JobRun` timeout in minutes. This is the maximum time that a job
|
|
@@ -8836,11 +8859,10 @@ module Aws::Glue
|
|
|
8836
8859
|
# timeout value set in the parent job.
|
|
8837
8860
|
#
|
|
8838
8861
|
# @option params [Float] :max_capacity
|
|
8839
|
-
# The number of
|
|
8840
|
-
#
|
|
8841
|
-
#
|
|
8842
|
-
#
|
|
8843
|
-
# page][1].
|
|
8862
|
+
# The number of Glue data processing units (DPUs) that can be allocated
|
|
8863
|
+
# when this job runs. A DPU is a relative measure of processing power
|
|
8864
|
+
# that consists of 4 vCPUs of compute capacity and 16 GB of memory. For
|
|
8865
|
+
# more information, see the [Glue pricing page][1].
|
|
8844
8866
|
#
|
|
8845
8867
|
# Do not set `Max Capacity` if using `WorkerType` and `NumberOfWorkers`.
|
|
8846
8868
|
#
|
|
@@ -8858,7 +8880,7 @@ module Aws::Glue
|
|
|
8858
8880
|
#
|
|
8859
8881
|
#
|
|
8860
8882
|
#
|
|
8861
|
-
# [1]: https://
|
|
8883
|
+
# [1]: https://aws.amazon.com/glue/pricing/
|
|
8862
8884
|
#
|
|
8863
8885
|
# @option params [String] :security_configuration
|
|
8864
8886
|
# The name of the `SecurityConfiguration` structure to be used with this
|
|
@@ -8925,7 +8947,7 @@ module Aws::Glue
|
|
|
8925
8947
|
|
|
8926
8948
|
# Starts a task to estimate the quality of the transform.
|
|
8927
8949
|
#
|
|
8928
|
-
# When you provide label sets as examples of truth,
|
|
8950
|
+
# When you provide label sets as examples of truth, Glue machine
|
|
8929
8951
|
# learning uses some of those examples to learn from them. The rest of
|
|
8930
8952
|
# the labels are used as a test to estimate quality.
|
|
8931
8953
|
#
|
|
@@ -8962,7 +8984,7 @@ module Aws::Glue
|
|
|
8962
8984
|
# transform to improve the transform's quality by generating label sets
|
|
8963
8985
|
# and adding labels.
|
|
8964
8986
|
#
|
|
8965
|
-
# When the `StartMLLabelingSetGenerationTaskRun` finishes,
|
|
8987
|
+
# When the `StartMLLabelingSetGenerationTaskRun` finishes, Glue will
|
|
8966
8988
|
# have generated a "labeling set" or a set of questions for humans to
|
|
8967
8989
|
# answer.
|
|
8968
8990
|
#
|
|
@@ -9167,18 +9189,18 @@ module Aws::Glue
|
|
|
9167
9189
|
req.send_request(options)
|
|
9168
9190
|
end
|
|
9169
9191
|
|
|
9170
|
-
# Adds tags to a resource. A tag is a label you can assign to an
|
|
9171
|
-
# resource. In
|
|
9172
|
-
# information about what resources you can tag, see [
|
|
9173
|
-
# Glue][1].
|
|
9192
|
+
# Adds tags to a resource. A tag is a label you can assign to an Amazon
|
|
9193
|
+
# Web Services resource. In Glue, you can tag only certain resources.
|
|
9194
|
+
# For information about what resources you can tag, see [Amazon Web
|
|
9195
|
+
# Services Tags in Glue][1].
|
|
9174
9196
|
#
|
|
9175
9197
|
#
|
|
9176
9198
|
#
|
|
9177
9199
|
# [1]: https://docs.aws.amazon.com/glue/latest/dg/monitor-tags.html
|
|
9178
9200
|
#
|
|
9179
9201
|
# @option params [required, String] :resource_arn
|
|
9180
|
-
# The ARN of the
|
|
9181
|
-
# information about
|
|
9202
|
+
# The ARN of the Glue resource to which to add the tags. For more
|
|
9203
|
+
# information about Glue resource ARNs, see the [Glue ARN string
|
|
9182
9204
|
# pattern][1].
|
|
9183
9205
|
#
|
|
9184
9206
|
#
|
|
@@ -9298,7 +9320,8 @@ module Aws::Glue
|
|
|
9298
9320
|
#
|
|
9299
9321
|
# @option params [String] :catalog_id
|
|
9300
9322
|
# The ID of the Data Catalog where the partitions in question reside. If
|
|
9301
|
-
# none is supplied, the
|
|
9323
|
+
# none is supplied, the Amazon Web Services account ID is used by
|
|
9324
|
+
# default.
|
|
9302
9325
|
#
|
|
9303
9326
|
# @option params [required, String] :database_name
|
|
9304
9327
|
# The name of the catalog database where the partitions reside.
|
|
@@ -9435,7 +9458,8 @@ module Aws::Glue
|
|
|
9435
9458
|
#
|
|
9436
9459
|
# @option params [String] :catalog_id
|
|
9437
9460
|
# The ID of the Data Catalog where the partitions in question reside. If
|
|
9438
|
-
# none is supplied, the
|
|
9461
|
+
# none is supplied, the Amazon Web Services account ID is used by
|
|
9462
|
+
# default.
|
|
9439
9463
|
#
|
|
9440
9464
|
# @option params [required, String] :database_name
|
|
9441
9465
|
# The name of the catalog database where the partitions reside.
|
|
@@ -9565,7 +9589,7 @@ module Aws::Glue
|
|
|
9565
9589
|
#
|
|
9566
9590
|
# @option params [String] :catalog_id
|
|
9567
9591
|
# The ID of the Data Catalog in which the connection resides. If none is
|
|
9568
|
-
# provided, the
|
|
9592
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
9569
9593
|
#
|
|
9570
9594
|
# @option params [required, String] :name
|
|
9571
9595
|
# The name of the connection definition to update.
|
|
@@ -9616,7 +9640,7 @@ module Aws::Glue
|
|
|
9616
9640
|
# by the new crawler to access customer resources.
|
|
9617
9641
|
#
|
|
9618
9642
|
# @option params [String] :database_name
|
|
9619
|
-
# The
|
|
9643
|
+
# The Glue database where results are stored, such as:
|
|
9620
9644
|
# `arn:aws:daylight:us-east-1::database/sometable/*`.
|
|
9621
9645
|
#
|
|
9622
9646
|
# @option params [String] :description
|
|
@@ -9681,6 +9705,7 @@ module Aws::Glue
|
|
|
9681
9705
|
# path: "Path",
|
|
9682
9706
|
# exclusions: ["Path"],
|
|
9683
9707
|
# connection_name: "ConnectionName",
|
|
9708
|
+
# sample_size: 1,
|
|
9684
9709
|
# },
|
|
9685
9710
|
# ],
|
|
9686
9711
|
# jdbc_targets: [
|
|
@@ -9774,7 +9799,8 @@ module Aws::Glue
|
|
|
9774
9799
|
#
|
|
9775
9800
|
# @option params [String] :catalog_id
|
|
9776
9801
|
# The ID of the Data Catalog in which the metadata database resides. If
|
|
9777
|
-
# none is provided, the
|
|
9802
|
+
# none is provided, the Amazon Web Services account ID is used by
|
|
9803
|
+
# default.
|
|
9778
9804
|
#
|
|
9779
9805
|
# @option params [required, String] :name
|
|
9780
9806
|
# The name of the database to update in the catalog. For Hive
|
|
@@ -9855,9 +9881,7 @@ module Aws::Glue
|
|
|
9855
9881
|
#
|
|
9856
9882
|
# * `"--enable-glue-datacatalog": ""`
|
|
9857
9883
|
#
|
|
9858
|
-
#
|
|
9859
|
-
#
|
|
9860
|
-
# * `"GLUE_PYTHON_VERSION": "2"`
|
|
9884
|
+
# ^
|
|
9861
9885
|
#
|
|
9862
9886
|
# You can specify a version of Python support for development endpoints
|
|
9863
9887
|
# by using the `Arguments` parameter in the `CreateDevEndpoint` or
|
|
@@ -9983,10 +10007,10 @@ module Aws::Glue
|
|
|
9983
10007
|
# required permissions.
|
|
9984
10008
|
#
|
|
9985
10009
|
# @option params [String] :glue_version
|
|
9986
|
-
# This value determines which version of
|
|
10010
|
+
# This value determines which version of Glue this machine learning
|
|
9987
10011
|
# transform is compatible with. Glue 1.0 is recommended for most
|
|
9988
10012
|
# customers. If the value is not set, the Glue compatibility defaults to
|
|
9989
|
-
# Glue 0.9. For more information, see [
|
|
10013
|
+
# Glue 0.9. For more information, see [Glue Versions][1] in the
|
|
9990
10014
|
# developer guide.
|
|
9991
10015
|
#
|
|
9992
10016
|
#
|
|
@@ -9994,11 +10018,11 @@ module Aws::Glue
|
|
|
9994
10018
|
# [1]: https://docs.aws.amazon.com/glue/latest/dg/release-notes.html#release-notes-versions
|
|
9995
10019
|
#
|
|
9996
10020
|
# @option params [Float] :max_capacity
|
|
9997
|
-
# The number of
|
|
9998
|
-
#
|
|
9999
|
-
#
|
|
10000
|
-
#
|
|
10001
|
-
#
|
|
10021
|
+
# The number of Glue data processing units (DPUs) that are allocated to
|
|
10022
|
+
# task runs for this transform. You can allocate from 2 to 100 DPUs; the
|
|
10023
|
+
# default is 10. A DPU is a relative measure of processing power that
|
|
10024
|
+
# consists of 4 vCPUs of compute capacity and 16 GB of memory. For more
|
|
10025
|
+
# information, see the [Glue pricing page][1].
|
|
10002
10026
|
#
|
|
10003
10027
|
# When the `WorkerType` field is set to a value other than `Standard`,
|
|
10004
10028
|
# the `MaxCapacity` field is set automatically and becomes read-only.
|
|
@@ -10079,7 +10103,8 @@ module Aws::Glue
|
|
|
10079
10103
|
#
|
|
10080
10104
|
# @option params [String] :catalog_id
|
|
10081
10105
|
# The ID of the Data Catalog where the partition to be updated resides.
|
|
10082
|
-
# If none is provided, the
|
|
10106
|
+
# If none is provided, the Amazon Web Services account ID is used by
|
|
10107
|
+
# default.
|
|
10083
10108
|
#
|
|
10084
10109
|
# @option params [required, String] :database_name
|
|
10085
10110
|
# The name of the catalog database in which the table in question
|
|
@@ -10294,7 +10319,7 @@ module Aws::Glue
|
|
|
10294
10319
|
#
|
|
10295
10320
|
# @option params [String] :catalog_id
|
|
10296
10321
|
# The ID of the Data Catalog where the table resides. If none is
|
|
10297
|
-
# provided, the
|
|
10322
|
+
# provided, the Amazon Web Services account ID is used by default.
|
|
10298
10323
|
#
|
|
10299
10324
|
# @option params [required, String] :database_name
|
|
10300
10325
|
# The name of the catalog database in which the table resides. For Hive
|
|
@@ -10495,7 +10520,8 @@ module Aws::Glue
|
|
|
10495
10520
|
#
|
|
10496
10521
|
# @option params [String] :catalog_id
|
|
10497
10522
|
# The ID of the Data Catalog where the function to be updated is
|
|
10498
|
-
# located. If none is provided, the
|
|
10523
|
+
# located. If none is provided, the Amazon Web Services account ID is
|
|
10524
|
+
# used by default.
|
|
10499
10525
|
#
|
|
10500
10526
|
# @option params [required, String] :database_name
|
|
10501
10527
|
# The name of the catalog database where the function to be updated is
|
|
@@ -10599,7 +10625,7 @@ module Aws::Glue
|
|
|
10599
10625
|
params: params,
|
|
10600
10626
|
config: config)
|
|
10601
10627
|
context[:gem_name] = 'aws-sdk-glue'
|
|
10602
|
-
context[:gem_version] = '1.
|
|
10628
|
+
context[:gem_version] = '1.89.0'
|
|
10603
10629
|
Seahorse::Client::Request.new(handlers, context)
|
|
10604
10630
|
end
|
|
10605
10631
|
|