aspera-cli 4.13.0 → 4.15.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- checksums.yaml.gz.sig +0 -0
- data/CHANGELOG.md +81 -7
- data/CONTRIBUTING.md +22 -6
- data/README.md +2038 -1080
- data/bin/ascli +18 -9
- data/bin/asession +12 -14
- data/examples/dascli +1 -1
- data/examples/proxy.pac +1 -1
- data/examples/rubyc +24 -0
- data/lib/aspera/aoc.rb +219 -159
- data/lib/aspera/ascmd.rb +25 -14
- data/lib/aspera/cli/basic_auth_plugin.rb +12 -9
- data/lib/aspera/cli/error.rb +17 -0
- data/lib/aspera/cli/extended_value.rb +47 -12
- data/lib/aspera/cli/formatter.rb +260 -179
- data/lib/aspera/cli/hints.rb +80 -0
- data/lib/aspera/cli/main.rb +104 -156
- data/lib/aspera/cli/manager.rb +259 -209
- data/lib/aspera/cli/plugin.rb +123 -63
- data/lib/aspera/cli/plugins/alee.rb +2 -3
- data/lib/aspera/cli/plugins/aoc.rb +341 -261
- data/lib/aspera/cli/plugins/ats.rb +22 -21
- data/lib/aspera/cli/plugins/bss.rb +5 -5
- data/lib/aspera/cli/plugins/config.rb +578 -627
- data/lib/aspera/cli/plugins/console.rb +44 -6
- data/lib/aspera/cli/plugins/cos.rb +15 -17
- data/lib/aspera/cli/plugins/faspex.rb +114 -100
- data/lib/aspera/cli/plugins/faspex5.rb +411 -264
- data/lib/aspera/cli/plugins/node.rb +354 -259
- data/lib/aspera/cli/plugins/orchestrator.rb +61 -29
- data/lib/aspera/cli/plugins/preview.rb +82 -90
- data/lib/aspera/cli/plugins/server.rb +79 -32
- data/lib/aspera/cli/plugins/shares.rb +55 -42
- data/lib/aspera/cli/sync_actions.rb +68 -0
- data/lib/aspera/cli/transfer_agent.rb +66 -73
- data/lib/aspera/cli/transfer_progress.rb +74 -0
- data/lib/aspera/cli/version.rb +1 -1
- data/lib/aspera/colors.rb +12 -8
- data/lib/aspera/command_line_builder.rb +14 -11
- data/lib/aspera/cos_node.rb +3 -2
- data/lib/aspera/data/6 +0 -0
- data/lib/aspera/environment.rb +24 -9
- data/lib/aspera/fasp/agent_aspera.rb +126 -0
- data/lib/aspera/fasp/agent_base.rb +31 -77
- data/lib/aspera/fasp/agent_connect.rb +25 -21
- data/lib/aspera/fasp/agent_direct.rb +89 -103
- data/lib/aspera/fasp/agent_httpgw.rb +231 -149
- data/lib/aspera/fasp/agent_node.rb +41 -34
- data/lib/aspera/fasp/agent_trsdk.rb +75 -32
- data/lib/aspera/fasp/error_info.rb +4 -2
- data/lib/aspera/fasp/faux_file.rb +52 -0
- data/lib/aspera/fasp/installation.rb +53 -195
- data/lib/aspera/fasp/management.rb +244 -0
- data/lib/aspera/fasp/parameters.rb +71 -37
- data/lib/aspera/fasp/parameters.yaml +76 -8
- data/lib/aspera/fasp/products.rb +162 -0
- data/lib/aspera/fasp/resume_policy.rb +3 -3
- data/lib/aspera/fasp/transfer_spec.rb +7 -6
- data/lib/aspera/fasp/uri.rb +26 -24
- data/lib/aspera/faspex_gw.rb +2 -2
- data/lib/aspera/faspex_postproc.rb +2 -2
- data/lib/aspera/hash_ext.rb +14 -4
- data/lib/aspera/json_rpc.rb +49 -0
- data/lib/aspera/keychain/macos_security.rb +13 -13
- data/lib/aspera/line_logger.rb +23 -0
- data/lib/aspera/log.rb +58 -16
- data/lib/aspera/node.rb +157 -92
- data/lib/aspera/oauth.rb +37 -19
- data/lib/aspera/open_application.rb +4 -4
- data/lib/aspera/persistency_action_once.rb +1 -1
- data/lib/aspera/persistency_folder.rb +2 -2
- data/lib/aspera/preview/file_types.rb +4 -2
- data/lib/aspera/preview/generator.rb +22 -35
- data/lib/aspera/preview/options.rb +2 -0
- data/lib/aspera/preview/terminal.rb +73 -16
- data/lib/aspera/preview/utils.rb +21 -28
- data/lib/aspera/proxy_auto_config.js +2 -2
- data/lib/aspera/rest.rb +136 -68
- data/lib/aspera/rest_call_error.rb +1 -1
- data/lib/aspera/rest_error_analyzer.rb +15 -14
- data/lib/aspera/rest_errors_aspera.rb +37 -34
- data/lib/aspera/secret_hider.rb +18 -15
- data/lib/aspera/ssh.rb +5 -2
- data/lib/aspera/sync.rb +127 -119
- data/lib/aspera/temp_file_manager.rb +10 -3
- data/lib/aspera/web_auth.rb +10 -7
- data/lib/aspera/web_server_simple.rb +9 -4
- data.tar.gz.sig +0 -0
- metadata +34 -17
- metadata.gz.sig +0 -0
- data/docs/test_env.conf +0 -186
- data/lib/aspera/cli/listener/line_dump.rb +0 -19
- data/lib/aspera/cli/listener/logger.rb +0 -22
- data/lib/aspera/cli/listener/progress.rb +0 -50
- data/lib/aspera/cli/listener/progress_multi.rb +0 -84
- data/lib/aspera/cli/plugins/sync.rb +0 -44
- data/lib/aspera/data/7 +0 -0
- data/lib/aspera/fasp/listener.rb +0 -13
checksums.yaml
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
---
|
2
2
|
SHA256:
|
3
|
-
metadata.gz:
|
4
|
-
data.tar.gz:
|
3
|
+
metadata.gz: 007b7653b79d11d35c5741fe091d6118204b25521a3ad30082e2c1970124d91a
|
4
|
+
data.tar.gz: a7b763b7f993f414d0ec78b79eeb1607dcb1618697bb4360f05fb39ad159443c
|
5
5
|
SHA512:
|
6
|
-
metadata.gz:
|
7
|
-
data.tar.gz:
|
6
|
+
metadata.gz: 176ba1755a5e545b2886b311e7be53c33983c3a8eaf75846801d83dd9dfc498bfd5e44cf0f65c51267374309e1f4ffa2657a793fc659622a9a9ba41d94b71344
|
7
|
+
data.tar.gz: 1e0f022813ba1b6e7cdb90a632811193689ac69175d9eac65a0589128c5d12181f283beb1a973109d9d1768ab770535be77aa9c37220363c8d0090b9139c8196
|
checksums.yaml.gz.sig
CHANGED
Binary file
|
data/CHANGELOG.md
CHANGED
@@ -1,5 +1,79 @@
|
|
1
1
|
# Changes (Release notes)
|
2
2
|
|
3
|
+
* 4.15.0
|
4
|
+
|
5
|
+
* General: removed many redundant options, more consistency between plugins, see below in "break".
|
6
|
+
* New Features:
|
7
|
+
* global: added resolution hints for well known issues.
|
8
|
+
* global: extended value expression `@extend:` finds and replace extended values in a string (e.g. for JSON)
|
9
|
+
* global: option `fields` now supports `RegExp`
|
10
|
+
* global: option `home` to set the main folder for configuration and cache
|
11
|
+
* global: option `ignore_certificate` to specify specific URLs instead of global option `insecure`
|
12
|
+
* global: option `cert_stores` to specify alternate certificate stores
|
13
|
+
* global: uniform progress bar for any type of transfer.
|
14
|
+
* global: add extended value types: `re` and `yaml`
|
15
|
+
* global: option `pid_file` to write tool's PID during execution, deleted on exit
|
16
|
+
* config: command `remote_certificate` to retrieve a remote certificate
|
17
|
+
* config: added logger level `trace1` and `trace2`
|
18
|
+
* wizard: can detect multiple applications at the same address or url.
|
19
|
+
* aoc: wizard accepts public links
|
20
|
+
* aoc: support private links, and possibility to list shared folder with workspace `@json:null`
|
21
|
+
* orchestrator: error analysis for workflow start
|
22
|
+
* httpgw: now supports pseudo file for testing: e.g. `faux:///testfile?1k`
|
23
|
+
* node: added command `transfer sessions` to list all sessions of all transfers
|
24
|
+
* node: generate bearer token from private key and user information
|
25
|
+
* node: access node API with bearer token as credentials
|
26
|
+
* agent: `direct` allows ignoring certificate for wss using http options
|
27
|
+
* preview: command `show` generates a preview and displays it in terminal
|
28
|
+
* Issues Fixed:
|
29
|
+
* Ruby warning: `net/protocol.rb:68: warning: already initialized constant Net::ProtocRetryError` solved by removing dependency on `net-smtp` from gem spec (already in base ruby).
|
30
|
+
* Breaking Changes:
|
31
|
+
* global: commands `detect` and `wizard` takes now a mandatory argument: address or url instead of option `url`.
|
32
|
+
* global: renamed option `pkeypath` to `key_path`
|
33
|
+
* global: renamed option `notif_to` to `notify_to` and `notif_template` to `notify_template`
|
34
|
+
* global: removed extended value handler `incps`, as it is never used (use `extend` instead).
|
35
|
+
* global: option `fields`: `+prop` is replaced with: `DEF,prop` and `-field` is replaced with: `DEF,-field`, and whole list is evaluated.
|
36
|
+
* global: replaced option `progress` with option `progressbar` (bool)
|
37
|
+
* global: removed option `rest_debug` and `-r`, replaced with `--log-level=trace2`
|
38
|
+
* global: the default file name for private key when using wizard is change from `aspera_aoc_key` to `my_private_key.pem`
|
39
|
+
* faspex5: removed option and `auth` type `link`: simply provide the public link as `url`
|
40
|
+
* faspex: remote source selection now uses percent selector instead of parameter `id` or `name`
|
41
|
+
* faspex: option `source_name` is now `remote_source`
|
42
|
+
* aoc: selection by name uses percent selector instead of option or parameter `name`
|
43
|
+
* aoc: removed option `link`: use `url` instead
|
44
|
+
* aoc: in command `short_link`, place type before command, e.g. `short_link private create /blah`
|
45
|
+
* aoc: replaced option `operation` with mandatory positional parameter for command `files transfer`
|
46
|
+
* aoc: replaced option `from_folder` with mandatory positional parameter for command `files transfer`
|
47
|
+
* orchestrator: workflow start takes arguments as optional positional extended value instead of option `param`
|
48
|
+
* node: `find` command now takes an optional `@ruby:` extended value instead of option `query` with prefix: `exec:`
|
49
|
+
* sync: plugin `sync` is removed: actions are available through `server` and `node` plugins.
|
50
|
+
* sync: replaced option `sync_session` with optional positional parameter.
|
51
|
+
* preview: command `scan`, `events` and `trevents` replaced option `query` with optional positional parameter for filter (like `find`).
|
52
|
+
* trsdk: parameters `host` and `port` in option `transfer_info` are replaced with parameter `url`, like `grpc://host:port`
|
53
|
+
|
54
|
+
* 4.14.0
|
55
|
+
|
56
|
+
* new: server: option `passphrase` for simpler command line (#114)
|
57
|
+
* new: percent selector for entities identifier
|
58
|
+
* new: faspex5: shared inbox and workgroup membership management
|
59
|
+
* new: faspex5: invite external user to shared inbox
|
60
|
+
* new: faspex5: package list and receive from workgroup and shared inbox
|
61
|
+
* new: config: Command `ascp info` shows default transfer spec.
|
62
|
+
* new: httpgw: synchronous and asynchronous upload modes
|
63
|
+
* new: node: command `bandwidth_average` to get average bandwidth of node, per periods
|
64
|
+
* fix: option `ts`: deep add and remove of keys. (#117)
|
65
|
+
* fix: faspex5: user lookup for `packages send` shall be exact match (#120)
|
66
|
+
* fix: direct: if transfer spec contains "paths" and elements with "destination", but first element has only "source", then destinations were ignored. Now "destination" all or none is enforced.
|
67
|
+
* change: using `aoc files` or node gen4 operations (`browse`, `delete`) on a link will follow the link only if path ends with /
|
68
|
+
* change: shares: command `repository` is changed to `files` for consistency with aoc and upcoming faspex5, but is still available as alias
|
69
|
+
* change: aoc: better handling of shared links
|
70
|
+
* change: global: option `value` is deprecated. Use positional parameter for creation data and option `query` for list/delete operations.
|
71
|
+
* change: config: remove deprecated command: `export_to_cli`
|
72
|
+
* change: config: removed all legacy preset command, newer command `preset` shall be used now.
|
73
|
+
* change: config: SDK is now installed in $HOME/.aspera/sdk instead of $HOME/.aspera/ascli/sdk
|
74
|
+
* change(break): aoc/node: Simplification: gen4 operations: show modify permission thumbnail are now directly under node gen 4 command. Command `file` is suppressed. Option `path` is suppressed. The default expected argument is a path. To provide a file id, use selector syntax: %id:_file_id_
|
75
|
+
* change(break): node: option `token_type` is removed, as starting with HSTS 4.3 basic token is only allowed with access keys, so use gen4 operations: `acc do self`
|
76
|
+
|
3
77
|
* 4.13.0
|
4
78
|
|
5
79
|
* new: preview: option `reencode_ffmpeg` allows overriding all re-encoding options
|
@@ -70,7 +144,7 @@
|
|
70
144
|
* new: improved documentation on faspex and aoc package send
|
71
145
|
* fix: `node do` command fixed
|
72
146
|
* fix: improved secret hiding from logs
|
73
|
-
* change(break): removed rarely commands nodeadmin
|
147
|
+
* change(break): removed rarely commands `nodeadmin`, `configuration`, `userdata`, `ctl` from plugin `server`
|
74
148
|
as well as option `cmd_prefix`
|
75
149
|
* change: `ascli` runs as user `cliuser` instead of `root` in container
|
76
150
|
* change: default access right for config folder is now user only, including private keys
|
@@ -189,9 +263,9 @@
|
|
189
263
|
* new: agent `http_gw` now supports upload
|
190
264
|
* new: added option `sdk_url` to install SDK from local file for offline install
|
191
265
|
* new: check new gem version periodically
|
192
|
-
* new: the --fields= option, support -
|
266
|
+
* new: the --fields= option, support -_field_name_ to remove a field from default fields
|
193
267
|
* new: Oauth tokens are discarded automatically after 30 minutes (useful for COS delegated refresh tokens)
|
194
|
-
* new: mimemagic is now optional, needs manual install for `preview`, compatible with version 0.4.x
|
268
|
+
* new: `mimemagic` is now optional, needs manual install for `preview`, compatible with version 0.4.x
|
195
269
|
* new: AoC a password can be provided for a public link
|
196
270
|
* new: `conf doc` take an optional parameter to go to a section
|
197
271
|
* new: initial support for Faspex 5 Beta 1
|
@@ -209,7 +283,7 @@
|
|
209
283
|
|
210
284
|
* 0.11.8
|
211
285
|
|
212
|
-
* Simplified to use `unoconv` instead of bare `libreoffice` for office conversion, as `unoconv` does not require a X server (previously using Xvfb)
|
286
|
+
* Simplified to use `unoconv` instead of bare `libreoffice` for office conversion, as `unoconv` does not require a X server (previously using `Xvfb`)
|
213
287
|
|
214
288
|
* 0.11.7
|
215
289
|
|
@@ -330,7 +404,7 @@
|
|
330
404
|
* 0.10.4
|
331
405
|
|
332
406
|
* new options for AoC : `secrets`
|
333
|
-
* ACLI-533 temp file list folder to use file lists is set by default, and used by `asession`
|
407
|
+
* `ACLI-533` temp file list folder to use file lists is set by default, and used by `asession`
|
334
408
|
|
335
409
|
* 0.10.3
|
336
410
|
|
@@ -370,13 +444,13 @@
|
|
370
444
|
|
371
445
|
* new command to display basic token of node
|
372
446
|
* new command to display bearer token of node in AoC
|
373
|
-
* the --fields= option, support +
|
447
|
+
* the --fields= option, support +_field_name_ to add a field to default fields
|
374
448
|
* many small changes
|
375
449
|
|
376
450
|
* 0.9.32
|
377
451
|
|
378
452
|
* all Faspex public links are now supported
|
379
|
-
* removed faspex operation recv_publink
|
453
|
+
* removed faspex operation `recv_publink`
|
380
454
|
* replaced with option `link` (consistent with AoC)
|
381
455
|
|
382
456
|
* 0.9.31
|
data/CONTRIBUTING.md
CHANGED
@@ -1,5 +1,5 @@
|
|
1
1
|
# Contributing
|
2
|
-
|
2
|
+
<!-- cspell:words passin -->
|
3
3
|
## Reporting Issues and Vulnerabilities
|
4
4
|
|
5
5
|
You can report issues at <https://github.com/IBM/aspera-cli/issues>
|
@@ -32,7 +32,7 @@ If you want to contribute, please:
|
|
32
32
|
- Add tests for it. This is important so I don't break it in a future version unintentionally.
|
33
33
|
- **Bonus Points** go out to anyone who also updates `CHANGELOG.md` :)
|
34
34
|
- Send a pull request on GitHub.
|
35
|
-
- run
|
35
|
+
- run `rubocop` to comply for coding standards
|
36
36
|
|
37
37
|
## Architecture
|
38
38
|
|
@@ -192,11 +192,11 @@ make dpush
|
|
192
192
|
|
193
193
|
### Specific version image build
|
194
194
|
|
195
|
-
It is possible to build a specific version by setting envvar `
|
195
|
+
It is possible to build a specific version by setting envvar `GEM_VERSION` and `make` with option `-e`:
|
196
196
|
|
197
197
|
```bash
|
198
|
-
|
199
|
-
|
198
|
+
GEM_VERSION=4.11.0 make -e docker
|
199
|
+
GEM_VERSION=4.11.0 make -e dpush
|
200
200
|
```
|
201
201
|
|
202
202
|
### Development version image build
|
@@ -209,10 +209,26 @@ make dockerbeta
|
|
209
209
|
make dpushversion
|
210
210
|
```
|
211
211
|
|
212
|
+
## Single executable build
|
213
|
+
|
214
|
+
It is possible to build `ascli` as a single native executable using `rubyc` (gem `ruby-packer`).
|
215
|
+
|
216
|
+
```bash
|
217
|
+
make single
|
218
|
+
```
|
219
|
+
|
220
|
+
This is based on tool `rubyc` (gem `ruby-packer`): either place the executable in folder `tmp`, or the architecture-specific version will be automatically downloaded.
|
221
|
+
|
222
|
+
> **Note:** Perl `Findbin` is needed, install on Linux with:
|
223
|
+
|
224
|
+
```bash
|
225
|
+
sudo dnf install -y perl perl-FindBin perl-IPC-Cmd
|
226
|
+
```
|
227
|
+
|
212
228
|
## Long Term Implementation and delivery improvements
|
213
229
|
|
214
230
|
- replace rest and oauth classes with ruby standard gems:
|
215
231
|
- <https://github.com/rest-client/rest-client>
|
216
232
|
- <https://github.com/oauth-xx/oauth2>
|
217
233
|
- use gem Thor <http://whatisthor.com/> (or other standard Ruby CLI manager)
|
218
|
-
- Package a single-file executable for various architectures with <https://github.com/pmq20/ruby-packer> (rubyc)
|
234
|
+
- Package a single-file executable for various architectures with <https://github.com/pmq20/ruby-packer> (`rubyc`)
|