automagix 4.0.0__tar.gz

automagix-4.0.0/LICENSE

@@ -0,0 +1,22 @@
+MIT License
+
+Copyright (c) 2019-2026 //SEIBERT/MEDIA GmbH
+Copyright (c) 2019-2026 Johannes Paul
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

automagix-4.0.0/PKG-INFO

@@ -0,0 +1,639 @@
+Metadata-Version: 2.4
+Name: automagix
+Version: 4.0.0
+Summary: Automation wrapper for bash and python commands
+Author-email: Johannes Paul <vanadinit@quantentunnel.de>
+License: MIT
+Project-URL: Homepage, https://codeberg.org/vanadinit/automagix
+Keywords: bash,shell,command,automation,process,wrapper,devops,system administration
+Classifier: Programming Language :: Python :: 3
+Classifier: License :: OSI Approved :: MIT License
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: pyyaml>=5.1
+Provides-Extra: tests
+Requires-Dist: cython<3.0.0; extra == "tests"
+Requires-Dist: pytest; extra == "tests"
+Requires-Dist: pytest-docker; extra == "tests"
+Requires-Dist: flake8; extra == "tests"
+Provides-Extra: shell-completion
+Requires-Dist: argcomplete; extra == "shell-completion"
+Provides-Extra: progress-bar
+Requires-Dist: tqdm>=4.66.0; extra == "progress-bar"
+Provides-Extra: bundlewrap
+Requires-Dist: bundlewrap; extra == "bundlewrap"
+Provides-Extra: teamvault
+Requires-Dist: bundlewrap-teamvault; extra == "teamvault"
+Dynamic: license-file
+
+# automagix
+Automation wrapper for bash and python commands. Extended Features version.  
+Fork of Automatix (https://github.com/seibert-media/automatix)
+
+# DESCRIPTION
+
+**automagix** is a wrapper for scripted sysadmin tasks. It offers
+ some useful functionality for easier scripting and having full
+ control over the automated process.
+
+The idea of **automagix** is to write down all the commands you would
+ normally type to your commandline or python console into a YAML file.
+ Then use **automagix** to execute these commands. 
+
+There are different modes for **automagix** to work. Without any
+ parameters automagix will try to execute the specified command
+ pipeline from the script file until an error occurs or the pipeline
+ is done. The interactive mode (**-i**) asks for every single
+ commandline step whether to execute, skip or abort.
+ Forced mode (**-f**) will also proceed if errors occur.
+
+**automagix** was originally designed for internal Seibert Group use.
+ It comes therefore with bundlewrap and teamvault support as well as
+ the possibility to use your own logging library.
+
+## Warning:
+
+Beware that this tool cannot substitute the system administrators
+ brain and it needs a responsible handling, since you can do
+ (and destroy) almost everything with it.
+
+**Automagix** evaluates YAML files and executes defined commands as
+ shell or python commands. There is no check for harmful commands.
+ Be aware that this can cause critical damage to your system.
+
+Please use the interactive mode and doublecheck commands before
+ executing. Usage of automagix is at your own risk!
+
+
+# INSTALLATION
+
+Automagix requires Python &ge; 3.10.
+
+```
+pip install automagix
+```
+
+# CONFIGURATION
+
+You can specify a path to a configuration YAML file via the
+ environment variable **AUTOMAGIX_CONFIG**.
+Default location is "~/.automagix.cfg.yaml".
+All (string) configuration values can be overwritten by the
+ corresponding upper case environment variables preceeded
+ by 'AUTOMAGIX_', e.g. _AUTOMAGIX_ENCODING_.
+
+### Example: .automagix.cfg.yaml
+
+    # Path to scripts directory
+    script_dir: '~/automagix_script_files'
+    
+    # Global constants for use in pipeline scripts
+    constants:
+      apt_update: 'apt-get -qy update'
+      apt_upgrade: 'DEBIAN_FRONTEND=noninteractive apt-get -qy -o Dpkg::Options::=--force-confold --no-install-recommends upgrade'
+      apt_full_upgrade: 'DEBIAN_FRONTEND=noninteractive apt-get -qy -o Dpkg::Options::=--force-confold --no-install-recommends full-upgrade'
+    
+    # Encoding
+    encoding: 'utf-8'
+
+    # Path to local bash (default: /bin/bash)
+    bash_path: '/bin/bash'
+    
+    # SSH Command used for remote connections
+    # You propably want -t for pseudo-terminal allocation here.
+    ssh_cmd: 'ssh -t {hostname} sudo '
+    
+    # Logger
+    logger: 'mylogger'
+    
+    # Logging library (has to implement the init_logger method)
+    logging_lib: 'mylib.logging'
+
+    # Logfile directory for parallel processing (ONLY for parallel processing!)
+    logfile_dir: 'automagix_logs'
+    
+    # Enable support for modules: bundlewrap, teamvault.
+    modules: ['bundlewrap', 'teamvault']
+
+    # Activate progress bar: "Basic" or "Tqdm", default "" (no progress bar)
+    progress_bar: Basic
+
+    # Startup script, which is triggered on every start of Automagix.
+    # The whole Automagix call with all arguments is passed through as arguments.
+    startup_script: '/some/path/bin/automagix_startup.sh'
+
+# SYNOPSIS
+
+**automagix**
+      \[**--help**|**-h**\]
+      \[**--systems** \[_SYSTEM1=ADDRESS_OR_NODENAME_ ...\]\]
+      \[**--vars** \[_VAR1=VALUE1_ ...\]\]
+      \[**--secrets** \[_SECRET1=SECRETID_ ...\]\]
+      \[**--vars-file** _VARS_FILE_PATH_ \]
+      \[**--print-overview**|**-p**\]
+      \[**--jump-to**|**-j** _JUMP_TO_\]
+      \[**--steps**|**-s** _STEPS_\]
+      \[**--interactive**|**-i**\]
+      \[**--force**|**-f**\]
+      \[**--debug**|**-d**\]
+      \[**--**\] **scriptfile**
+
+
+## OPTIONS
+
+**scriptfile**
+: The only required parameter for this tool to work. Use " -- " if
+ needed to delimit this from argument fields. See **SCRIPTFILE**
+ section for more information.  
+
+**-h**, **--help**
+: View help message and exit.  
+
+**--systems** _SYSTEM1=ADDRESS_OR_NODENAME_
+: Use this to set systems without adding them to the
+  scriptfile or to overwrite them. You can specify multiple
+  systems like: --systems v1=string1 v2=string2 v3=string3  
+  
+**--vars** _VAR1=VALUE1_
+: Use this to set vars without adding them to the scriptfile
+  or to overwrite them. You can specify multiple vars
+  like: --vars v1=string1 v2=string2 v3=string3  
+  
+**--secrets** _SECRET1=SECRETID_
+: Use this to set secrets without adding them to the
+  scriptfile or to overwrite them. You can specify multiple
+  secrets like: --secrets v1=string1 v2=string2 v3=string3 *(only if
+  teamvault is enabled)*  
+  
+**--vars-file** _VARS_FILE_PATH_
+: Use this to specify a CSV file from where **automagix** reads
+  systems, variables and secrets. First row must contain the field
+  types and names. You may also specify an `label` and `group` field.
+  
+  The `label` field can be to achieve a better overview and which row
+  is currently executed. It is used, when printing error messages or
+  as status line in screens for parallel processing. Without label
+  the row number is displayed.
+
+  The `group` field is only relevant for parallel processing. Row of
+  the same group are grouped together in a single screen and processed
+  sequentially there. Different groups are processed parallel.
+  Rows without specified group are run each in a parallel screen.
+  These rows are processed after the groups.
+
+  Example header: `label,group,systems:mysystem,vars:myvar`.
+  
+**--parallel**
+: Run CSV file entries parallel in screen sessions; only valid with --vars-file.
+  GNU screen has to be installed. See EXTRAS section below.
+
+**--print-overview**, **-p**
+: Just print command pipeline overview with indices then exit without
+ executing the commandline. Note that the *always pipeline* will be
+ executed anyway.  
+
+**--jump-to** _JUMP_TO_, **-j** _JUMP_TO_
+: Jump to step with index _JUMP_TO_ instead of starting at the
+ beginning. Use this option without argument to get an interactive selection.
+ You can also use negative numbers to start counting from the end.  
+
+**--steps** _STEPS_, **-s** _STEPS_
+: Only execute these steps (comma-separated indices) or exclude steps
+ by prepending the comma-separated list with "e".
+ Examples: `-s 1,3,7`, `-s e2`, `-s e0,5,7,2`  
+
+**--interactive**, **-i**
+: Confirm actions before executing.  
+  
+**--force**, **-f**
+: Try always to proceed (except manual steps), even if errors occur
+ (no retries).  
+
+**--debug**, **-d**
+: Activate debug log level.  
+
+
+### EXAMPLE: Usage
+
+    automagix -i --systems source=sourcesystem.com target=targetsystem.org -- scriptfile.yaml
+
+
+## SCRIPTFILE
+
+The **scriptfile** describes your automated process. Therefore it
+ contains information about systems, variables, secrets and the
+ command pipeline.
+
+You can provide a path to your **scriptfile** or place your
+ scriptfile in the predefined directory (see **CONFIGURATION**
+ section, _script_dir_). The path has precedence over the predefined
+ directory, if the file exists at both locations.
+
+The **scriptfile** has to contain valid YAML.
+
+### EXAMPLE: scriptfile
+    
+    name: Migration Server XY
+    # Systems you like to refer to in pipeline (accessible via 'SYSTEMS.source')
+    # If Bundlewrap support is activated use node names instead of hostnames or add preceeding 'hostname!'.
+    require_version: '1.5.0'
+    systems:
+      source: sourcesystem.com
+      target: targetsystem.org
+    # Custom vars to use in pipeline
+    vars:
+      version: 1.2.3
+      domain: 'bla.mein-test-system'
+    # Teamvault Secrets, if activated (left: like vars, right: SECRETID_FIELD, FIELD=username|password|file)
+    secrets:
+      web_user: v6GQag_username
+      web_pw: v6GQag_password
+    # Precommands, which are executed before each shell command in the main pipeline
+    precommands:
+      local: '. myfunctions'
+      remote: '. /tmp/myfunctions'
+    # like command pipeline but will be exectuted always beforehand
+    always:
+      - python: |
+          import mylib as nc
+          PERSISTENT_VARS.update(locals())
+    pipeline:
+      - remote@target: systemctl stop server
+      - remote@source: zfs snapshot -r tank@before-migration
+      - manual: Please trigger preparing tasks via webinterface
+      - myvar=local: curl -L -vvv -k https://{domain}/
+      - local: echo "1.1.1.1 {domain}" >> /etc/hosts
+      - sla=python: NODES.source.metadata.get('sla')
+      - python: |
+            sla = '{sla}'
+            if sla == 'gold':
+                print('Wow that\'s pretty cool. You have SLA Gold.')
+            else:
+                print('Oh. Running out of money? SLA Gold is worth it. You should check your wallet.')
+            PERSISTENT_VARS['sla'] = sla
+      - cond=python: sla == 'gold'
+      - cond?local: echo "This command is only executed if sla is gold."
+    cleanup:
+      - local: rm temp_files
+
+
+### FIELDS
+
+**name** _(string)_
+: Just a name for the process. Does not do anything.
+
+**require_version** _(string)_
+: The required Automagix version for this script to run. Similar to the
+ [Python version specifiers](https://packaging.python.org/en/latest/specifications/version-specifiers/#version-specifiers).
+ Multiple conditions can be separated by comma. Allowed operators are: "==","!=",">=" (default),"<=",">","<","~="
+
+**systems** _(associative array)_
+: Define some systems. Value has to be a valid SSH destination like an
+ IP address or hostname. If Bundlewrap support is enabled, it has to
+ be a valid and existing Bundlewrap node or group name, or you can 
+ precede your IP or hostname with `hostname!` to define a
+ non-Bundlewrap system.
+You can refer to these systems in the command pipeline in multiple ways:
+
+1) remote@systemname as your command action (see below)
+
+2) via {SYSTEMS.systemname} which will be replaced with the value
+
+3) via SYSTEMS.systemname in python actions which contains the value
+
+4) via NODES.systemname in python actions to use the Bundlewrap node
+   object (Bundlewrap nodes only, no groups)
+
+**vars** _(associative array)_
+: Define some vars. Note: Only valid Python variable names are allowed.  
+ To specify a variable type use `type|varname` where *type* is
+ one of *int, float, bool, str* and varname the variable name.
+ Automatix will try to convert an assigned value to the specified type.
+ **Note**: For the boolean type the string "False" and upper/lower-case
+ variations are converted to `False` deviating from Python's normal behavior.  
+ Variables are accessible in the command pipeline via
+ {varname} (converted to *str*) and in python actions via `VARS.varname`.
+
+**secrets** _(associative array)_
+: Define teamvault secrets. Value has to be in this format:
+ _SECRETID_FIELD_. _FIELD_ must be one of username, password or file.
+ The resolved secret values are accessible in command line via
+ {secretname}. *(only if teamvault is enabled)*
+
+**precommands** _(associative array)_
+: Define a command which is executed before every shell command.
+ You can specify a command for local and remote commands separately.
+ This can be useful to source files with shell functions you want to use.
+
+**always**, **cleanup** _(list of associative arrays)_
+: See **ALWAYS / CLEANUP PIPELINE** section.
+
+**pipeline** _(list of associative arrays)_
+: See **PIPELINE** section.
+
+### PIPELINE
+
+Here you define the commands automagix shall execute.
+
+**KEY**: One of these possible command actions:
+
+1) **manual**: Some manual instruction for the user. The user has to
+ confirm, that automagix may proceed.
+
+2) **local**: Local shell command to execute. The Bash specified 
+ in `bash_path` (default: /bin/bash) will be used for execution.
+ The environment is inherited with additional 
+ **RUNNING_INSIDE_AUTOMAGIX** set to 1.
+
+3) **remote@systemname**: Remote shell command to execute. Systemname
+ has to be a defined system. The command will be run via SSH (without
+  pseudo-terminal allocation). It uses the standard SSH command.
+  Therefore your .ssh/config should be respected.
+ If systemname is a Bundlewrap group, the remote command will be
+  executed sequentially for every node.
+
+4) **python**: Python code to execute.
+   * `PERSISTENT_VARS`, `PVARS`, `SkipBatchItemException`, `AbortException`
+     are available, see corresponding sections in **TIPS & TRICKS** 
+   * Notice that the variable `VARS` contains
+     the Automagix variables as a dictionary. `VARS` supports also
+     the attribute notation like `VARS.myvariable`. You can use it 
+     to access or change the variables directly.
+   * The path to the executed script file is available as `SCRIPT_FILE_PATH`.
+   * You can refer to systems and constants via `SYSTEMS.systemname`
+     and `CONST.constantname`.
+   * If bundlewrap is enabled, the Bundlewrap repository object is
+     available via `AUTOMAGIX_BW_REPO` and system node objects are
+     available via `NODES.systemname` (replace "systemname").
+     Use `AUTOMAGIX_BW_REPO.reload()` to reinitialize the Bundlewrap 
+     repository from the file system. This can be useful for using
+     newly created nodes (e.g. remote commands).  
+   
+
+**ASSIGNMENT**: For **local**, **remote** and **python** action you
+ can also define a variable to which the output will be assigned.
+ To do this prefix the desired variablename and = before the action
+ key, e.g. `myvar=python: NODES.system.hostname`. Be careful when
+ working with multiline statements. In **python** the first line is
+ likely to set the variable.  
+ Only for **local** and **remote** action: If a variable type was
+ specified in the **vars** section, Automatix will also try to
+ convert the value here.
+ 
+**CONDITIONS**: You can define the command only to be executed if
+ your condition variable evaluates to "True" in Python. To achieve
+ this write the variable name followed by a question mark at the very
+ beginning like `cond?python: destroy_system()`. Be aware that all
+ output from **local** or **remote** commands will lead to a non-empty
+ string which evaluates to "True" in Python, but empty output will
+ evaluate to "False". Use `!?` instead of `?` to invert the condition.
+
+**STATIC_FLAG**: If you do not want values to be replaced in your command,
+ you can suffix the command key with '-' to indicate a static command
+ value, e.g. `python-: f'{this} is not replaced'`. This is  especially
+ useful for Python commands which use curly brackets themselves.
+
+**VALUE**: Your command. Variables will be replaced with Python
+ format function. Therefore, use curly brackets to refer to variables,
+ systems, secrets and constants.
+
+Constants are available via CONST.KEY, where KEY is the key of your
+ constants in your **CONFIGURATION** file. There you can define some
+ widely used constants.
+
+In most cases its a good idea to define your command in quotes to
+ avoid parsing errors, but it is not always necessary. Another way is
+ to use '|' to indicate a _literal scalar block_. There you can even
+ define whole program structures for python (see example).
+
+#### Escaping in Pipeline
+
+Because automagix uses Python's format() function (not for static commands):  
+`{` -> `{{`  
+`}` ->  `}}`  
+
+Standard YAML escapes (see also https://yaml.org/spec/1.2/spec.html):  
+`'` -> `''`  
+`"` -> `\"`  
+`\ ` -> `\\`  
+`:` -> Please use quotes (double or single).
+
+
+### ALWAYS / CLEANUP PIPELINE
+
+Same usage as the 'normal' command pipeline, but will be executed
+ every time at start of automagix (**always**) or at the end
+ (**cleanup**) even if aborted (a). The commands are executed without
+ --interactive flag, independend of the specified parameters.
+
+Intended use case for **always**: python imports or informations that
+ are needed afterwards and do not change anything on systems.
+ You want to have these available even if using --jump|-j feature.
+
+Intended use case for **cleanup**: Remove temporary files or artifacts.
+
+
+## ENVIRONMENT
+
+**AUTOMAGIX_CONFIG**: Specify the path to the configuration file.
+ Default is "~/.automagix.cfg.yaml".  
+
+**AUTOMAGIX_**_config-variable-in-upper-case_: Set or overwrite the 
+ corresponding configuration value. See **CONFIGURATION** section.
+ Works only for string and boolean values!
+ String values (case-insensitive 'true' or 'false') are converted
+ to `True` or `False` in Python, if the fields expects a boolean.
+ **All other values (int, float, dict, list, ...) are ignored!**
+
+**AUTOMAGIX_TIME**: Set this to an arbitrary value to print the times
+ for the single steps and the whole script, e.g. `AUTOMAGIX_TIME=true`.
+
+
+# TIPS & TRICKS
+
+### YAML Syntax
+
+For multiline commands and variables YAML offers different possibilities
+ to write multiline strings. A look at https://yaml-multiline.info/ might
+ be helpful.  
+
+### PERSISTENT_VARS
+
+If you want to access variables in **python** action you defined in
+preceeding command, you can use the **PERSISTENT_VARS** dictionary
+(shortcut: **PVARS**).
+This is added to the local scope of **python** actions and the
+dictonary keys are also available as attributes.
+ Examples:
+- To make all local variables of the actual command persistent use
+ `PERSISTENT_VARS.update(locals())`.
+- To delete one persistent variable named "myvar" use
+ `del PERSISTENT_VARS['myvar']`
+- To make variable "v2" persistent use `PERSISTENT_VARS['v2'] = v2`
+  or `PERSISTENT_VARS.v2 = v2`
+- Use the shortcut like `PVARS.v2 = v2`
+
+**Note: Following works ONLY with the shortcut "PVARS"**:
+
+You can use these variables also as condition or as normal automagix
+variable in curly brackets by using the shortcut and the attribute notation:
+    
+      - python: PVARS.cond = some_function()
+      - PVARS.cond?local: echo 'This is only printed if "some_function" evaluates to "True"'
+      - PVARS.cond!?local: echo 'And this is printed if "some_function" evaluates to "False"'
+      - local: echo "The condition variable contains the value '{PVARS.cond}'."
+
+*Since version 2.4.0 making variables global does not work any longer!*
+
+### Abort and Skip Exceptions
+
+To abort the current automagix and jump to the next batch item you can
+ raise the `SkipBatchItemException`. For aborting the whole automagix
+ process raise `AbortException(return_code: int)`. In both cases the
+ cleanup pipeline is executed. Same is the case for selecting
+ `a`:abort or `c`:continue when asked (interactive or error).
+
+### Logging / Saving the output
+
+**automagix** offers no own capability to log the output to a log file or
+ save it otherwise.  
+
+If you have _GNU screen_ installed, you may start a screen session with
+ `-L` and optional `-Logfile LOGFILE` in which you start **automagix**.
+ (This is how it works with "parallel processing", see **EXTRAS** section.)
+
+A different approach is to use `tee`, e.g. `automagix [script file + options] 2>&1 | tee auto.log`.
+ Different to the screen approach this seems not to capture your input.
+
+# BEST PRACTISES
+
+There are different ways to start scripting with **automagix**. The
+ author's approach is mainly to consider the process and simply write
+ down, what to do (manual steps for complex or not automated steps)
+ and which commands to use.  
+Then start **automagix** in interactive mode (-i) and adjust the
+ single steps one by one. Replace manual steps, if suitable. Whenever
+ adjustment is needed, abort, adjust and restart **automagix** with
+ jump (-j) to the adjusted step.  
+From **automagix** 1.13.0 on you can use the reload scriptfile feature
+ instead. When asked for options (either because a command failed or
+ you are in interactive mode) you can use **-R** to reload the
+ scriptfile. If lines in the scriptfile have changed, or you need to
+ repeat steps, you can use R+/-$number to reload and adjust the
+ restart point (available since **automagix** 1.14.0). NOTICE: If using
+ vars-file, this reloads the script ONLY the active CSV row!
+
+Repeat this procedure to automate more and more and increase quality,
+ whenever you feel like it.
+
+Consider to put often used paths or code sequences in automagix
+ variables for better readability.  
+Do the same with variable content like URLs, to make it possible to
+ overwrite it by command line options. Where ever possible prefer to
+ use functions to determine already available information, such as BW
+ metadata, instead of defining things explicitly. This will make
+ things easier when using the script with different systems /
+ parameters.
+
+Preferred way of using **automagix** is to put often used and complex
+ algorithms in python libraries and import them. Advantage of this
+ approach is that you can use your  implemented functions multiple
+ times and build up a toolbox of nice functionality over time.
+
+
+# NOTES
+
+**Manual steps** will always cause automagix to stop and wait for
+ user input.
+
+Be careful with **assignments** containing line breaks (echo, ...).
+ Using the variables may lead to unexpected behaviour or errors.
+ From version 1.14.0 on trailing new lines in **assignments**
+ of Shell commands (_local_, _remote@_) are removed.
+
+Assignments containing **null bytes** are currently not supported.
+
+Because the **always** pipeline should not change anything, aborting
+ while running this pipeline will not trigger a cleanup.
+
+If you want to abort the **pipeline** without triggering the
+ **cleanup** pipeline, use CRTL+C.
+
+While **aborting remote functions** automagix is not
+ able to determine still running processes invoked by the function,
+ because it only checks the processes for the commands (in this case
+ the function name) which is called in the pipeline.
+
+User input questions are of following categories:
+- [MS] **M**anual **S**tep
+- [CF] **C**ommand **F**ailed
+- [PF] **P**artial command **F**ailed (BW groups)
+- [RR] **R**emote process still **R**unning
+- [SE] **S**yntax **E**rror
+
+The terminal (T) answer starts an interactive Bash-Shell.
+ Therefore .bashrc is executed, but the command prompt (PS1) is
+ replaced to indicate, that we are still in an automagix process.
+ 
+
+# EXTRAS
+
+## Parallel processing
+Requirement: GNU screen installed and accessible via `screen` command in bash.
+
+This **automagix** version has the option to process multiple **automagix** instances at a time.
+ This is achieved by starting multiple [GNU screen](https://www.gnu.org/software/screen/) sessions.
+ Please make yourself comfortable with the screen controls before using this feature to avoid getting lost.
+
+The main programm stays in a loop while attaching to the screen sessions and you will come back to it
+ if you detach a screen session. The **automagix-manager** runs in its own screen session and is
+ responsible for starting the automagix screens and status updates.
+
+By default the programm starts with 10 parallel automagix instances. Use the main programm loop controls
+ to change the number of allowed parallel sessions (pressing 'm' followed by your desired number).
+
+If you force the programm to terminate (e.g. keyboard interrupt, process kill, ...),
+ check for still running screen processes via `screen -list`. They are independent and may continue
+ running. Cleanup manually, if necessary.
+
+The screens write their output to log files in the specified **logfile_dir** (see **CONFIGURATION** section).
+ These logfiles contain the escape sequences that are used to provide the colored output an the terminal.
+ You can use a pager that supports interpreting these sequences like the terminal to have a similar
+ experience (`more` or `less -r` worked for me).
+
+## Shell completion (experimental)
+Automagix supports shell completion for parameters and the script directory via [argcomplete](https://github.com/kislyuk/argcomplete).
+
+Therefor follow the installation instructions for argcomplete, which is at the current time
+
+    pip install argcomplete
+
+and either global activation via executing
+
+    activate-global-python-argcomplete
+
+or activation for automagix (e.g. in `.bashrc` or `.zshrc`)
+
+    eval "$(register-python-argcomplete automagix)"
+
+Automagix will recognize the installed module and offer the completion automatically.
+
+## Progress bar (experimental)
+You can activate an "apt-like" progress bar based on the amount of commands.
+ There are two types of progress bars *Basic* and *Tqdm*, which can be activated
+ by setting the configuration option `progress_bar` to the corresponding value
+ (config file or environment). "Tqdm" requires additional installation of the tqdm
+ Python library (`pip install tqdm`).
+
+The status on the right displays `[elapsed time<remaining time, rate]`,
+ where rate is percentage/second if fast and second/percentage if slow.
+
+Note, that using commands that heavily modify the terminal behaviour/output
+ (such as `top`, `watch`, `glances`, ...), may lead to a unreadable
+ or undesirable output. It might be a better idea to encourage the user
+ to open a separate terminal and type these commands there.
+
+Using automagix itself as command should work, but may lead to confusing
+ output as well. Note, that the progress bar will be overwritten by the
+ new automagix instance for the duration of the automagix command.