multiSSH3 4.81__py3-none-any.whl → 4.89__py3-none-any.whl

{multiSSH3-4.81.dist-info → multiSSH3-4.89.dist-info}/METADATA

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: multiSSH3
-Version: 4.81
+Version: 4.89
 Summary: Run commands on multiple hosts via SSH
 Home-page: https://github.com/yufei-pan/multiSSH3
 Author: Yufei Pan
@@ -20,12 +20,12 @@ Can be used in bash scripts for automation actions.
 Also able to be imported and / or use with Flexec SSH Backend to perform cluster automation actions.
 
 Install via
-```
+```bash
 pip install multiSSH3
 ```
 
 multiSSH3 will be available as
-```
+```bash
 mssh
 mssh3
 multissh
@@ -37,7 +37,7 @@ multissh will read a config file located at ```/etc/multiSSH3.config.json```
 
 To store / generate a config file with the current command line options, you can use
 
-```
+```bash
 mssh --generate_default_config_file
 ```
 
@@ -49,42 +49,52 @@ If you want to store password, it will be a plain text password in this config f
 
 This option can also be used to store cli options into the config files. For example.
 
-```
+```bash
 mssh --ipmi_interface_ip_prefix 192 --generate_default_config_file
 ```
 will store 
-```
+```json
 "DEFAULT_IPMI_INTERFACE_IP_PREFIX": "192"
 ```
 into the json file.
 
 By defualt reads bash env variables for hostname aliases. Also able to read
-```
+```bash
 DEFAULT_ENV_FILE = '/etc/profile.d/hosts.sh'
 ```
 as hostname aliases.
 
 For example:
-```
+```bash
 export all='192.168.1-2.1-64'
 mssh all 'echo hi'
 ```
 
+Note: you probably want to set presistent ssh connections to speed up each connection events. 
+An example .ssh/config:
+```bash
+Host *
+  StrictHostKeyChecking no
+  ControlMaster auto
+  ControlPath /run/ssh_sockets_%r@%h-%p
+  ControlPersist 3600
+```
+
 It is also able to recognize ip blocks / number blocks / hex blocks / character blocks directly.
 
 For example:
-```
+```bash
 mssh testrig[1-10] lsblk
 mssh ww[a-c],10.100.0.* 'cat /etc/fstab' 'sed -i "/lustre/d' /etc/fstab' 'cat /etc/fstab'
 ```
 
 It also supports interactive inputs. ( and able to async boardcast to all supplied hosts )
-```
+```bash
 mssh www bash
 ```
 
 By default, it will try to fit everything inside your window. 
-```
+```bash
 DEFAULT_CURSES_MINIMUM_CHAR_LEN = 40
 DEFAULT_CURSES_MINIMUM_LINE_LEN = 1
 ```
@@ -93,7 +103,7 @@ While leaving minimum 40 characters / 1 line for each host display by default. Y
 
 Use ```mssh --help``` for more info.
 
-```
+```bash
 usage: mssh [-h] [-u USERNAME] [-ea EXTRAARGS] [-p PASSWORD] [-11] [-f FILE] [--file_sync] [--scp] [-t TIMEOUT] [-r REPEAT] [-i INTERVAL] [--ipmi]
             [-pre INTERFACE_IP_PREFIX] [-q] [-ww WINDOW_WIDTH] [-wh WINDOW_HEIGHT] [-sw] [-eo] [-no] [--no_env] [--env_file ENV_FILE] [-m MAXCONNECTIONS] [-j]
             [--success_hosts] [-g] [-nw] [-su] [-sh SKIPHOSTS] [-V]
@@ -164,8 +174,6 @@ Following document is generated courtesy of Mr.ChatGPT-o1 Preview:
 - [multissh](#multissh)
   - [Table of Contents](#table-of-contents)
   - [Features](#features)
-  - [Installation](#installation)
-  - [Usage](#usage)
     - [Basic Syntax](#basic-syntax)
     - [Command-Line Options](#command-line-options)
   - [Examples](#examples)
@@ -194,36 +202,10 @@ Following document is generated courtesy of Mr.ChatGPT-o1 Preview:
 - **Interactive Mode**: Run interactive commands with curses-based UI for monitoring.
 - **Quiet Mode**: Suppress output for cleaner automation scripts.
 
-## Installation
-
-1. **Clone the Repository**
-
-   ```bash
-   git clone https://github.com/yourusername/multissh.git
-   ```
-
-2. **Navigate to the Directory**
-
-   ```bash
-   cd multissh
-   ```
-
-3. **Make the Script Executable**
-
-   ```bash
-   chmod +x multissh.py
-   ```
-
-4. **Install Dependencies**
-
-   Ensure you have Python 3 and the required modules installed. You may need to install `curses` and `ipaddress` modules if they are not already available.
-
-## Usage
-
 ### Basic Syntax
 
 ```bash
-./multissh.py [options] <hosts> <commands>
+mssh [options] <hosts> <commands>
 ```
 
 - `<hosts>`: Comma-separated list of target hosts. Supports ranges and wildcards.
@@ -267,7 +249,7 @@ Following document is generated courtesy of Mr.ChatGPT-o1 Preview:
 ### Running a Command on Multiple Hosts
 
 ```bash
-./multissh.py "host1,host2,host3" "uptime"
+mssh "host1,host2,host3" "uptime"
 ```
 
 This command runs `uptime` on `host1`, `host2`, and `host3`.
@@ -275,7 +257,7 @@ This command runs `uptime` on `host1`, `host2`, and `host3`.
 ### Copying Files to Multiple Hosts
 
 ```bash
-./multissh.py -f "/path/to/local/file.txt" "host1,host2,host3" "/remote/path/"
+mssh -f "/path/to/local/file.txt" "host1,host2,host3" "/remote/path/"
 ```
 
 This command copies `file.txt` to `/remote/path/` on the specified hosts.
@@ -283,7 +265,7 @@ This command copies `file.txt` to `/remote/path/` on the specified hosts.
 ### Using Hostname Ranges
 
 ```bash
-./multissh.py "host[01-05]" "hostname"
+mssh "host[01-05]" "hostname"
 ```
 
 This expands to `host01`, `host02`, `host03`, `host04`, `host05` and runs `hostname` on each.
@@ -291,7 +273,7 @@ This expands to `host01`, `host02`, `host03`, `host04`, `host05` and runs `hostn
 ### Using IPMI
 
 ```bash
-./multissh.py --ipmi "192.168.1.[100-105]" "chassis power status"
+mssh --ipmi "192.168.1.[100-105]" "chassis power status"
 ```
 
 Runs `ipmitool chassis power status` on the specified IPMI interfaces.
@@ -299,7 +281,7 @@ Runs `ipmitool chassis power status` on the specified IPMI interfaces.
 ### Using Password Authentication
 
 ```bash
-./multissh.py -p "yourpassword" "host1,host2" "whoami"
+mssh -p "yourpassword" "host1,host2" "whoami"
 ```
 
 Uses `sshpass` to provide the password for SSH authentication.
@@ -307,7 +289,7 @@ Uses `sshpass` to provide the password for SSH authentication.
 ### Skipping Unreachable Hosts
 
 ```bash
-./multissh.py -su "host1,host2,host3" "date"
+mssh -su "host1,host2,host3" "date"
 ```
 
 Skips hosts that are unreachable during execution.
@@ -315,7 +297,7 @@ Skips hosts that are unreachable during execution.
 ### JSON Output
 
 ```bash
-./multissh.py -j "host1,host2" "uname -a"
+mssh -j "host1,host2" "uname -a"
 ```
 
 Outputs the results in JSON format, suitable for parsing.
@@ -323,7 +305,7 @@ Outputs the results in JSON format, suitable for parsing.
 ### Quiet Mode
 
 ```bash
-./multissh.py -q "host1,host2" "ls /nonexistent"
+mssh -q "host1,host2" "ls /nonexistent"
 ```
 
 Suppresses all output, useful for scripts where you only care about exit codes.
@@ -335,8 +317,6 @@ Suppresses all output, useful for scripts where you only care about exit codes.
 - Use `--no_env` to prevent loading any environment variables from files.
 
 ## Notes
-
-- **SSH Configuration**: The script modifies `~/.ssh/config` to disable `StrictHostKeyChecking`. Ensure this is acceptable in your environment.
 - **Dependencies**: Requires Python 3, `sshpass` (if using password authentication), and standard Unix utilities like `ssh`, `scp`, and `rsync`.
 - **Signal Handling**: Supports graceful termination with `Ctrl+C`.
 

multiSSH3-4.89.dist-info/RECORD

@@ -0,0 +1,7 @@
+multiSSH3.py,sha256=g_U5Kk6pDABART5Tb4yoViPZ-5fiARpb_8Irvs7f2QA,86990
+multiSSH3-4.89.dist-info/LICENSE,sha256=OXLcl0T2SZ8Pmy2_dmlvKuetivmyPd5m1q-Gyd-zaYY,35149
+multiSSH3-4.89.dist-info/METADATA,sha256=J9K4EyDzcP7Pvj4p779YAkYz7vbDGfQoxz9hmkWRra8,16043
+multiSSH3-4.89.dist-info/WHEEL,sha256=GV9aMThwP_4oNCtvEC2ec3qUYutgWeAzklro_0m4WJQ,91
+multiSSH3-4.89.dist-info/entry_points.txt,sha256=xi2rWWNfmHx6gS8Mmx0rZL2KZz6XWBYP3DWBpWAnnZ0,143
+multiSSH3-4.89.dist-info/top_level.txt,sha256=tUwttxlnpLkZorSsroIprNo41lYSxjd2ASuL8-EJIJw,10
+multiSSH3-4.89.dist-info/RECORD,,

multiSSH3.py

@@ -15,7 +15,9 @@ import io
 import signal
 import functools
 import glob
-#import fnmatch
+import shutil
+import getpass
+
 try:
 	# Check if functiools.cache is available
 	cache_decorator = functools.cache
@@ -27,7 +29,7 @@ except AttributeError:
 		# If neither is available, use a dummy decorator
 		def cache_decorator(func):
 			return func
-version = '4.81'
+version = '4.89'
 VERSION = version
 
 CONFIG_FILE = '/etc/multiSSH3.config.json'	
@@ -81,19 +83,27 @@ __build_in_default_config = {
 	'DEFAULT_GREPPABLE_MODE': False,
 	'DEFAULT_SKIP_UNREACHABLE': False,
 	'DEFAULT_SKIP_HOSTS': '',
+	'SSH_STRICT_HOST_KEY_CHECKING': False,
 	'ERROR_MESSAGES_TO_IGNORE': [
 		'Pseudo-terminal will not be allocated because stdin is not a terminal',
 		'Connection to .* closed',
 		'Warning: Permanently added',
 		'mux_client_request_session',
 		'disabling multiplexing',
+		'Killed by signal',
+		'Connection reset by peer',
 	],
 	'_DEFAULT_CALLED': True,
 	'_DEFAULT_RETURN_UNFINISHED': False,
 	'_DEFAULT_UPDATE_UNREACHABLE_HOSTS': True,
 	'_DEFAULT_NO_START': False,
 	'_etc_hosts': {},
-	'_sshpassAvailable': False,
+	'_sshpassPath': None,
+	'_sshPath': None,
+	'_scpPath': None,
+	'_ipmitoolPath': None,
+	'_rsyncPath': None,
+	'_bashPath': None,
 	'__ERROR_MESSAGES_TO_IGNORE_REGEX':None,
 }
 
@@ -131,6 +141,8 @@ DEFAULT_GREPPABLE_MODE = __configs_from_file.get('DEFAULT_GREPPABLE_MODE', __bui
 DEFAULT_SKIP_UNREACHABLE = __configs_from_file.get('DEFAULT_SKIP_UNREACHABLE', __build_in_default_config['DEFAULT_SKIP_UNREACHABLE'])
 DEFAULT_SKIP_HOSTS = __configs_from_file.get('DEFAULT_SKIP_HOSTS', __build_in_default_config['DEFAULT_SKIP_HOSTS'])
 
+SSH_STRICT_HOST_KEY_CHECKING = __configs_from_file.get('SSH_STRICT_HOST_KEY_CHECKING', __build_in_default_config['SSH_STRICT_HOST_KEY_CHECKING'])
+
 ERROR_MESSAGES_TO_IGNORE = __configs_from_file.get('ERROR_MESSAGES_TO_IGNORE', __build_in_default_config['ERROR_MESSAGES_TO_IGNORE'])
 
 _DEFAULT_CALLED = __configs_from_file.get('_DEFAULT_CALLED', __build_in_default_config['_DEFAULT_CALLED'])
@@ -139,7 +151,8 @@ _DEFAULT_UPDATE_UNREACHABLE_HOSTS = __configs_from_file.get('_DEFAULT_UPDATE_UNR
 _DEFAULT_NO_START = __configs_from_file.get('_DEFAULT_NO_START', __build_in_default_config['_DEFAULT_NO_START'])
 
 # form the regex from the list
-if '__ERROR_MESSAGES_TO_IGNORE_REGEX' in __configs_from_file:
+__ERROR_MESSAGES_TO_IGNORE_REGEX = __configs_from_file.get('__ERROR_MESSAGES_TO_IGNORE_REGEX', __build_in_default_config['__ERROR_MESSAGES_TO_IGNORE_REGEX'])
+if __ERROR_MESSAGES_TO_IGNORE_REGEX:
 	print('Using __ERROR_MESSAGES_TO_IGNORE_REGEX from config file, ignoring ERROR_MESSAGES_TO_IGNORE')
 	__ERROR_MESSAGES_TO_IGNORE_REGEX = re.compile(__configs_from_file['__ERROR_MESSAGES_TO_IGNORE_REGEX'])
 else:
@@ -152,7 +165,7 @@ __global_suppress_printout = True
 __mainReturnCode = 0
 __failedHosts = set()
 class Host:
-	def __init__(self, name, command, files = None,ipmi = False,interface_ip_prefix = None,scp=False,extraargs=None):
+	def __init__(self, name, command, files = None,ipmi = False,interface_ip_prefix = None,scp=False,extraargs=None,gatherMode=False):
 		self.name = name # the name of the host (hostname or IP address)
 		self.command = command # the command to run on the host
 		self.returncode = None # the return code of the command
@@ -164,19 +177,24 @@ class Host:
 		self.ipmi = ipmi # whether to use ipmi to connect to the host
 		self.interface_ip_prefix = interface_ip_prefix # the prefix of the ip address of the interface to be used to connect to the host
 		self.scp = scp # whether to use scp to copy files to the host
+		self.gatherMode = gatherMode # whether the host is in gather mode
 		self.extraargs = extraargs # extra arguments to be passed to ssh
 		self.resolvedName = None # the resolved IP address of the host
 	def __iter__(self):
 		return zip(['name', 'command', 'returncode', 'stdout', 'stderr'], [self.name, self.command, self.returncode, self.stdout, self.stderr])
 	def __repr__(self):
 		# return the complete data structure
-		return f"Host(name={self.name}, command={self.command}, returncode={self.returncode}, stdout={self.stdout}, stderr={self.stderr}, output={self.output}, printedLines={self.printedLines}, files={self.files}, ipmi={self.ipmi}, interface_ip_prefix={self.interface_ip_prefix}, scp={self.scp}, extraargs={self.extraargs}, resolvedName={self.resolvedName})"
+		return f"Host(name={self.name}, command={self.command}, returncode={self.returncode}, stdout={self.stdout}, stderr={self.stderr}, output={self.output}, printedLines={self.printedLines}, files={self.files}, ipmi={self.ipmi}, interface_ip_prefix={self.interface_ip_prefix}, scp={self.scp}, gatherMode={self.gatherMode}, extraargs={self.extraargs}, resolvedName={self.resolvedName})"
 	def __str__(self):
 		return f"Host(name={self.name}, command={self.command}, returncode={self.returncode}, stdout={self.stdout}, stderr={self.stderr})"
 
 __wildCharacters = ['*','?','x']
 
-__gloablUnavailableHosts = set()
+_no_env = DEFAULT_NO_ENV
+
+_env_file = DEFAULT_ENV_FILE
+
+__globalUnavailableHosts = set()
 
 __ipmiiInterfaceIPPrefix = DEFAULT_IPMI_INTERFACE_IP_PREFIX
 
@@ -186,15 +204,26 @@ _emo = False
 
 _etc_hosts = __configs_from_file.get('_etc_hosts', __build_in_default_config['_etc_hosts'])
 
-_env_file = DEFAULT_ENV_FILE
 
 # check if command sshpass is available
-_sshpassAvailable = __configs_from_file.get('_sshpassAvailable', __build_in_default_config['_sshpassAvailable'])
-try:
-	subprocess.run(['which', 'sshpass'], stdout=subprocess.PIPE, stderr=subprocess.PIPE, check=True)
-	_sshpassAvailable = True
-except:
-	pass
+_binPaths = {}
+def check_path(program_name):
+	global __configs_from_file
+	global __build_in_default_config
+	global _binPaths
+	config_key = f'_{program_name}Path'
+	program_path = (
+		__configs_from_file.get(config_key) or
+		__build_in_default_config.get(config_key) or
+		shutil.which(program_name)
+	)
+	if program_path:
+		_binPaths[program_name] = program_path
+		return True
+	return False
+
+[check_path(program) for program in ['sshpass', 'ssh', 'scp', 'ipmitool','rsync','bash']]
+
 
 
 @cache_decorator
@@ -242,37 +271,6 @@ def expandIPv4Address(hosts):
 	expandedHosts.extend(expandedHost)
 	return expandedHosts
 
-@cache_decorator
-def readEnvFromFile(environemnt_file = ''):
-	'''
-	Read the environment variables from env_file
-	Returns:
-		dict: A dictionary of environment variables
-	'''
-	global env
-	try:
-		if env:
-			return env
-	except:
-		env = {}
-	global _env_file
-	if environemnt_file:
-		envf = environemnt_file
-	else:
-		envf = _env_file if _env_file else DEFAULT_ENV_FILE
-	if os.path.exists(envf):
-		with open(envf,'r') as f:
-			for line in f:
-				if line.startswith('#') or not line.strip():
-					continue
-				key, value = line.replace('export ', '', 1).strip().split('=', 1)
-				key = key.strip().strip('"').strip("'")
-				value = value.strip().strip('"').strip("'")
-				# avoid infinite recursion
-				if key != value:
-					env[key] = value.strip('"').strip("'")
-	return env
-
 @cache_decorator
 def getIP(hostname,local=False):
 	'''
@@ -313,9 +311,40 @@ def getIP(hostname,local=False):
 		return socket.gethostbyname(hostname)
 	except:
 		return None
+	
+@cache_decorator
+def readEnvFromFile(environemnt_file = ''):
+	'''
+	Read the environment variables from env_file
+	Returns:
+		dict: A dictionary of environment variables
+	'''
+	global env
+	try:
+		if env:
+			return env
+	except:
+		env = {}
+	global _env_file
+	if environemnt_file:
+		envf = environemnt_file
+	else:
+		envf = _env_file if _env_file else DEFAULT_ENV_FILE
+	if os.path.exists(envf):
+		with open(envf,'r') as f:
+			for line in f:
+				if line.startswith('#') or not line.strip():
+					continue
+				key, value = line.replace('export ', '', 1).strip().split('=', 1)
+				key = key.strip().strip('"').strip("'")
+				value = value.strip().strip('"').strip("'")
+				# avoid infinite recursion
+				if key != value:
+					env[key] = value.strip('"').strip("'")
+	return env
 
 @cache_decorator 
-def expand_hostname(text,validate=True,no_env=False):
+def expand_hostname(text,validate=True):
 	'''
 	Expand the hostname range in the text.
 	Will search the string for a range ( [] encloused and non enclosed number ranges).
@@ -336,12 +365,12 @@ def expand_hostname(text,validate=True,no_env=False):
 		hostname = expandinghosts.pop()
 		match = re.search(r'\[(.*?-.*?)\]', hostname)
 		if not match:
-			expandedhosts.update(validate_expand_hostname(hostname,no_env=no_env) if validate else [hostname])
+			expandedhosts.update(validate_expand_hostname(hostname) if validate else [hostname])
 			continue
 		try:
 			range_start, range_end = match.group(1).split('-')
 		except ValueError:
-			expandedhosts.update(validate_expand_hostname(hostname,no_env=no_env) if validate else [hostname])
+			expandedhosts.update(validate_expand_hostname(hostname) if validate else [hostname])
 			continue
 		range_start = range_start.strip()
 		range_end = range_end.strip()
@@ -353,7 +382,7 @@ def expand_hostname(text,validate=True,no_env=False):
 			elif range_start.isalpha() and range_start.isupper():
 				range_end = 'Z'
 			else:
-				expandedhosts.update(validate_expand_hostname(hostname,no_env=no_env) if validate else [hostname])
+				expandedhosts.update(validate_expand_hostname(hostname) if validate else [hostname])
 				continue
 		if not range_start:
 			if range_end.isdigit():
@@ -363,7 +392,7 @@ def expand_hostname(text,validate=True,no_env=False):
 			elif range_end.isalpha() and range_end.isupper():
 				range_start = 'A'
 			else:
-				expandedhosts.update(validate_expand_hostname(hostname,no_env=no_env) if validate else [hostname])
+				expandedhosts.update(validate_expand_hostname(hostname) if validate else [hostname])
 				continue
 		if range_start.isdigit() and range_end.isdigit():
 			padding_length = min(len(range_start), len(range_end))
@@ -373,14 +402,14 @@ def expand_hostname(text,validate=True,no_env=False):
 				if '[' in hostname:
 					expandinghosts.append(hostname.replace(match.group(0), formatted_i, 1))
 				else:
-					expandedhosts.update(validate_expand_hostname(hostname.replace(match.group(0), formatted_i, 1),no_env=no_env) if validate else [hostname])
+					expandedhosts.update(validate_expand_hostname(hostname.replace(match.group(0), formatted_i, 1)) if validate else [hostname])
 		else:
 			if all(c in string.hexdigits for c in range_start + range_end):
 				for i in range(int(range_start, 16), int(range_end, 16)+1):
 					if '[' in hostname:
 						expandinghosts.append(hostname.replace(match.group(0), format(i, 'x'), 1))
 					else:
-						expandedhosts.update(validate_expand_hostname(hostname.replace(match.group(0), format(i, 'x'), 1),no_env=no_env) if validate else [hostname])
+						expandedhosts.update(validate_expand_hostname(hostname.replace(match.group(0), format(i, 'x'), 1)) if validate else [hostname])
 			else:
 				try:
 					start_index = alphanumeric.index(range_start)
@@ -389,13 +418,13 @@ def expand_hostname(text,validate=True,no_env=False):
 						if '[' in hostname:
 							expandinghosts.append(hostname.replace(match.group(0), alphanumeric[i], 1))
 						else:
-							expandedhosts.update(validate_expand_hostname(hostname.replace(match.group(0), alphanumeric[i], 1),no_env=no_env) if validate else [hostname])
+							expandedhosts.update(validate_expand_hostname(hostname.replace(match.group(0), alphanumeric[i], 1)) if validate else [hostname])
 				except ValueError:
-					expandedhosts.update(validate_expand_hostname(hostname,no_env=no_env) if validate else [hostname])
+					expandedhosts.update(validate_expand_hostname(hostname) if validate else [hostname])
 	return expandedhosts
 
 @cache_decorator
-def expand_hostnames(hosts,no_env=False):
+def expand_hostnames(hosts):
 	'''
 	Expand the hostnames in the hosts list
 
@@ -424,17 +453,17 @@ def expand_hostnames(hosts,no_env=False):
 		if re.match(r'^((((25[0-4]|2[0-4][0-9]|1[0-9][0-9]|[1-9][0-9]|[1-9])|x|\*|\?)(-((25[0-4]|2[0-4][0-9]|1[0-9][0-9]|[1-9][0-9]|[1-9])|x|\*|\?))?)|(\[((25[0-4]|2[0-4][0-9]|1[0-9][0-9]|[1-9][0-9]|[1-9])|x|\*|\?)(-((25[0-4]|2[0-4][0-9]|1[0-9][0-9]|[1-9][0-9]|[1-9])}|x|\*|\?))?\]))(\.((((25[0-5]|2[0-4][0-9]|1[0-9][0-9]|[1-9]?[0-9])|x|\*|\?)(-((25[0-5]|2[0-4][0-9]|1[0-9][0-9]|[1-9]?[0-9])|x|\*|\?))?)|(\[((25[0-5]|2[0-4][0-9]|1[0-9][0-9]|[1-9]?[0-9])|x|\*|\?)(-((25[0-5]|2[0-4][0-9]|1[0-9][0-9]|[1-9]?[0-9])|x|\*|\?))?\]))){2}(\.(((25[0-4]|2[0-4][0-9]|1[0-9][0-9]|[1-9][0-9]|[1-9])|x|\*|\?)(-((25[0-4]|2[0-4][0-9]|1[0-9][0-9]|[1-9][0-9]|[1-9])|x|\*|\?))?)|(\[((25[0-4]|2[0-4][0-9]|1[0-9][0-9]|[1-9][0-9]|[1-9])|x|\*|\?)(-((25[0-4]|2[0-4][0-9]|1[0-9][0-9]|[1-9][0-9]|[1-9])}|x|\*|\?))?\]))$', host):
 			hostSetToAdd = sorted(expandIPv4Address(frozenset([host])),key=ipaddress.IPv4Address)
 		else:
-			hostSetToAdd = sorted(expand_hostname(host,no_env=no_env))
+			hostSetToAdd = sorted(expand_hostname(host))
 		if username:
 			# we expand the username
-			username = sorted(expand_hostname(username,validate=False,no_env=no_env))
+			username = sorted(expand_hostname(username,validate=False))
 			# we combine the username and hostname
 			hostSetToAdd = [u+'@'+h for u,h in product(username,hostSetToAdd)]
 		expandedhosts.extend(hostSetToAdd)
 	return expandedhosts
 
 @cache_decorator
-def validate_expand_hostname(hostname,no_env=False):
+def validate_expand_hostname(hostname):
 	'''
 	Validate the hostname and expand it if it is a range of IP addresses
 
@@ -444,17 +473,18 @@ def validate_expand_hostname(hostname,no_env=False):
 	Returns:
 		list: A list of valid hostnames
 	'''
+	global _no_env
 	# maybe it is just defined in ./target_files/hosts.sh and exported to the environment
 	# we will try to get the valid host name from the environment
 	hostname = hostname.strip('$')
 	if getIP(hostname,local=True):
 		return [hostname]
-	elif not no_env and hostname in os.environ:
+	elif not _no_env and hostname in os.environ:
 		# we will expand these hostnames again
-		return expand_hostnames(frozenset(os.environ[hostname].split(',')),no_env=no_env)
+		return expand_hostnames(frozenset(os.environ[hostname].split(',')))
 	elif hostname in readEnvFromFile():
 		# we will expand these hostnames again
-		return expand_hostnames(frozenset(readEnvFromFile()[hostname].split(',')),no_env=no_env)
+		return expand_hostnames(frozenset(readEnvFromFile()[hostname].split(',')))
 	elif getIP(hostname,local=False):
 		return [hostname]
 	else:
@@ -582,64 +612,129 @@ def ssh_command(host, sem, timeout=60,passwds=None):
 	global _emo
 	global __ERROR_MESSAGES_TO_IGNORE_REGEX
 	global __ipmiiInterfaceIPPrefix
-	global _sshpassAvailable
-	with sem:
-		try:
-			host.username = None
-			host.address = host.name
-			if '@' in host.name:
-				host.username, host.address = host.name.rsplit('@',1)
-			if "#HOST#" in host.command.upper() or "#HOSTNAME#" in host.command.upper():
-				host.command = host.command.replace("#HOST#",host.address).replace("#HOSTNAME#",host.address).replace("#host#",host.address).replace("#hostname#",host.address)
-			if "#USER#" in host.command.upper() or "#USERNAME#" in host.command.upper():
-				if host.username:
-					host.command = host.command.replace("#USER#",host.username).replace("#USERNAME#",host.username).replace("#user#",host.username).replace("#username#",host.username)
-				else:
-					host.command = host.command.replace("#USER#",'CURRENT_USER').replace("#USERNAME#",'CURRENT_USER').replace("#user#",'CURRENT_USER').replace("#username#",'CURRENT_USER')
-			formatedCMD = []
-			if host.extraargs:
-				extraargs = host.extraargs.split()
-			else:
-				extraargs = []
-			if __ipmiiInterfaceIPPrefix:
-				host.interface_ip_prefix = __ipmiiInterfaceIPPrefix if host.ipmi and not host.interface_ip_prefix else host.interface_ip_prefix
-			if host.interface_ip_prefix:
-				try:
-					hostOctets = getIP(host.address,local=False).split('.')
-					prefixOctets = host.interface_ip_prefix.split('.')
-					host.address = '.'.join(prefixOctets[:3]+hostOctets[min(3,len(prefixOctets)):])
-					host.resolvedName = host.username + '@' if host.username else ''
-					host.resolvedName += host.address
-				except:
-					host.resolvedName = host.name
+	global _binPaths
+	try:
+		keyCheckArgs = []
+		rsyncKeyCheckArgs = []
+		if not SSH_STRICT_HOST_KEY_CHECKING:
+			keyCheckArgs = ['-o StrictHostKeyChecking=no','-o UserKnownHostsFile=/dev/null']
+			rsyncKeyCheckArgs = ['--rsh','ssh -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null']
+		host.username = None
+		host.address = host.name
+		if '@' in host.name:
+			host.username, host.address = host.name.rsplit('@',1)
+		if "#HOST#" in host.command.upper() or "#HOSTNAME#" in host.command.upper():
+			host.command = host.command.replace("#HOST#",host.address).replace("#HOSTNAME#",host.address).replace("#host#",host.address).replace("#hostname#",host.address)
+		if "#USER#" in host.command.upper() or "#USERNAME#" in host.command.upper():
+			if host.username:
+				host.command = host.command.replace("#USER#",host.username).replace("#USERNAME#",host.username).replace("#user#",host.username).replace("#username#",host.username)
 			else:
+				current_user = getpass.getuser()
+				host.command = host.command.replace("#USER#",current_user).replace("#USERNAME#",current_user).replace("#user#",current_user).replace("#username#",current_user)
+		formatedCMD = []
+		if host.extraargs and type(host.extraargs) == str:
+			extraargs = host.extraargs.split()
+		elif host.extraargs and type(host.extraargs) == list:
+			extraargs = [str(arg) for arg in host.extraargs]
+		else:
+			extraargs = []
+		if __ipmiiInterfaceIPPrefix:
+			host.interface_ip_prefix = __ipmiiInterfaceIPPrefix if host.ipmi and not host.interface_ip_prefix else host.interface_ip_prefix
+		if host.interface_ip_prefix:
+			try:
+				hostOctets = getIP(host.address,local=False).split('.')
+				prefixOctets = host.interface_ip_prefix.split('.')
+				host.address = '.'.join(prefixOctets[:3]+hostOctets[min(3,len(prefixOctets)):])
+				host.resolvedName = host.username + '@' if host.username else ''
+				host.resolvedName += host.address
+			except:
 				host.resolvedName = host.name
-			if host.ipmi:
+		else:
+			host.resolvedName = host.name
+		if host.ipmi:
+			if 'ipmitool' in _binPaths:
 				if host.command.startswith('ipmitool '):
 					host.command = host.command.replace('ipmitool ','')
+				elif host.command.startswith(_binPaths['ipmitool']):
+					host.command = host.command.replace(_binPaths['ipmitool'],'')
 				if not host.username:
 					host.username = 'admin'
-				if passwds:
-					formatedCMD = ['bash','-c',f'ipmitool -H {host.address} -U {host.username} -P {passwds} {" ".join(extraargs)} {host.command}']
+				if 'bash' in _binPaths:
+					if passwds:
+						formatedCMD = [_binPaths['bash'],'-c',f'ipmitool -H {host.address} -U {host.username} -P {passwds} {" ".join(extraargs)} {host.command}']
+					else:
+						formatedCMD = [_binPaths['bash'],'-c',f'ipmitool -H {host.address} -U {host.username} {" ".join(extraargs)} {host.command}']
 				else:
-					formatedCMD = ['bash','-c',f'ipmitool -H {host.address} -U {host.username} {" ".join(extraargs)} {host.command}']
+					if passwds:
+						formatedCMD = [_binPaths['ipmitool'],f'-H {host.address}',f'-U {host.username}',f'-P {passwds}'] + extraargs + [host.command]
+					else:
+						formatedCMD = [_binPaths['ipmitool'],f'-H {host.address}',f'-U {host.username}'] + extraargs + [host.command]
+			elif 'ssh' in _binPaths:
+				host.output.append('Ipmitool not found on the local machine! Trying ipmitool on the remote machine...')
+				host.ipmi = False
+				host.interface_ip_prefix = None
+				host.command = 'ipmitool '+host.command if not host.command.startswith('ipmitool ') else host.command
+				ssh_command(host,sem,timeout,passwds)
+				return
 			else:
-				if host.files:
-					if host.scp:
-						formatedCMD = ['scp','-rpB'] + extraargs +['--']+host.files+[f'{host.resolvedName}:{host.command}']
+				host.output.append('Ipmitool not found on the local machine! Please install ipmitool to use ipmi mode.')
+				host.stderr.append('Ipmitool not found on the local machine! Please install ipmitool to use ipmi mode.')
+				host.returncode = 1
+				return
+		else:
+			if host.files:
+				if host.scp:
+					if 'scp' in _binPaths:
+						useScp = True
+					elif 'rsync' in _binPaths:
+						host.output.append('scp not found on the local machine! Trying to use rsync...')
+						useScp = False
 					else:
-						formatedCMD = ['rsync','-ahlX','--partial','--inplace', '--info=name'] + extraargs +['--']+host.files+[f'{host.resolvedName}:{host.command}']	
+						host.output.append('scp not found on the local machine! Please install scp or rsync to use file sync mode.')
+						host.stderr.append('scp not found on the local machine! Please install scp or rsync to use file sync mode.')
+						host.returncode = 1
+						return
+				elif 'rsync' in _binPaths:
+					useScp = False
+				elif 'scp' in _binPaths:
+					host.output.append('rsync not found on the local machine! Trying to use scp...')
+					useScp = True
 				else:
-					formatedCMD = ['ssh'] + extraargs +['--']+ [host.resolvedName, host.command]
-				if passwds and _sshpassAvailable:
-					formatedCMD = ['sshpass', '-p', passwds] + formatedCMD
-				elif passwds:
-					host.output.append('Warning: sshpass is not available. Please install sshpass to use password authentication.')
-					#host.stderr.append('Warning: sshpass is not available. Please install sshpass to use password authentication.')
-					host.output.append('Please provide password via live input or use ssh key authentication.')
-					# # try to send the password via __keyPressesIn
-					# __keyPressesIn[-1] = list(passwds) + ['\n']
-					# __keyPressesIn.append([])
+					host.output.append('rsync not found on the local machine! Please install rsync or scp to use file sync mode.')
+					host.stderr.append('rsync not found on the local machine! Please install rsync or scp to use file sync mode.')
+					host.returncode = 1
+					return
+				if host.gatherMode:
+					fileArgs = [f'{host.resolvedName}:{file}' for file in host.files] + [host.command]
+				else:
+					fileArgs = host.files + [f'{host.resolvedName}:{host.command}']
+				if useScp:
+					formatedCMD = [_binPaths['scp'],'-rpB'] + keyCheckArgs + extraargs +['--']+fileArgs
+				else:
+					formatedCMD = [_binPaths['rsync'],'-ahlX','--partial','--inplace', '--info=name'] + rsyncKeyCheckArgs + extraargs +['--']+fileArgs	
+			else:
+				formatedCMD = [_binPaths['ssh']] + keyCheckArgs + extraargs +['--']+ [host.resolvedName, host.command]
+			if passwds and 'sshpass' in _binPaths:
+				formatedCMD = [_binPaths['sshpass'], '-p', passwds] + formatedCMD
+			elif passwds:
+				host.output.append('Warning: sshpass is not available. Please install sshpass to use password authentication.')
+				#host.stderr.append('Warning: sshpass is not available. Please install sshpass to use password authentication.')
+				host.output.append('Please provide password via live input or use ssh key authentication.')
+				# # try to send the password via __keyPressesIn
+				# __keyPressesIn[-1] = list(passwds) + ['\n']
+				# __keyPressesIn.append([])
+	except Exception as e:
+		import traceback
+		host.output.append(f'Error occurred while formatting the command : {host.command}!')
+		host.stderr.append(f'Error occurred while formatting the command : {host.command}!')
+		host.stderr.extend(str(e).split('\n'))
+		host.output.extend(str(e).split('\n'))
+		host.stderr.extend(traceback.format_exc().split('\n'))
+		host.output.extend(traceback.format_exc().split('\n'))
+		host.returncode = -1
+		return
+	with sem:
+		try:
 			host.output.append('Running command: '+' '.join(formatedCMD))
 			#host.stdout = []
 			proc = subprocess.Popen(formatedCMD,stdout=subprocess.PIPE,stderr=subprocess.PIPE,stdin=subprocess.PIPE)
@@ -733,7 +828,7 @@ def ssh_command(host, sem, timeout=60,passwds=None):
 		host.command = 'ipmitool '+host.command if not host.command.startswith('ipmitool ') else host.command
 		ssh_command(host,sem,timeout,passwds)
 	# If transfering files, we will try again using scp if rsync connection is not successful
-	if host.files and not host.scp and host.returncode != 0 and host.stderr:
+	if host.files and not host.scp and not useScp and host.returncode != 0 and host.stderr:
 		host.stderr = []
 		host.stdout = []
 		host.output.append('Rsync connection failed! Trying SCP connection...')
@@ -1143,34 +1238,34 @@ def print_output(hosts,usejson = False,quiet = False,greppable = False):
 		print(rtnStr)
 	return rtnStr
 
-sshConfigged = False
-def verify_ssh_config():
-	'''
-	Verify that ~/.ssh/config exists and contains the line "StrictHostKeyChecking no"
-
-	Args:
-		None
-
-	Returns:
-		None
-	'''
-	global sshConfigged
-	if not sshConfigged:
-		# first we make sure ~/.ssh/config exists
-		config = ''
-		if not os.path.exists(os.path.expanduser('~/.ssh')):
-			os.makedirs(os.path.expanduser('~/.ssh'))
-		if os.path.exists(os.path.expanduser('~/.ssh/config')):
-			with open(os.path.expanduser('~/.ssh/config'),'r') as f:
-				config = f.read()
-		if config:
-			if 'StrictHostKeyChecking no' not in config:
-				with open(os.path.expanduser('~/.ssh/config'),'a') as f:
-					f.write('\nHost *\n\tStrictHostKeyChecking no\n')
-		else:
-			with open(os.path.expanduser('~/.ssh/config'),'w') as f:
-				f.write('Host *\n\tStrictHostKeyChecking no\n')
-		sshConfigged = True
+# sshConfigged = False
+# def verify_ssh_config():
+# 	'''
+# 	Verify that ~/.ssh/config exists and contains the line "StrictHostKeyChecking no"
+
+# 	Args:
+# 		None
+
+# 	Returns:
+# 		None
+# 	'''
+# 	global sshConfigged
+# 	if not sshConfigged:
+# 		# first we make sure ~/.ssh/config exists
+# 		config = ''
+# 		if not os.path.exists(os.path.expanduser('~/.ssh')):
+# 			os.makedirs(os.path.expanduser('~/.ssh'))
+# 		if os.path.exists(os.path.expanduser('~/.ssh/config')):
+# 			with open(os.path.expanduser('~/.ssh/config'),'r') as f:
+# 				config = f.read()
+# 		if config:
+# 			if 'StrictHostKeyChecking no' not in config:
+# 				with open(os.path.expanduser('~/.ssh/config'),'a') as f:
+# 					f.write('\nHost *\n\tStrictHostKeyChecking no\n')
+# 		else:
+# 			with open(os.path.expanduser('~/.ssh/config'),'w') as f:
+# 				f.write('Host *\n\tStrictHostKeyChecking no\n')
+# 		sshConfigged = True
 
 def signal_handler(sig, frame):
 	'''
@@ -1194,9 +1289,9 @@ def signal_handler(sig, frame):
 		os.system(f'pkill -ef {os.path.basename(__file__)}')
 		sys.exit(0)
 
-
 def processRunOnHosts(timeout, password, max_connections, hosts, returnUnfinished, nowatch, json, called, greppable,unavailableHosts,willUpdateUnreachableHosts,curses_min_char_len = DEFAULT_CURSES_MINIMUM_CHAR_LEN, curses_min_line_len = DEFAULT_CURSES_MINIMUM_LINE_LEN,single_window = DEFAULT_SINGLE_WINDOW):
-	global __gloablUnavailableHosts
+	global __globalUnavailableHosts
+	global _no_env
 	threads = start_run_on_hosts(hosts, timeout=timeout,password=password,max_connections=max_connections)
 	if not nowatch and threads and not returnUnfinished and any([thread.is_alive() for thread in threads]) and sys.stdout.isatty() and os.get_terminal_size() and os.get_terminal_size().columns > 10:
 		curses.wrapper(curses_print, hosts, threads, min_char_len = curses_min_char_len, min_line_len = curses_min_line_len, single_window = single_window)
@@ -1209,7 +1304,11 @@ def processRunOnHosts(timeout, password, max_connections, hosts, returnUnfinishe
 	# update the unavailable hosts and global unavailable hosts
 	if willUpdateUnreachableHosts:
 		unavailableHosts.update([host.name for host in hosts if host.stderr and ('No route to host' in host.stderr[0].strip() or host.stderr[0].strip().startswith('Timeout!'))])
-		__gloablUnavailableHosts.update(unavailableHosts)
+		__globalUnavailableHosts.update(unavailableHosts)
+		# update the os environment variable if not _no_env
+		if not _no_env:
+			os.environ['__multiSSH3_UNAVAILABLE_HOSTS'] = ','.join(unavailableHosts)
+
 	# print the output, if the output of multiple hosts are the same, we aggragate them
 	if not called:
 		print_output(hosts,json,greppable=greppable)
@@ -1242,7 +1341,7 @@ def formHostStr(host) -> str:
 def __formCommandArgStr(oneonone = DEFAULT_ONE_ON_ONE, timeout = DEFAULT_TIMEOUT,password = DEFAULT_PASSWORD,
 						 nowatch = DEFAULT_NO_WATCH,json = DEFAULT_JSON_MODE,max_connections=DEFAULT_MAX_CONNECTIONS,
 						 files = None,ipmi = DEFAULT_IPMI,interface_ip_prefix = DEFAULT_INTERFACE_IP_PREFIX,
-						 scp=DEFAULT_SCP,username=DEFAULT_USERNAME,extraargs=DEFAULT_EXTRA_ARGS,skipUnreachable=DEFAULT_SKIP_UNREACHABLE,
+						 scp=DEFAULT_SCP,gather_mode = False,username=DEFAULT_USERNAME,extraargs=DEFAULT_EXTRA_ARGS,skipUnreachable=DEFAULT_SKIP_UNREACHABLE,
 						 no_env=DEFAULT_NO_ENV,greppable=DEFAULT_GREPPABLE_MODE,skip_hosts = DEFAULT_SKIP_HOSTS,
 						 file_sync = False, error_only = DEFAULT_ERROR_ONLY,
 						 shortend = False) -> str:
@@ -1257,6 +1356,7 @@ def __formCommandArgStr(oneonone = DEFAULT_ONE_ON_ONE, timeout = DEFAULT_TIMEOUT
 	if ipmi: argsList.append('--ipmi')
 	if interface_ip_prefix and interface_ip_prefix != DEFAULT_INTERFACE_IP_PREFIX: argsList.append(f'--interface_ip_prefix="{interface_ip_prefix}"' if not shortend else f'-pre="{interface_ip_prefix}"')
 	if scp: argsList.append('--scp')
+	if gather_mode: argsList.append('--gather_mode' if not shortend else '-gm')
 	if username and username != DEFAULT_USERNAME: argsList.append(f'--username="{username}"' if not shortend else f'-u="{username}"')
 	if extraargs and extraargs != DEFAULT_EXTRA_ARGS: argsList.append(f'--extraargs="{extraargs}"' if not shortend else f'-ea="{extraargs}"')
 	if skipUnreachable: argsList.append('--skipUnreachable' if not shortend else '-su')
@@ -1270,7 +1370,7 @@ def __formCommandArgStr(oneonone = DEFAULT_ONE_ON_ONE, timeout = DEFAULT_TIMEOUT
 def getStrCommand(hosts = DEFAULT_HOSTS,commands = None,oneonone = DEFAULT_ONE_ON_ONE, timeout = DEFAULT_TIMEOUT,password = DEFAULT_PASSWORD,
 						 nowatch = DEFAULT_NO_WATCH,json = DEFAULT_JSON_MODE,called = _DEFAULT_CALLED,max_connections=DEFAULT_MAX_CONNECTIONS,
 						 files = None,ipmi = DEFAULT_IPMI,interface_ip_prefix = DEFAULT_INTERFACE_IP_PREFIX,returnUnfinished = _DEFAULT_RETURN_UNFINISHED,
-						 scp=DEFAULT_SCP,username=DEFAULT_USERNAME,extraargs=DEFAULT_EXTRA_ARGS,skipUnreachable=DEFAULT_SKIP_UNREACHABLE,
+						 scp=DEFAULT_SCP,gather_mode = False,username=DEFAULT_USERNAME,extraargs=DEFAULT_EXTRA_ARGS,skipUnreachable=DEFAULT_SKIP_UNREACHABLE,
 						 no_env=DEFAULT_NO_ENV,greppable=DEFAULT_GREPPABLE_MODE,willUpdateUnreachableHosts=_DEFAULT_UPDATE_UNREACHABLE_HOSTS,no_start=_DEFAULT_NO_START,
 						 skip_hosts = DEFAULT_SKIP_HOSTS, curses_min_char_len = DEFAULT_CURSES_MINIMUM_CHAR_LEN, curses_min_line_len = DEFAULT_CURSES_MINIMUM_LINE_LEN,
 						 single_window = DEFAULT_SINGLE_WINDOW,file_sync = False,error_only = DEFAULT_ERROR_ONLY, shortend = False):
@@ -1279,7 +1379,7 @@ def getStrCommand(hosts = DEFAULT_HOSTS,commands = None,oneonone = DEFAULT_ONE_O
 	files = frozenset(files) if files else None
 	argsStr = __formCommandArgStr(oneonone = oneonone, timeout = timeout,password = password,
 						 nowatch = nowatch,json = json,max_connections=max_connections,
-						 files = files,ipmi = ipmi,interface_ip_prefix = interface_ip_prefix,scp=scp,
+						 files = files,ipmi = ipmi,interface_ip_prefix = interface_ip_prefix,scp=scp,gather_mode = gather_mode,
 						 username=username,extraargs=extraargs,skipUnreachable=skipUnreachable,no_env=no_env,
 						 greppable=greppable,skip_hosts = skip_hosts, file_sync = file_sync,error_only = error_only, shortend = shortend)
 	commandStr = '"' + '" "'.join(commands) + '"' if commands else ''
@@ -1288,7 +1388,7 @@ def getStrCommand(hosts = DEFAULT_HOSTS,commands = None,oneonone = DEFAULT_ONE_O
 def run_command_on_hosts(hosts = DEFAULT_HOSTS,commands = None,oneonone = DEFAULT_ONE_ON_ONE, timeout = DEFAULT_TIMEOUT,password = DEFAULT_PASSWORD,
 						 nowatch = DEFAULT_NO_WATCH,json = DEFAULT_JSON_MODE,called = _DEFAULT_CALLED,max_connections=DEFAULT_MAX_CONNECTIONS,
 						 files = None,ipmi = DEFAULT_IPMI,interface_ip_prefix = DEFAULT_INTERFACE_IP_PREFIX,returnUnfinished = _DEFAULT_RETURN_UNFINISHED,
-						 scp=DEFAULT_SCP,username=DEFAULT_USERNAME,extraargs=DEFAULT_EXTRA_ARGS,skipUnreachable=DEFAULT_SKIP_UNREACHABLE,
+						 scp=DEFAULT_SCP,gather_mode = False,username=DEFAULT_USERNAME,extraargs=DEFAULT_EXTRA_ARGS,skipUnreachable=DEFAULT_SKIP_UNREACHABLE,
 						 no_env=DEFAULT_NO_ENV,greppable=DEFAULT_GREPPABLE_MODE,willUpdateUnreachableHosts=_DEFAULT_UPDATE_UNREACHABLE_HOSTS,no_start=_DEFAULT_NO_START,
 						 skip_hosts = DEFAULT_SKIP_HOSTS, curses_min_char_len = DEFAULT_CURSES_MINIMUM_CHAR_LEN, curses_min_line_len = DEFAULT_CURSES_MINIMUM_LINE_LEN,
 						 single_window = DEFAULT_SINGLE_WINDOW,file_sync = False,error_only = DEFAULT_ERROR_ONLY):
@@ -1310,6 +1410,7 @@ def run_command_on_hosts(hosts = DEFAULT_HOSTS,commands = None,oneonone = DEFAUL
 		interface_ip_prefix (str, optional): The prefix of the IPMI interface. Defaults to {DEFAULT_INTERFACE_IP_PREFIX}.
 		returnUnfinished (bool, optional): Whether to return the unfinished hosts. Defaults to {_DEFAULT_RETURN_UNFINISHED}.
 		scp (bool, optional): Whether to use scp instead of rsync. Defaults to {DEFAULT_SCP}.
+		gather_mode (bool, optional): Whether to use gather mode. Defaults to False.
 		username (str, optional): The username to use to connect to the hosts. Defaults to {DEFAULT_USERNAME}.
 		extraargs (str, optional): Extra arguments to pass to the ssh / rsync / scp command. Defaults to {DEFAULT_EXTRA_ARGS}.
 		skipUnreachable (bool, optional): Whether to skip unreachable hosts. Defaults to {DEFAULT_SKIP_UNREACHABLE}.
@@ -1326,8 +1427,16 @@ def run_command_on_hosts(hosts = DEFAULT_HOSTS,commands = None,oneonone = DEFAUL
 	Returns:
 		list: A list of Host objects
 	'''
-	global __gloablUnavailableHosts
+	global __globalUnavailableHosts
 	global __global_suppress_printout
+	global _no_env
+	global _emo
+	_emo = False
+	_no_env = no_env
+	if not no_env and '__multiSSH3_UNAVAILABLE_HOSTS' in os.environ:
+		__globalUnavailableHosts = set(os.environ['__multiSSH3_UNAVAILABLE_HOSTS'].split(','))
+	elif '__multiSSH3_UNAVAILABLE_HOSTS' in readEnvFromFile():
+		__globalUnavailableHosts = set(readEnvFromFile()['__multiSSH3_UNAVAILABLE_HOSTS'].split(','))
 	if not max_connections:
 		max_connections = 4 * os.cpu_count()
 	elif max_connections == 0:
@@ -1336,7 +1445,7 @@ def run_command_on_hosts(hosts = DEFAULT_HOSTS,commands = None,oneonone = DEFAUL
 		max_connections = (-max_connections) * os.cpu_count()
 	if not commands:
 		commands = []
-	verify_ssh_config()
+	#verify_ssh_config()
 	# load global unavailable hosts only if the function is called (so using --repeat will not load the unavailable hosts again)
 	if called:
 		# if called,
@@ -1345,18 +1454,17 @@ def run_command_on_hosts(hosts = DEFAULT_HOSTS,commands = None,oneonone = DEFAUL
 		if skipUnreachable is None:
 			skipUnreachable = True
 		if skipUnreachable:
-			unavailableHosts = __gloablUnavailableHosts
+			unavailableHosts = __globalUnavailableHosts
 		else:
 			unavailableHosts = set()
 	else:
 		# if run in command line ( or emulating running in command line, we default to skip unreachable hosts within one command call )
 		if skipUnreachable:
-			unavailableHosts = __gloablUnavailableHosts
+			unavailableHosts = __globalUnavailableHosts
 		else:
 			unavailableHosts = set()
 			skipUnreachable = True
-	global _emo
-	_emo = False
+
 	# We create the hosts
 	hostStr = formHostStr(hosts)
 	skipHostStr = formHostStr(skip_hosts) if skip_hosts else ''
@@ -1375,8 +1483,8 @@ def run_command_on_hosts(hosts = DEFAULT_HOSTS,commands = None,oneonone = DEFAUL
 				if '@' not in host:
 					skipHostStr[i] = userStr + host
 			skipHostStr = ','.join(skipHostStr)
-	targetHostsList = expand_hostnames(frozenset(hostStr.split(',')),no_env=no_env)
-	skipHostsList = expand_hostnames(frozenset(skipHostStr.split(',')),no_env=no_env)
+	targetHostsList = expand_hostnames(frozenset(hostStr.split(',')))
+	skipHostsList = expand_hostnames(frozenset(skipHostStr.split(',')))
 	if skipHostsList:
 		if not __global_suppress_printout: print(f"Skipping hosts: {skipHostsList}")
 	if files and not commands:
@@ -1387,15 +1495,18 @@ def run_command_on_hosts(hosts = DEFAULT_HOSTS,commands = None,oneonone = DEFAUL
 		files = set(files+commands) if files else set(commands)
 	if files:
 		# try to resolve files first (like * etc)
-		pathSet = set()
-		for file in files:
-			try:
-				pathSet.update(glob.glob(file,include_hidden=True,recursive=True))
-			except:
-				pathSet.update(glob.glob(file,recursive=True))
-		if not pathSet:
-			print(f'Warning: No source files at {files} are found after resolving globs!')
-			sys.exit(66)
+		if not gather_mode:
+			pathSet = set()
+			for file in files:
+				try:
+					pathSet.update(glob.glob(file,include_hidden=True,recursive=True))
+				except:
+					pathSet.update(glob.glob(file,recursive=True))
+			if not pathSet:
+				print(f'Warning: No source files at {files} are found after resolving globs!')
+				sys.exit(66)
+		else:
+			pathSet = set(files)
 		if file_sync:
 			# use abosolute path for file sync
 			commands = [os.path.abspath(file) for file in pathSet]
@@ -1418,9 +1529,9 @@ def run_command_on_hosts(hosts = DEFAULT_HOSTS,commands = None,oneonone = DEFAUL
 				continue
 			if host.strip() in skipHostsList: continue
 			if file_sync:
-				hosts.append(Host(host.strip(), os.path.dirname(command)+os.path.sep, files = [command],ipmi=ipmi,interface_ip_prefix=interface_ip_prefix,scp=scp,extraargs=extraargs))
+				hosts.append(Host(host.strip(), os.path.dirname(command)+os.path.sep, files = [command],ipmi=ipmi,interface_ip_prefix=interface_ip_prefix,scp=scp,extraargs=extraargs,gatherMode=gather_mode))
 			else:
-				hosts.append(Host(host.strip(), command, files = files,ipmi=ipmi,interface_ip_prefix=interface_ip_prefix,scp=scp,extraargs=extraargs))
+				hosts.append(Host(host.strip(), command, files = files,ipmi=ipmi,interface_ip_prefix=interface_ip_prefix,scp=scp,extraargs=extraargs,gatherMode=gather_mode))
 			if not __global_suppress_printout: 
 				print(f"Running command: {command} on host: {host}")
 		if not __global_suppress_printout: print('-'*80)
@@ -1462,9 +1573,9 @@ def run_command_on_hosts(hosts = DEFAULT_HOSTS,commands = None,oneonone = DEFAUL
 					continue
 				if host.strip() in skipHostsList: continue
 				if file_sync:
-					hosts.append(Host(host.strip(), os.path.dirname(command)+os.path.sep, files = [command],ipmi=ipmi,interface_ip_prefix=interface_ip_prefix,scp=scp,extraargs=extraargs))
+					hosts.append(Host(host.strip(), os.path.dirname(command)+os.path.sep, files = [command],ipmi=ipmi,interface_ip_prefix=interface_ip_prefix,scp=scp,extraargs=extraargs,gatherMode=gather_mode))
 				else:
-					hosts.append(Host(host.strip(), command, files = files,ipmi=ipmi,interface_ip_prefix=interface_ip_prefix,scp=scp,extraargs=extraargs))
+					hosts.append(Host(host.strip(), command, files = files,ipmi=ipmi,interface_ip_prefix=interface_ip_prefix,scp=scp,extraargs=extraargs,gatherMode=gather_mode))
 			if not __global_suppress_printout and len(commands) > 1:
 				print('-'*80)
 				print(f"Running command: {command} on hosts: {hostStr}" + (f"; skipping: {skipHostStr}" if skipHostStr else ''))
@@ -1514,6 +1625,7 @@ def get_default_config(args):
 		'DEFAULT_GREPPABLE_MODE': args.greppable,
 		'DEFAULT_SKIP_UNREACHABLE': args.skip_unreachable,
 		'DEFAULT_SKIP_HOSTS': args.skip_hosts,
+		'SSH_STRICT_HOST_KEY_CHECKING': SSH_STRICT_HOST_KEY_CHECKING,
 		'ERROR_MESSAGES_TO_IGNORE': ERROR_MESSAGES_TO_IGNORE,
 	}
 
@@ -1521,18 +1633,19 @@ def write_default_config(args,CONFIG_FILE,backup = True):
 	if backup and os.path.exists(CONFIG_FILE):
 		os.rename(CONFIG_FILE,CONFIG_FILE+'.bak')
 	default_config = get_default_config(args)
+	# apply the updated defualt_config to __configs_from_file and write that to file
+	__configs_from_file.update(default_config)
 	with open(CONFIG_FILE,'w') as f:
-		json.dump(default_config,f,indent=4)
+		json.dump(__configs_from_file,f,indent=4)
 
 
 def main():
 	global _emo
 	global __global_suppress_printout
-	global __gloablUnavailableHosts
 	global __mainReturnCode
 	global __failedHosts
 	global __ipmiiInterfaceIPPrefix
-	global _sshpassAvailable
+	global _binPaths
 	global _env_file
 	_emo = False
 	# We handle the signal
@@ -1548,6 +1661,7 @@ def main():
 	parser.add_argument("-f","--file", action='append', help="The file to be copied to the hosts. Use -f multiple times to copy multiple files")
 	parser.add_argument('--file_sync', action='store_true', help=f'Operate in file sync mode, sync path in <COMMANDS> from this machine to <HOSTS>. Treat --file <FILE> and <COMMANDS> both as source as source and destination will be the same in this mode. (default: {DEFAULT_FILE_SYNC})', default=DEFAULT_FILE_SYNC)
 	parser.add_argument('--scp', action='store_true', help=f'Use scp for copying files instead of rsync. Need to use this on windows. (default: {DEFAULT_SCP})', default=DEFAULT_SCP)
+	parser.add_argument('-gm','--gather_mode', action='store_true', help=f'Gather files from the hosts instead of sending files to the hosts. Will send remote files specified in <FILE> to local path specified in <COMMANDS>  (default: False)', default=False)
 	#parser.add_argument("-d",'-c',"--destination", type=str, help="The destination of the files. Same as specify with commands. Added for compatibility. Use #HOST# or #HOSTNAME# to replace the host name in the destination")
 	parser.add_argument("-t","--timeout", type=int, help=f"Timeout for each command in seconds (default: {DEFAULT_CLI_TIMEOUT} (disabled))", default=DEFAULT_CLI_TIMEOUT)
 	parser.add_argument("-r","--repeat", type=int, help=f"Repeat the command for a number of times (default: {DEFAULT_REPEAT})", default=DEFAULT_REPEAT)
@@ -1561,22 +1675,22 @@ def main():
 	parser.add_argument('-sw','--single_window', action='store_true', help=f'Use a single window for all hosts. (default: {DEFAULT_SINGLE_WINDOW})', default=DEFAULT_SINGLE_WINDOW)
 	parser.add_argument('-eo','--error_only', action='store_true', help=f'Only print the error output. (default: {DEFAULT_ERROR_ONLY})', default=DEFAULT_ERROR_ONLY)
 	parser.add_argument("-no","--no_output", action='store_true', help=f"Do not print the output. (default: {DEFAULT_NO_OUTPUT})", default=DEFAULT_NO_OUTPUT)
-	parser.add_argument('--no_env', action='store_true', help=f'Do not load the environment variables. (default: {DEFAULT_NO_ENV})', default=DEFAULT_NO_ENV)
-	parser.add_argument("--env_file", type=str, help=f"The file to load the environment variables from. (default: {DEFAULT_ENV_FILE})", default=DEFAULT_ENV_FILE)
+	parser.add_argument('--no_env', action='store_true', help=f'Do not load the command line environment variables. (default: {DEFAULT_NO_ENV})', default=DEFAULT_NO_ENV)
+	parser.add_argument("--env_file", type=str, help=f"The file to load the mssh file based environment variables from. ( Still work with --no_env ) (default: {DEFAULT_ENV_FILE})", default=DEFAULT_ENV_FILE)
 	parser.add_argument("-m","--max_connections", type=int, help=f"Max number of connections to use (default: 4 * cpu_count)", default=DEFAULT_MAX_CONNECTIONS)
 	parser.add_argument("-j","--json", action='store_true', help=F"Output in json format. (default: {DEFAULT_JSON_MODE})", default=DEFAULT_JSON_MODE)
 	parser.add_argument("--success_hosts", action='store_true', help=f"Output the hosts that succeeded in summary as wells. (default: {DEFAULT_PRINT_SUCCESS_HOSTS})", default=DEFAULT_PRINT_SUCCESS_HOSTS)
 	parser.add_argument("-g","--greppable", action='store_true', help=f"Output in greppable format. (default: {DEFAULT_GREPPABLE_MODE})", default=DEFAULT_GREPPABLE_MODE)
 	parser.add_argument("-su","--skip_unreachable", action='store_true', help=f"Skip unreachable hosts while using --repeat. Note: Timedout Hosts are considered unreachable. Note: multiple command sequence will still auto skip unreachable hosts. (default: {DEFAULT_SKIP_UNREACHABLE})", default=DEFAULT_SKIP_UNREACHABLE)
 	parser.add_argument("-sh","--skip_hosts", type=str, help=f"Skip the hosts in the list. (default: {DEFAULT_SKIP_HOSTS if DEFAULT_SKIP_HOSTS else 'None'})", default=DEFAULT_SKIP_HOSTS)
-	parser.add_argument('--generate_default_config_file', action='store_true', help=f'Generate / store the default config file from command line argument and current config at {CONFIG_FILE}')
-	parser.add_argument("-V","--version", action='version', version=f'%(prog)s {version} {("with sshpass " if _sshpassAvailable else "")}by {AUTHOR} ({AUTHOR_EMAIL})')
+	parser.add_argument('--store_config_file', action='store_true', help=f'Store / generate the default config file from command line argument and current config at {CONFIG_FILE}')
+	parser.add_argument("-V","--version", action='version', version=f'%(prog)s {version} with [ {", ".join(_binPaths.keys())} ] by {AUTHOR} ({AUTHOR_EMAIL})')
 	
 	# parser.add_argument('-u', '--user', metavar='user', type=str, nargs=1,
 	#                     help='the user to use to connect to the hosts')
 	args = parser.parse_args()
 
-	if args.generate_default_config_file:
+	if args.store_config_file:
 		try:
 			if os.path.exists(CONFIG_FILE):
 				print(f"Warning: {CONFIG_FILE} already exists, what to do? (o/b/n)")
@@ -1596,6 +1710,8 @@ def main():
 		except Exception as e:
 			print(f"Error while writing config file: {e}")
 		if not args.commands:
+			with open(CONFIG_FILE,'r') as f:
+				print(f"Config file content: \n{f.read()}")
 			sys.exit(0)
 
 	_env_file = args.env_file
@@ -1623,7 +1739,7 @@ def main():
 	if not __global_suppress_printout:
 		print('> ' + getStrCommand(args.hosts,args.commands,oneonone=args.oneonone,timeout=args.timeout,password=args.password,
 						 nowatch=args.nowatch,json=args.json,called=args.no_output,max_connections=args.max_connections,
-						 files=args.file,file_sync=args.file_sync,ipmi=args.ipmi,interface_ip_prefix=args.interface_ip_prefix,scp=args.scp,username=args.username,
+						 files=args.file,file_sync=args.file_sync,ipmi=args.ipmi,interface_ip_prefix=args.interface_ip_prefix,scp=args.scp,gather_mode = args.gather_mode,username=args.username,
 						 extraargs=args.extraargs,skipUnreachable=args.skip_unreachable,no_env=args.no_env,greppable=args.greppable,skip_hosts = args.skip_hosts,
 						 curses_min_char_len = args.window_width, curses_min_line_len = args.window_height,single_window=args.single_window,error_only=args.error_only))
 	if args.error_only:
@@ -1638,7 +1754,7 @@ def main():
 		hosts = run_command_on_hosts(args.hosts,args.commands,
 							 oneonone=args.oneonone,timeout=args.timeout,password=args.password,
 							 nowatch=args.nowatch,json=args.json,called=args.no_output,max_connections=args.max_connections,
-							 files=args.file,file_sync=args.file_sync,ipmi=args.ipmi,interface_ip_prefix=args.interface_ip_prefix,scp=args.scp,username=args.username,
+							 files=args.file,file_sync=args.file_sync,ipmi=args.ipmi,interface_ip_prefix=args.interface_ip_prefix,scp=args.scp,gather_mode = args.gather_mode,username=args.username,
 							 extraargs=args.extraargs,skipUnreachable=args.skip_unreachable,no_env=args.no_env,greppable=args.greppable,skip_hosts = args.skip_hosts,
 							 curses_min_char_len = args.window_width, curses_min_line_len = args.window_height,single_window=args.single_window,error_only=args.error_only)
 		#print('*'*80)

multiSSH3-4.81.dist-info/RECORD

@@ -1,7 +0,0 @@
-multiSSH3.py,sha256=Nerzo1GexP3GoZv0uhjydtu2zSpw4vY2k4Rx0F3yD8M,81707
-multiSSH3-4.81.dist-info/LICENSE,sha256=OXLcl0T2SZ8Pmy2_dmlvKuetivmyPd5m1q-Gyd-zaYY,35149
-multiSSH3-4.81.dist-info/METADATA,sha256=GnSUBBxKq9cvqK4Z2cMVsOqWMgjqL_vpEO5XOZ0mNV8,16515
-multiSSH3-4.81.dist-info/WHEEL,sha256=GV9aMThwP_4oNCtvEC2ec3qUYutgWeAzklro_0m4WJQ,91
-multiSSH3-4.81.dist-info/entry_points.txt,sha256=xi2rWWNfmHx6gS8Mmx0rZL2KZz6XWBYP3DWBpWAnnZ0,143
-multiSSH3-4.81.dist-info/top_level.txt,sha256=tUwttxlnpLkZorSsroIprNo41lYSxjd2ASuL8-EJIJw,10
-multiSSH3-4.81.dist-info/RECORD,,