ClusterShell 1.5.1__tar.gz → 1.7__tar.gz

{clustershell-1.5.1 → clustershell-1.7}/ChangeLog

@@ -1,3 +1,384 @@
+2015-11-10 S. Thiell <sthiell@stanford.edu>
+
+	* Version 1.7 released.
+
+2015-11-01 S. Thiell <sthiell@stanford.edu>
+
+	* Clush.py: added -P/--progress to force display of the live progress
+	indicator and display global write bandwidth when writing standard input.
+
+2015-10-25 S. Thiell <sthiell@stanford.edu>
+
+	* Clush.py: added --option/-O clush.conf settings override (pull
+	request #248).
+
+2015-10-18 S. Thiell <sthiell@stanford.edu>
+
+	* Clush.py: added --hostfile command line option to specify a file
+	containing single hosts, node sets or node groups (ticket #235).
+
+2015-10-16 S. Thiell <sthiell@stanford.edu>
+
+	* NodeSet.py: enhancing parser to recognize nodesets with brackets having
+	leading/trailing digits like in "prod-00[01-99]" (ticket #228).
+
+2015-08-29 S. Thiell <sthiell@stanford.edu>
+
+	* CLI/Nodeset.py: added --axis option to choose nD fold axis (ticket
+	#269).
+	* NodeSet.py: added fold_axis public member to NodeSetBase along with
+	expand algorithm when casting to string to choose nD fold axis (ticket
+	#269).
+
+2015-08-28 S. Thiell <sthiell@stanford.edu>
+
+	* CLI/Config.py: better per-user clush.conf support. clush now also checks
+	for $XDG_CONFIG_HOME/clustershell/clush.conf and
+	$HOME/.local/etc/clustershell/clush.conf (ticket #111).
+
+2015-08-27 S. Thiell <sthiell@stanford.edu>
+
+	* CLI/Nodeset.py: add --list-all / -L to list groups from all group
+	sources (ticket #266). If repeated, it has the same behavior than -l.
+
+	* NodeUtils.py: add support for built-in groups definition files based on
+	YAML. Added autodir configuration option in groups.conf to declare a
+	directory where .yaml files are automatically loaded. Example available in
+	groups.d/cluster.yaml.example. Added support for groups.conf section with
+	multiple source names separated by comma. This is also the case for
+	groups.conf.d/*.conf extensions. Also added new upcall command $SOURCE
+	variable that is replaced by calling source name before execution.
+	Finally, /etc/clustershell/groups is now deprecated and replaced by
+	/etc/clustershell/groups.d/local.cfg for new installation (ticket #258).
+
+2015-07-07 S. Thiell <sthiell@stanford.edu>
+
+	* CLI/Nodeset.py: add --autostep=auto and --autostep=x% option (#161).
+
+	* NodeSet: add autostep property to allow changing the way every RangeSet of
+	a NodeSet object is displayed (eg. node[2-8/2] instead of node[2,4,6,8]).
+	Autostep value is the min number of indexes that are found at equal distance
+	of each other inside a range before NodeSet starts to use this syntax.
+
+2015-05-18 S. Thiell <stephane.thiell@cea.fr>
+
+	* Version 1.6.92 released.
+
+2015-04-10 S. Thiell <stephane.thiell@cea.fr>
+
+	* Tree: implement task.copy() in tree mode using temporary tar file.
+
+2015-04-01 S. Thiell <stephane.thiell@cea.fr>
+
+	* Tree: allow local command execution on gateways by adding remote=False to
+	task.shell()/run().  In practice with this patch, we can now easily
+	execute local commands on (remote) gateways using node argument like
+	`ipmitool -H %h` to spread the load between gateways.
+
+2015-03-24 S. Thiell <stephane.thiell@cea.fr>
+
+	* NodeSet.py: disallow opening bracket after digit (ticket #228).
+
+2015-03-23 S. Thiell <stephane.thiell@cea.fr>
+
+	* Clush.py: Warn user of possible use of shell globbing, especially when
+	using brackets and bash without GLOBIGNORE set (ticket #225).
+	* Clush.py: Fix --diff against null content (ticket #214).
+
+2015-03-19 S. Thiell <stephane.thiell@cea.fr>
+
+	* Task.py: Make max_retcode() return None on no-op. Until now, max_retcode()
+	returned 0 by default, so even when no command was able to finish (for
+	example, due to reached timeout). This behavior did not allow users to
+	distinguish between successful commands and such no-op.
+
+2015-03-11 S. Thiell <stephane.thiell@cea.fr>
+
+	* Worker.py: Introduce StreamWorker as a generic worker class to manage a
+	set of streams (using one EngineClient with multiple I/O streams
+	internally). It's a concrete class that is now used in Gateway.py to
+	manage I/O from the parent host in tree propagation mode. Also changed
+	WorkerSimple (and thus WorkerPopen) to inherit from StreamWorker.
+
+2014-05-20 S. Thiell <stephane.thiell@cea.fr>
+
+	* EngineClient.py: Code improvement to support multiple customizable I/O
+	streams per EngineClient in different mode, each being named and having
+	their own read/write buffers and attributes.
+
+2014-04-30 A. Degremont <aurelien.degremont@cea.fr>
+
+	* Clush.py: Add a 'worker' option to switch default worker (ticket #221).
+
+2014-04-23 S. Thiell <stephane.thiell@cea.fr>
+
+	* EPoll.py: Close epoll control file descriptor when engine is released.
+
+2014-01-26 A. Degremont <aurelien.degremont@cea.fr>
+
+	* NodeUtils.py: Add group source caching expiration (ticket #98).
+
+2014-01-16 S. Thiell <stephane.thiell@cea.fr>
+
+	* RangeSet.py: Multidimensional RangeSet support (new RangeSetND class).
+	Created RangeSetND class to manage a matrix of RangeSet objects. Folding
+	of such objects is quite complex and time consuming. A special
+	optimization is provided when only one dimension is varying. Patch by
+	aurelien.degremont@cea.fr and stephane.thiell@cea.fr.
+
+	* NodeSet.py: Multidimensional nodeset support.  Added support of
+	RangeSetND to NodeSet. Optimized NodeSet so that 1D NodeSet objects are
+	still using RangeSet (ticket #92). Also benefiting from RangeSetND
+	optimization when only one dimension is varying. Patch by
+	aurelien.degremont@cea.fr and stephane.thiell@cea.fr.
+
+2014-01-14 S. Thiell <stephane.thiell@cea.fr>
+
+	* NodeSet.py: fix and clean fromall()/@* magic and add resolver option to
+	grouplist()'s NodeSet module function.
+
+2014-01-14 S. Thiell <stephane.thiell@cea.fr>
+
+	* NodeSet.py: Define module API to access and set group resolver used for
+	@-prefixed (eg. '@group') resolution. This is used to circumvent accessing
+	and setting NodeSet module's variable 'RESOLVER_STD_GROUP' directly, which
+	is not convenient and error prone. The new functions are
+	std_group_resolver() and set_std_group_resolver(). Updated User Guide.
+
+	* CLI/Clush.py: ignore IOError on stdin reader thread, but print a warning
+	in verbose or debug mode (ticket #201).
+
+2014-01-06 S. Thiell <stephane.thiell@cea.fr>
+
+	* NodeSet.py: Fix internal implementation of NodeSet.contiguous(), that
+	is, as NodeSet is mutable, we should avoid using the same NodeSet instance
+	in NodeSet.contiguous() for different NodeSet values.
+
+2013-12-17 S. Thiell <stephane.thiell@cea.fr>
+
+	* Task.py: fix task.iter_buffers() and worker.iter_buffers() to allow
+	optional argument match_keys to be an empty list for convenience. It
+	should be set to None to disable match_keys check. Also check that
+	match_keys is a true key/node sequence and not a string.
+
+2013-11-05 S. Thiell <stephane.thiell@cea.fr>
+
+	* EngineClient.py: Hide unwanted debug messages: when aborting a task,
+	cleanup of associated resources may lead to dropped inter-task messages
+	through the EnginePort mechanism. We now only display associated warning
+	messages when debugging is enabled...
+
+	* Task.py: Fix abort() race condition.
+
+	* CLI/Clush.py: Fix a defect to allow the use of command timeout when
+	copying files (with clush -u delay -c ..., ticket #220).
+
+2013-11-04 A. Degremont <aurelien.degremont@cea.fr>
+
+	* Worker/Rsh.py: Add a Rsh worker. It is compatible with rsh clones
+	like mrsh/krsh. (ticket #216).
+	* Task.py: Add a 'worker' default option for Task object. It is used
+	in Task.shell() and Task.copy().
+
+2012-09-13 S. Thiell <stephane.thiell@cea.fr>
+
+	* Engine.py: Allow EngineTimer with immediate fire date, that is, a fire
+	delay of 0s. Obviously not fired in time, such a timer will still be armed
+	and fired as soon as possible (ticket #200).
+
+2012-08-27 S. Thiell <stephane.thiell@cea.fr>
+
+	* Engine.py: Fix catch-all used in case of KeyboardInterrupt exception
+	during runloop, resulting in ghost engine clients in that case and results
+	possibly not cleaned properly (ticket #199).
+
+2012-08-01 S. Thiell <stephane.thiell@cea.fr>
+
+	* CLI/Clush.py: Fix clush_exit() side effects thanks to latest task
+	termination improvements (tickets #185).
+
+	* Task.py: Avoid termination race condition when using multiple threads
+	and calling abort()+join() from another thread (tickets #197).
+
+2012-07-09 S. Thiell <stephane.thiell@cea.fr>
+
+	* NodeSet.py: "All nodes" extended pattern support with @* (ticket #193).
+
+2012-04-08 S. Thiell <stephane.thiell@cea.fr>
+
+	* Version 1.6 released.
+
+	* doc/guide: Add ClusterShell User and Programming Guide LaTeX source to
+	repository.
+
+2012-04-07 S. Thiell <stephane.thiell@cea.fr>
+
+	* doc/examples/check_nodes.py: Add simple example of event-driven script.
+
+2012-03-31 S. Thiell <stephane.thiell@cea.fr>
+
+	* CLI/Nodeset.py: Allow -a and common nodeset operations when using -l to
+	list belonging groups (a new 1.6 feature, see ticket #162).
+
+2012-03-29 S. Thiell <stephane.thiell@cea.fr>
+
+	* Worker/Worker.py: added documentation for
+	worker.current_[node,msg,errmsg,rc] variables (ticket #160).
+
+	* Task.py: timeout parameters better explained (ticket #157).
+
+2012-03-28 S. Thiell <stephane.thiell@cea.fr>
+
+	* CLI/OptionParser.py: Add --diff option to enable diff display between
+	gathered outputs. Enabled in clush and clubak (ticket #176).
+
+	* CLI/Display.py: Add _print_diff() and flush() methods.
+
+	* Task.py: Initialize MsgTree instances in constructor according to
+	default values in order to allow no-op calls to buffer getters before
+	resume() (ticket #186).
+
+2012-03-26 S. Thiell <stephane.thiell@cea.fr>
+
+	* CLI/Clush.py: Fix clush --[r]copy behavior when no source directory is
+	specified (ticket #172).
+
+	* CLI/Clush.py: Fix interactive mode gather/standard toggle error, when
+	using special character '=' (ticket #171).
+
+	* CLI/Clubak.py: Add -v/-q verbosity options (ticket #174).
+
+2012-03-24 S. Thiell <stephane.thiell@cea.fr>
+
+	* CLI/Clubak.py: Add --interpret-keys=never,always,auto option to clubak
+	to allow a more generic usage of clubak, ie. even in cases where keys are
+	not nodeset compliant (ticket #180).
+
+2012-03-21 S. Thiell <stephane.thiell@cea.fr>
+
+	* conf/groups.conf: Fix group cross reference issue (ticket #183), we now
+	use sed commands instead of awk ones in this default groups.conf file.
+
+2012-03-18 S. Thiell <stephane.thiell@cea.fr>
+
+	* conf/groups.conf: Fix default source regexp for mawk (ticket #178). 
+
+	* Packaging: Add groups.conf.d directory and sample files.
+
+2012-03-17 S. Thiell <stephane.thiell@cea.fr>
+
+	* CLI/Nodeset.py: Add support for -l[ll] <nodeset(s)> to list belonging
+	groups (CLI interface to NodeSet.groups()) (ticket #162).
+
+	* NodeSet: Add groups() public method to list groups nodeset belongs to.
+
+2012-03-15 S. Thiell <stephane.thiell@cea.fr>
+
+	* NodeUtils.py: Add groupsdir option (ticket #179).
+
+2012-03-14 S. Thiell <stephane.thiell@cea.fr>
+
+	* CLI/Nodeset.py: Add --contiguous splitting option (ticket #173).
+
+	* NodeSet.py: Add contiguous() iterator.
+
+	* RangeSet.py: Add contiguous() iterator.
+
+	* RangeSet.py: Allow slice object in fromone() constructor.
+
+2012-02-26 S. Thiell <stephane.thiell@cea.fr>
+
+	* Gateway.py: Improved logging facility, configurable through
+	CLUSTERSHELL_GW_LOG_DIR and CLUSTERSHELL_GW_LOG_LEVEL environment
+	variables from the root node.
+
+	* Communication.py: Messages are now transfered in xml payload instead of
+	'output' attribute for improved handling of multi-lines messages in
+	StdOutMessage and StdErrMessage.
+
+2012-02-24 S. Thiell <stephane.thiell@cea.fr>
+
+	* Worker/EngineClient.py: Fix gateway write performance issue, as seen on a
+	very large cluster with a no-grooming test case and lots of small messages
+	sent, by calling os.write() as soon as possible (might safely fail if not
+	ready as we are in non-blocking mode).
+
+	* NodeSet.py: Internal parsing optimization by adding a "should copy
+	RangeSet object?" flag to NodeSetBase constructor in order to save useless
+	but slightly costly RangeSet.copy() calls.
+
+	* NodeSet.py: Small rangeset parsing optimization on single node string
+	parsing code.
+
+2012-02-19 S. Thiell <stephane.thiell@cea.fr>
+
+	* NodeSet.py: Add NodeSet.nsiter(), a fast iterator on nodes as NodeSet
+	objects to avoid object-to-string-to-object conversion in some cases when
+	using __iter__() -- like in PropagationTreeRouter.dispatch().
+
+2012-02-15 S. Thiell <stephane.thiell@cea.fr>
+
+	* Clush.py: Add --topology <file> hidden option to enable V2 tree
+	propagation technology preview.
+
+2012-02-01 S. Thiell <stephane.thiell@cea.fr>
+
+	* RangeSet.py: Fix RangeSet.__setstate__() for proper object unpickling
+	from older RangeSet versions. Add unpickling tests.
+
+2012-01-28 S. Thiell <stephane.thiell@cea.fr>
+
+	* RangeSet.py: Discard AVL-tree based implementation, as we noticed that
+	built-in set is much faster. New implementation is based on built-in set,
+	and slightly changes padding and __iter__() behaviors. Padding value is
+	now accessible and settable at any time via a public variable "padding".
+	Auto-detection of padding is still available, but it is used as a
+	convenience for printing range sets. Moreover, all set-like operations are
+	now only based on integers, ignoring RangeSet's padding value. __iter__()
+	has been changed in order to iterate over sorted inner set integers,
+	instead of string items. A new method striter() is available to iterate
+	over string padding-enabled items. These changes allow us to offer a full
+	set-like API for RangeSet (new methods like isdisjoint(), pop(), etc. are
+	available according to your Python version). Also, a new constructor that
+	take any iterable of integers is available. Finally, this implementation
+	should much more faster than all previous ones, especially for large range
+	sets (ten thousand and more) with lots of holes.
+
+2012-01-10 S. Thiell <stephane.thiell@cea.fr>
+
+	* RangeSet.py: Move RangeSet class from NodeSet.py to this new module
+	dedicated to scalable management of cluster range sets (tens of thousands
+	of disjoint ranges). Change internal algorithm used to manage ranges from
+	a list to an AVL-tree based on bintrees project's avltree implementation.
+	Got rid of expand/fold() methods that don't scale, all sets-like methods
+	have been rewritten using AVL-tree.
+
+2012-01-04 S. Thiell <stephane.thiell@cea.fr>
+
+	* Task.py: Change behavior of shell()'s tree=None (auto) parameter: added
+	Task default parameter "auto_tree" defaulting to False and checked by
+	shell() when tree=None. This means that even with a valid topology
+	configuration file, the user has to explicitly enable tree mode for now.
+	This is for next 1.6 release and should be changed to True in version 2.0.
+
+2011-11-28 S. Thiell <stephane.thiell@cea.fr>
+
+	* Task.py: Fix 'tree' option of shell(), which can be either True (force
+	enable tree mode), False (disable tree mode) and None (automatic).
+
+2011-11-24 S. Thiell <stephane.thiell@cea.fr>
+
+	* CLI/Clush.py: Enable tree mode by default with grooming option.
+
+	* Worker/Tree.py: Integrate WorkerTree within ClusterShell Engine
+	framework, it will be used instead of PropagationTree.
+
+	* Engine/Engine.py: Inhibit any engine client changes when client is not
+	registered.
+
+	* Topology.py: Change DEFAULT section to Main section in topology.conf.
+	Cosmetic changes.
+
 2011-06-09 S. Thiell <stephane.thiell@cea.fr>
 
 	* Version 1.5.1 released.
@@ -167,6 +548,17 @@
 	* CLI/Clush.py: Do not disable internal messages gathering when using -bL
 	for proper display after Ctrl-C interruption (#133).
 
+2011-01-26 S. Thiell <stephane.thiell@cea.fr>
+
+	* tests/config: test config-template directory created.
+
+2011-01-17 S. Thiell <stephane.thiell@cea.fr>
+
+	* Communication.py: New module from 2.0 dev branch (author: H. Doreau).
+	* Gateway.py: New module from 2.0 dev branch (author: H. Doreau).
+	* Propagation.py: New module from 2.0 dev branch (author: H. Doreau).
+	* Topology.py: New module from 2.0 dev branch (author: H. Doreau).
+
 2011-01-15 S. Thiell <stephane.thiell@cea.fr>
 
 	* Version 1.4 released.
@@ -308,7 +700,7 @@
 
 	* setup.py: Switch to setuptools.
 
-    * clustershell.spec.in: Fix issue on el5 with if condition when defining
+	* clustershell.spec.in: Fix issue on el5 with if condition when defining
 	python_sitelib.
 
 2010-08-26 S. Thiell <stephane.thiell@cea.fr>

clustershell-1.7/README.md

@@ -0,0 +1,128 @@
+ClusterShell 1.7 Python Library and Tools
+=========================================
+
+ClusterShell is an event-driven open source Python library, designed to run
+local or distant commands in parallel on server farms or on large Linux
+clusters. It will take care of common issues encountered on HPC clusters, such
+as operating on groups of nodes, running distributed commands using optimized
+execution algorithms, as well as gathering results and merging identical
+outputs, or retrieving return codes. ClusterShell takes advantage of existing
+remote shell facilities already installed on your systems, like SSH.
+
+ClusterShell's primary goal is to improve the administration of high-
+performance clusters by providing a lightweight but scalable Python API for
+developers. It also provides clush, clubak and nodeset, three convenient
+command-line tools that allow traditional shell scripts to benefit from some
+of the library features.
+
+Requirements (v1.7)
+-------------------
+
+ * GNU/Linux, *BSD, Mac OS X
+ * OpenSSH (ssh/scp) or rsh
+ * Python 2.x (x >= 4)
+ * PyYAML (optional)
+
+License
+-------
+
+ClusterShell is distributed under the CeCILL-C license, a French transposition
+of the GNU LGPL, and is fully LGPL-compatible (see Licence_CeCILL-C_V1-en.txt).
+
+Documentation
+-------------
+
+Online documentation is available here:
+
+    http://clustershell.readthedocs.org/
+
+The Sphinx documentation source is available under the doc/sphinx directory.
+Type 'make' to see all available formats (you need Sphinx installed and
+sphinx_rtd_theme to build the documentation). For example, to generate html
+docs, just type:
+
+    make html BUILDDIR=/dest/path
+
+For local library API documentation, just type:
+
+    $ pydoc ClusterShell
+
+The following man pages are also provided:
+
+    clush(1), clubak(1), nodeset(1), clush.conl(5), groups.conf(5)
+
+Test Suite
+----------
+
+Regression testing scripts are available in the 'tests' directory:
+
+    $ cd tests
+    $ nosetests -sv <Test.py>
+    $ nosetests -sv --all-modules
+
+You have to allow 'ssh localhost' and 'ssh $HOSTNAME' without any warnings for
+"remote" tests to run as expected. $HOSTNAME should not be 127.0.0.1 nor ::1.
+Also some tests use the 'bc' command.
+
+ClusterShell interactively
+--------------------------
+
+```python
+>>> from ClusterShell.Task import task_self
+>>> from ClusterShell.NodeSet import NodeSet
+>>> task = task_self()
+>>> task.run("/bin/uname -r", nodes="linux[4-6,32-39]")
+<ClusterShell.Worker.Ssh.WorkerSsh object at 0x20a5e90>
+>>> for buf, key in task.iter_buffers():
+...     print NodeSet.fromlist(key), buf
+... 
+linux[32-39] 2.6.40.6-0.fc15.x86_64
+
+linux[4-6] 2.6.32-71.el6.x86_64
+```
+
+Links
+-----
+
+Web site:
+
+    http://clustershell.sourceforge.net
+    or http://cea-hpc.github.com/clustershell/
+
+Online documentation:
+
+    http://clustershell.readthedocs.org/
+
+Github source respository:
+
+    https://github.com/cea-hpc/clustershell
+
+Github Wiki:
+
+    https://github.com/cea-hpc/clustershell/wiki
+
+Github Issue tracking system:
+
+    https://github.com/cea-hpc/clustershell/issues
+
+Sourceforge.net project page:
+
+    http://sourceforge.net/projects/clustershell
+
+Python Package Index (PyPI) link:
+
+    http://pypi.python.org/pypi/ClusterShell
+
+ClusterShell was born along with Shine, a scalable Lustre FS admin tool:
+
+    http://lustre-shine.sourceforge.net
+
+Core developers/reviewers
+-------------------------
+
+* Stephane Thiell
+* Aurelien Degremont
+* Henri Doreau
+* Dominique Martinet
+
+CEA/DAM 2010, 2011, 2012, 2013, 2014, 2015 - http://www-hpc.cea.fr

{clustershell-1.5.1 → clustershell-1.7}/clustershell.spec

@@ -1,7 +1,7 @@
 %{!?python_sitelib: %global python_sitelib %(%{__python} -c "from distutils.sysconfig import get_python_lib; print(get_python_lib())")}
 
 Name:          clustershell
-Version:       1.5.1
+Version:       1.7
 Release:       1%{?dist}
 Summary:       Python framework for efficient cluster administration
 
@@ -12,6 +12,7 @@ Source0:       http://downloads.sourceforge.net/%{name}/%{name}-%{version}.tar.g
 BuildRoot:     %(mktemp -ud %{_tmppath}/%{name}-%{version}-%{release}-XXXXXX)
 BuildArch:     noarch
 BuildRequires: python-devel python-setuptools
+Requires:      PyYAML
 
 %description
 Tools and event-based Python library to execute commands on cluster nodes in
@@ -38,11 +39,14 @@ Syntax highlighting in the VIM editor for ClusterShell configuration files.
 
 %install
 rm -rf %{buildroot}
+# install library (lib), scripts (bin) and config (etc)
 %{__python} setup.py install -O1 --skip-build --root %{buildroot}
+# move config dir away from default setuptools /usr prefix (if rpm-building as user)
+[ -d %{buildroot}/usr/etc ] && mv %{buildroot}/usr/etc %{buildroot}/%{_sysconfdir}
 
-# config files
-install -d %{buildroot}/%{_sysconfdir}/clustershell
-install -p -m 0644 conf/*.conf %{buildroot}/%{_sysconfdir}/clustershell/
+# old versions of rpm (el5) requires that a file/link exists in buildroot even
+# when ghosted, but it is not installed at the end...
+ln -s conf/groups.d/local.cfg %{buildroot}/%{_sysconfdir}/clustershell/groups
 
 # man pages
 install -d %{buildroot}/%{_mandir}/{man1,man5}
@@ -59,21 +63,31 @@ install -p -m 0644 doc/extras/vim/ftdetect/clustershell.vim %{buildroot}/%{vimda
 install -p -m 0644 doc/extras/vim/syntax/clushconf.vim %{buildroot}/%{vimdatadir}/syntax/
 install -p -m 0644 doc/extras/vim/syntax/groupsconf.vim %{buildroot}/%{vimdatadir}/syntax/
 
-
 %clean
 rm -rf %{buildroot}
 
 %files
 %defattr(-,root,root,-)
-%doc README ChangeLog Licence_CeCILL-C_V1-en.txt Licence_CeCILL-C_V1-fr.txt
+%doc README.md ChangeLog Licence_CeCILL-C_V1-en.txt Licence_CeCILL-C_V1-fr.txt
+%doc doc/examples
+%doc doc/sphinx
 %{_mandir}/man1/clubak.1*
 %{_mandir}/man1/clush.1*
 %{_mandir}/man1/nodeset.1*
 %{_mandir}/man5/clush.conf.5*
 %{_mandir}/man5/groups.conf.5*
 %dir %{_sysconfdir}/clustershell
+%dir %{_sysconfdir}/clustershell/groups.d
+%dir %{_sysconfdir}/clustershell/groups.conf.d
 %config(noreplace) %{_sysconfdir}/clustershell/clush.conf
 %config(noreplace) %{_sysconfdir}/clustershell/groups.conf
+%ghost %{_sysconfdir}/clustershell/groups
+%config(noreplace) %{_sysconfdir}/clustershell/groups.d/local.cfg
+%doc %{_sysconfdir}/clustershell/groups.conf.d/README
+%doc %{_sysconfdir}/clustershell/groups.conf.d/*.conf.example
+%doc %{_sysconfdir}/clustershell/groups.d/README
+%doc %{_sysconfdir}/clustershell/groups.d/*.yaml.example
+%doc %{_sysconfdir}/clustershell/topology.conf.example
 %{python_sitelib}/ClusterShell/
 %{python_sitelib}/ClusterShell-*-py?.?.egg-info
 %{_bindir}/clubak
@@ -87,6 +101,15 @@ rm -rf %{buildroot}
 %{vimdatadir}/syntax/groupsconf.vim
 
 %changelog
+* Tue Nov 10 2015 Stephane Thiell <sthiell@stanford.edu> 1.7-1
+- update to 1.7
+
+* Fri Aug  7 2015 Stephane Thiell <stephane.thiell@cea.fr> 1.6.96-1
+- update to 1.6.96
+
+* Sun Apr 08 2012 Stephane Thiell <stephane.thiell@cea.fr> 1.6-1
+- update to 1.6
+
 * Thu Jun 09 2011 Stephane Thiell <stephane.thiell@cea.fr> 1.5.1-1
 - update to 1.5.1
 

clustershell-1.7/conf/clush.conf

@@ -0,0 +1,28 @@
+# Configuration file for clush
+#
+# Please see man clush.conf(5)
+#
+
+[Main]
+fanout: 64
+connect_timeout: 15
+command_timeout: 0
+color: auto
+fd_max: 16384
+history_size: 100
+node_count: yes
+verbosity: 1
+
+# Add always all remote hosts to known_hosts without confirmation
+#ssh_user: root
+#ssh_path: /usr/bin/ssh
+#ssh_options: -oStrictHostKeyChecking=no
+
+# Non-interactively performing password authentication with SSH's so called
+# "interactive keyboard password authentication".
+#ssh_user: root
+#ssh_path: /usr/bin/sshpass -f /root/remotepasswordfile /usr/bin/ssh
+#scp_path: /usr/bin/sshpass -f /root/remotepasswordfile /usr/bin/scp
+#ssh_options: -oBatchMode=no -oStrictHostKeyChecking=no
+
+

clustershell-1.7/conf/groups.conf

@@ -0,0 +1,45 @@
+# ClusterShell node groups main configuration file
+#
+# Please see `man 5 groups.conf` and
+# http://clustershell.readthedocs.org/en/latest/config.html#node-groups
+# for further details.
+#
+# NOTE: This is a simple group configuration example file, not a
+#       default config file. Please edit it to fit your own needs.
+#
+[Main]
+
+# Default group source
+default: local
+
+# Group source config directory list (space separated, use quotes if needed).
+# Examples are provided. Copy them from *.conf.example to *.conf to enable.
+#
+# $CFGDIR is replaced by the highest priority config directory found.
+# Default confdir value enables both system-wide and user configuration.
+confdir: /etc/clustershell/groups.conf.d $CFGDIR/groups.conf.d
+
+# New in 1.7, autodir defines a directory list (space separated, use quotes if
+# needed) where group data files will be auto-loaded.
+# Only *.yaml file are loaded. Copy *.yaml.example files to enable.
+# Group data files avoid the need of external calls for static config files.
+#
+# $CFGDIR is replaced by the highest priority config directory found.
+# Default autodir value enables both system-wide and user configuration.
+autodir: /etc/clustershell/groups.d $CFGDIR/groups.d
+
+# Sections below also define group sources.
+#
+# NOTE: /etc/clustershell/groups is deprecated since version 1.7, thus if it
+#       doesn't exist, the "local.cfg" file from autodir will be used.
+#
+# See the documentation for $CFGDIR, $SOURCE, $GROUP and $NODE upcall special
+# variables. Please remember that they are substitued before the shell command
+# is effectively executed.
+#
+[local]
+# flat file "group: nodeset" based group source using $CFGDIR/groups.d/local.cfg
+# with backward support for /etc/clustershell/groups
+map: [ -f $CFGDIR/groups ] && f=$CFGDIR/groups || f=$CFGDIR/groups.d/local.cfg; sed -n 's/^$GROUP:\(.*\)/\1/p' $f
+all: [ -f $CFGDIR/groups ] && f=$CFGDIR/groups || f=$CFGDIR/groups.d/local.cfg; sed -n 's/^all:\(.*\)/\1/p' $f
+list: [ -f $CFGDIR/groups ] && f=$CFGDIR/groups || f=$CFGDIR/groups.d/local.cfg; sed -n 's/^\([0-9A-Za-z_-]*\):.*/\1/p' $f