robotframework-pabot 4.0.6__tar.gz → 4.1.0__tar.gz

{robotframework_pabot-4.0.6 → robotframework_pabot-4.1.0}/PKG-INFO

@@ -1,6 +1,6 @@
-Metadata-Version: 2.1
+Metadata-Version: 2.2
 Name: robotframework-pabot
-Version: 4.0.6
+Version: 4.1.0
 Summary: Parallel test runner for Robot Framework
 Home-page: https://pabot.org
 Download-URL: https://pypi.python.org/pypi/robotframework-pabot
@@ -20,5 +20,6 @@ License-File: LICENSE.txt
 Requires-Dist: robotframework>=3.2
 Requires-Dist: robotframework-stacktrace>=0.4.1
 Requires-Dist: natsort>=8.2.0
+Dynamic: download-url
 
 A parallel executor for Robot Framework tests. With Pabot you can split one execution into multiple and save test execution time.

{robotframework_pabot-4.0.6 → robotframework_pabot-4.1.0}/README.md

@@ -53,45 +53,45 @@ There are several ways you can help in improving this tool:
    - Contribute by programming and making a pull request (easiest way is to work on an issue from the issue tracker)
 
 ## Command-line options
-
-    pabot [--verbose|--testlevelsplit|--command .. --end-command|
-           --processes num|--no-pabotlib|--pabotlibhost host|--pabotlibport port|
-           --processtimeout num|
-           --shard i/n|
-           --artifacts extensions|--artifactsinsubfolders|
-           --resourcefile file|--argumentfile[num] file|--suitesfrom file] 
-          [robot options] [path ...]
+<!-- START DOCSTRING -->
+pabot [--verbose|--testlevelsplit|--command .. --end-command|
+        --processes num|--no-pabotlib|--pabotlibhost host|--pabotlibport port|
+        --processtimeout num|
+        --shard i/n|
+        --artifacts extensions|--artifactsinsubfolders|
+        --resourcefile file|--argumentfile[num] file|--suitesfrom file|--ordering file
+        --chunk
+        --pabotprerunmodifier modifier] 
+      [robot options] [path ...]
+
+PabotLib remote server is started by default to enable locking and resource distribution between parallel test executions.
 
 Supports all [Robot Framework command line options](https://robotframework.org/robotframework/latest/RobotFrameworkUserGuide.html#all-command-line-options) and also following pabot options:
 
 --verbose     
-  more output from the parallel execution
+  More output from the parallel execution.
 
 --testlevelsplit          
-  Split execution on test level instead of default suite level.
-  If .pabotsuitenames contains both tests and suites then this
-  will only affect new suites and split only them.
-  Leaving this flag out when both suites and tests in
-  .pabotsuitenames file will also only affect new suites and
-  add them as suite files.
+  Split execution on test level instead of default suite level. If .pabotsuitenames contains both tests and suites then
+  this will only affect new suites and split only them. Leaving this flag out when both suites and tests in 
+  .pabotsuitenames file will also only affect new suites and add them as suite files.
 
 --command [ACTUAL COMMANDS TO START ROBOT EXECUTOR] --end-command    
-  RF script for situations where robot is not used directly
-
---processes   [NUMBER OF PROCESSES]          
-  How many parallel executors to use (default max of 2 and cpu count).
-  Special option "all" will use as many processes as there are
-  executable suites or tests.
+  RF script for situations where robot is not used directly.
 
-PabotLib remote server is started by default to enable locking and resource distribution 
-between parallel test executions.
+--processes [NUMBER OF PROCESSES]          
+  How many parallel executors to use (default max of 2 and cpu count). Special option "all" will use as many processes as 
+  there are executable suites or tests.
 
---no-pabotlib
+--no-pabotlib  
   Disable the PabotLib remote server if you don't need locking or resource distribution features.
 
---pabotlibhost   [HOSTNAME]          
-  Connect to an already running instance of the PabotLib remote server at the given host
-  (disables the local PabotLib server start). 
+--pabotlibhost [HOSTNAME]          
+  Connect to an already running instance of the PabotLib remote server at the given host (disables the local PabotLib 
+  server start). For example, to connect to a remote PabotLib server running on another machine:
+  
+      pabot --pabotlibhost 192.168.1.123 --pabotlibport 8271 tests/
+
   The remote server can be also started and executed separately from pabot instances:
   
       python -m pabot.pabotlib <path_to_resourcefile> <host> <port>
@@ -99,21 +99,20 @@ between parallel test executions.
   
   This enables sharing a resource with multiple Robot Framework instances.
 
---pabotlibport   [PORT]          
-  Port number of the PabotLib remote server (default is 8270)
-  See --pabotlibhost for more information
+--pabotlibport [PORT]          
+  Port number of the PabotLib remote server (default is 8270). See --pabotlibhost for more information.
 
---processtimeout   [TIMEOUT]          
+--processtimeout [TIMEOUT]          
   Maximum time in seconds to wait for a process before killing it. If not set, there's no timeout.
 
---resourcefile   [FILEPATH]          
-  Indicator for a file that can contain shared variables for distributing resources. This needs to be used together with pabotlib option. Resource file syntax is same as Windows ini files. Where a section is a shared set of variables.
+--shard [INDEX]/[TOTAL]   
+  Optionally split execution into smaller pieces. This can be used for distributing testing to multiple machines.
   
 --artifacts [FILE EXTENSIONS]   
-  List of file extensions (comma separated).    
-  Defines which files (screenshots, videos etc.) from separate reporting directories would be copied and included in a final report.   
-  Possible links to copied files in RF log would be updated (only relative paths supported).   
-  The default value is `png`.    
+  List of file extensions (comma separated). Defines which files (screenshots, videos etc.) from separate reporting 
+  directories would be copied and included in a final report. Possible links to copied files in RF log would be updated 
+  (only relative paths supported). The default value is `png`.
+
   Examples:
 
      --artifacts png,mp4,txt
@@ -121,22 +120,33 @@ between parallel test executions.
 --artifactsinsubfolders   
   Copy artifacts located not only directly in the RF output dir, but also in it's sub-folders.
 
---argumentfile[INTEGER]   [FILEPATH]          
+--resourcefile [FILEPATH]          
+  Indicator for a file that can contain shared variables for distributing resources. This needs to be used together with 
+  pabotlib option. Resource file syntax is same as Windows ini files. Where a section is a shared set of variables.
+
+--argumentfile [INTEGER] [FILEPATH]          
   Run same suites with multiple [argumentfile](http://robotframework.org/robotframework/latest/RobotFrameworkUserGuide.html#argument-files) options.
+
   For example:
 
      --argumentfile1 arg1.txt --argumentfile2 arg2.txt
 
---suitesfrom   [FILEPATH TO OUTPUTXML]          
-  Optionally read suites from output.xml file. Failed suites will run
-  first and longer running ones will be executed before shorter ones.
+--suitesfrom [FILEPATH TO OUTPUTXML]          
+  Optionally read suites from output.xml file. Failed suites will run first and longer running ones will be executed 
+  before shorter ones.
+
+--ordering [FILE PATH]   
+  Optionally give execution order from a file.
 
---shard [INDEX]/[TOTAL]
-  Optionally split execution into smaller pieces. This can
-  be used for distributing testing to multiple machines.
+--chunk   
+  Optionally chunk tests to PROCESSES number of robot runs. This can save time because all the suites will share the same 
+  setups and teardowns.
 
---chunk
-  Optionally chunk tests to PROCESSES number of robot runs. This can save time because all the suites will share the same setups and teardowns.
+--pabotprerunmodifier [PRERUNMODIFIER MODULE OR CLASS]   
+  Like Robot Framework's --prerunmodifier, but executed only once in the pabot's main process after all other 
+  --prerunmodifiers. But unlike the regular --prerunmodifier command, --pabotprerunmodifier is not executed again in each 
+  pabot subprocesses. Depending on the intended use, this may be desirable as well as more efficient. Can be used, for 
+  example, to modify the list of tests to be performed.
 
 Example usages:
 
@@ -149,6 +159,7 @@ Example usages:
      # To disable PabotLib:
      pabot --no-pabotlib tests
 
+<!-- END DOCSTRING -->
 ### PabotLib
 
 pabot.PabotLib provides keywords that will help communication and data sharing between the executor processes.
@@ -219,7 +230,7 @@ There different possibilities to influence the execution:
   * If the base suite name is changing with robot option [```--name / -N```](https://robotframework.org/robotframework/latest/RobotFrameworkUserGuide.html#setting-the-name) you can also give partial suite name without the base suite.
   * You can add a line with text `#WAIT` to force executor to wait until all previous suites have been executed.
   * You can group suites and tests together to same executor process by adding line `{` before the group and `}`after.
-  * You can introduce dependencies using the word `#DEPENDS` after a test declaration. Please take care that in case of circular dependencies an exception will be thrown. An example could be.
+  * You can introduce dependencies using the word `#DEPENDS` after a test declaration. Can be used several times if it is necessary to refer to several different tests. Please take care that in case of circular dependencies an exception will be thrown. An example could be.
 
 ```
 --test robotTest.1 Scalar.Test With Environment Variables #DEPENDS robotTest.1 Scalar.Test with BuiltIn Variables of Robot Framework

{robotframework_pabot-4.0.6 → robotframework_pabot-4.1.0}/src/pabot/__init__.py

@@ -2,4 +2,4 @@ from __future__ import absolute_import
 
 from .pabotlib import PabotLib
 
-__version__ = "4.0.6"
+__version__ = "4.1.0"

{robotframework_pabot-4.0.6 → robotframework_pabot-4.1.0}/src/pabot/arguments.py

@@ -106,8 +106,9 @@ def _parse_pabot_args(args):  # type: (List[str]) -> Tuple[List[str], Dict[str,
         "resourcefile": str,
         "pabotlibhost": str,
         "pabotlibport": int,
+        "pabotprerunmodifier": str,
         "processtimeout": int,
-        "ordering": _parse_ordering,
+        "ordering": str,
         "suitesfrom": str,
         "artifacts": lambda x: x.split(","),
         "shard": _parse_shard,
@@ -195,17 +196,6 @@ def _parse_pabot_args(args):  # type: (List[str]) -> Tuple[List[str], Dict[str,
     return remaining_args, pabot_args
 
 
-def _parse_ordering(filename):  # type: (str) -> List[ExecutionItem]
-    try:
-        with open(filename, "r") as orderingfile:
-            return [
-                parse_execution_item_line(line.strip())
-                for line in orderingfile.readlines()
-            ]
-    except:
-        raise DataError("Error parsing ordering file '%s'" % filename)
-
-
 def _delete_none_keys(d):  # type: (Dict[str, Optional[object]]) -> Dict[str, object]
     keys = set()
     for k in d:

{robotframework_pabot-4.0.6 → robotframework_pabot-4.1.0}/src/pabot/execution_items.py

@@ -5,6 +5,7 @@ from robot import __version__ as ROBOT_VERSION
 from robot.errors import DataError
 from robot.utils import PY2, is_unicode
 
+import re
 
 @total_ordering
 class ExecutionItem(object):
@@ -97,20 +98,31 @@ class GroupItem(ExecutionItem):
 class RunnableItem(ExecutionItem):
     pass
 
-    depends = None  # type: str
+    depends = None  # type: List[str]
     depends_keyword = "#DEPENDS"
 
+    def _split_dependencies(self, line_name, depends_indexes):
+        depends_lst = [] if len(depends_indexes) < 2 else [line_name[i + len(self.depends_keyword) : j].strip() for i, j in zip(depends_indexes, depends_indexes[1:])]
+        depends_lst.append(line_name[depends_indexes[-1] + len(self.depends_keyword) : ].strip())
+        return depends_lst
+
+    def _merge_dependencies(self, line_start):
+        output_line = line_start
+        for d in self.depends:
+            output_line = output_line + " " + self.depends_keyword + " " + d
+        return output_line
+
     def set_name_and_depends(self, name):
         line_name = name.encode("utf-8") if PY2 and is_unicode(name) else name
-        depends_begin_index = line_name.find(self.depends_keyword)
+        depends_indexes = [d.start() for d in re.finditer(self.depends_keyword, line_name)]
         self.name = (
             line_name
-            if depends_begin_index == -1
-            else line_name[0:depends_begin_index].strip()
+            if len(depends_indexes) == 0
+            else line_name[0:depends_indexes[0]].strip()
         )
         self.depends = (
-            line_name[depends_begin_index + len(self.depends_keyword) :].strip()
-            if depends_begin_index != -1
+            self._split_dependencies(line_name, depends_indexes)
+            if len(depends_indexes) != 0
             else None
         )
 
@@ -118,7 +130,7 @@ class RunnableItem(ExecutionItem):
         # type: () -> str
         line_without_depends = "--" + self.type + " " + self.name
         return (
-            line_without_depends + " " + self.depends_keyword + " " + self.depends
+            self._merge_dependencies(line_without_depends)
             if self.depends
             else line_without_depends
         )

{robotframework_pabot-4.0.6 → robotframework_pabot-4.1.0}/src/pabot/pabot.py

@@ -15,73 +15,12 @@
 #  limitations under the License.
 #
 #  partly based on work by Nokia Solutions and Networks Oyj
+
+# Help documentation from README.md:
 """A parallel executor for Robot Framework test cases.
 Version [PABOT_VERSION]
 
-Supports all Robot Framework command line options and also following
-options (these must be before normal RF options):
-
---verbose
-  more output
-
---command [ACTUAL COMMANDS TO START ROBOT EXECUTOR] --end-command
-  RF script for situations where pybot is not used directly
-
---processes [NUMBER OF PROCESSES]
-  How many parallel executors to use (default max of 2 and cpu count).
-  Special option "all" will use as many processes as there are
-  executable suites or tests.
-
---testlevelsplit
-  Split execution on test level instead of default suite level.
-  If .pabotsuitenames contains both tests and suites then this
-  will only affect new suites and split only them.
-  Leaving this flag out when both suites and tests in
-  .pabotsuitenames file will also only affect new suites and
-  add them as suite files.
-
---resourcefile [FILEPATH]
-  Indicator for a file that can contain shared variables for
-  distributing resources.
-
---no-pabotlib
-  Disable the PabotLib remote server if you don't need locking or resource distribution features.
-  PabotLib remote server is started by default.
-
---pabotlibhost [HOSTNAME]          
-  Connect to an already running instance of the PabotLib remote server at the given host
-  (disables the local PabotLib server start). For example, to connect to a 
-  remote PabotLib server running on another machine:
-  
-      pabot --pabotlibhost 192.168.1.123 --pabotlibport 8271 tests/
-
-  The remote PabotLib server can be started separately using:
-      python -m pabot.pabotlib <path_to_resourcefile> <host> <port>
-      python -m pabot.pabotlib resource.txt 192.168.1.123 8271
-
---pabotlibport [PORT]
-  Port number of the PabotLib remote server (default is 8270)
-
---processtimeout [TIMEOUT]
-  Maximum time in seconds to wait for a process before killing it. If not set, there's no timeout.
-
---ordering [FILE PATH]
-  Optionally give execution order from a file.
-
---suitesfrom [FILEPATH TO OUTPUTXML]
-  Optionally read suites from output.xml file. Failed suites will run
-  first and longer running ones will be executed before shorter ones.
-
---argumentfile[INTEGER] [FILEPATH]
-  Run same suite with multiple argumentfile options.
-  For example "--argumentfile1 arg1.txt --argumentfile2 arg2.txt".
-
---shard [SHARD]/[SHARD COUNT]
-  Optionally split execution into smaller pieces. This can
-  be used for distributing testing to multiple machines.
-
---chunk
-  Optionally chunk tests to PROCESSES number of robot runs.
+PLACEHOLDER_README.MD
 
 Copyright 2022 Mikko Korpela - Apache 2 License
 """
@@ -184,6 +123,27 @@ _ROBOT_EXTENSIONS = [
 _ALL_ELAPSED = []  # type: List[Union[int, float]]
 
 
+def extract_section(filename, start_marker, end_marker):
+    with open(filename, "r", encoding="utf-8") as f:
+        lines = f.readlines()
+
+    inside_section = False
+    extracted_lines = []
+
+    for line in lines:
+        if start_marker in line:
+            inside_section = True
+            continue
+        if end_marker in line:
+            inside_section = False
+            break
+        if inside_section:
+            # Add line from README.md without [] and (https: address)
+            extracted_lines.append(re.sub(r'\[([^\]]+)\]\(https?://[^\)]+\)', r'\1', line))
+
+    return "".join(extracted_lines).strip()
+
+
 class Color:
     SUPPORTED_OSES = ["posix"]
 
@@ -880,6 +840,8 @@ def solve_shard_suites(suite_names, pabot_args):
 
 
 def solve_suite_names(outs_dir, datasources, options, pabot_args):
+    if pabot_args.get("pabotprerunmodifier"):
+        options['prerunmodifier'].append(pabot_args['pabotprerunmodifier'])
     h = Hashes(
         dirs=get_hash_of_dirs(datasources),
         cmd=get_hash_of_command(options, pabot_args),
@@ -915,7 +877,7 @@ def solve_suite_names(outs_dir, datasources, options, pabot_args):
                 for l in lines[4:]
             )
             execution_item_lines = [parse_execution_item_line(l) for l in lines[4:]]
-            if corrupted or h != file_h or file_hash != hash_of_file:
+            if corrupted or h != file_h or file_hash != hash_of_file or pabot_args.get("pabotprerunmodifier"):
                 return _regenerate(
                     file_h,
                     h,
@@ -1949,7 +1911,11 @@ def main_program(args):
         _start_message_writer()
         options, datasources, pabot_args, opts_for_run = parse_args(args)
         if pabot_args["help"]:
-            print(__doc__.replace("[PABOT_VERSION]", PABOT_VERSION))
+            help_print = __doc__.replace(
+                "PLACEHOLDER_README.MD",
+                extract_section("README.md", "<!-- START DOCSTRING -->", "<!-- END DOCSTRING -->")
+                )
+            print(help_print.replace("[PABOT_VERSION]", PABOT_VERSION))
             return 0
         if len(datasources) == 0:
             print("[ " + _wrap_with(Color.RED, "ERROR") + " ]: No datasources given.")
@@ -1988,7 +1954,8 @@ def main_program(args):
         )
         return result_code if not _ABNORMAL_EXIT_HAPPENED else 252
     except Information as i:
-        print(__doc__.replace("[PABOT_VERSION]", PABOT_VERSION))
+        version_print = __doc__.replace("\nPLACEHOLDER_README.MD\n", "")
+        print(version_print.replace("[PABOT_VERSION]", PABOT_VERSION))
         print(i.message)
     except DataError as err:
         print(err.message)
@@ -2010,10 +1977,24 @@ def main_program(args):
         _stop_message_writer()
 
 
+def _parse_ordering(filename):  # type: (str) -> List[ExecutionItem]
+    try:
+        with open(filename, "r") as orderingfile:
+            return [
+                parse_execution_item_line(line.strip())
+                for line in orderingfile.readlines()
+            ]
+    except FileNotFoundError:
+        raise DataError("Error: File '%s' not found." % filename)
+    except:
+        raise DataError("Error parsing ordering file '%s'" % filename)
+
+
 def _group_suites(outs_dir, datasources, options, pabot_args):
     suite_names = solve_suite_names(outs_dir, datasources, options, pabot_args)
     _verify_depends(suite_names)
-    ordered_suites = _preserve_order(suite_names, pabot_args.get("ordering"))
+    ordering_arg = _parse_ordering(pabot_args.get("ordering")) if (pabot_args.get("ordering")) is not None else None
+    ordered_suites = _preserve_order(suite_names, ordering_arg)
     shard_suites = solve_shard_suites(ordered_suites, pabot_args)
     grouped_suites = (
         _chunked_suite_names(shard_suites, pabot_args["processes"])
@@ -2083,20 +2064,27 @@ def _group_by_depend(suite_names):
         return [suite_names]
     independent_tests = list(filter(lambda suite: not suite.depends, runnable_suites))
     dependency_tree = [independent_tests]
-    while True:
-        dependent_tests = list(filter(lambda suite: suite.depends, runnable_suites))
-        dependent_on_last_stage = list(
-            filter(
-                lambda suite: any(
-                    test_in_tier_before.name == suite.depends
-                    for test_in_tier_before in dependency_tree[-1]
-                ),
-                dependent_tests,
-            )
-        )
-        if not dependent_on_last_stage:
-            break
-        dependency_tree += [dependent_on_last_stage]
+    dependent_tests = list(filter(lambda suite: suite.depends, runnable_suites))
+    unknown_dependent_tests = dependent_tests
+    while len(unknown_dependent_tests) > 0:
+        run_in_this_stage, run_later = [], []
+        for d in unknown_dependent_tests:
+            stage_indexes = []
+            for i, stage in enumerate(dependency_tree):
+                for test in stage:
+                    if test.name in d.depends:
+                        stage_indexes.append(i)
+            # All #DEPENDS test are already run:
+            if len(stage_indexes) == len(d.depends):
+                run_in_this_stage.append(d)
+            else:
+                run_later.append(d)
+        unknown_dependent_tests = run_later
+        if len(run_in_this_stage) == 0:
+            text = "There are circular or unmet dependencies using #DEPENDS. Check this/these test(s): " + str(run_later)
+            raise DataError(text)
+        else:
+            dependency_tree.append(run_in_this_stage)
     flattened_dependency_tree = sum(dependency_tree, [])
     if len(flattened_dependency_tree) != len(runnable_suites):
         raise DataError(

{robotframework_pabot-4.0.6 → robotframework_pabot-4.1.0}/src/robotframework_pabot.egg-info/PKG-INFO

@@ -1,6 +1,6 @@
-Metadata-Version: 2.1
+Metadata-Version: 2.2
 Name: robotframework-pabot
-Version: 4.0.6
+Version: 4.1.0
 Summary: Parallel test runner for Robot Framework
 Home-page: https://pabot.org
 Download-URL: https://pypi.python.org/pypi/robotframework-pabot
@@ -20,5 +20,6 @@ License-File: LICENSE.txt
 Requires-Dist: robotframework>=3.2
 Requires-Dist: robotframework-stacktrace>=0.4.1
 Requires-Dist: natsort>=8.2.0
+Dynamic: download-url
 
 A parallel executor for Robot Framework tests. With Pabot you can split one execution into multiple and save test execution time.

{robotframework_pabot-4.0.6 → robotframework_pabot-4.1.0}/src/robotframework_pabot.egg-info/SOURCES.txt

@@ -32,6 +32,7 @@ tests/test_functional.py
 tests/test_ordering.py
 tests/test_pabot.py
 tests/test_pabotlib.py
+tests/test_pabotprerunmodifier.py
 tests/test_pabotsuitenames_io.py
 tests/test_prerunmodifier.py
 tests/test_resultmerger.py

robotframework_pabot-4.1.0/tests/test_depends.py

@@ -0,0 +1,219 @@
+import subprocess
+import sys
+import textwrap
+import shutil
+import tempfile
+import unittest
+
+
+def _string_convert(byte_string):
+    legacy_python = sys.version_info < (3, 0)
+    return byte_string.decode() if legacy_python else byte_string
+
+
+class DependsTest(unittest.TestCase):
+    test_file = """
+        *** Settings ***
+        Test Template    Test1
+        *** Test Cases ***
+        The Test S1Test 01    1
+        The Test S1Test 02    1
+        The Test S1Test 03    1
+        The Test S1Test 04    1
+        The Test S1Test 05    1
+        The Test S1Test 06    1
+        The Test S1Test 07    1
+        The Test S1Test 08    1
+        The Test S1Test 09    1
+        The Test S1Test 10    1
+        The Test S1Test 11    1
+        The Test S1Test 12    1
+        *** Keywords ***
+        Test1
+            [Arguments]  ${arg}
+            Log  Test
+        """
+    passed = _string_convert(b"PASSED")
+    failed = _string_convert(b"FAILED")
+    test_01 = _string_convert(b"S1Test 01")
+    test_02 = _string_convert(b"S1Test 02")
+    test_03 = _string_convert(b"S1Test 03")
+    test_04 = _string_convert(b"S1Test 04")
+    test_05 = _string_convert(b"S1Test 05")
+    test_06 = _string_convert(b"S1Test 06")
+    test_07 = _string_convert(b"S1Test 07")
+    test_08 = _string_convert(b"S1Test 08")
+    test_09 = _string_convert(b"S1Test 09")
+    test_10 = _string_convert(b"S1Test 10")
+    test_11 = _string_convert(b"S1Test 11")
+    test_12 = _string_convert(b"S1Test 12")
+
+    def setUp(self):
+        self.tmpdir = tempfile.mkdtemp()
+
+    def tearDown(self):
+        shutil.rmtree(self.tmpdir)
+
+    def _run_tests_with(self, testfile, orderfile):
+        robot_file = open("{}/test.robot".format(self.tmpdir), "w")
+        robot_file.write(textwrap.dedent(testfile))
+        robot_file.close()
+        with open("{}/order.dat".format(self.tmpdir), "w") as f:
+            f.write(textwrap.dedent(orderfile))
+        process = subprocess.Popen(
+            [
+                sys.executable,
+                "-m" "pabot.pabot",
+                "--testlevelsplit",
+                "--ordering",
+                "{}/order.dat".format(self.tmpdir),
+                "{}/test.robot".format(self.tmpdir),
+            ],
+            cwd=self.tmpdir,
+            stdout=subprocess.PIPE,
+            stderr=subprocess.PIPE,
+        )
+        return process.communicate()
+
+    def test_dependency_ok(self):
+        stdout, stderr = self._run_tests_with(
+            self.test_file,
+            """
+        --test Test.The Test S1Test 01 #DEPENDS Test.The Test S1Test 02
+        --test Test.The Test S1Test 02 #DEPENDS Test.The Test S1Test 08
+        --test Test.The Test S1Test 08
+        """,
+        )
+        self.assertIn(self.passed, stdout, stderr)
+        self.assertNotIn(self.failed, stdout, stderr)
+        self.assertEqual(stdout.count(self.passed), 12)
+        test_01_index = stdout.find(self.test_01)
+        test_02_index = stdout.find(self.test_02)
+        test_08_index = stdout.find(self.test_08)
+        self.assertNotEqual(test_01_index, -1)
+        self.assertNotEqual(test_02_index, -1)
+        self.assertNotEqual(test_08_index, -1)
+        self.assertTrue(test_08_index < test_02_index)
+        self.assertTrue(test_02_index < test_01_index)
+
+    def test_multiple_dependencies_ok(self):
+        stdout, stderr = self._run_tests_with(
+            self.test_file,
+            """
+        --test Test.The Test S1Test 01
+        --test Test.The Test S1Test 02 #DEPENDS Test.The Test S1Test 01
+        --test Test.The Test S1Test 03 #DEPENDS Test.The Test S1Test 02
+        --test Test.The Test S1Test 04
+        --test Test.The Test S1Test 05 #DEPENDS Test.The Test S1Test 01 #DEPENDS Test.The Test S1Test 04
+        --test Test.The Test S1Test 06 #DEPENDS Test.The Test S1Test 05
+        --test Test.The Test S1Test 07
+        --test Test.The Test S1Test 08
+        --test Test.The Test S1Test 09 #DEPENDS Test.The Test S1Test 07 #DEPENDS Test.The Test S1Test 08 #DEPENDS Test.The Test S1Test 06
+        --test Test.The Test S1Test 10 #DEPENDS Test.The Test S1Test 12
+        --test Test.The Test S1Test 11 #DEPENDS Test.The Test S1Test 03 #DEPENDS Test.The Test S1Test 06 #DEPENDS Test.The Test S1Test 10 #DEPENDS Test.The Test S1Test 09
+        --test Test.The Test S1Test 12
+        """,
+        )
+        self.assertIn(self.passed, stdout, stderr)
+        self.assertNotIn(self.failed, stdout, stderr)
+        self.assertEqual(stdout.count(self.passed), 12)
+        test_01_index = stdout.find(self.test_01)
+        test_02_index = stdout.find(self.test_02)
+        test_03_index = stdout.find(self.test_03)
+        test_04_index = stdout.find(self.test_04)
+        test_05_index = stdout.find(self.test_05)
+        test_06_index = stdout.find(self.test_06)
+        test_07_index = stdout.find(self.test_07)
+        test_08_index = stdout.find(self.test_08)
+        test_09_index = stdout.find(self.test_09)
+        test_10_index = stdout.find(self.test_10)
+        test_11_index = stdout.find(self.test_11)
+        test_12_index = stdout.find(self.test_12)
+        self.assertNotEqual(test_01_index, -1)
+        self.assertNotEqual(test_02_index, -1)
+        self.assertNotEqual(test_03_index, -1)
+        self.assertNotEqual(test_04_index, -1)
+        self.assertNotEqual(test_05_index, -1)
+        self.assertNotEqual(test_06_index, -1)
+        self.assertNotEqual(test_07_index, -1)
+        self.assertNotEqual(test_08_index, -1)
+        self.assertNotEqual(test_09_index, -1)
+        self.assertNotEqual(test_10_index, -1)
+        self.assertNotEqual(test_11_index, -1)
+        self.assertNotEqual(test_12_index, -1)
+        self.assertTrue(test_02_index > test_01_index)
+        self.assertTrue(test_03_index > test_02_index)
+        self.assertTrue(test_05_index > test_01_index)
+        self.assertTrue(test_05_index > test_04_index)
+        self.assertTrue(test_06_index > test_05_index)
+        self.assertTrue(test_09_index > test_07_index)
+        self.assertTrue(test_09_index > test_08_index)
+        self.assertTrue(test_09_index > test_06_index)
+        self.assertTrue(test_10_index > test_12_index)
+        self.assertTrue(test_11_index > test_03_index)
+        self.assertTrue(test_11_index > test_06_index)
+        self.assertTrue(test_11_index > test_10_index)
+        self.assertTrue(test_11_index > test_09_index)
+
+    def test_circular_dependency(self):
+        stdout, stderr = self._run_tests_with(
+            self.test_file,
+            """
+        --test Test.The Test S1Test 01 #DEPENDS Test.The Test S1Test 02
+        --test Test.The Test S1Test 02 #DEPENDS Test.The Test S1Test 01
+        --test Test.The Test S1Test 08
+        """,
+        )
+        self.assertIn(b"circular or unmet dependencies using #DEPENDS. Check this/these test(s): [<test:Test.The Test S1Test 01>, <test:Test.The Test S1Test 02>]", stdout)
+        self.assertEqual(b"", stderr)
+
+    def test_circular_dependency_with_multiple_depends(self):
+        stdout, stderr = self._run_tests_with(
+            self.test_file,
+            """
+        --test Test.The Test S1Test 01
+        --test Test.The Test S1Test 02 #DEPENDS Test.The Test S1Test 01
+        --test Test.The Test S1Test 03 #DEPENDS Test.The Test S1Test 01
+        --test Test.The Test S1Test 08 #DEPENDS Test.The Test S1Test 02 #DEPENDS Test.The Test S1Test 03 #DEPENDS Test.The Test S1Test 09
+        --test Test.The Test S1Test 09 #DEPENDS Test.The Test S1Test 01 #DEPENDS Test.The Test S1Test 08
+        """,
+        )
+        self.assertIn(b"circular or unmet dependencies using #DEPENDS. Check this/these test(s): [<test:Test.The Test S1Test 08>, <test:Test.The Test S1Test 09>]", stdout)
+        self.assertEqual(b"", stderr)
+
+    def test_unmet_dependency(self):
+        stdout, stderr = self._run_tests_with(
+            self.test_file,
+            """
+        --test Test.The Test S1Test 01
+        --test Test.The Test S1Test 02 #DEPENDS Test.The Test S1Test 23
+        --test Test.The Test S1Test 08
+        """,
+        )
+        self.assertIn(b"circular or unmet dependencies using #DEPENDS. Check this/these test(s): [<test:Test.The Test S1Test 02>]", stdout)
+        self.assertEqual(b"", stderr)
+
+    def test_same_reference(self):
+        stdout, stderr = self._run_tests_with(
+            self.test_file,
+            """
+        --test Test.The Test S1Test 01
+        --test Test.The Test S1Test 02 #DEPENDS Test.The Test S1Test 02
+        --test Test.The Test S1Test 08
+        """,
+        )
+        self.assertIn(b"circular or unmet dependencies using #DEPENDS. Check this/these test(s): [<test:Test.The Test S1Test 02>]", stdout)
+        self.assertEqual(b"", stderr)
+
+    def test_wait(self):
+        stdout, stderr = self._run_tests_with(
+            self.test_file,
+            """
+        --test Test.The Test S1Test 01
+        --test Test.The Test S1Test 02 #DEPENDS Test.The Test S1Test 08
+        #WAIT
+        --test Test.The Test S1Test 08
+        """,
+        )
+        self.assertIn(b"circular or unmet dependencies using #DEPENDS. Check this/these test(s): [<test:Test.The Test S1Test 02>]", stdout)
+        self.assertEqual(b"", stderr)

robotframework_pabot-4.1.0/tests/test_pabotprerunmodifier.py

@@ -0,0 +1,212 @@
+import unittest
+import tempfile
+import textwrap
+import shutil
+import subprocess
+import sys
+import os
+import re
+import robot
+
+
+def check_robot_version_and_return_name():
+    version = robot.__version__
+    major_version = int(version.split('.')[0])
+
+    if major_version >= 7:
+        return "full_name"
+    else:
+        return "longname"
+
+
+class PabotPrerunModifierTests(unittest.TestCase):
+    @classmethod
+    def setUpClass(self):
+        self.tmpdir = tempfile.mkdtemp()
+        self.tmpdir_name = (re.sub(r'(\d)([a-z])', lambda m: m.group(1) + m.group(2).upper(),
+                                   " ".join(word.capitalize().strip() for word in os.path.basename(self.tmpdir).split("_")))).strip()
+
+        # robot case file 1
+        self.robot_file_path_1 = f'{self.tmpdir}/test_1.robot'
+        with open(self.robot_file_path_1, 'w') as robot_file:
+            robot_file.write(
+                textwrap.dedent("""
+*** Test Cases ***
+Testing 1
+   [Tags]  tag  test3
+   Log  hello
+
+Testing 2
+   [Tags]  tag  test  test2  test3
+   Log  world
+
+Testing 3
+   [Tags]  tag
+   Log  world
+"""))
+            
+        # robot case file 2
+        self.robot_file_path_2 = f'{self.tmpdir}/test_2.robot'
+        with open(self.robot_file_path_2, 'w') as robot_file:
+            robot_file.write(
+                textwrap.dedent("""
+*** Test Cases ***
+Testing 4
+   [Tags]  tag
+   Log  hello
+
+Testing 5
+   [Tags]  tag  test2  test3
+   Log  world
+
+Testing 6
+   [Tags]  tag
+   Log  world
+"""))
+
+        # pabotprerunmodifier script. Works like Robot Framework --include command
+        self.modifier_file_path = f'{self.tmpdir}/Modifier.py'
+        correct_full_name_call = check_robot_version_and_return_name()
+        with open(self.modifier_file_path, 'w') as modifier_file:
+            modifier_file.write(
+                textwrap.dedent(f"""
+from robot.api import SuiteVisitor
+
+class Modifier(SuiteVisitor):
+    def __init__(self, tag):
+        self.list_of_test_names = []
+        self.tag = tag
+ 
+    def start_suite(self, suite):
+        if suite.tests:
+            for test in suite.tests:
+                if self.tag in test.tags:
+                   self.list_of_test_names.append(test.{correct_full_name_call})
+    
+    def end_suite(self, suite):
+        suite.tests = [t for t in suite.tests if t.{correct_full_name_call} in self.list_of_test_names]
+        suite.suites = [s for s in suite.suites if s.test_count > 0]              
+"""))
+
+        # prerunmodifier script
+        self.modifier2_file_path = f'{self.tmpdir}/Modifier2.py'
+        with open(self.modifier2_file_path, 'w') as modifier_file:
+            modifier_file.write(
+                textwrap.dedent("""
+from robot.api import SuiteVisitor
+
+class Modifier2(SuiteVisitor):
+    def start_suite(self, suite):
+        if suite.tests:
+            for test in suite.tests:
+                if '2' in test.name:
+                    test.name = 'new-name-2'
+                    test.tags.add(['tag2'])
+"""))
+
+        # ordering file
+        self.ordering_file_path = f'{self.tmpdir}/ordering.txt'
+        with open(self.ordering_file_path, 'w') as ordering_file:
+            ordering_file.write(
+                textwrap.dedent(f"""
+{{
+--test {self.tmpdir_name}.Test 1.Testing 2
+--test {self.tmpdir_name}.Test 2.Testing 5
+}}
+--test {self.tmpdir_name}.Test 1.Testing 1
+"""))
+
+
+    def test_pabotprerunmodifier(self):
+        process = subprocess.Popen(
+            [
+                sys.executable,
+                "-m", "pabot.pabot",
+                "--pabotprerunmodifier",
+                self.modifier_file_path + ":test",
+                self.tmpdir
+            ],
+            cwd=self.tmpdir,
+            stdout=subprocess.PIPE,
+            stderr=subprocess.PIPE
+        )
+
+        stdout, stderr = process.communicate()
+        # without testlevelsplit argument whole test suite 1 will be executed.
+        self.assertIn(f'PASSED {self.tmpdir_name}.Test 1'.encode('utf-8'), stdout)
+        self.assertIn(b'3 tests, 3 passed, 0 failed, 0 skipped.', stdout)
+        self.assertEqual(b"", stderr)
+
+
+    def test_pabotprerunmodifier_with_testlevelsplit(self):
+        process = subprocess.Popen(
+            [
+                sys.executable,
+                "-m", "pabot.pabot",
+                "--testlevelsplit",
+                "--pabotprerunmodifier",
+                self.modifier_file_path + ":test2",
+                self.tmpdir
+            ],
+            cwd=self.tmpdir,
+            stdout=subprocess.PIPE,
+            stderr=subprocess.PIPE
+        )
+
+        stdout, stderr = process.communicate()
+        self.assertIn(f'PASSED {self.tmpdir_name}.Test 1.Testing 2'.encode('utf-8'), stdout)
+        self.assertIn(f'PASSED {self.tmpdir_name}.Test 2.Testing 5'.encode('utf-8'), stdout)
+        self.assertIn(b'2 tests, 2 passed, 0 failed, 0 skipped.', stdout)
+        self.assertEqual(b"", stderr)
+
+
+    def test_pabotprerunmodifier_with_testlevelsplit_and_ordering(self):
+        process = subprocess.Popen(
+            [
+                sys.executable,
+                "-m", "pabot.pabot",
+                "--testlevelsplit",
+                "--pabotprerunmodifier",
+                self.modifier_file_path + ":test3",
+                "--ordering",
+                self.ordering_file_path,
+                self.tmpdir
+            ],
+            cwd=self.tmpdir,
+            stdout=subprocess.PIPE,
+            stderr=subprocess.PIPE
+        )
+
+        stdout, stderr = process.communicate()
+        self.assertIn(f'PASSED Group_{self.tmpdir_name}.Test 1.Testing 2_{self.tmpdir_name}.Test 2.Testing 5'.encode('utf-8'), stdout)
+        self.assertIn(f'PASSED {self.tmpdir_name}.Test 1.Testing 1'.encode('utf-8'), stdout)
+        self.assertIn(b'3 tests, 3 passed, 0 failed, 0 skipped.', stdout)
+        self.assertEqual(b"", stderr)
+
+
+    def test_pabotprerunmodifier_with_prerunmodifier(self):
+        process = subprocess.Popen(
+            [
+                sys.executable,
+                "-m", "pabot.pabot",
+                "--testlevelsplit",
+                "--pabotprerunmodifier",
+                self.modifier_file_path + ":tag2",
+                "--prerunmodifier",
+                self.modifier2_file_path,
+                self.tmpdir
+            ],
+            cwd=self.tmpdir,
+            stdout=subprocess.PIPE,
+            stderr=subprocess.PIPE
+        )
+
+        stdout, stderr = process.communicate()
+        self.assertIn(f'PASSED {self.tmpdir_name}.Test 1.new-name-2'.encode('utf-8'), stdout)
+        self.assertIn(b'1 tests, 1 passed, 0 failed, 0 skipped.', stdout)
+        self.assertEqual(b"", stderr)
+
+
+    @classmethod
+    def tearDownClass(self):
+        shutil.rmtree(self.tmpdir)

robotframework_pabot-4.0.6/tests/test_depends.py

@@ -1,145 +0,0 @@
-import subprocess
-import sys
-import textwrap
-import shutil
-import tempfile
-import unittest
-
-
-def _string_convert(byte_string):
-    legacy_python = sys.version_info < (3, 0)
-    return byte_string.decode() if legacy_python else byte_string
-
-
-class DependsTest(unittest.TestCase):
-    test_file = """
-        *** Settings ***
-        Test Template    Test1
-        *** Test Cases ***
-        The Test S1Test 01    1
-        The Test S1Test 02    1
-        The Test S1Test 03    1
-        The Test S1Test 04    1
-        The Test S1Test 05    1
-        The Test S1Test 06    1
-        The Test S1Test 07    1
-        The Test S1Test 08    1
-        The Test S1Test 09    1
-        The Test S1Test 10    1
-        The Test S1Test 11    1
-        The Test S1Test 12    1
-        *** Keywords ***
-        Test1
-            [Arguments]  ${arg}
-            Log  Test
-        """
-    passed = _string_convert(b"PASSED")
-    failed = _string_convert(b"FAILED")
-    test_01 = _string_convert(b"S1Test 01")
-    test_02 = _string_convert(b"S1Test 02")
-    test_08 = _string_convert(b"S1Test 08")
-
-    def setUp(self):
-        self.tmpdir = tempfile.mkdtemp()
-
-    def tearDown(self):
-        shutil.rmtree(self.tmpdir)
-
-    def _run_tests_with(self, testfile, orderfile):
-        robot_file = open("{}/test.robot".format(self.tmpdir), "w")
-        robot_file.write(textwrap.dedent(testfile))
-        robot_file.close()
-        with open("{}/order.dat".format(self.tmpdir), "w") as f:
-            f.write(textwrap.dedent(orderfile))
-        process = subprocess.Popen(
-            [
-                sys.executable,
-                "-m" "pabot.pabot",
-                "--testlevelsplit",
-                "--ordering",
-                "{}/order.dat".format(self.tmpdir),
-                "{}/test.robot".format(self.tmpdir),
-            ],
-            cwd=self.tmpdir,
-            stdout=subprocess.PIPE,
-            stderr=subprocess.PIPE,
-        )
-        return process.communicate()
-
-    def test_dependency_ok(self):
-        stdout, stderr = self._run_tests_with(
-            self.test_file,
-            """
-        --test Test.The Test S1Test 01 #DEPENDS Test.The Test S1Test 02
-        --test Test.The Test S1Test 02 #DEPENDS Test.The Test S1Test 08
-        --test Test.The Test S1Test 08
-        """,
-        )
-        self.assertIn(self.passed, stdout, stderr)
-        self.assertNotIn(self.failed, stdout, stderr)
-        self.assertEqual(stdout.count(self.passed), 12)
-        test_01_index = stdout.find(self.test_01)
-        test_02_index = stdout.find(self.test_02)
-        test_08_index = stdout.find(self.test_08)
-        self.assertNotEqual(test_01_index, -1)
-        self.assertNotEqual(test_02_index, -1)
-        self.assertNotEqual(test_08_index, -1)
-        self.assertTrue(test_08_index < test_02_index)
-        self.assertTrue(test_02_index < test_01_index)
-
-    def test_circular_dependency(self):
-        stdout, stderr = self._run_tests_with(
-            self.test_file,
-            """
-        --test Test.The Test S1Test 01 #DEPENDS Test.The Test S1Test 02
-        --test Test.The Test S1Test 02 #DEPENDS Test.The Test S1Test 01
-        --test Test.The Test S1Test 08
-        """,
-        )
-        self.assertIn(
-            b"Invalid test configuration: Circular or unmet dependencies detected between test suites",
-            stdout,
-        )
-
-    def test_unmet_dependency(self):
-        stdout, stderr = self._run_tests_with(
-            self.test_file,
-            """
-        --test Test.The Test S1Test 01
-        --test Test.The Test S1Test 02 #DEPENDS Test.The Test S1Test 23
-        --test Test.The Test S1Test 08
-        """,
-        )
-        self.assertIn(
-            b"Invalid test configuration: Circular or unmet dependencies detected between test suites. Please check your #DEPENDS definitions.",
-            stdout,
-        )
-
-    def test_same_reference(self):
-        stdout, stderr = self._run_tests_with(
-            self.test_file,
-            """
-        --test Test.The Test S1Test 01
-        --test Test.The Test S1Test 02 #DEPENDS Test.The Test S1Test 02
-        --test Test.The Test S1Test 08
-        """,
-        )
-        self.assertIn(
-            b"Invalid test configuration: Circular or unmet dependencies detected between test suites. Please check your #DEPENDS definitions.",
-            stdout,
-        )
-
-    def test_wait(self):
-        stdout, stderr = self._run_tests_with(
-            self.test_file,
-            """
-        --test Test.The Test S1Test 01
-        --test Test.The Test S1Test 02 #DEPENDS Test.The Test S1Test 08
-        #WAIT
-        --test Test.The Test S1Test 08
-        """,
-        )
-        self.assertIn(
-            b"Invalid test configuration: Circular or unmet dependencies detected between test suites",
-            stdout,
-        )