cli-test-framework 0.3.6__tar.gz → 0.4.0__tar.gz

{cli_test_framework-0.3.6/src/cli_test_framework.egg-info → cli_test_framework-0.4.0}/PKG-INFO

@@ -1,6 +1,6 @@
-Metadata-Version: 2.2
+Metadata-Version: 2.4
 Name: cli-test-framework
-Version: 0.3.6
+Version: 0.4.0
 Summary: A powerful command line testing framework in Python with setup modules, parallel execution, and file comparison capabilities.
 Home-page: https://github.com/ozil111/cli-test-framework
 Author: Xiaotong Wang
@@ -233,6 +233,11 @@ compare-files data1.h5 data2.h5 \
 compare-files data1.h5 data2.h5 \
     --h5-table-regex "group1/.*" \
     --h5-structure-only
+
+# Use comma-separated table names with regex (New in 0.3.7)
+compare-files data1.h5 data2.h5 \
+    --h5-table-regex "table1,table2,table3" \
+    --h5-rtol 1e-6
 ```
 
 #### Binary Comparison
@@ -519,3 +524,42 @@ The user manual includes:
 **🚀 Ready to supercharge your testing workflow with setup modules, parallel execution and advanced file comparison!**
 
 For detailed parallel testing guide, see: [PARALLEL_TESTING_GUIDE.md](https://github.com/ozil111/cli-test-framework/blob/main/PARALLEL_TESTING_GUIDE.md)
+
+# 支持数据过滤（New in 0.3.6）
+
+你可以通过 `--h5-data-filter` 选项只比较满足特定条件的数据。例如：
+
+```bash
+# 只比较大于 1e-6 的数据
+compare-files data1.h5 data2.h5 --h5-data-filter '>1e-6'
+
+# 只比较绝对值大于 1e-6 的数据
+compare-files data1.h5 data2.h5 --h5-data-filter 'abs>1e-6'
+
+# 只比较小于等于 0.01 的数据
+compare-files data1.h5 data2.h5 --h5-data-filter '<=0.01'
+```
+
+支持的表达式包括：`>`, `>=`, `<`, `<=`, `==`，以及 `abs` 前缀（绝对值过滤）。
+
+# 版本更新日志
+
+## 0.3.7 (Latest)
+
+### 🐛 Bug Fixes
+- **Fixed H5 table regex matching**: `--h5-table-regex=table1,table2` now correctly matches both `table1` and `table2` instead of treating the entire string as a single regex pattern
+- **Enhanced regex pattern support**: Multiple comma-separated table names are now supported in `--h5-table-regex` parameter
+
+### ✨ New Features
+- **Improved HDF5 comparison**: Better handling of multiple table selection with regex patterns
+- **Enhanced debug output**: More detailed logging for HDF5 table matching process
+
+### 🔧 Improvements
+- **Backward compatibility**: All existing functionality remains unchanged
+- **Better error handling**: More informative error messages for regex pattern parsing
+
+## 0.3.6
+
+### ✨ New Features
+- **Data filtering for HDF5 files**: Added `--h5-data-filter` option to compare only data meeting specific criteria
+- **Enhanced HDF5 comparison**: Support for absolute value filtering and various comparison operators

{cli_test_framework-0.3.6 → cli_test_framework-0.4.0}/README.md

@@ -198,6 +198,11 @@ compare-files data1.h5 data2.h5 \
 compare-files data1.h5 data2.h5 \
     --h5-table-regex "group1/.*" \
     --h5-structure-only
+
+# Use comma-separated table names with regex (New in 0.3.7)
+compare-files data1.h5 data2.h5 \
+    --h5-table-regex "table1,table2,table3" \
+    --h5-rtol 1e-6
 ```
 
 #### Binary Comparison
@@ -484,3 +489,42 @@ The user manual includes:
 **🚀 Ready to supercharge your testing workflow with setup modules, parallel execution and advanced file comparison!**
 
 For detailed parallel testing guide, see: [PARALLEL_TESTING_GUIDE.md](https://github.com/ozil111/cli-test-framework/blob/main/PARALLEL_TESTING_GUIDE.md)
+
+# 支持数据过滤（New in 0.3.6）
+
+你可以通过 `--h5-data-filter` 选项只比较满足特定条件的数据。例如：
+
+```bash
+# 只比较大于 1e-6 的数据
+compare-files data1.h5 data2.h5 --h5-data-filter '>1e-6'
+
+# 只比较绝对值大于 1e-6 的数据
+compare-files data1.h5 data2.h5 --h5-data-filter 'abs>1e-6'
+
+# 只比较小于等于 0.01 的数据
+compare-files data1.h5 data2.h5 --h5-data-filter '<=0.01'
+```
+
+支持的表达式包括：`>`, `>=`, `<`, `<=`, `==`，以及 `abs` 前缀（绝对值过滤）。
+
+# 版本更新日志
+
+## 0.3.7 (Latest)
+
+### 🐛 Bug Fixes
+- **Fixed H5 table regex matching**: `--h5-table-regex=table1,table2` now correctly matches both `table1` and `table2` instead of treating the entire string as a single regex pattern
+- **Enhanced regex pattern support**: Multiple comma-separated table names are now supported in `--h5-table-regex` parameter
+
+### ✨ New Features
+- **Improved HDF5 comparison**: Better handling of multiple table selection with regex patterns
+- **Enhanced debug output**: More detailed logging for HDF5 table matching process
+
+### 🔧 Improvements
+- **Backward compatibility**: All existing functionality remains unchanged
+- **Better error handling**: More informative error messages for regex pattern parsing
+
+## 0.3.6
+
+### ✨ New Features
+- **Data filtering for HDF5 files**: Added `--h5-data-filter` option to compare only data meeting specific criteria
+- **Enhanced HDF5 comparison**: Support for absolute value filtering and various comparison operators

{cli_test_framework-0.3.6 → cli_test_framework-0.4.0}/docs/user_manual.md

@@ -319,8 +319,31 @@ compare-files data1.h5 data2.h5 --h5-table table1,table2
 
 # Compare with numerical tolerance
 compare-files data1.h5 data2.h5 --h5-rtol 1e-5 --h5-atol 1e-8
+
+# Use regex patterns for table selection
+compare-files data1.h5 data2.h5 --h5-table-regex "table.*"
+
+# Use comma-separated table names with regex (New in 0.3.7)
+compare-files data1.h5 data2.h5 --h5-table-regex "table1,table2,table3"
+```
+
+#### Data Filtering (New in 0.3.7)
+
+You can use the `--h5-data-filter` option to only compare data that meets a certain condition. For example:
+
+```bash
+# Only compare values greater than 1e-6
+compare-files data1.h5 data2.h5 --h5-data-filter '>1e-6'
+
+# Only compare absolute values greater than 1e-6
+compare-files data1.h5 data2.h5 --h5-data-filter 'abs>1e-6'
+
+# Only compare values less than or equal to 0.01
+compare-files data1.h5 data2.h5 --h5-data-filter '<=0.01'
 ```
 
+Supported filter expressions: `>`, `>=`, `<`, `<=`, `==`, and `abs` prefix for absolute value filtering.
+
 ### Binary File Comparison
 ```bash
 # Compare with similarity check

{cli_test_framework-0.3.6 → cli_test_framework-0.4.0}/setup.py

@@ -8,7 +8,7 @@ with open(os.path.join(this_directory, 'README.md'), encoding='utf-8') as f:
 
 setup(
     name="cli-test-framework",
-    version="0.3.6",
+    version="0.4.0",
     author="Xiaotong Wang",
     author_email="xiaotongwang98@gmail.com",
     description="A powerful command line testing framework in Python with setup modules, parallel execution, and file comparison capabilities.",

{cli_test_framework-0.3.6 → cli_test_framework-0.4.0}/src/cli_test_framework/__init__.py

@@ -5,7 +5,7 @@ This package provides tools for testing command-line applications and scripts
 with support for parallel execution and advanced file comparison capabilities.
 """
 
-__version__ = "0.3.3"
+__version__ = "0.3.7"
 __author__ = "Xiaotong Wang"
 __email__ = "xiaotongwang98@gmail.com"
 

{cli_test_framework-0.3.6 → cli_test_framework-0.4.0}/src/cli_test_framework/commands/compare.py

@@ -58,7 +58,7 @@ def parse_arguments():
     # H5 comparison options
     h5_group = parser.add_argument_group('HDF5 comparison options')
     h5_group.add_argument("--h5-table", help="Comma-separated list of table names to compare in HDF5 files")
-    h5_group.add_argument("--h5-table-regex", help="Regular expression pattern to match table names in HDF5 files")
+    h5_group.add_argument("--h5-table-regex", help="Comma-separated list of regular expression patterns to match table names in HDF5 files. Each pattern is matched independently.")
     h5_group.add_argument("--h5-structure-only", action="store_true", 
                          help="Only compare HDF5 file structure without comparing content")
     h5_group.add_argument("--h5-show-content-diff", action="store_true",

cli_test_framework-0.4.0/src/cli_test_framework/core/execution.py

@@ -0,0 +1,67 @@
+import subprocess
+import time
+from typing import Optional
+
+from .assertions import Assertions
+from .types import ExpectedResult, TestCaseData, TestResultData
+
+
+def validate_result(expected: ExpectedResult, actual: TestResultData) -> None:
+    """
+    Pure validation logic. Raises AssertionError on mismatch.
+    """
+    assertions = Assertions()
+
+    if "return_code" in expected:
+        assertions.return_code_equals(actual["return_code"], expected["return_code"])
+
+    if "output_contains" in expected:
+        for text in expected["output_contains"]:
+            assertions.contains(actual["output"], text)
+
+    if "output_matches" in expected and expected["output_matches"]:
+        assertions.matches(actual["output"], expected["output_matches"])
+
+
+def execute_single_test_case(case: TestCaseData, workspace: Optional[str] = None) -> TestResultData:
+    """
+    Stateless execution of a single test case.
+    """
+    start_time = time.time()
+    full_command = f"{case['command']} {' '.join(case['args'])}".strip()
+
+    result: TestResultData = {
+        "name": case["name"],
+        "status": "failed",
+        "message": "",
+        "command": full_command,
+        "output": "",
+        "return_code": None,
+        "duration": 0.0,
+    }
+
+    try:
+        process = subprocess.run(
+            full_command,
+            cwd=workspace if workspace else None,
+            capture_output=True,
+            text=True,
+            check=False,
+            shell=True,
+        )
+
+        output = process.stdout + process.stderr
+        result["output"] = output
+        result["return_code"] = process.returncode
+
+        validate_result(case["expected"], result)
+        result["status"] = "passed"
+    except AssertionError as exc:
+        result["message"] = str(exc)
+    except Exception as exc:
+        result["message"] = f"Execution error: {str(exc)}"
+    finally:
+        result["duration"] = time.time() - start_time
+
+    return result
+

cli_test_framework-0.4.0/src/cli_test_framework/core/process_worker.py

@@ -0,0 +1,43 @@
+"""
+进程工作器模块
+用于多进程并行测试执行，避免序列化问题
+"""
+
+from typing import Dict, Any
+from .execution import execute_single_test_case
+from .types import TestCaseData
+
+def run_test_in_process(test_index: int, case_data: Dict[str, Any], workspace: str = None) -> Dict[str, Any]:
+    """
+    在独立进程中运行单个测试用例
+    
+    Args:
+        test_index: 测试索引
+        case_data: 测试用例数据字典
+        workspace: 工作目录
+    
+    Returns:
+        测试结果字典
+    """
+    case: TestCaseData = {
+        "name": case_data["name"],
+        "command": case_data["command"],
+        "args": case_data["args"],
+        "expected": case_data["expected"],
+        "description": case_data.get("description"),
+    }
+
+    command_preview = f"{case['command']} {' '.join(case['args'])}".strip()
+    print(f"  [Process Worker {test_index}] Executing command: {command_preview}")
+
+    result = execute_single_test_case(case, workspace)
+
+    if result["output"].strip():
+        print(f"  [Process Worker {test_index}] Command output for {case['name']}:")
+        for line in result["output"].splitlines():
+            print(f"    {line}")
+
+    if result["status"] != "passed" and result.get("message"):
+        print(f"  [Process Worker {test_index}] Error for {case['name']}: {result['message']}")
+
+    return result 

cli_test_framework-0.4.0/src/cli_test_framework/core/types.py

@@ -0,0 +1,45 @@
+from typing import Any, Dict, List, Optional, TypedDict
+
+
+class ExpectedResult(TypedDict, total=False):
+    """Expectation configuration for a single test case."""
+
+    return_code: Optional[int]
+    output_contains: List[str]
+    output_matches: Optional[str]
+
+
+class TestCaseData(TypedDict):
+    """Input data shape for a test case after解析/路径处理."""
+
+    name: str
+    command: str
+    args: List[str]
+    expected: ExpectedResult
+    description: Optional[str]
+
+
+class SetupConfig(TypedDict):
+    """Setup configuration (currently environment variables only)."""
+
+    environment_variables: Dict[str, str]
+
+
+class TestSuiteConfig(TypedDict):
+    """Top-level configuration for a suite loaded from JSON/YAML."""
+
+    setup: Optional[SetupConfig]
+    test_cases: List[TestCaseData]
+
+
+class TestResultData(TypedDict):
+    """Normalized result produced by executing a single test case."""
+
+    name: str
+    status: str  # 'passed', 'failed'
+    message: str
+    command: str
+    output: str
+    return_code: Optional[int]
+    duration: float
+

{cli_test_framework-0.3.6 → cli_test_framework-0.4.0}/src/cli_test_framework/file_comparator/h5_comparator.py

@@ -123,31 +123,36 @@ class H5Comparator(BaseComparator):
             
             if self.tables or self.table_regex:
                 # If specific tables or regex pattern is specified
+                regex_patterns = []
                 if self.table_regex:
-                    # If the regex looks like a simple path (no regex metacharacters except . and /),
-                    # escape it to treat it as a literal string
-                    regex_str = self.table_regex
-                    self.logger.debug(f"Original table_regex: {regex_str}")
-                    # Check if it contains regex metacharacters other than . and /
-                    import string
-                    regex_metacharacters = set('[]{}()*+?^$|\\')
-                    if not any(char in regex_str for char in regex_metacharacters):
-                        # Escape dots and other special characters for literal matching
-                        regex_str = re.escape(regex_str)
-                        self.logger.debug(f"Treating table_regex as literal path, escaped: {regex_str}")
-                    else:
-                        self.logger.debug(f"Using table_regex as regular expression: {regex_str}")
-                    regex_pattern = re.compile(regex_str)
-                else:
-                    regex_pattern = None
+                    # Split by comma to support multiple regex patterns
+                    regex_strings = [pattern.strip() for pattern in self.table_regex.split(',')]
+                    self.logger.debug(f"Parsed regex patterns: {regex_strings}")
+                    
+                    for regex_str in regex_strings:
+                        # If the regex looks like a simple path (no regex metacharacters except . and /),
+                        # escape it to treat it as a literal string
+                        self.logger.debug(f"Processing regex pattern: {regex_str}")
+                        # Check if it contains regex metacharacters other than . and /
+                        import string
+                        regex_metacharacters = set('[]{}()*+?^$|\\')
+                        if not any(char in regex_str for char in regex_metacharacters):
+                            # Escape dots and other special characters for literal matching
+                            escaped_regex_str = re.escape(regex_str)
+                            self.logger.debug(f"Treating pattern as literal path, escaped: {escaped_regex_str}")
+                            regex_patterns.append(re.compile(escaped_regex_str))
+                        else:
+                            self.logger.debug(f"Using pattern as regular expression: {regex_str}")
+                            regex_patterns.append(re.compile(regex_str))
                 
                 def should_process(name):
                     if self.tables and name in self.tables:
                         self.logger.debug(f"Matched by tables list: {name}")
                         return True
-                    if regex_pattern and regex_pattern.fullmatch(name):
-                        self.logger.debug(f"Matched by regex: {name}")
-                        return True
+                    for pattern in regex_patterns:
+                        if pattern.fullmatch(name):
+                            self.logger.debug(f"Matched by regex pattern {pattern.pattern}: {name}")
+                            return True
                     return False
                 
                 def process_item(name, item):
@@ -187,7 +192,7 @@ class H5Comparator(BaseComparator):
                             self.logger.error(f"Error processing {table_path}: {str(e)}")
                 
                 # Then process regex pattern if specified
-                if regex_pattern:
+                if regex_patterns:
                     def visit_with_regex(name, obj):
                         self.logger.debug(f"Checking path: {name}")
                         if should_process(name):

{cli_test_framework-0.3.6 → cli_test_framework-0.4.0}/src/cli_test_framework/file_comparator/json_comparator.py

@@ -53,8 +53,8 @@ class JsonComparator(TextComparator):
         json_text = ''.join(text_content)
         try:
             json_data = json.loads(json_text)
-            if self.key_field:
-                # Only keep the specified key field(s)
+            if self.key_field and isinstance(json_data, dict):
+                # Only keep the specified key field(s) when top-level is a mapping
                 key_fields = self.key_field if isinstance(self.key_field, list) else [self.key_field]
                 filtered_data = {key: json_data[key] for key in key_fields if key in json_data}
                 return filtered_data
@@ -79,8 +79,9 @@ class JsonComparator(TextComparator):
             self._compare_json_key_based(content1, content2, "", differences)
         else:
             self._compare_json_exact(content1, content2, "", differences)
-            
-        return False, differences
+        
+        identical = len(differences) == 0
+        return identical, differences
 
     def _compare_json_exact(self, obj1, obj2, path, differences, max_diffs=10):
         """

cli_test_framework-0.4.0/src/cli_test_framework/runners/json_runner.py

@@ -0,0 +1,63 @@
+from typing import Optional, Dict, Any
+from ..core.base_runner import BaseRunner
+from ..core.test_case import TestCase
+from ..core.execution import execute_single_test_case
+from ..core.types import TestCaseData
+from ..utils.path_resolver import PathResolver, parse_command_string, resolve_paths
+import json
+import sys
+
+class JSONRunner(BaseRunner):
+    def __init__(self, config_file="test_cases.json", workspace: Optional[str] = None):
+        super().__init__(config_file, workspace)
+        # Backward-compatible attribute for tests that patch path_resolver
+        self.path_resolver = PathResolver(self.workspace)
+
+    def load_test_cases(self) -> None:
+        """Load test cases from a JSON file."""
+        try:
+            with open(self.config_path, 'r', encoding='utf-8') as f:
+                config = json.load(f)
+
+            # 加载setup配置
+            self.load_setup_from_config(config)
+
+            required_fields = ["name", "command", "args", "expected"]
+            for case in config["test_cases"]:
+                if not all(field in case for field in required_fields):
+                    raise ValueError(f"Test case {case.get('name', 'unnamed')} is missing required fields")
+
+                # 使用智能命令解析，正确处理包含空格的路径
+                # Use resolver attribute (keeps backward compatibility with tests monkeypatching it)
+                case["command"] = self.path_resolver.parse_command_string(case["command"])
+                case["args"] = self.path_resolver.resolve_paths(case["args"])
+                self.test_cases.append(TestCase(**case))
+
+            print(f"Successfully loaded {len(self.test_cases)} test cases")
+            # print(self.test_cases)
+        except Exception as e:
+            sys.exit(f"Failed to load configuration file: {str(e)}")
+
+    def run_single_test(self, case: TestCase) -> Dict[str, str]:
+        case_data: TestCaseData = {
+            "name": case.name,
+            "command": case.command,
+            "args": case.args,
+            "expected": case.expected,
+            "description": case.description or None,
+        }
+
+        command_preview = f"{case_data['command']} {' '.join(case_data['args'])}".strip()
+        print(f"  Executing command: {command_preview}")
+
+        result = execute_single_test_case(case_data, str(self.workspace) if self.workspace else None)
+
+        if result["output"].strip():
+            print("  Command output:")
+            for line in result["output"].splitlines():
+                print(f"    {line}")
+
+        if result["status"] != "passed" and result.get("message"):
+            print(f"  Error: {result['message']}")
+
+        return result

cli_test_framework-0.4.0/src/cli_test_framework/runners/parallel_json_runner.py

@@ -0,0 +1,79 @@
+from typing import Optional, Dict, Any
+from ..core.parallel_runner import ParallelRunner
+from ..core.test_case import TestCase
+from ..core.execution import execute_single_test_case
+from ..core.types import TestCaseData
+from ..utils.path_resolver import PathResolver, parse_command_string, resolve_paths
+import json
+import sys
+import threading
+
+class ParallelJSONRunner(ParallelRunner):
+    """并行JSON测试运行器"""
+    
+    def __init__(self, config_file="test_cases.json", workspace: Optional[str] = None,
+                 max_workers: Optional[int] = None, execution_mode: str = "thread"):
+        """
+        初始化并行JSON运行器
+        
+        Args:
+            config_file: JSON配置文件路径
+            workspace: 工作目录
+            max_workers: 最大并发数
+            execution_mode: 执行模式，'thread' 或 'process'
+        """
+        super().__init__(config_file, workspace, max_workers, execution_mode)
+        # Backward-compatible attribute for potential external patches/tests
+        self.path_resolver = PathResolver(self.workspace)
+        self._print_lock = threading.Lock()  # 用于控制输出顺序
+
+    def load_test_cases(self) -> None:
+        """从JSON文件加载测试用例"""
+        try:
+            with open(self.config_path, 'r', encoding='utf-8') as f:
+                config = json.load(f)
+
+            # 加载setup配置
+            self.load_setup_from_config(config)
+
+            required_fields = ["name", "command", "args", "expected"]
+            for case in config["test_cases"]:
+                if not all(field in case for field in required_fields):
+                    raise ValueError(f"Test case {case.get('name', 'unnamed')} is missing required fields")
+
+                # Use resolver attribute (keeps backward compatibility with tests monkeypatching it)
+                case["command"] = self.path_resolver.parse_command_string(case["command"])
+                case["args"] = self.path_resolver.resolve_paths(case["args"])
+                self.test_cases.append(TestCase(**case))
+
+            print(f"Successfully loaded {len(self.test_cases)} test cases")
+        except Exception as e:
+            sys.exit(f"Failed to load configuration file: {str(e)}")
+
+    def run_single_test(self, case: TestCase) -> Dict[str, Any]:
+        """运行单个测试用例（线程安全版本）"""
+        case_data: TestCaseData = {
+            "name": case.name,
+            "command": case.command,
+            "args": case.args,
+            "expected": case.expected,
+            "description": case.description or None,
+        }
+
+        command_preview = f"{case_data['command']} {' '.join(case_data['args'])}".strip()
+        with self._print_lock:
+            print(f"  [Worker] Executing command: {command_preview}")
+
+        result = execute_single_test_case(case_data, str(self.workspace) if self.workspace else None)
+
+        if result["output"].strip():
+            with self._print_lock:
+                print(f"  [Worker] Command output for {case.name}:")
+                for line in result["output"].splitlines():
+                    print(f"    {line}")
+
+        if result["status"] != "passed" and result.get("message"):
+            with self._print_lock:
+                print(f"  [Worker] Error for {case.name}: {result['message']}")
+
+        return result 

cli_test_framework-0.4.0/src/cli_test_framework/runners/yaml_runner.py

@@ -0,0 +1,62 @@
+from typing import Optional, Dict, Any
+from ..core.base_runner import BaseRunner
+from ..core.test_case import TestCase
+from ..core.execution import execute_single_test_case
+from ..core.types import TestCaseData
+from ..utils.path_resolver import PathResolver, parse_command_string, resolve_paths
+import sys
+
+class YAMLRunner(BaseRunner):
+    def __init__(self, config_file="test_cases.yaml", workspace: Optional[str] = None):
+        super().__init__(config_file, workspace)
+        # Backward-compatible attribute for tests that patch path_resolver
+        self.path_resolver = PathResolver(self.workspace)
+
+    def load_test_cases(self):
+        """Load test cases from a YAML file."""
+        try:
+            import yaml
+            with open(self.config_path, 'r', encoding='utf-8') as f:
+                config = yaml.safe_load(f)
+                
+            # 加载setup配置
+            self.load_setup_from_config(config)
+                
+            required_fields = ["name", "command", "args", "expected"]
+            for case in config["test_cases"]:
+                if not all(field in case for field in required_fields):
+                    raise ValueError(f"Test case {case.get('name', 'unnamed')} is missing required fields")
+                
+                # Use resolver attribute (keeps backward compatibility with tests monkeypatching it)
+                case["command"] = self.path_resolver.parse_command_string(case["command"])
+                case["args"] = self.path_resolver.resolve_paths(case["args"])
+                self.test_cases.append(TestCase(**case))
+                
+            print(f"Successfully loaded {len(self.test_cases)} test cases")
+        except Exception as e:
+            sys.exit(f"Failed to load configuration file: {str(e)}")
+
+    def run_single_test(self, case: TestCase) -> Dict[str, Any]:
+        """Run a single test case and return the result"""
+        case_data: TestCaseData = {
+            "name": case.name,
+            "command": case.command,
+            "args": case.args,
+            "expected": case.expected,
+            "description": case.description or None,
+        }
+
+        command_preview = f"{case_data['command']} {' '.join(case_data['args'])}".strip()
+        print(f"  Executing command: {command_preview}")
+
+        result = execute_single_test_case(case_data, str(self.workspace) if self.workspace else None)
+
+        if result["output"].strip():
+            print("  Command output:")
+            for line in result["output"].splitlines():
+                print(f"    {line}")
+
+        if result["status"] != "passed" and result.get("message"):
+            print(f"  Error: {result['message']}")
+
+        return result

cli_test_framework-0.4.0/src/cli_test_framework/utils/__init__.py

@@ -0,0 +1,19 @@
+# File: /python-test-framework/python-test-framework/src/utils/__init__.py
+
+"""
+Utility functions for the CLI Testing Framework
+"""
+
+from .path_resolver import (
+    PathResolver,
+    parse_command_string,
+    resolve_paths,
+    resolve_command,
+)
+
+__all__ = [
+    'PathResolver',
+    'parse_command_string',
+    'resolve_paths',
+    'resolve_command',
+]