miniworld-maze 1.0.0__tar.gz → 1.1.0__tar.gz

{miniworld_maze-1.0.0 → miniworld_maze-1.1.0}/LICENSE

@@ -1,6 +1,6 @@
 MIT License
 
-Copyright (c) 2025 DrStrategy Research Team
+Copyright (c) 2025 Tim Joseph
 
 Permission is hereby granted, free of charge, to any person obtaining a copy
 of this software and associated documentation files (the "Software"), to deal
@@ -18,4 +18,4 @@ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
 AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
 LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
 OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
-SOFTWARE.
+SOFTWARE.

miniworld_maze-1.1.0/PKG-INFO

@@ -0,0 +1,250 @@
+Metadata-Version: 2.3
+Name: miniworld-maze
+Version: 1.1.0
+Summary: Multi-room maze environments from the DrStrategy paper for reinforcement learning research
+Keywords: reinforcement-learning,environment,gymnasium,multi-room-maze,drstrategy,maze-navigation,partial-observability,3d-environments
+Author: Tim Joseph
+Author-email: Tim Joseph <tim@mctigger.com>
+License: MIT License
+         
+         Copyright (c) 2025 Tim Joseph
+         
+         Permission is hereby granted, free of charge, to any person obtaining a copy
+         of this software and associated documentation files (the "Software"), to deal
+         in the Software without restriction, including without limitation the rights
+         to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+         copies of the Software, and to permit persons to whom the Software is
+         furnished to do so, subject to the following conditions:
+         
+         The above copyright notice and this permission notice shall be included in all
+         copies or substantial portions of the Software.
+         
+         THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+         IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+         FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+         AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+         LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+         OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+         SOFTWARE.
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Science/Research
+Classifier: Intended Audience :: Developers
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Topic :: Software Development :: Libraries :: Python Modules
+Classifier: Environment :: Console
+Classifier: Typing :: Typed
+Requires-Dist: gymnasium>=1.0.0,<2.0.0
+Requires-Dist: numpy>=1.20.0,<3.0.0
+Requires-Dist: opencv-python>=4.5.0,<5.0.0
+Requires-Dist: pillow>=8.0.0,<11.0.0
+Requires-Dist: pyopengl>=3.1.0,<4.0.0
+Requires-Dist: pyglet>=1.5.0,<2.0.0
+Requires-Dist: black>=22.0,<25.0 ; extra == 'dev'
+Requires-Dist: isort>=5.10,<6.0 ; extra == 'dev'
+Requires-Dist: flake8>=4.0,<7.0 ; extra == 'dev'
+Requires-Dist: ruff>=0.1.0,<1.0.0 ; extra == 'dev'
+Requires-Dist: build>=0.8.0,<2.0.0 ; extra == 'dev'
+Requires-Dist: twine>=4.0.0,<6.0.0 ; extra == 'dev'
+Requires-Dist: mujoco>=2.3.0,<4.0.0 ; extra == 'mujoco'
+Requires-Python: >=3.8
+Project-URL: Bug Tracker, https://github.com/mctigger/miniworld-maze/issues
+Project-URL: Documentation, https://github.com/mctigger/miniworld-maze#readme
+Project-URL: Homepage, https://github.com/mctigger/miniworld-maze
+Project-URL: Repository, https://github.com/mctigger/miniworld-maze
+Provides-Extra: dev
+Provides-Extra: mujoco
+Description-Content-Type: text/markdown
+
+# MiniWorld DrStrategy - Multi-Room Maze Environment
+
+A refactored implementation of Dr. Strategy's MiniWorld-based maze environments with updated dependencies and modern Python packaging. Based on the now-deprecated [MiniWorld](https://github.com/Farama-Foundation/Miniworld) project and the original [DrStrategy implementation](https://github.com/ahn-ml/drstrategy).
+
+## Environment Observations
+
+### Environment Views
+Full environment layout and render-on-position views:
+
+| Full Environment | Partial Top-Down Observations | Partial First-Person Observations |
+|---|---|---|
+| ![Full View Clean](assets/images/full_view_clean.png) | ![Top Middle TD](assets/images/render_on_pos_1_top_middle_room_topdown.png) ![Center TD](assets/images/render_on_pos_3_environment_center_topdown.png) | ![Top Middle FP](assets/images/render_on_pos_1_top_middle_room_firstperson.png) ![Center FP](assets/images/render_on_pos_3_environment_center_firstperson.png) |
+
+## Installation
+
+```bash
+pip install miniworld-maze
+```
+
+## Usage
+
+### Basic Usage
+
+See `examples/basic_usage.py` for a complete working example:
+
+```python
+#!/usr/bin/env python3
+"""
+Basic usage example for miniworld-maze environments.
+
+This is a minimal example showing how to create and interact with the environment.
+"""
+
+from miniworld_maze import NineRoomsEnvironmentWrapper
+
+
+def main():
+    # Create environment
+    env = NineRoomsEnvironmentWrapper(variant="NineRooms", size=64)
+    obs, info = env.reset()
+
+    # obs is a dictionary containing:
+    # - 'observation': (64, 64, 3) RGB image array
+    # - 'desired_goal': (64, 64, 3) RGB image of the goal state
+    # - 'achieved_goal': (64, 64, 3) RGB image of the current state
+
+    # Take a few random actions
+    for step in range(10):
+        action = env.action_space.sample()
+        obs, reward, terminated, truncated, info = env.step(action)
+
+        print(f"Step {step + 1}: reward={reward:.3f}, terminated={terminated}")
+
+        if terminated or truncated:
+            obs, info = env.reset()
+
+    env.close()
+    print("Environment closed successfully!")
+
+
+if __name__ == "__main__":
+    main()
+```
+
+### Headless Environments
+
+When running in headless environments (servers, CI/CD, Docker containers) or when encountering X11/OpenGL context issues, you need to enable headless rendering:
+
+```bash
+# Set environment variable before running Python
+export PYGLET_HEADLESS=1
+python your_script.py
+```
+
+Or in your Python code (must be set before importing the library):
+
+```python
+import os
+os.environ['PYGLET_HEADLESS'] = '1'
+
+import miniworld_maze
+# ... rest of your code
+```
+
+This configures the underlying pyglet library to use EGL rendering instead of X11, allowing the environments to run without a display server.
+
+## Environment Variants
+
+### Available Environments
+
+The package provides three main environment variants, each with different room layouts and connection patterns:
+
+#### 1. NineRooms (3×3 Grid)
+```
+-------------
+| 0 | 1 | 2 |
+-------------
+| 3 | 4 | 5 |
+-------------
+| 6 | 7 | 8 |
+-------------
+```
+A standard 3×3 grid where adjacent rooms are connected. The agent can navigate between rooms through doorways, with connections forming a fully connected grid pattern.
+
+#### 2. SpiralNineRooms (3×3 Spiral Pattern)
+```
+-------------
+| 0 | 1 | 2 |
+-------------
+| 3 | 4 | 5 |
+-------------
+| 6 | 7 | 8 |
+-------------
+```
+Same room layout as NineRooms but with a spiral connection pattern. Only specific room pairs are connected, creating a more challenging navigation task with fewer available paths.
+
+#### 3. TwentyFiveRooms (5×5 Grid)
+```
+---------------------
+| 0 | 1 | 2 | 3 | 4 |
+---------------------
+| 5 | 6 | 7 | 8 | 9 |
+---------------------
+|10 |11 |12 |13 |14 |
+---------------------
+|15 |16 |17 |18 |19 |
+---------------------
+|20 |21 |22 |23 |24 |
+---------------------
+```
+A larger 5×5 grid environment with 25 rooms, providing more complex navigation challenges and longer episode lengths.
+
+### Observation Types
+
+Each environment supports three different observation modes:
+
+- **`TOP_DOWN_PARTIAL`** (default): Agent-centered partial top-down view with limited visibility range (POMDP)
+- **`TOP_DOWN_FULL`**: Complete top-down view showing the entire environment
+- **`FIRST_PERSON`**: 3D first-person perspective view from the agent's current position
+
+### Action Space
+
+- **Discrete Actions** (default): 7 discrete actions (turn left/right, move forward/backward, strafe left/right, no-op)
+- **Continuous Actions**: Continuous control with `continuous=True` parameter
+
+### Environment Configuration
+
+All environments can be customized with the following parameters:
+
+```python
+from miniworld_maze import NineRoomsEnvironmentWrapper
+from miniworld_maze.core import ObservationLevel
+
+env = NineRoomsEnvironmentWrapper(
+    variant="NineRooms",                    # "NineRooms", "SpiralNineRooms", "TwentyFiveRooms"
+    obs_level=ObservationLevel.TOP_DOWN_PARTIAL,  # Observation type
+    continuous=False,                       # Use continuous actions
+    size=64,                               # Observation image size (64x64)
+    room_size=5,                           # Size of each room in environment units
+    door_size=2,                           # Size of doors between rooms  
+    agent_mode="empty",                    # Agent rendering: "empty", "circle", "triangle"
+)
+```
+
+### Observation Format
+
+The environment returns observations in dictionary format:
+
+```python
+obs = {
+    'observation': np.ndarray,    # (64, 64, 3) RGB image of current view
+    'desired_goal': np.ndarray,   # (64, 64, 3) RGB image of goal location
+    'achieved_goal': np.ndarray,  # (64, 64, 3) RGB image of current state
+}
+```
+
+### Reward Structure
+
+- **Goal reaching**: Positive reward when agent reaches the goal location
+- **Step penalty**: Small negative reward per step to encourage efficiency
+- **Episode termination**: When goal is reached or maximum steps exceeded
+
+
+## License
+
+MIT License - see LICENSE file for details.

miniworld_maze-1.1.0/README.md

@@ -0,0 +1,186 @@
+# MiniWorld DrStrategy - Multi-Room Maze Environment
+
+A refactored implementation of Dr. Strategy's MiniWorld-based maze environments with updated dependencies and modern Python packaging. Based on the now-deprecated [MiniWorld](https://github.com/Farama-Foundation/Miniworld) project and the original [DrStrategy implementation](https://github.com/ahn-ml/drstrategy).
+
+## Environment Observations
+
+### Environment Views
+Full environment layout and render-on-position views:
+
+| Full Environment | Partial Top-Down Observations | Partial First-Person Observations |
+|---|---|---|
+| ![Full View Clean](assets/images/full_view_clean.png) | ![Top Middle TD](assets/images/render_on_pos_1_top_middle_room_topdown.png) ![Center TD](assets/images/render_on_pos_3_environment_center_topdown.png) | ![Top Middle FP](assets/images/render_on_pos_1_top_middle_room_firstperson.png) ![Center FP](assets/images/render_on_pos_3_environment_center_firstperson.png) |
+
+## Installation
+
+```bash
+pip install miniworld-maze
+```
+
+## Usage
+
+### Basic Usage
+
+See `examples/basic_usage.py` for a complete working example:
+
+```python
+#!/usr/bin/env python3
+"""
+Basic usage example for miniworld-maze environments.
+
+This is a minimal example showing how to create and interact with the environment.
+"""
+
+from miniworld_maze import NineRoomsEnvironmentWrapper
+
+
+def main():
+    # Create environment
+    env = NineRoomsEnvironmentWrapper(variant="NineRooms", size=64)
+    obs, info = env.reset()
+
+    # obs is a dictionary containing:
+    # - 'observation': (64, 64, 3) RGB image array
+    # - 'desired_goal': (64, 64, 3) RGB image of the goal state
+    # - 'achieved_goal': (64, 64, 3) RGB image of the current state
+
+    # Take a few random actions
+    for step in range(10):
+        action = env.action_space.sample()
+        obs, reward, terminated, truncated, info = env.step(action)
+
+        print(f"Step {step + 1}: reward={reward:.3f}, terminated={terminated}")
+
+        if terminated or truncated:
+            obs, info = env.reset()
+
+    env.close()
+    print("Environment closed successfully!")
+
+
+if __name__ == "__main__":
+    main()
+```
+
+### Headless Environments
+
+When running in headless environments (servers, CI/CD, Docker containers) or when encountering X11/OpenGL context issues, you need to enable headless rendering:
+
+```bash
+# Set environment variable before running Python
+export PYGLET_HEADLESS=1
+python your_script.py
+```
+
+Or in your Python code (must be set before importing the library):
+
+```python
+import os
+os.environ['PYGLET_HEADLESS'] = '1'
+
+import miniworld_maze
+# ... rest of your code
+```
+
+This configures the underlying pyglet library to use EGL rendering instead of X11, allowing the environments to run without a display server.
+
+## Environment Variants
+
+### Available Environments
+
+The package provides three main environment variants, each with different room layouts and connection patterns:
+
+#### 1. NineRooms (3×3 Grid)
+```
+-------------
+| 0 | 1 | 2 |
+-------------
+| 3 | 4 | 5 |
+-------------
+| 6 | 7 | 8 |
+-------------
+```
+A standard 3×3 grid where adjacent rooms are connected. The agent can navigate between rooms through doorways, with connections forming a fully connected grid pattern.
+
+#### 2. SpiralNineRooms (3×3 Spiral Pattern)
+```
+-------------
+| 0 | 1 | 2 |
+-------------
+| 3 | 4 | 5 |
+-------------
+| 6 | 7 | 8 |
+-------------
+```
+Same room layout as NineRooms but with a spiral connection pattern. Only specific room pairs are connected, creating a more challenging navigation task with fewer available paths.
+
+#### 3. TwentyFiveRooms (5×5 Grid)
+```
+---------------------
+| 0 | 1 | 2 | 3 | 4 |
+---------------------
+| 5 | 6 | 7 | 8 | 9 |
+---------------------
+|10 |11 |12 |13 |14 |
+---------------------
+|15 |16 |17 |18 |19 |
+---------------------
+|20 |21 |22 |23 |24 |
+---------------------
+```
+A larger 5×5 grid environment with 25 rooms, providing more complex navigation challenges and longer episode lengths.
+
+### Observation Types
+
+Each environment supports three different observation modes:
+
+- **`TOP_DOWN_PARTIAL`** (default): Agent-centered partial top-down view with limited visibility range (POMDP)
+- **`TOP_DOWN_FULL`**: Complete top-down view showing the entire environment
+- **`FIRST_PERSON`**: 3D first-person perspective view from the agent's current position
+
+### Action Space
+
+- **Discrete Actions** (default): 7 discrete actions (turn left/right, move forward/backward, strafe left/right, no-op)
+- **Continuous Actions**: Continuous control with `continuous=True` parameter
+
+### Environment Configuration
+
+All environments can be customized with the following parameters:
+
+```python
+from miniworld_maze import NineRoomsEnvironmentWrapper
+from miniworld_maze.core import ObservationLevel
+
+env = NineRoomsEnvironmentWrapper(
+    variant="NineRooms",                    # "NineRooms", "SpiralNineRooms", "TwentyFiveRooms"
+    obs_level=ObservationLevel.TOP_DOWN_PARTIAL,  # Observation type
+    continuous=False,                       # Use continuous actions
+    size=64,                               # Observation image size (64x64)
+    room_size=5,                           # Size of each room in environment units
+    door_size=2,                           # Size of doors between rooms  
+    agent_mode="empty",                    # Agent rendering: "empty", "circle", "triangle"
+)
+```
+
+### Observation Format
+
+The environment returns observations in dictionary format:
+
+```python
+obs = {
+    'observation': np.ndarray,    # (64, 64, 3) RGB image of current view
+    'desired_goal': np.ndarray,   # (64, 64, 3) RGB image of goal location
+    'achieved_goal': np.ndarray,  # (64, 64, 3) RGB image of current state
+}
+```
+
+### Reward Structure
+
+- **Goal reaching**: Positive reward when agent reaches the goal location
+- **Step penalty**: Small negative reward per step to encourage efficiency
+- **Episode termination**: When goal is reached or maximum steps exceeded
+
+
+## License
+
+MIT License - see LICENSE file for details.

miniworld_maze-1.1.0/examples/basic_usage.py

@@ -0,0 +1,36 @@
+#!/usr/bin/env python3
+"""
+Basic usage example for miniworld-maze environments.
+
+This is a minimal example showing how to create and interact with the environment.
+"""
+
+from miniworld_maze import NineRoomsEnvironmentWrapper
+
+
+def main():
+    # Create environment
+    env = NineRoomsEnvironmentWrapper(variant="NineRooms", size=64)
+    obs, info = env.reset()
+
+    # obs is a dictionary containing:
+    # - 'observation': (64, 64, 3) RGB image array
+    # - 'desired_goal': (64, 64, 3) RGB image of the goal state
+    # - 'achieved_goal': (64, 64, 3) RGB image of the current state
+
+    # Take a few random actions
+    for step in range(10):
+        action = env.action_space.sample()
+        obs, reward, terminated, truncated, info = env.step(action)
+
+        print(f"Step {step + 1}: reward={reward:.3f}, terminated={terminated}")
+
+        if terminated or truncated:
+            obs, info = env.reset()
+
+    env.close()
+    print("Environment closed successfully!")
+
+
+if __name__ == "__main__":
+    main()