mdpsolver 0.9.4__tar.gz → 0.9.6__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- {mdpsolver-0.9.4/src/mdpsolver.egg-info → mdpsolver-0.9.6}/PKG-INFO +29 -13
- {mdpsolver-0.9.4 → mdpsolver-0.9.6}/README.md +28 -12
- {mdpsolver-0.9.4 → mdpsolver-0.9.6}/pyproject.toml +1 -1
- {mdpsolver-0.9.4 → mdpsolver-0.9.6}/src/mdpsolver/model.py +4 -2
- mdpsolver-0.9.6/src/mdpsolver/problems/__pycache__/cbmaux.cpython-310.pyc +0 -0
- mdpsolver-0.9.6/src/mdpsolver/problems/__pycache__/tbmaux.cpython-310.pyc +0 -0
- mdpsolver-0.9.6/src/mdpsolver/solvermodule.cp310-win_amd64.pyd +0 -0
- mdpsolver-0.9.6/src/mdpsolver/solvermodule.cp311-win_amd64.pyd +0 -0
- mdpsolver-0.9.6/src/mdpsolver/solvermodule.cp312-win_amd64.pyd +0 -0
- mdpsolver-0.9.6/src/mdpsolver/solvermodule.cpython-310-x86_64-linux-gnu.so +0 -0
- mdpsolver-0.9.6/src/mdpsolver/solvermodule.cpython-311-x86_64-linux-gnu.so +0 -0
- mdpsolver-0.9.6/src/mdpsolver/solvermodule.cpython-312-x86_64-linux-gnu.so +0 -0
- {mdpsolver-0.9.4 → mdpsolver-0.9.6/src/mdpsolver.egg-info}/PKG-INFO +29 -13
- {mdpsolver-0.9.4 → mdpsolver-0.9.6}/src/mdpsolver.egg-info/SOURCES.txt +5 -1
- mdpsolver-0.9.4/src/mdpsolver/solvermodule.cp310-win_amd64.pyd +0 -0
- mdpsolver-0.9.4/src/mdpsolver/solvermodule.cp311-win_amd64.pyd +0 -0
- mdpsolver-0.9.4/src/mdpsolver/solvermodule.cp312-win_amd64.pyd +0 -0
- mdpsolver-0.9.4/src/mdpsolver/solvermodule.cpython-310-x86_64-linux-gnu.so +0 -0
- {mdpsolver-0.9.4 → mdpsolver-0.9.6}/LICENSE +0 -0
- {mdpsolver-0.9.4 → mdpsolver-0.9.6}/MANIFEST.in +0 -0
- {mdpsolver-0.9.4 → mdpsolver-0.9.6}/setup.cfg +0 -0
- {mdpsolver-0.9.4 → mdpsolver-0.9.6}/src/mdpsolver/__init__.py +0 -0
- {mdpsolver-0.9.4 → mdpsolver-0.9.6}/src/mdpsolver/problems/cbmaux.py +0 -0
- {mdpsolver-0.9.4 → mdpsolver-0.9.6}/src/mdpsolver/problems/tbmaux.py +0 -0
- {mdpsolver-0.9.4 → mdpsolver-0.9.6}/src/mdpsolver.egg-info/dependency_links.txt +0 -0
- {mdpsolver-0.9.4 → mdpsolver-0.9.6}/src/mdpsolver.egg-info/top_level.txt +0 -0
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.1
|
|
2
2
|
Name: mdpsolver
|
|
3
|
-
Version: 0.9.
|
|
3
|
+
Version: 0.9.6
|
|
4
4
|
Summary: A fast solver for Markov Decision Processes
|
|
5
5
|
Author-email: Anders Reenberg Andersen <andersra@live.dk>, Jesper Fink Andersen <jfan@dtu.dk>
|
|
6
6
|
Project-URL: Homepage, https://github.com/areenberg/MDPSolver
|
|
@@ -13,30 +13,46 @@ Requires-Python: >=3.10
|
|
|
13
13
|
Description-Content-Type: text/markdown
|
|
14
14
|
License-File: LICENSE
|
|
15
15
|
|
|
16
|
-
#
|
|
17
|
-
|
|
18
|
-
|
|
16
|
+
# MDPSolver
|
|
17
|
+
|
|
18
|
+
<img src="https://github.com/areenberg/MDPSolver/blob/anders_development/Images/MDPSolver_logo_3.png" alt="Logo" width="180">
|
|
19
|
+
|
|
20
|
+
MDPSolver is a Python package for Markov Decision Processes (MDPs) with discounted rewards and infinite-horizon.
|
|
19
21
|
|
|
20
22
|
## Features
|
|
21
23
|
|
|
22
|
-
* Fast solver
|
|
23
|
-
* Available on PyPI.
|
|
24
|
+
* Fast solver: Our C++-based solver is substantially faster than other MDP packages available for Python. See details in the documentation.
|
|
24
25
|
* Three optimization algorithms: *Value iteration*, *Policy iteration*, and *Modified policy iteration*.
|
|
25
|
-
* Three value-update methods: *Standard*, *Gauss–Seidel*, *Successive over-relaxation*.
|
|
26
|
-
*
|
|
26
|
+
* Three value-update methods: *Standard*, *Gauss–Seidel*, *Successive over-relaxation*.
|
|
27
|
+
* Supports sparse matrices.
|
|
28
|
+
* Employs parallel computing.
|
|
27
29
|
|
|
28
|
-
#
|
|
30
|
+
# Installation
|
|
29
31
|
|
|
30
|
-
|
|
32
|
+
## Linux
|
|
31
33
|
|
|
32
|
-
|
|
34
|
+
Install directly from PyPI with:
|
|
35
|
+
|
|
36
|
+
```
|
|
37
|
+
pip install mdpsolver
|
|
38
|
+
```
|
|
33
39
|
|
|
34
|
-
|
|
40
|
+
After the installation, MDPSolver works *out of the box*.
|
|
41
|
+
|
|
42
|
+
## Windows
|
|
43
|
+
|
|
44
|
+
Requires [Visual Studio 2022](https://visualstudio.microsoft.com/downloads/) (17.9) with MSVC C++ compiler and libraries installed.
|
|
45
|
+
|
|
46
|
+
After installing Visual Studio (incl. MSVC C++ compiler and libraries), install directly from PyPI with:
|
|
35
47
|
|
|
36
48
|
```
|
|
37
49
|
pip install mdpsolver
|
|
38
50
|
```
|
|
39
51
|
|
|
52
|
+
# Quick start guide
|
|
53
|
+
|
|
54
|
+
The following shows how to get quickly started with `mdpsolver`.
|
|
55
|
+
|
|
40
56
|
## Usage
|
|
41
57
|
|
|
42
58
|
Start by specifying the reward function and transition probabilities as lists. The following is an example of a simple MDP containing **three states** and **two actions in each state**.
|
|
@@ -140,7 +156,7 @@ mdl.mdp(discount=0.8,
|
|
|
140
156
|
|
|
141
157
|
# Documentation
|
|
142
158
|
|
|
143
|
-
|
|
159
|
+
The documentation can be found in the wiki for MDPSolver (https://github.com/areenberg/MDPSolver/wiki).
|
|
144
160
|
|
|
145
161
|
# How to cite
|
|
146
162
|
|
|
@@ -1,27 +1,43 @@
|
|
|
1
|
-
#
|
|
2
|
-
|
|
3
|
-
|
|
1
|
+
# MDPSolver
|
|
2
|
+
|
|
3
|
+
<img src="https://github.com/areenberg/MDPSolver/blob/anders_development/Images/MDPSolver_logo_3.png" alt="Logo" width="180">
|
|
4
|
+
|
|
5
|
+
MDPSolver is a Python package for Markov Decision Processes (MDPs) with discounted rewards and infinite-horizon.
|
|
4
6
|
|
|
5
7
|
## Features
|
|
6
8
|
|
|
7
|
-
* Fast solver
|
|
8
|
-
* Available on PyPI.
|
|
9
|
+
* Fast solver: Our C++-based solver is substantially faster than other MDP packages available for Python. See details in the documentation.
|
|
9
10
|
* Three optimization algorithms: *Value iteration*, *Policy iteration*, and *Modified policy iteration*.
|
|
10
|
-
* Three value-update methods: *Standard*, *Gauss–Seidel*, *Successive over-relaxation*.
|
|
11
|
-
*
|
|
11
|
+
* Three value-update methods: *Standard*, *Gauss–Seidel*, *Successive over-relaxation*.
|
|
12
|
+
* Supports sparse matrices.
|
|
13
|
+
* Employs parallel computing.
|
|
12
14
|
|
|
13
|
-
#
|
|
15
|
+
# Installation
|
|
14
16
|
|
|
15
|
-
|
|
17
|
+
## Linux
|
|
16
18
|
|
|
17
|
-
|
|
19
|
+
Install directly from PyPI with:
|
|
20
|
+
|
|
21
|
+
```
|
|
22
|
+
pip install mdpsolver
|
|
23
|
+
```
|
|
18
24
|
|
|
19
|
-
|
|
25
|
+
After the installation, MDPSolver works *out of the box*.
|
|
26
|
+
|
|
27
|
+
## Windows
|
|
28
|
+
|
|
29
|
+
Requires [Visual Studio 2022](https://visualstudio.microsoft.com/downloads/) (17.9) with MSVC C++ compiler and libraries installed.
|
|
30
|
+
|
|
31
|
+
After installing Visual Studio (incl. MSVC C++ compiler and libraries), install directly from PyPI with:
|
|
20
32
|
|
|
21
33
|
```
|
|
22
34
|
pip install mdpsolver
|
|
23
35
|
```
|
|
24
36
|
|
|
37
|
+
# Quick start guide
|
|
38
|
+
|
|
39
|
+
The following shows how to get quickly started with `mdpsolver`.
|
|
40
|
+
|
|
25
41
|
## Usage
|
|
26
42
|
|
|
27
43
|
Start by specifying the reward function and transition probabilities as lists. The following is an example of a simple MDP containing **three states** and **two actions in each state**.
|
|
@@ -125,7 +141,7 @@ mdl.mdp(discount=0.8,
|
|
|
125
141
|
|
|
126
142
|
# Documentation
|
|
127
143
|
|
|
128
|
-
|
|
144
|
+
The documentation can be found in the wiki for MDPSolver (https://github.com/areenberg/MDPSolver/wiki).
|
|
129
145
|
|
|
130
146
|
# How to cite
|
|
131
147
|
|
|
@@ -23,7 +23,8 @@ class model:
|
|
|
23
23
|
initValueVector=list(),
|
|
24
24
|
verbose=False,
|
|
25
25
|
postProcessing=True,
|
|
26
|
-
makeFinalCheck=True
|
|
26
|
+
makeFinalCheck=True,
|
|
27
|
+
parallel=True):
|
|
27
28
|
#solves the problem employing the specified algorithm
|
|
28
29
|
self.mdl.solve(algorithm=algorithm,
|
|
29
30
|
tolerance=tolerance,
|
|
@@ -34,7 +35,8 @@ class model:
|
|
|
34
35
|
initValueVector=initValueVector,
|
|
35
36
|
verbose=verbose,
|
|
36
37
|
postProcessing=postProcessing,
|
|
37
|
-
makeFinalCheck=makeFinalCheck
|
|
38
|
+
makeFinalCheck=makeFinalCheck,
|
|
39
|
+
parallel=parallel)
|
|
38
40
|
|
|
39
41
|
def getRuntime(self):
|
|
40
42
|
#returns the runtime in milliseconds
|
|
Binary file
|
|
Binary file
|
|
Binary file
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.1
|
|
2
2
|
Name: mdpsolver
|
|
3
|
-
Version: 0.9.
|
|
3
|
+
Version: 0.9.6
|
|
4
4
|
Summary: A fast solver for Markov Decision Processes
|
|
5
5
|
Author-email: Anders Reenberg Andersen <andersra@live.dk>, Jesper Fink Andersen <jfan@dtu.dk>
|
|
6
6
|
Project-URL: Homepage, https://github.com/areenberg/MDPSolver
|
|
@@ -13,30 +13,46 @@ Requires-Python: >=3.10
|
|
|
13
13
|
Description-Content-Type: text/markdown
|
|
14
14
|
License-File: LICENSE
|
|
15
15
|
|
|
16
|
-
#
|
|
17
|
-
|
|
18
|
-
|
|
16
|
+
# MDPSolver
|
|
17
|
+
|
|
18
|
+
<img src="https://github.com/areenberg/MDPSolver/blob/anders_development/Images/MDPSolver_logo_3.png" alt="Logo" width="180">
|
|
19
|
+
|
|
20
|
+
MDPSolver is a Python package for Markov Decision Processes (MDPs) with discounted rewards and infinite-horizon.
|
|
19
21
|
|
|
20
22
|
## Features
|
|
21
23
|
|
|
22
|
-
* Fast solver
|
|
23
|
-
* Available on PyPI.
|
|
24
|
+
* Fast solver: Our C++-based solver is substantially faster than other MDP packages available for Python. See details in the documentation.
|
|
24
25
|
* Three optimization algorithms: *Value iteration*, *Policy iteration*, and *Modified policy iteration*.
|
|
25
|
-
* Three value-update methods: *Standard*, *Gauss–Seidel*, *Successive over-relaxation*.
|
|
26
|
-
*
|
|
26
|
+
* Three value-update methods: *Standard*, *Gauss–Seidel*, *Successive over-relaxation*.
|
|
27
|
+
* Supports sparse matrices.
|
|
28
|
+
* Employs parallel computing.
|
|
27
29
|
|
|
28
|
-
#
|
|
30
|
+
# Installation
|
|
29
31
|
|
|
30
|
-
|
|
32
|
+
## Linux
|
|
31
33
|
|
|
32
|
-
|
|
34
|
+
Install directly from PyPI with:
|
|
35
|
+
|
|
36
|
+
```
|
|
37
|
+
pip install mdpsolver
|
|
38
|
+
```
|
|
33
39
|
|
|
34
|
-
|
|
40
|
+
After the installation, MDPSolver works *out of the box*.
|
|
41
|
+
|
|
42
|
+
## Windows
|
|
43
|
+
|
|
44
|
+
Requires [Visual Studio 2022](https://visualstudio.microsoft.com/downloads/) (17.9) with MSVC C++ compiler and libraries installed.
|
|
45
|
+
|
|
46
|
+
After installing Visual Studio (incl. MSVC C++ compiler and libraries), install directly from PyPI with:
|
|
35
47
|
|
|
36
48
|
```
|
|
37
49
|
pip install mdpsolver
|
|
38
50
|
```
|
|
39
51
|
|
|
52
|
+
# Quick start guide
|
|
53
|
+
|
|
54
|
+
The following shows how to get quickly started with `mdpsolver`.
|
|
55
|
+
|
|
40
56
|
## Usage
|
|
41
57
|
|
|
42
58
|
Start by specifying the reward function and transition probabilities as lists. The following is an example of a simple MDP containing **three states** and **two actions in each state**.
|
|
@@ -140,7 +156,7 @@ mdl.mdp(discount=0.8,
|
|
|
140
156
|
|
|
141
157
|
# Documentation
|
|
142
158
|
|
|
143
|
-
|
|
159
|
+
The documentation can be found in the wiki for MDPSolver (https://github.com/areenberg/MDPSolver/wiki).
|
|
144
160
|
|
|
145
161
|
# How to cite
|
|
146
162
|
|
|
@@ -8,9 +8,13 @@ src/mdpsolver/solvermodule.cp310-win_amd64.pyd
|
|
|
8
8
|
src/mdpsolver/solvermodule.cp311-win_amd64.pyd
|
|
9
9
|
src/mdpsolver/solvermodule.cp312-win_amd64.pyd
|
|
10
10
|
src/mdpsolver/solvermodule.cpython-310-x86_64-linux-gnu.so
|
|
11
|
+
src/mdpsolver/solvermodule.cpython-311-x86_64-linux-gnu.so
|
|
12
|
+
src/mdpsolver/solvermodule.cpython-312-x86_64-linux-gnu.so
|
|
11
13
|
src/mdpsolver.egg-info/PKG-INFO
|
|
12
14
|
src/mdpsolver.egg-info/SOURCES.txt
|
|
13
15
|
src/mdpsolver.egg-info/dependency_links.txt
|
|
14
16
|
src/mdpsolver.egg-info/top_level.txt
|
|
15
17
|
src/mdpsolver/problems/cbmaux.py
|
|
16
|
-
src/mdpsolver/problems/tbmaux.py
|
|
18
|
+
src/mdpsolver/problems/tbmaux.py
|
|
19
|
+
src/mdpsolver/problems/__pycache__/cbmaux.cpython-310.pyc
|
|
20
|
+
src/mdpsolver/problems/__pycache__/tbmaux.cpython-310.pyc
|
|
Binary file
|
|
Binary file
|
|
Binary file
|
|
Binary file
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|