evalmc 0.0.2__tar.gz → 0.0.3__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (34) hide show
  1. evalmc-0.0.3/PKG-INFO +95 -0
  2. evalmc-0.0.3/README.md +72 -0
  3. evalmc-0.0.3/evalmc.egg-info/PKG-INFO +95 -0
  4. {evalmc-0.0.2 → evalmc-0.0.3}/pyproject.toml +2 -2
  5. evalmc-0.0.2/PKG-INFO +0 -60
  6. evalmc-0.0.2/README.md +0 -37
  7. evalmc-0.0.2/evalmc.egg-info/PKG-INFO +0 -60
  8. {evalmc-0.0.2 → evalmc-0.0.3}/LICENSE +0 -0
  9. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/__init__.py +0 -0
  10. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/__main__.py +0 -0
  11. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/check_challenge.py +0 -0
  12. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/check_registered.py +0 -0
  13. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/config_paths.py +0 -0
  14. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/host.py +0 -0
  15. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/login.py +0 -0
  16. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/main.py +0 -0
  17. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/nominate.py +0 -0
  18. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/push_helpers.py +0 -0
  19. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/register.py +0 -0
  20. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/set_token.py +0 -0
  21. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/status.py +0 -0
  22. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/submission.py +0 -0
  23. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/submit_onnx.py +0 -0
  24. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc/utils.py +0 -0
  25. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc.egg-info/SOURCES.txt +0 -0
  26. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc.egg-info/dependency_links.txt +0 -0
  27. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc.egg-info/entry_points.txt +0 -0
  28. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc.egg-info/requires.txt +0 -0
  29. {evalmc-0.0.2 → evalmc-0.0.3}/evalmc.egg-info/top_level.txt +0 -0
  30. {evalmc-0.0.2 → evalmc-0.0.3}/setup.cfg +0 -0
  31. {evalmc-0.0.2 → evalmc-0.0.3}/tests/test_cli_nominate.py +0 -0
  32. {evalmc-0.0.2 → evalmc-0.0.3}/tests/test_cli_smoke.py +0 -0
  33. {evalmc-0.0.2 → evalmc-0.0.3}/tests/test_push_helpers.py +0 -0
  34. {evalmc-0.0.2 → evalmc-0.0.3}/tests/test_submission_api_base.py +0 -0
evalmc-0.0.3/PKG-INFO ADDED
@@ -0,0 +1,95 @@
1
+ Metadata-Version: 2.4
2
+ Name: evalmc
3
+ Version: 0.0.3
4
+ Summary: Submit ONNX policies and Docker agents to MyoChallenge
5
+ Author-email: MyoChallenge Team <caggiano@gmail.com>
6
+ License-Expression: Apache-2.0
7
+ Project-URL: Homepage, https://github.com/MyoHub/mcEvalProd-CLI
8
+ Classifier: Development Status :: 4 - Beta
9
+ Classifier: Intended Audience :: Developers
10
+ Classifier: Operating System :: OS Independent
11
+ Classifier: Programming Language :: Python :: 3
12
+ Classifier: Programming Language :: Python :: 3.9
13
+ Classifier: Programming Language :: Python :: 3.10
14
+ Classifier: Programming Language :: Python :: 3.11
15
+ Requires-Python: >=3.9
16
+ Description-Content-Type: text/markdown
17
+ License-File: LICENSE
18
+ Requires-Dist: click>=8.0.0
19
+ Requires-Dist: docker>=6.0.0
20
+ Requires-Dist: requests>=2.25.0
21
+ Requires-Dist: boto3>=1.26.0
22
+ Dynamic: license-file
23
+
24
+ # evalmc
25
+
26
+ MyoChallenge submission CLI — upload ONNX policies or Docker agent images to
27
+ [mc26.myosuite.org](https://mc26.myosuite.org).
28
+
29
+ [![PyPI](https://img.shields.io/pypi/v/evalmc.svg)](https://pypi.org/project/evalmc/)
30
+ [![Python](https://img.shields.io/pypi/pyversions/evalmc.svg)](https://pypi.org/project/evalmc/)
31
+ [![License](https://img.shields.io/pypi/l/evalmc.svg)](https://pypi.org/project/evalmc/)
32
+
33
+ ```bash
34
+ pip install -U evalmc
35
+ ```
36
+
37
+ Default API: `https://api.mc.myosuite.org`
38
+
39
+ ---
40
+
41
+ ## Quick start
42
+
43
+ ```bash
44
+ evalmc host --set-host https://api.mc.myosuite.org
45
+ evalmc login
46
+ evalmc status
47
+ evalmc submit-onnx model.onnx -t chasetag -p 1
48
+ ```
49
+
50
+ `evalmc login` stores the email and auth token from the dashboard.
51
+ Credentials live in `~/.myochallenge/`.
52
+
53
+ ---
54
+
55
+ ## Commands
56
+
57
+ | Command | Purpose |
58
+ |---|---|
59
+ | `evalmc host` | Show or set the API host |
60
+ | `evalmc login` | Save email + auth token |
61
+ | `evalmc status` | Confirm host and team |
62
+ | `evalmc submit-onnx` | Upload an ONNX policy |
63
+ | `evalmc nominate` | Pick a scored artifact for title-cycle finals |
64
+ | `evalmc push` | Submit a Docker / ECR agent image |
65
+
66
+ ### ONNX
67
+
68
+ Recommended for ChaseTag. The graph is `obs → action`; no `policy.py` required.
69
+
70
+ ```bash
71
+ evalmc submit-onnx model.onnx -t chasetag -p 1
72
+ ```
73
+
74
+ ### Title-cycle nomination
75
+
76
+ Before freeze, choose which scored in-window submission plays in finals.
77
+ If you skip this, the platform uses your best score.
78
+
79
+ ```bash
80
+ evalmc nominate -t chasetag -p 1 --submission-id 123
81
+ ```
82
+
83
+ ### Docker
84
+
85
+ For custom Python around the policy. The image must ship `policy.py` and/or
86
+ `model.onnx` under `/policy` (or `/app`).
87
+
88
+ ```bash
89
+ evalmc push my-agent:tag -t chasetag -p 1
90
+ ```
91
+
92
+ ---
93
+
94
+ Some tracks are invitation-only. Registration and submission are rejected until
95
+ the team is on the whitelist. Leaderboards stay public.
evalmc-0.0.3/README.md ADDED
@@ -0,0 +1,72 @@
1
+ # evalmc
2
+
3
+ MyoChallenge submission CLI — upload ONNX policies or Docker agent images to
4
+ [mc26.myosuite.org](https://mc26.myosuite.org).
5
+
6
+ [![PyPI](https://img.shields.io/pypi/v/evalmc.svg)](https://pypi.org/project/evalmc/)
7
+ [![Python](https://img.shields.io/pypi/pyversions/evalmc.svg)](https://pypi.org/project/evalmc/)
8
+ [![License](https://img.shields.io/pypi/l/evalmc.svg)](https://pypi.org/project/evalmc/)
9
+
10
+ ```bash
11
+ pip install -U evalmc
12
+ ```
13
+
14
+ Default API: `https://api.mc.myosuite.org`
15
+
16
+ ---
17
+
18
+ ## Quick start
19
+
20
+ ```bash
21
+ evalmc host --set-host https://api.mc.myosuite.org
22
+ evalmc login
23
+ evalmc status
24
+ evalmc submit-onnx model.onnx -t chasetag -p 1
25
+ ```
26
+
27
+ `evalmc login` stores the email and auth token from the dashboard.
28
+ Credentials live in `~/.myochallenge/`.
29
+
30
+ ---
31
+
32
+ ## Commands
33
+
34
+ | Command | Purpose |
35
+ |---|---|
36
+ | `evalmc host` | Show or set the API host |
37
+ | `evalmc login` | Save email + auth token |
38
+ | `evalmc status` | Confirm host and team |
39
+ | `evalmc submit-onnx` | Upload an ONNX policy |
40
+ | `evalmc nominate` | Pick a scored artifact for title-cycle finals |
41
+ | `evalmc push` | Submit a Docker / ECR agent image |
42
+
43
+ ### ONNX
44
+
45
+ Recommended for ChaseTag. The graph is `obs → action`; no `policy.py` required.
46
+
47
+ ```bash
48
+ evalmc submit-onnx model.onnx -t chasetag -p 1
49
+ ```
50
+
51
+ ### Title-cycle nomination
52
+
53
+ Before freeze, choose which scored in-window submission plays in finals.
54
+ If you skip this, the platform uses your best score.
55
+
56
+ ```bash
57
+ evalmc nominate -t chasetag -p 1 --submission-id 123
58
+ ```
59
+
60
+ ### Docker
61
+
62
+ For custom Python around the policy. The image must ship `policy.py` and/or
63
+ `model.onnx` under `/policy` (or `/app`).
64
+
65
+ ```bash
66
+ evalmc push my-agent:tag -t chasetag -p 1
67
+ ```
68
+
69
+ ---
70
+
71
+ Some tracks are invitation-only. Registration and submission are rejected until
72
+ the team is on the whitelist. Leaderboards stay public.
evalmc-0.0.3/evalmc.egg-info/PKG-INFO ADDED
@@ -0,0 +1,95 @@
1
+ Metadata-Version: 2.4
2
+ Name: evalmc
3
+ Version: 0.0.3
4
+ Summary: Submit ONNX policies and Docker agents to MyoChallenge
5
+ Author-email: MyoChallenge Team <caggiano@gmail.com>
6
+ License-Expression: Apache-2.0
7
+ Project-URL: Homepage, https://github.com/MyoHub/mcEvalProd-CLI
8
+ Classifier: Development Status :: 4 - Beta
9
+ Classifier: Intended Audience :: Developers
10
+ Classifier: Operating System :: OS Independent
11
+ Classifier: Programming Language :: Python :: 3
12
+ Classifier: Programming Language :: Python :: 3.9
13
+ Classifier: Programming Language :: Python :: 3.10
14
+ Classifier: Programming Language :: Python :: 3.11
15
+ Requires-Python: >=3.9
16
+ Description-Content-Type: text/markdown
17
+ License-File: LICENSE
18
+ Requires-Dist: click>=8.0.0
19
+ Requires-Dist: docker>=6.0.0
20
+ Requires-Dist: requests>=2.25.0
21
+ Requires-Dist: boto3>=1.26.0
22
+ Dynamic: license-file
23
+
24
+ # evalmc
25
+
26
+ MyoChallenge submission CLI — upload ONNX policies or Docker agent images to
27
+ [mc26.myosuite.org](https://mc26.myosuite.org).
28
+
29
+ [![PyPI](https://img.shields.io/pypi/v/evalmc.svg)](https://pypi.org/project/evalmc/)
30
+ [![Python](https://img.shields.io/pypi/pyversions/evalmc.svg)](https://pypi.org/project/evalmc/)
31
+ [![License](https://img.shields.io/pypi/l/evalmc.svg)](https://pypi.org/project/evalmc/)
32
+
33
+ ```bash
34
+ pip install -U evalmc
35
+ ```
36
+
37
+ Default API: `https://api.mc.myosuite.org`
38
+
39
+ ---
40
+
41
+ ## Quick start
42
+
43
+ ```bash
44
+ evalmc host --set-host https://api.mc.myosuite.org
45
+ evalmc login
46
+ evalmc status
47
+ evalmc submit-onnx model.onnx -t chasetag -p 1
48
+ ```
49
+
50
+ `evalmc login` stores the email and auth token from the dashboard.
51
+ Credentials live in `~/.myochallenge/`.
52
+
53
+ ---
54
+
55
+ ## Commands
56
+
57
+ | Command | Purpose |
58
+ |---|---|
59
+ | `evalmc host` | Show or set the API host |
60
+ | `evalmc login` | Save email + auth token |
61
+ | `evalmc status` | Confirm host and team |
62
+ | `evalmc submit-onnx` | Upload an ONNX policy |
63
+ | `evalmc nominate` | Pick a scored artifact for title-cycle finals |
64
+ | `evalmc push` | Submit a Docker / ECR agent image |
65
+
66
+ ### ONNX
67
+
68
+ Recommended for ChaseTag. The graph is `obs → action`; no `policy.py` required.
69
+
70
+ ```bash
71
+ evalmc submit-onnx model.onnx -t chasetag -p 1
72
+ ```
73
+
74
+ ### Title-cycle nomination
75
+
76
+ Before freeze, choose which scored in-window submission plays in finals.
77
+ If you skip this, the platform uses your best score.
78
+
79
+ ```bash
80
+ evalmc nominate -t chasetag -p 1 --submission-id 123
81
+ ```
82
+
83
+ ### Docker
84
+
85
+ For custom Python around the policy. The image must ship `policy.py` and/or
86
+ `model.onnx` under `/policy` (or `/app`).
87
+
88
+ ```bash
89
+ evalmc push my-agent:tag -t chasetag -p 1
90
+ ```
91
+
92
+ ---
93
+
94
+ Some tracks are invitation-only. Registration and submission are rejected until
95
+ the team is on the whitelist. Leaderboards stay public.
{evalmc-0.0.2 → evalmc-0.0.3}/pyproject.toml RENAMED
@@ -4,8 +4,8 @@ build-backend = "setuptools.build_meta"
4
4
 
5
5
  [project]
6
6
  name = "evalmc"
7
- version = "0.0.2"
8
- description = "MyoChallenge submission CLI"
7
+ version = "0.0.3"
8
+ description = "Submit ONNX policies and Docker agents to MyoChallenge"
9
9
  readme = "README.md"
10
10
  license = "Apache-2.0"
11
11
  requires-python = ">=3.9"
evalmc-0.0.2/PKG-INFO DELETED
@@ -1,60 +0,0 @@
1
- Metadata-Version: 2.4
2
- Name: evalmc
3
- Version: 0.0.2
4
- Summary: MyoChallenge submission CLI
5
- Author-email: MyoChallenge Team <caggiano@gmail.com>
6
- License-Expression: Apache-2.0
7
- Project-URL: Homepage, https://github.com/MyoHub/mcEvalProd-CLI
8
- Classifier: Development Status :: 4 - Beta
9
- Classifier: Intended Audience :: Developers
10
- Classifier: Operating System :: OS Independent
11
- Classifier: Programming Language :: Python :: 3
12
- Classifier: Programming Language :: Python :: 3.9
13
- Classifier: Programming Language :: Python :: 3.10
14
- Classifier: Programming Language :: Python :: 3.11
15
- Requires-Python: >=3.9
16
- Description-Content-Type: text/markdown
17
- License-File: LICENSE
18
- Requires-Dist: click>=8.0.0
19
- Requires-Dist: docker>=6.0.0
20
- Requires-Dist: requests>=2.25.0
21
- Requires-Dist: boto3>=1.26.0
22
- Dynamic: license-file
23
-
24
- # evalmc — MyoChallenge submission CLI
25
-
26
- ```bash
27
- pip install -U evalmc
28
- ```
29
-
30
- Default API host is `https://api.mc.myosuite.org`.
31
-
32
- ## Setup
33
-
34
- ```bash
35
- evalmc host --set-host https://api.mc.myosuite.org
36
- evalmc login # email + auth token from mc26.myosuite.org
37
- evalmc status
38
- ```
39
-
40
- ## Submit
41
-
42
- **ONNX** (recommended for ChaseTag):
43
-
44
- ```bash
45
- evalmc submit-onnx model.onnx -t chasetag -p 1
46
- ```
47
-
48
- **Nominate** a scored in-window submission for title-cycle finals:
49
-
50
- ```bash
51
- evalmc nominate -t chasetag -p 1 --submission-id 123
52
- ```
53
-
54
- **Docker / ECR** (custom Python policies):
55
-
56
- ```bash
57
- evalmc push my-agent:tag -t chasetag -p 1
58
- ```
59
-
60
- Credentials live in `~/.myochallenge/` (`host_url`, `auth_token.json`).
evalmc-0.0.2/README.md DELETED
@@ -1,37 +0,0 @@
1
- # evalmc — MyoChallenge submission CLI
2
-
3
- ```bash
4
- pip install -U evalmc
5
- ```
6
-
7
- Default API host is `https://api.mc.myosuite.org`.
8
-
9
- ## Setup
10
-
11
- ```bash
12
- evalmc host --set-host https://api.mc.myosuite.org
13
- evalmc login # email + auth token from mc26.myosuite.org
14
- evalmc status
15
- ```
16
-
17
- ## Submit
18
-
19
- **ONNX** (recommended for ChaseTag):
20
-
21
- ```bash
22
- evalmc submit-onnx model.onnx -t chasetag -p 1
23
- ```
24
-
25
- **Nominate** a scored in-window submission for title-cycle finals:
26
-
27
- ```bash
28
- evalmc nominate -t chasetag -p 1 --submission-id 123
29
- ```
30
-
31
- **Docker / ECR** (custom Python policies):
32
-
33
- ```bash
34
- evalmc push my-agent:tag -t chasetag -p 1
35
- ```
36
-
37
- Credentials live in `~/.myochallenge/` (`host_url`, `auth_token.json`).
evalmc-0.0.2/evalmc.egg-info/PKG-INFO DELETED
@@ -1,60 +0,0 @@
1
- Metadata-Version: 2.4
2
- Name: evalmc
3
- Version: 0.0.2
4
- Summary: MyoChallenge submission CLI
5
- Author-email: MyoChallenge Team <caggiano@gmail.com>
6
- License-Expression: Apache-2.0
7
- Project-URL: Homepage, https://github.com/MyoHub/mcEvalProd-CLI
8
- Classifier: Development Status :: 4 - Beta
9
- Classifier: Intended Audience :: Developers
10
- Classifier: Operating System :: OS Independent
11
- Classifier: Programming Language :: Python :: 3
12
- Classifier: Programming Language :: Python :: 3.9
13
- Classifier: Programming Language :: Python :: 3.10
14
- Classifier: Programming Language :: Python :: 3.11
15
- Requires-Python: >=3.9
16
- Description-Content-Type: text/markdown
17
- License-File: LICENSE
18
- Requires-Dist: click>=8.0.0
19
- Requires-Dist: docker>=6.0.0
20
- Requires-Dist: requests>=2.25.0
21
- Requires-Dist: boto3>=1.26.0
22
- Dynamic: license-file
23
-
24
- # evalmc — MyoChallenge submission CLI
25
-
26
- ```bash
27
- pip install -U evalmc
28
- ```
29
-
30
- Default API host is `https://api.mc.myosuite.org`.
31
-
32
- ## Setup
33
-
34
- ```bash
35
- evalmc host --set-host https://api.mc.myosuite.org
36
- evalmc login # email + auth token from mc26.myosuite.org
37
- evalmc status
38
- ```
39
-
40
- ## Submit
41
-
42
- **ONNX** (recommended for ChaseTag):
43
-
44
- ```bash
45
- evalmc submit-onnx model.onnx -t chasetag -p 1
46
- ```
47
-
48
- **Nominate** a scored in-window submission for title-cycle finals:
49
-
50
- ```bash
51
- evalmc nominate -t chasetag -p 1 --submission-id 123
52
- ```
53
-
54
- **Docker / ECR** (custom Python policies):
55
-
56
- ```bash
57
- evalmc push my-agent:tag -t chasetag -p 1
58
- ```
59
-
60
- Credentials live in `~/.myochallenge/` (`host_url`, `auth_token.json`).
{evalmc-0.0.2 → evalmc-0.0.3}/LICENSE RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/__init__.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/__main__.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/check_challenge.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/config_paths.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/host.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/login.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/main.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/nominate.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/push_helpers.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/register.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/set_token.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/status.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/submission.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/submit_onnx.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/evalmc/utils.py RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/setup.cfg RENAMED
File without changes
{evalmc-0.0.2 → evalmc-0.0.3}/tests/test_cli_smoke.py RENAMED
File without changes