acumen 0.0.1.dev0__tar.gz → 0.0.2__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- acumen-0.0.2/.codecov.yaml +17 -0
- acumen-0.0.2/.github/ISSUE_TEMPLATE/bug_report.yml +93 -0
- acumen-0.0.2/.github/ISSUE_TEMPLATE/config.yml +5 -0
- acumen-0.0.2/.github/ISSUE_TEMPLATE/feature_request.yml +11 -0
- acumen-0.0.2/.github/workflows/build.yaml +26 -0
- acumen-0.0.2/.github/workflows/release.yaml +27 -0
- acumen-0.0.2/.github/workflows/test.yaml +113 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/.gitignore +4 -0
- acumen-0.0.2/.pre-commit-config.yaml +38 -0
- acumen-0.0.2/.readthedocs.yaml +16 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/.vscode/settings.json +1 -0
- acumen-0.0.2/CHANGELOG.md +74 -0
- acumen-0.0.2/PKG-INFO +161 -0
- acumen-0.0.2/README.md +111 -0
- acumen-0.0.2/docs/_static/css/custom.css +20 -0
- {acumen-0.0.1.dev0/src/acumen/assets → acumen-0.0.2/docs/_static/images}/banner.svg +52 -19
- acumen-0.0.2/docs/_static/images/logo.png +0 -0
- acumen-0.0.2/docs/_static/images/logo.svg +85 -0
- acumen-0.0.2/docs/api/bench.md +4 -0
- acumen-0.0.2/docs/api/check.md +4 -0
- acumen-0.0.2/docs/api/epoch.md +4 -0
- acumen-0.0.2/docs/api/fit.md +20 -0
- acumen-0.0.2/docs/api/improve.md +4 -0
- acumen-0.0.2/docs/api/index.md +87 -0
- acumen-0.0.2/docs/api/init.md +4 -0
- acumen-0.0.2/docs/api/prepare.md +4 -0
- acumen-0.0.2/docs/api/prices.md +4 -0
- acumen-0.0.2/docs/api/report.md +4 -0
- acumen-0.0.2/docs/api/ship.md +4 -0
- acumen-0.0.2/docs/api/tasks.md +4 -0
- acumen-0.0.2/docs/api/wiki.md +4 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/docs/conf.py +10 -0
- acumen-0.0.2/docs/extensions/acumen_cli.py +172 -0
- acumen-0.0.2/docs/getting_started.md +707 -0
- acumen-0.0.2/docs/index.md +19 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/pyproject.toml +16 -7
- {acumen-0.0.1.dev0 → acumen-0.0.2}/src/acumen/__init__.py +128 -22
- acumen-0.0.2/src/acumen/agents.py +1224 -0
- acumen-0.0.2/src/acumen/bench.py +418 -0
- acumen-0.0.2/src/acumen/check.py +673 -0
- acumen-0.0.2/src/acumen/cli.py +2660 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/src/acumen/config.py +72 -12
- acumen-0.0.2/src/acumen/data.py +92 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/src/acumen/env.py +281 -99
- acumen-0.0.2/src/acumen/epoch.py +73 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/src/acumen/grade.py +18 -1
- acumen-0.0.2/src/acumen/guard.py +179 -0
- acumen-0.0.2/src/acumen/htmldiff.py +144 -0
- acumen-0.0.2/src/acumen/improve.py +511 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/src/acumen/logs.py +146 -35
- acumen-0.0.2/src/acumen/markdown.py +158 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/src/acumen/paths.py +22 -7
- acumen-0.0.2/src/acumen/prepare.py +231 -0
- acumen-0.0.2/src/acumen/pricefeed.py +325 -0
- acumen-0.0.2/src/acumen/prices.py +379 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/src/acumen/procs.py +3 -4
- acumen-0.0.2/src/acumen/prompts.py +1469 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/src/acumen/report.py +1030 -334
- acumen-0.0.2/src/acumen/review.py +456 -0
- acumen-0.0.2/src/acumen/runner.py +588 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/src/acumen/sandbox.py +53 -21
- {acumen-0.0.1.dev0 → acumen-0.0.2}/src/acumen/scaffold.py +52 -13
- acumen-0.0.2/src/acumen/scriptdiff.py +216 -0
- acumen-0.0.2/src/acumen/scrub.py +477 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/src/acumen/ship.py +106 -53
- {acumen-0.0.1.dev0 → acumen-0.0.2}/src/acumen/skills.py +16 -2
- {acumen-0.0.1.dev0 → acumen-0.0.2}/src/acumen/taskgen.py +153 -192
- acumen-0.0.2/src/acumen/tasks.py +209 -0
- acumen-0.0.2/src/acumen/theme.py +51 -0
- acumen-0.0.2/src/acumen/training.py +235 -0
- acumen-0.0.2/src/acumen/trajectory.py +796 -0
- acumen-0.0.2/src/acumen/transcript.py +162 -0
- acumen-0.0.2/src/acumen/wiki.py +748 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/tests/conftest.py +25 -5
- acumen-0.0.2/tests/test_cli.py +1849 -0
- acumen-0.0.2/tests/test_core.py +5977 -0
- acumen-0.0.2/tests/test_data.py +414 -0
- acumen-0.0.2/tests/test_scrub.py +296 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/tests/test_ship_install.py +14 -4
- acumen-0.0.1.dev0/.codecov.yaml +0 -17
- acumen-0.0.1.dev0/.github/ISSUE_TEMPLATE/bug_report.yml +0 -93
- acumen-0.0.1.dev0/.github/ISSUE_TEMPLATE/config.yml +0 -5
- acumen-0.0.1.dev0/.github/ISSUE_TEMPLATE/feature_request.yml +0 -11
- acumen-0.0.1.dev0/.github/workflows/build.yaml +0 -26
- acumen-0.0.1.dev0/.github/workflows/release.yaml +0 -27
- acumen-0.0.1.dev0/.github/workflows/test.yaml +0 -107
- acumen-0.0.1.dev0/.pre-commit-config.yaml +0 -38
- acumen-0.0.1.dev0/.readthedocs.yaml +0 -16
- acumen-0.0.1.dev0/CHANGELOG.md +0 -11
- acumen-0.0.1.dev0/PKG-INFO +0 -168
- acumen-0.0.1.dev0/README.md +0 -121
- acumen-0.0.1.dev0/docs/_static/css/custom.css +0 -4
- acumen-0.0.1.dev0/docs/_static/images/banner_plate.svg +0 -9
- acumen-0.0.1.dev0/docs/api.md +0 -164
- acumen-0.0.1.dev0/docs/index.md +0 -12
- acumen-0.0.1.dev0/src/acumen/_skills/__init__.py +0 -0
- acumen-0.0.1.dev0/src/acumen/_skills/data/SKILL.md +0 -109
- acumen-0.0.1.dev0/src/acumen/_skills/data/references/authoring.md +0 -91
- acumen-0.0.1.dev0/src/acumen/_skills/data/references/benchmark.md +0 -100
- acumen-0.0.1.dev0/src/acumen/_skills/data/references/python-api.md +0 -106
- acumen-0.0.1.dev0/src/acumen/_skills/data/references/setup.md +0 -94
- acumen-0.0.1.dev0/src/acumen/_skills/data/references/ship.md +0 -53
- acumen-0.0.1.dev0/src/acumen/_skills/install.py +0 -185
- acumen-0.0.1.dev0/src/acumen/assets/logo.svg +0 -47
- acumen-0.0.1.dev0/src/acumen/bench.py +0 -202
- acumen-0.0.1.dev0/src/acumen/cli.py +0 -626
- acumen-0.0.1.dev0/src/acumen/draft.py +0 -202
- acumen-0.0.1.dev0/src/acumen/improve.py +0 -596
- acumen-0.0.1.dev0/src/acumen/prompts.py +0 -942
- acumen-0.0.1.dev0/src/acumen/runner.py +0 -343
- acumen-0.0.1.dev0/src/acumen/tasks.py +0 -144
- acumen-0.0.1.dev0/src/acumen/transcript.py +0 -77
- acumen-0.0.1.dev0/tests/test_cli.py +0 -207
- acumen-0.0.1.dev0/tests/test_core.py +0 -1252
- {acumen-0.0.1.dev0 → acumen-0.0.2}/.cruft.json +0 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/.editorconfig +0 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/.vscode/extensions.json +0 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/.vscode/launch.json +0 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/LICENSE +0 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/biome.jsonc +0 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/docs/_static/.gitkeep +0 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/docs/changelog.md +0 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/docs/references.bib +0 -0
- {acumen-0.0.1.dev0 → acumen-0.0.2}/docs/references.md +0 -0
- {acumen-0.0.1.dev0/docs/_static/images → acumen-0.0.2/src/acumen/assets}/banner.svg +0 -0
- {acumen-0.0.1.dev0/docs/_static/images → acumen-0.0.2/src/acumen/assets}/logo.svg +0 -0
|
@@ -0,0 +1,17 @@
|
|
|
1
|
+
# Based on pydata/xarray
|
|
2
|
+
codecov:
|
|
3
|
+
require_ci_to_pass: no
|
|
4
|
+
|
|
5
|
+
coverage:
|
|
6
|
+
status:
|
|
7
|
+
project:
|
|
8
|
+
default:
|
|
9
|
+
# Require 1% coverage, i.e., always succeed
|
|
10
|
+
target: 1
|
|
11
|
+
patch: false
|
|
12
|
+
changes: false
|
|
13
|
+
|
|
14
|
+
comment:
|
|
15
|
+
layout: diff, flags, files
|
|
16
|
+
behavior: once
|
|
17
|
+
require_base: no
|
|
@@ -0,0 +1,93 @@
|
|
|
1
|
+
name: Bug report
|
|
2
|
+
description: Report something that is broken or incorrect
|
|
3
|
+
labels: bug
|
|
4
|
+
body:
|
|
5
|
+
- type: markdown
|
|
6
|
+
attributes:
|
|
7
|
+
value: |
|
|
8
|
+
**Note**: Please read [this guide](https://matthewrocklin.com/blog/work/2018/02/28/minimal-bug-reports)
|
|
9
|
+
detailing how to provide the necessary information for us to reproduce your bug. In brief:
|
|
10
|
+
* Please provide exact steps how to reproduce the bug in a clean Python environment.
|
|
11
|
+
* In case it's not clear what's causing this bug, please provide the data or the data generation procedure.
|
|
12
|
+
* Replicate problems on public datasets or share data subsets when full sharing isn't possible.
|
|
13
|
+
|
|
14
|
+
- type: textarea
|
|
15
|
+
id: report
|
|
16
|
+
attributes:
|
|
17
|
+
label: Report
|
|
18
|
+
description: A clear and concise description of what the bug is.
|
|
19
|
+
validations:
|
|
20
|
+
required: true
|
|
21
|
+
|
|
22
|
+
- type: textarea
|
|
23
|
+
id: versions
|
|
24
|
+
attributes:
|
|
25
|
+
label: Versions
|
|
26
|
+
description: |
|
|
27
|
+
Which version of packages.
|
|
28
|
+
|
|
29
|
+
Please install `session-info2`, run the following command in a notebook,
|
|
30
|
+
click the “Copy as Markdown” button, then paste the results into the text box below.
|
|
31
|
+
|
|
32
|
+
```python
|
|
33
|
+
In[1]: import session_info2; session_info2.session_info(dependencies=True)
|
|
34
|
+
```
|
|
35
|
+
|
|
36
|
+
Alternatively, run this in a console:
|
|
37
|
+
|
|
38
|
+
```python
|
|
39
|
+
>>> import session_info2; print(session_info2.session_info(dependencies=True)._repr_mimebundle_()["text/markdown"])
|
|
40
|
+
```
|
|
41
|
+
render: python
|
|
42
|
+
placeholder: |
|
|
43
|
+
anndata 0.11.3
|
|
44
|
+
---- ----
|
|
45
|
+
charset-normalizer 3.4.1
|
|
46
|
+
coverage 7.7.0
|
|
47
|
+
psutil 7.0.0
|
|
48
|
+
dask 2024.7.1
|
|
49
|
+
jaraco.context 5.3.0
|
|
50
|
+
numcodecs 0.15.1
|
|
51
|
+
jaraco.functools 4.0.1
|
|
52
|
+
Jinja2 3.1.6
|
|
53
|
+
sphinxcontrib-jsmath 1.0.1
|
|
54
|
+
sphinxcontrib-htmlhelp 2.1.0
|
|
55
|
+
toolz 1.0.0
|
|
56
|
+
session-info2 0.1.2
|
|
57
|
+
PyYAML 6.0.2
|
|
58
|
+
llvmlite 0.44.0
|
|
59
|
+
scipy 1.15.2
|
|
60
|
+
pandas 2.2.3
|
|
61
|
+
sphinxcontrib-devhelp 2.0.0
|
|
62
|
+
h5py 3.13.0
|
|
63
|
+
tblib 3.0.0
|
|
64
|
+
setuptools-scm 8.2.0
|
|
65
|
+
more-itertools 10.3.0
|
|
66
|
+
msgpack 1.1.0
|
|
67
|
+
sparse 0.15.5
|
|
68
|
+
wrapt 1.17.2
|
|
69
|
+
jaraco.collections 5.1.0
|
|
70
|
+
numba 0.61.0
|
|
71
|
+
pyarrow 19.0.1
|
|
72
|
+
pytz 2025.1
|
|
73
|
+
MarkupSafe 3.0.2
|
|
74
|
+
crc32c 2.7.1
|
|
75
|
+
sphinxcontrib-qthelp 2.0.0
|
|
76
|
+
sphinxcontrib-serializinghtml 2.0.0
|
|
77
|
+
zarr 2.18.4
|
|
78
|
+
asciitree 0.3.3
|
|
79
|
+
six 1.17.0
|
|
80
|
+
sphinxcontrib-applehelp 2.0.0
|
|
81
|
+
numpy 2.1.3
|
|
82
|
+
cloudpickle 3.1.1
|
|
83
|
+
sphinxcontrib-bibtex 2.6.3
|
|
84
|
+
natsort 8.4.0
|
|
85
|
+
jaraco.text 3.12.1
|
|
86
|
+
setuptools 76.1.0
|
|
87
|
+
Deprecated 1.2.18
|
|
88
|
+
packaging 24.2
|
|
89
|
+
python-dateutil 2.9.0.post0
|
|
90
|
+
---- ----
|
|
91
|
+
Python 3.13.2 | packaged by conda-forge | (main, Feb 17 2025, 14:10:22) [GCC 13.3.0]
|
|
92
|
+
OS Linux-6.11.0-109019-tuxedo-x86_64-with-glibc2.39
|
|
93
|
+
Updated 2025-03-18 15:47
|
|
@@ -0,0 +1,11 @@
|
|
|
1
|
+
name: Feature request
|
|
2
|
+
description: Propose a new feature for acumen
|
|
3
|
+
labels: enhancement
|
|
4
|
+
body:
|
|
5
|
+
- type: textarea
|
|
6
|
+
id: description
|
|
7
|
+
attributes:
|
|
8
|
+
label: Description of feature
|
|
9
|
+
description: Please describe your suggestion for a new feature. It might help to describe a problem or use case, plus any alternatives that you have considered.
|
|
10
|
+
validations:
|
|
11
|
+
required: true
|
|
@@ -0,0 +1,26 @@
|
|
|
1
|
+
name: Check Build
|
|
2
|
+
|
|
3
|
+
on:
|
|
4
|
+
push:
|
|
5
|
+
branches: [main]
|
|
6
|
+
pull_request:
|
|
7
|
+
branches: [main]
|
|
8
|
+
|
|
9
|
+
concurrency:
|
|
10
|
+
group: ${{ github.workflow }}-${{ github.ref }}
|
|
11
|
+
cancel-in-progress: true
|
|
12
|
+
|
|
13
|
+
jobs:
|
|
14
|
+
package:
|
|
15
|
+
runs-on: ubuntu-latest
|
|
16
|
+
steps:
|
|
17
|
+
- uses: actions/checkout@v6
|
|
18
|
+
with:
|
|
19
|
+
filter: blob:none
|
|
20
|
+
fetch-depth: 0
|
|
21
|
+
- name: Install uv
|
|
22
|
+
uses: astral-sh/setup-uv@v7
|
|
23
|
+
- name: Build package
|
|
24
|
+
run: uv build
|
|
25
|
+
- name: Check package
|
|
26
|
+
run: uvx twine check --strict dist/*.whl
|
|
@@ -0,0 +1,27 @@
|
|
|
1
|
+
name: Release
|
|
2
|
+
|
|
3
|
+
on:
|
|
4
|
+
release:
|
|
5
|
+
types: [published]
|
|
6
|
+
|
|
7
|
+
# Use "trusted publishing", see https://docs.pypi.org/trusted-publishers/
|
|
8
|
+
jobs:
|
|
9
|
+
release:
|
|
10
|
+
name: Upload release to PyPI
|
|
11
|
+
runs-on: ubuntu-latest
|
|
12
|
+
environment:
|
|
13
|
+
name: pypi
|
|
14
|
+
url: https://pypi.org/p/acumen
|
|
15
|
+
permissions:
|
|
16
|
+
id-token: write # IMPORTANT: this permission is mandatory for trusted publishing
|
|
17
|
+
steps:
|
|
18
|
+
- uses: actions/checkout@v6
|
|
19
|
+
with:
|
|
20
|
+
filter: blob:none
|
|
21
|
+
fetch-depth: 0
|
|
22
|
+
- name: Install uv
|
|
23
|
+
uses: astral-sh/setup-uv@v7
|
|
24
|
+
- name: Build package
|
|
25
|
+
run: uv build
|
|
26
|
+
- name: Publish package distributions to PyPI
|
|
27
|
+
uses: pypa/gh-action-pypi-publish@release/v1
|
|
@@ -0,0 +1,113 @@
|
|
|
1
|
+
name: Test
|
|
2
|
+
|
|
3
|
+
on:
|
|
4
|
+
push:
|
|
5
|
+
branches: [main]
|
|
6
|
+
pull_request:
|
|
7
|
+
branches: [main]
|
|
8
|
+
schedule:
|
|
9
|
+
- cron: "0 5 1,15 * *"
|
|
10
|
+
|
|
11
|
+
concurrency:
|
|
12
|
+
group: ${{ github.workflow }}-${{ github.ref }}
|
|
13
|
+
cancel-in-progress: true
|
|
14
|
+
|
|
15
|
+
jobs:
|
|
16
|
+
# Get the test environment from hatch as defined in pyproject.toml.
|
|
17
|
+
# This ensures that the pyproject.toml is the single point of truth for test definitions and the same tests are
|
|
18
|
+
# run locally and on continuous integration.
|
|
19
|
+
# Check [[tool.hatch.envs.hatch-test.matrix]] in pyproject.toml and https://hatch.pypa.io/latest/environment/ for
|
|
20
|
+
# more details.
|
|
21
|
+
get-environments:
|
|
22
|
+
runs-on: ubuntu-slim
|
|
23
|
+
outputs:
|
|
24
|
+
envs: ${{ steps.get-envs.outputs.envs }}
|
|
25
|
+
steps:
|
|
26
|
+
- uses: actions/checkout@v6
|
|
27
|
+
with:
|
|
28
|
+
filter: blob:none
|
|
29
|
+
fetch-depth: 0
|
|
30
|
+
- name: Install uv
|
|
31
|
+
uses: astral-sh/setup-uv@v7
|
|
32
|
+
- name: Get test environments
|
|
33
|
+
id: get-envs
|
|
34
|
+
run: |
|
|
35
|
+
ENVS_JSON=$(uvx hatch env show --json | jq -c 'to_entries
|
|
36
|
+
| map(
|
|
37
|
+
select(.key | startswith("hatch-test"))
|
|
38
|
+
| {
|
|
39
|
+
name: .key,
|
|
40
|
+
label: (if (.key | contains("pre")) then .key + " (PRE-RELEASE DEPENDENCIES)" else .key end),
|
|
41
|
+
python: .value.python
|
|
42
|
+
}
|
|
43
|
+
)')
|
|
44
|
+
echo "envs=${ENVS_JSON}" | tee $GITHUB_OUTPUT
|
|
45
|
+
|
|
46
|
+
# Run tests through hatch. Spawns a separate runner for each environment defined in the hatch matrix obtained above.
|
|
47
|
+
test:
|
|
48
|
+
needs: get-environments
|
|
49
|
+
permissions:
|
|
50
|
+
id-token: write # for codecov OIDC
|
|
51
|
+
contents: read
|
|
52
|
+
|
|
53
|
+
strategy:
|
|
54
|
+
fail-fast: false
|
|
55
|
+
matrix:
|
|
56
|
+
os: [ubuntu-latest]
|
|
57
|
+
env: ${{ fromJSON(needs.get-environments.outputs.envs) }}
|
|
58
|
+
|
|
59
|
+
name: ${{ matrix.env.label }}
|
|
60
|
+
runs-on: ${{ matrix.os }}
|
|
61
|
+
continue-on-error: ${{ contains(matrix.env.name, 'pre') }} # make "all-green" pass even if pre-release job fails
|
|
62
|
+
|
|
63
|
+
steps:
|
|
64
|
+
- uses: actions/checkout@v6
|
|
65
|
+
with:
|
|
66
|
+
filter: blob:none
|
|
67
|
+
fetch-depth: 0
|
|
68
|
+
- name: Set up Node.js
|
|
69
|
+
uses: actions/setup-node@v6
|
|
70
|
+
with:
|
|
71
|
+
node-version: 22
|
|
72
|
+
- name: Install uv
|
|
73
|
+
uses: astral-sh/setup-uv@v7
|
|
74
|
+
with:
|
|
75
|
+
python-version: ${{ matrix.env.python }}
|
|
76
|
+
- name: Install agent CLIs
|
|
77
|
+
run: npm install --global @anthropic-ai/claude-code @openai/codex
|
|
78
|
+
- name: create hatch environment
|
|
79
|
+
run: uvx hatch env create ${{ matrix.env.name }}
|
|
80
|
+
- name: list all all installed package versions
|
|
81
|
+
run: uvx hatch run ${{ matrix.env.name }}:uv pip list
|
|
82
|
+
- name: run tests using hatch
|
|
83
|
+
env:
|
|
84
|
+
MPLBACKEND: agg
|
|
85
|
+
PLATFORM: ${{ matrix.os }}
|
|
86
|
+
DISPLAY: :42
|
|
87
|
+
run: uvx hatch run ${{ matrix.env.name }}:run-cov -v --color=yes -n auto
|
|
88
|
+
- name: generate coverage report
|
|
89
|
+
run: |
|
|
90
|
+
# See https://coverage.readthedocs.io/page/config.html#run-patch
|
|
91
|
+
test -f .coverage || uvx hatch run ${{ matrix.env.name }}:cov-combine
|
|
92
|
+
uvx hatch run ${{ matrix.env.name }}:cov-report # report visibly
|
|
93
|
+
uvx hatch run ${{ matrix.env.name }}:coverage xml # create report for upload
|
|
94
|
+
- name: Upload coverage
|
|
95
|
+
uses: codecov/codecov-action@v6
|
|
96
|
+
with:
|
|
97
|
+
# TODO: set back to true once scverse/acumen is onboarded on Codecov
|
|
98
|
+
fail_ci_if_error: false
|
|
99
|
+
use_oidc: true
|
|
100
|
+
|
|
101
|
+
# Check that all tests defined above pass. This makes it easy to set a single "required" test in branch
|
|
102
|
+
# protection instead of having to update it frequently. See https://github.com/re-actors/alls-green#why.
|
|
103
|
+
check:
|
|
104
|
+
name: Tests pass in all hatch environments
|
|
105
|
+
if: always()
|
|
106
|
+
needs:
|
|
107
|
+
- get-environments
|
|
108
|
+
- test
|
|
109
|
+
runs-on: ubuntu-latest
|
|
110
|
+
steps:
|
|
111
|
+
- uses: re-actors/alls-green@release/v1
|
|
112
|
+
with:
|
|
113
|
+
jobs: ${{ toJSON(needs) }}
|
|
@@ -11,6 +11,10 @@ __pycache__/
|
|
|
11
11
|
# Distribution / packaging
|
|
12
12
|
/dist/
|
|
13
13
|
|
|
14
|
+
# uv's resolved dependency set. acumen is a library — consumers resolve their own tree, and
|
|
15
|
+
# CI resolves fresh through hatch — so a committed lock would pin nothing that is checked.
|
|
16
|
+
/uv.lock
|
|
17
|
+
|
|
14
18
|
# Tests and coverage
|
|
15
19
|
/data/
|
|
16
20
|
/node_modules/
|
|
@@ -0,0 +1,38 @@
|
|
|
1
|
+
fail_fast: false
|
|
2
|
+
default_language_version:
|
|
3
|
+
python: python3
|
|
4
|
+
default_stages:
|
|
5
|
+
- pre-commit
|
|
6
|
+
- pre-push
|
|
7
|
+
minimum_pre_commit_version: 2.16.0
|
|
8
|
+
repos:
|
|
9
|
+
- repo: https://github.com/biomejs/pre-commit
|
|
10
|
+
rev: v2.6.4
|
|
11
|
+
hooks:
|
|
12
|
+
- id: biome-format
|
|
13
|
+
exclude: ^\.cruft\.json$ # inconsistent indentation with cruft - file never to be modified manually.
|
|
14
|
+
- repo: https://github.com/tox-dev/pyproject-fmt
|
|
15
|
+
rev: v2.30.6
|
|
16
|
+
hooks:
|
|
17
|
+
- id: pyproject-fmt
|
|
18
|
+
- repo: https://github.com/astral-sh/ruff-pre-commit
|
|
19
|
+
rev: v0.17.4
|
|
20
|
+
hooks:
|
|
21
|
+
- id: ruff-check
|
|
22
|
+
types_or: [python, pyi, jupyter]
|
|
23
|
+
args: [--fix, --exit-non-zero-on-fix]
|
|
24
|
+
- id: ruff-format
|
|
25
|
+
types_or: [python, pyi, jupyter]
|
|
26
|
+
- repo: https://github.com/pre-commit/pre-commit-hooks
|
|
27
|
+
rev: v6.0.0
|
|
28
|
+
hooks:
|
|
29
|
+
- id: detect-private-key
|
|
30
|
+
- id: check-ast
|
|
31
|
+
- id: end-of-file-fixer
|
|
32
|
+
- id: mixed-line-ending
|
|
33
|
+
args: [--fix=lf]
|
|
34
|
+
- id: trailing-whitespace
|
|
35
|
+
- id: check-case-conflict
|
|
36
|
+
# Check that there are no merge conflicts (could be generated by template sync)
|
|
37
|
+
- id: check-merge-conflict
|
|
38
|
+
args: [--assume-in-merge]
|
|
@@ -0,0 +1,16 @@
|
|
|
1
|
+
# https://docs.readthedocs.io/page/config-file/v2.html
|
|
2
|
+
version: 2
|
|
3
|
+
build:
|
|
4
|
+
os: ubuntu-24.04
|
|
5
|
+
tools:
|
|
6
|
+
python: "3.14"
|
|
7
|
+
nodejs: latest
|
|
8
|
+
jobs:
|
|
9
|
+
create_environment:
|
|
10
|
+
- asdf plugin add uv
|
|
11
|
+
- asdf install uv latest
|
|
12
|
+
- asdf global uv latest
|
|
13
|
+
build:
|
|
14
|
+
html:
|
|
15
|
+
- uvx hatch run docs:build
|
|
16
|
+
- mv docs/_build $READTHEDOCS_OUTPUT
|
|
@@ -0,0 +1,74 @@
|
|
|
1
|
+
# Changelog
|
|
2
|
+
|
|
3
|
+
All notable changes to this project will be documented in this file.
|
|
4
|
+
|
|
5
|
+
The format is based on [Keep a Changelog][],
|
|
6
|
+
and this project adheres to [Semantic Versioning][].
|
|
7
|
+
|
|
8
|
+
[keep a changelog]: https://keepachangelog.com/
|
|
9
|
+
[semantic versioning]: https://semver.org/
|
|
10
|
+
|
|
11
|
+
## [0.0.2]
|
|
12
|
+
|
|
13
|
+
### Added
|
|
14
|
+
|
|
15
|
+
- Added `acumen fit --ablation {no-optimize,no-wiki}` to run ablation arms. A report without a `valid` split now uses `test` instead
|
|
16
|
+
- Added `acumen prepare` to build task datasets once into `cache/`, and a `data:` key in `tasks.yaml` that links them into each run
|
|
17
|
+
|
|
18
|
+
### Changed
|
|
19
|
+
|
|
20
|
+
- Restructured the docs, with a scverse-style README, a Getting started tutorial and one API page per `acumen` subcommand
|
|
21
|
+
- `--agent codex` now installs shipped skills into `~/.agents/skills`, where current Codex looks for them
|
|
22
|
+
- The report now tests success rate and cost separately, with a Benjamini–Hochberg FDR correction per axis
|
|
23
|
+
- Updated the GPT colour ramp in the report so `astra` is the darkest and the other models lighten in even steps
|
|
24
|
+
- Merged the per-command model keys (`draft_model`, `improve_model`, `tasks_model`, `ship_model`, `check_model`) into a single `meta_model` key
|
|
25
|
+
- Transcripts from every provider are now rendered through one shared trajectory model, and each run also writes a `trajectory.json`. `claude-code-log` is no longer a dependency
|
|
26
|
+
- Claude agents now run with the `claude` CLI on `PATH`, falling back to the one bundled in `claude-agent-sdk`
|
|
27
|
+
- `result.json` now records the agent CLI's version as `cli_version`, replacing `sdk_version`
|
|
28
|
+
|
|
29
|
+
### Fixed
|
|
30
|
+
|
|
31
|
+
- Fixed agent failures reporting a bare "errored: success" instead of the provider's reason
|
|
32
|
+
- Fixed `acumen ship --force` leaving the old installer's tests broken. The ship agent now ports them and runs them before delivering
|
|
33
|
+
- Fixed `acumen ship` failing to push and open the pull request because the agent could not find the operator's git and `gh` credentials
|
|
34
|
+
|
|
35
|
+
## [0.0.1dev]
|
|
36
|
+
|
|
37
|
+
### Added
|
|
38
|
+
|
|
39
|
+
- `acumen check` now also reviews each task for inconsistencies between its prompt, answer and reproducer. `--no-review` skips this step
|
|
40
|
+
- Added `acumen check` to verify each task's answer by rerunning its reproducer at `tasks/<id>-<split>.py`
|
|
41
|
+
- `acumen tasks` now keeps one reproducer script per split in `tasks/`
|
|
42
|
+
- Added an optional `needs_script` key to `tasks.yaml` for tasks that need no code
|
|
43
|
+
- Claude and Codex models can now run side by side in benchmarks and drive every meta-agent command
|
|
44
|
+
- `cost_usd` is now computed from each run's token counts, so both providers are priced the same way
|
|
45
|
+
- Added `acumen prices` to show and refresh the rate table, and a `prices:` config key to override it
|
|
46
|
+
- Rates are now read from the providers' pricing pages instead of a table shipped with the release
|
|
47
|
+
- `acumen bench` now fails before spending anything when the pricing pages cannot be read
|
|
48
|
+
- `result.json` now records where each run's prices came from and their date
|
|
49
|
+
- The report now flags arms that were priced on different dates
|
|
50
|
+
- Added HTML transcripts for Codex runs
|
|
51
|
+
- `acumen bench` without an arm now benches the baseline and every version in `skills/` in one pass
|
|
52
|
+
|
|
53
|
+
### Changed
|
|
54
|
+
|
|
55
|
+
- The report's cost vs. success figure now joins each model's versions with arrows instead of using marker shapes
|
|
56
|
+
- The Pareto frontier in the report is now dashed and runs to the right edge of the panel
|
|
57
|
+
- Both backends are now optional, installed with `acumen[claude]`, `acumen[all]` or just the `codex` CLI for Codex
|
|
58
|
+
- `max_turns` and `max_usd` are now enforced for Codex
|
|
59
|
+
- `acumen bench` now supports `--auth {auto,session,api}` and defaults to the provider's subscription
|
|
60
|
+
- Runs that fail because provider usage or credit ran out are now treated as invalid and retried on resume
|
|
61
|
+
|
|
62
|
+
### Fixed
|
|
63
|
+
|
|
64
|
+
- Fixed baseline runs finding a skill that the target package ships inside itself. The target venv is now cleaned of agent guidance before any agent runs
|
|
65
|
+
- Fixed Claude runs being recorded with the wrong result when a background command kept the session alive
|
|
66
|
+
- Increased the Bash timeout for sandboxed commands to 600 seconds, so long downloads are no longer sent to the background
|
|
67
|
+
- Fixed capped or crashed Codex runs recording a cost of `$0.00`
|
|
68
|
+
- Fixed capped runs being failed even when they had already written a correct answer
|
|
69
|
+
- Fixed sandboxed agents being blocked from hosts that targets need, such as EBI, Zenodo and NCBI
|
|
70
|
+
- Fixed runs whose sandbox could not execute anything being graded as wrong answers instead of infrastructure failures
|
|
71
|
+
- `acumen tasks` now overwrites the untouched `tasks.yaml` placeholder from `acumen init` without `--force`
|
|
72
|
+
- Fixed Codex transcripts being rendered as empty pages
|
|
73
|
+
- Removed "Claude" from the drafting and improving prompts, which are also used by Codex
|
|
74
|
+
- Removed `check_auth` and `auth_available`, which ignored Codex credentials
|
acumen-0.0.2/PKG-INFO
ADDED
|
@@ -0,0 +1,161 @@
|
|
|
1
|
+
Metadata-Version: 2.5
|
|
2
|
+
Name: acumen
|
|
3
|
+
Version: 0.0.2
|
|
4
|
+
Summary: Build, Benchmark, and Optimize Agentic Skills for Python Packages.
|
|
5
|
+
Project-URL: Documentation, https://acumen-skills.readthedocs.io/
|
|
6
|
+
Project-URL: Homepage, https://github.com/scverse/acumen
|
|
7
|
+
Project-URL: Source, https://github.com/scverse/acumen
|
|
8
|
+
Author: Pau Badia i Mompel
|
|
9
|
+
Maintainer-email: Pau Badia i Mompel <paubim@stanford.edu>
|
|
10
|
+
License: MIT License
|
|
11
|
+
|
|
12
|
+
Copyright (c) 2026, Pau Badia i Mompel
|
|
13
|
+
|
|
14
|
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
|
15
|
+
of this software and associated documentation files (the "Software"), to deal
|
|
16
|
+
in the Software without restriction, including without limitation the rights
|
|
17
|
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
|
18
|
+
copies of the Software, and to permit persons to whom the Software is
|
|
19
|
+
furnished to do so, subject to the following conditions:
|
|
20
|
+
|
|
21
|
+
The above copyright notice and this permission notice shall be included in all
|
|
22
|
+
copies or substantial portions of the Software.
|
|
23
|
+
|
|
24
|
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
|
25
|
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
|
26
|
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
|
27
|
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
|
28
|
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
|
29
|
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
|
30
|
+
SOFTWARE.
|
|
31
|
+
License-File: LICENSE
|
|
32
|
+
Classifier: Programming Language :: Python :: 3 :: Only
|
|
33
|
+
Classifier: Programming Language :: Python :: 3.12
|
|
34
|
+
Classifier: Programming Language :: Python :: 3.13
|
|
35
|
+
Classifier: Programming Language :: Python :: 3.14
|
|
36
|
+
Classifier: Programming Language :: Python :: 3.15
|
|
37
|
+
Requires-Python: >=3.12
|
|
38
|
+
Requires-Dist: matplotlib
|
|
39
|
+
Requires-Dist: numpy
|
|
40
|
+
Requires-Dist: pandas
|
|
41
|
+
Requires-Dist: psutil>=5.9
|
|
42
|
+
Requires-Dist: pyyaml
|
|
43
|
+
Requires-Dist: scipy
|
|
44
|
+
Requires-Dist: session-info2
|
|
45
|
+
Provides-Extra: all
|
|
46
|
+
Requires-Dist: claude-agent-sdk>=0.2.126; extra == 'all'
|
|
47
|
+
Provides-Extra: claude
|
|
48
|
+
Requires-Dist: claude-agent-sdk>=0.2.126; extra == 'claude'
|
|
49
|
+
Description-Content-Type: text/markdown
|
|
50
|
+
|
|
51
|
+
<p align="center">
|
|
52
|
+
<img src="docs/_static/images/banner.svg" alt="acumen" width="360">
|
|
53
|
+
</p>
|
|
54
|
+
|
|
55
|
+
<!-- docs-start -->
|
|
56
|
+
|
|
57
|
+
<p align="center"><b>Build, benchmark, and optimize agentic skills for Python packages.</b></p>
|
|
58
|
+
|
|
59
|
+
[![Tests][badge-tests]][tests]
|
|
60
|
+
[![Documentation][badge-docs]][documentation]
|
|
61
|
+
|
|
62
|
+
[![Issues][badge-issues]][issue tracker]
|
|
63
|
+
[![Coverage][badge-coverage]][codecoverage]
|
|
64
|
+
[![Stars][badge-stars]](https://github.com/scverse/acumen/stargazers)
|
|
65
|
+
|
|
66
|
+
[![PyPI][badge-pypi]][pypi]
|
|
67
|
+
[![Downloads month][badge-mdown]][down]
|
|
68
|
+
[![Downloads all][badge-adown]][down]
|
|
69
|
+
|
|
70
|
+
[badge-tests]: https://img.shields.io/github/actions/workflow/status/scverse/acumen/test.yaml?branch=main
|
|
71
|
+
[badge-docs]: https://img.shields.io/readthedocs/acumen-skills
|
|
72
|
+
[badge-issues]: https://img.shields.io/github/issues/scverse/acumen
|
|
73
|
+
[badge-coverage]: https://codecov.io/gh/scverse/acumen/branch/main/graph/badge.svg
|
|
74
|
+
[badge-pypi]: https://img.shields.io/pypi/v/acumen.svg
|
|
75
|
+
[badge-mdown]: https://static.pepy.tech/badge/acumen/month
|
|
76
|
+
[badge-adown]: https://static.pepy.tech/badge/acumen
|
|
77
|
+
[badge-stars]: https://img.shields.io/github/stars/scverse/acumen?style=flat&logo=github&color=yellow
|
|
78
|
+
|
|
79
|
+
`acumen` is a python package to build, benchmark and optimize agentic skills for any Python package.
|
|
80
|
+
An agentic skill is a short set of plain-text instructions that helps a coding agent use a package correctly.
|
|
81
|
+
Given a package and a few tasks, `acumen` trains a skill in the same way one would train a model.
|
|
82
|
+
In every epoch, coding agents attempt the training tasks, and `acumen` learns from the errors they make to rewrite the skill.
|
|
83
|
+
Each new version is scored on held-out validation tasks, training stops once validation no longer improves, and the best version is evaluated one last time on an untouched test set.
|
|
84
|
+
With the final skill, coding agents are more successful at solving tasks that require using the Python package than they are without the skill.
|
|
85
|
+
|
|
86
|
+
[//]: # "numfocus-fiscal-sponsor-attribution"
|
|
87
|
+
|
|
88
|
+
`acumen` is part of the scverse® project ([website](https://scverse.org), [governance](https://scverse.org/about/roles)) and is fiscally sponsored by [NumFOCUS](https://numfocus.org/).
|
|
89
|
+
If you like scverse® and want to support our mission, please consider making a tax-deductible [donation](https://numfocus.org/donate-to-scverse) to help the project pay for developer time, professional services, travel, workshops, and a variety of other needs.
|
|
90
|
+
|
|
91
|
+
<div align="center">
|
|
92
|
+
<a href="https://numfocus.org/project/scverse">
|
|
93
|
+
<img
|
|
94
|
+
src="https://raw.githubusercontent.com/numfocus/templates/master/images/numfocus-logo.png"
|
|
95
|
+
width="200"
|
|
96
|
+
>
|
|
97
|
+
</a>
|
|
98
|
+
</div>
|
|
99
|
+
|
|
100
|
+
## Getting started
|
|
101
|
+
|
|
102
|
+
Please refer to the [documentation][],
|
|
103
|
+
in particular, the [Getting started][getting started] tutorial and the [API documentation][].
|
|
104
|
+
|
|
105
|
+
## Installation
|
|
106
|
+
|
|
107
|
+
You need to have Python 3.12 or newer installed on your system.
|
|
108
|
+
If you don't have Python installed, we recommend installing [uv][].
|
|
109
|
+
|
|
110
|
+
`acumen` runs its agents with Claude, Codex, or both, and you only need to install the backend you use.
|
|
111
|
+
There are several alternative options to install `acumen`:
|
|
112
|
+
|
|
113
|
+
1. Install the latest stable release from [PyPI][pypi] to run Claude models (requires an Anthropic API key or a `claude` login):
|
|
114
|
+
|
|
115
|
+
```bash
|
|
116
|
+
pip install acumen[claude]
|
|
117
|
+
```
|
|
118
|
+
|
|
119
|
+
2. Install the latest stable release from [PyPI][pypi] to run Codex models (requires the `codex` CLI on your `PATH` and a Codex login or API key):
|
|
120
|
+
|
|
121
|
+
```bash
|
|
122
|
+
pip install acumen
|
|
123
|
+
```
|
|
124
|
+
|
|
125
|
+
3. Install the latest stable release from [PyPI][pypi] to run both:
|
|
126
|
+
|
|
127
|
+
```bash
|
|
128
|
+
pip install acumen[all]
|
|
129
|
+
```
|
|
130
|
+
|
|
131
|
+
4. Install the latest development version:
|
|
132
|
+
|
|
133
|
+
```bash
|
|
134
|
+
pip install "acumen[all] @ git+https://github.com/scverse/acumen.git@main"
|
|
135
|
+
```
|
|
136
|
+
|
|
137
|
+
## Release notes
|
|
138
|
+
|
|
139
|
+
See the [changelog][].
|
|
140
|
+
|
|
141
|
+
## Contact
|
|
142
|
+
|
|
143
|
+
For questions and help requests, you can reach out in the [scverse discourse][].
|
|
144
|
+
If you found a bug, please use the [issue tracker][].
|
|
145
|
+
|
|
146
|
+
## Citation
|
|
147
|
+
|
|
148
|
+
> t.b.a
|
|
149
|
+
|
|
150
|
+
[uv]: https://github.com/astral-sh/uv
|
|
151
|
+
[scverse discourse]: https://discourse.scverse.org/
|
|
152
|
+
[scverse]: https://scverse.org/
|
|
153
|
+
[issue tracker]: https://github.com/scverse/acumen/issues
|
|
154
|
+
[tests]: https://github.com/scverse/acumen/actions/workflows/test.yaml
|
|
155
|
+
[documentation]: https://acumen-skills.readthedocs.io/
|
|
156
|
+
[getting started]: https://acumen-skills.readthedocs.io/page/getting_started.html
|
|
157
|
+
[changelog]: https://acumen-skills.readthedocs.io/page/changelog.html
|
|
158
|
+
[api documentation]: https://acumen-skills.readthedocs.io/page/api/index.html
|
|
159
|
+
[pypi]: https://pypi.org/project/acumen
|
|
160
|
+
[down]: https://pepy.tech/project/acumen
|
|
161
|
+
[codecoverage]: https://codecov.io/gh/scverse/acumen
|