microecs 0.3.2__tar.gz → 0.3.3__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- {microecs-0.3.2/microecs.egg-info → microecs-0.3.3}/PKG-INFO +62 -40
- microecs-0.3.2/PKG-INFO → microecs-0.3.3/README.md +52 -50
- {microecs-0.3.2 → microecs-0.3.3}/microecs/pool.py +1 -1
- {microecs-0.3.2 → microecs-0.3.3}/microecs/query_result.py +3 -0
- {microecs-0.3.2 → microecs-0.3.3}/microecs/world.py +6 -0
- microecs-0.3.2/README.md → microecs-0.3.3/microecs.egg-info/PKG-INFO +72 -38
- {microecs-0.3.2 → microecs-0.3.3}/setup.py +1 -1
- {microecs-0.3.2 → microecs-0.3.3}/LICENSE.TXT +0 -0
- {microecs-0.3.2 → microecs-0.3.3}/microecs/__init__.py +0 -0
- {microecs-0.3.2 → microecs-0.3.3}/microecs/component.py +0 -0
- {microecs-0.3.2 → microecs-0.3.3}/microecs/utils.py +0 -0
- {microecs-0.3.2 → microecs-0.3.3}/microecs.egg-info/SOURCES.txt +0 -0
- {microecs-0.3.2 → microecs-0.3.3}/microecs.egg-info/dependency_links.txt +0 -0
- {microecs-0.3.2 → microecs-0.3.3}/microecs.egg-info/requires.txt +0 -0
- {microecs-0.3.2 → microecs-0.3.3}/microecs.egg-info/top_level.txt +0 -0
- {microecs-0.3.2 → microecs-0.3.3}/setup.cfg +0 -0
|
@@ -1,6 +1,6 @@
|
|
|
1
|
-
Metadata-Version: 2.
|
|
1
|
+
Metadata-Version: 2.4
|
|
2
2
|
Name: microecs
|
|
3
|
-
Version: 0.3.
|
|
3
|
+
Version: 0.3.3
|
|
4
4
|
Summary: MicroECS: Minimal Entity Component System (ECS) in python and numpy
|
|
5
5
|
Home-page: https://gitlab.com/meehai/microecs
|
|
6
6
|
License: MIT
|
|
@@ -9,6 +9,14 @@ Description-Content-Type: text/markdown
|
|
|
9
9
|
License-File: LICENSE.TXT
|
|
10
10
|
Requires-Dist: numpy>=2.2.0
|
|
11
11
|
Requires-Dist: loggez>=0.8
|
|
12
|
+
Dynamic: description
|
|
13
|
+
Dynamic: description-content-type
|
|
14
|
+
Dynamic: home-page
|
|
15
|
+
Dynamic: license
|
|
16
|
+
Dynamic: license-file
|
|
17
|
+
Dynamic: requires-dist
|
|
18
|
+
Dynamic: requires-python
|
|
19
|
+
Dynamic: summary
|
|
12
20
|
|
|
13
21
|
# MicroECS
|
|
14
22
|
|
|
@@ -16,24 +24,35 @@ Minimal (~300 LoC) Entity Component System in python and numpy. Examples also us
|
|
|
16
24
|
|
|
17
25
|
Usage:
|
|
18
26
|
|
|
19
|
-
- `pip install
|
|
20
|
-
-
|
|
21
|
-
|
|
27
|
+
- Via pip: `pip install microecs`
|
|
28
|
+
- From source code:
|
|
29
|
+
```bash
|
|
30
|
+
git clone https://gitlab.com/meehai/microecs # clone the source code
|
|
31
|
+
cd microecs # go in the cloned directory
|
|
32
|
+
python -m venv .venv && source .venv/bin/activate # make a virtual env, optional but useful
|
|
33
|
+
python -m pip install -e . # install micro ecs in this virtual env
|
|
34
|
+
python -m pytest test/ # run the unit & integration tests to verify installation
|
|
35
|
+
python examples/01-hello-world.py # run the basic hello world example (others in that dir)
|
|
36
|
+
```
|
|
37
|
+
|
|
38
|
+
Docs: [meehai.gitlab.io/microecs](https://meehai.gitlab.io/microecs/)
|
|
39
|
+
|
|
40
|
+
## Relevant primitives: `Component`, `Pool`, `QueryResult`, `World`
|
|
22
41
|
|
|
23
|
-
There are only 4 primitives (bottom up):
|
|
42
|
+
There are only 4 primitives (bottom up):
|
|
24
43
|
|
|
25
44
|
- `Component` is a simple python dataclass holding only data. All entries must be numpy arrays with metadata fields: shape and dtype. We support 5 dtypes only: `int32`, `float32`, `bool`, `str` and `object`. A component with no fields is a valid **tag** for querying (e.g. `class Frozen(Component): pass`).
|
|
26
45
|
- `Pool` is a simple 'archetype' dynamic array, holding entities of the same type (same set of components). Usses `Components` metadata to construct contiguous arrays for all entities of the same type.
|
|
27
|
-
- `QueryResult` is a list of pools that match some query on all the entities of the `World`. It acts as a contiguous numpy-like container that implements numpy's
|
|
46
|
+
- `QueryResult` is a list of pools that match some query on all the entities of the `World`. It acts as a contiguous numpy-like container that implements numpy's interface. For all intents and purposes it should feel like a `(N, ...)` view over all selected entities. To get a proper numpy array, use `qr.numpy()`. To iterate over each entity in a query result (e.g. rendering), use `for eid, position in zip(qr.entity_ids, qr.position): ...`.
|
|
28
47
|
- `World` is a manager of `Pools` and has an overview of all the entities in the scene. It also manages the migration of entities from one pool to the other. A `World` can also require extra metadata keys on every field via `World(extra_metadata=["serializable"])`, to enforce component-level behavior such as field serialization.
|
|
29
48
|
|
|
30
|
-
Few relevant concepts:
|
|
49
|
+
### Few relevant concepts:
|
|
31
50
|
|
|
32
51
|
- `Pool` operates on array indices, while `World` operates on entity IDs (also integers). This allows seamless movement between pools while the high-level systems still working as intended.
|
|
33
52
|
- All mutable operations on `World` are lazy. These are: `add_entity`, `remove_entity`, `add_component`, `remove_component`. They are added to a command buffer which is only executed when calling `world.update()`.
|
|
34
53
|
- `Systems` are a convention, they are not part of this library. They can be defined at application level and act as hooks or callbacks. The `World` object doesn't need to know more than entities and components.
|
|
35
54
|
|
|
36
|
-
Super simplified main loop structure
|
|
55
|
+
## Super simplified main loop structure
|
|
37
56
|
|
|
38
57
|
```python
|
|
39
58
|
from typing import Callable
|
|
@@ -89,40 +108,22 @@ def main():
|
|
|
89
108
|
rl.EndDrawing()
|
|
90
109
|
```
|
|
91
110
|
|
|
92
|
-
##
|
|
93
|
-
|
|
94
|
-
`qr.position` returns a `_Field`: a view over the matching pools that behaves like one `(N, *e)`
|
|
95
|
-
numpy array (e.g. `(N, 2)` for a `(2,)` field). It applies each op **per pool** and stitches the
|
|
96
|
-
result back. So the contract is exactly:
|
|
97
|
-
|
|
98
|
-
> Any op that treats rows independently behaves **identically to numpy** on the concatenated
|
|
99
|
-
> `(N, *e)` array — same values, same shape, and the same error on bad shapes.
|
|
111
|
+
## Per-entity systems (e.g. rendering, foreign APIs)
|
|
100
112
|
|
|
101
|
-
That
|
|
102
|
-
raises on the ones numpy rejects), comparisons, `np.where` / `np.clip`, batched `np.matmul`,
|
|
103
|
-
**feature-axis** reductions/indexing (`np.linalg.norm(qr.velocity, axis=1)`, `qr.pose[:, 0]`), and
|
|
104
|
-
write-back broadcasting (`qr.position[:] = <scalar | (*e,) | (N, *e)>`). Pinned in
|
|
105
|
-
`test/unit/test_field_numpy_parity.py`.
|
|
113
|
+
Not every system vectorizes. A renderer calls a draw function per primitive; same for any per-entity foreign API. That's a per-entity system inside an otherwise-vectorized app. The cheapest way to iterate through all the entities is by using `zip()` on the `QueryResult` object on the fields you need, e.g:
|
|
106
114
|
|
|
107
|
-
|
|
115
|
+
```python
|
|
116
|
+
qr = world.query(HasPosition, HasColor, HasRadius)
|
|
117
|
+
for pos, color, radius in zip(qr.position, qr.color, qr.radius): # one entity per step, fields aligned
|
|
118
|
+
rl.DrawCircle(int(pos[0]), int(pos[1]), float(radius[0]), color) # per-entity by necessity (no "draw all")
|
|
119
|
+
```
|
|
108
120
|
|
|
109
|
-
|
|
110
|
-
`qr.f[i]` (`qr.f[:]`, `qr.f[2:4]`, `qr.f[mask]`, fancy), partial entity writes, and ndarray
|
|
111
|
-
methods/attrs (`.sum()`, `.mean()`, `.dtype`, `.ndim`, `.T`). Need any of these? Materialize
|
|
112
|
-
first with `qr.f.numpy()`.
|
|
113
|
-
- **Axis-0 ops are per-pool, not global (footgun).** `np.sort` / `np.cumsum` / `np.sum` over
|
|
114
|
-
`axis=0` run *within each pool* and reset at pool boundaries — they do **not** see all entities
|
|
115
|
-
at once, so they differ from numpy. They're allowed, but if you want a global result, do
|
|
116
|
-
`qr.f.numpy()` first. A reduction that collapses the entity axis is rejected when its length no
|
|
117
|
-
longer matches the pool's row count.
|
|
118
|
-
- **Operands must come from the same query.** Alignment is per-pool, not by flat index, so don't
|
|
119
|
-
mix a `_Field` from one `world.query(...)` into an op on another.
|
|
121
|
+
There are other ways to extract a single entity e.g. `qr.some_field[i]` or `e = world.get_entity(eid)`, but these are slower in the general case and should be avoided in expensive loops, like rendering, even if they are a bit more ergonomic. See benchmark below.
|
|
120
122
|
|
|
121
|
-
|
|
123
|
+
<details>
|
|
124
|
+
<summary> Microbenchmark: ECS vs OOP on a simple physics step </summary>
|
|
122
125
|
|
|
123
|
-
|
|
124
|
-
ways, all verified to produce the identical result. Reproduce with
|
|
125
|
-
`python test/manual/perf/bench_ecs_vs_oop.py` (it prints `{mode: avg_seconds_per_step}`).
|
|
126
|
+
Benchmark: we run the same physics step `pos += vel*dt` over N=100k entities split across 2 pools in various ways (ECS or OOP). All methods are verified to produce the identical result. Reproduce with `python test/manual/perf/bench_ecs_vs_oop.py` (it prints `{mode: avg_seconds_per_step}`).
|
|
126
127
|
|
|
127
128
|
| pattern | ns/entity | vs OOP-scalar |
|
|
128
129
|
|---|---:|---:|
|
|
@@ -135,8 +136,6 @@ ways, all verified to produce the identical result. Reproduce with
|
|
|
135
136
|
| `micro-ecs-get-entity` — `world.get_entity(eid)` per entity | 1674 | 35× slower |
|
|
136
137
|
| `micro-ecs-index` — `qr.f[i]` per entity (an `np.searchsorted` each) | 4573 | 95× slower |
|
|
137
138
|
|
|
138
|
-
*Intel Core Ultra 7 165H, single-threaded, python 3.12 / numpy 2.2. ns/entity = seconds/step ÷ N.*
|
|
139
|
-
|
|
140
139
|
Three things to take from it:
|
|
141
140
|
|
|
142
141
|
1. **Vectorized wins big.** Batched ops (`_Field` or per-pool) run at 1–2 ns/entity — **27–52×
|
|
@@ -152,3 +151,26 @@ Three things to take from it:
|
|
|
152
151
|
**Rule of thumb:** keep systems vectorized and push branches into `np.where` / `np.clip`. If a
|
|
153
152
|
workload is *irreducibly* per-entity (data-dependent control flow), plain python objects beat
|
|
154
153
|
microecs ~15× — use them there. microecs is the right tool for **vectorizable** simulation.
|
|
154
|
+
|
|
155
|
+
</details>
|
|
156
|
+
|
|
157
|
+
## How much are `Pool` and `QueryResult` numpy-like and corner cases
|
|
158
|
+
|
|
159
|
+
Given `qr=world.query(A, B)`, then `qr.position` returns a `_Field`: a view over the matching pools that behaves like one contiguous-like `(N, *e)`
|
|
160
|
+
numpy array (e.g. `(N, 2)` for a `(2,)` field). It applies each op **per pool** and stitches result back.
|
|
161
|
+
|
|
162
|
+
That covers elementwise math and ufuncs (e.g. `np.where`, `np.linalg.norm(..., axis=1)` etc.), broadcasting (every operand shape numpy accepts, and it raises on the ones numpy rejects). See `test/unit/test_field_numpy_parity.py` for a whole set of operations comparing both.
|
|
163
|
+
|
|
164
|
+
Edge cases worth knowing:
|
|
165
|
+
|
|
166
|
+
- **Not a full ndarray — these raise, never lie.** Entity-axis indexing beyond a single
|
|
167
|
+
`qr.f[i]` (`qr.f[:]`, `qr.f[2:4]`, `qr.f[mask]`, fancy), partial entity writes, and ndarray
|
|
168
|
+
methods/attrs (`.sum()`, `.mean()`, `.dtype`, `.ndim`, `.T`). Need any of these? Materialize
|
|
169
|
+
first with `qr.f.numpy()`.
|
|
170
|
+
- **Axis-0 ops are per-pool, not global (footgun).** `np.sort` / `np.cumsum` / `np.sum` over
|
|
171
|
+
`axis=0` run within each pool and reset at pool boundaries — they do **not** see all entities
|
|
172
|
+
at once, so they differ from numpy. They're allowed, but if you want a global result, do
|
|
173
|
+
`qr.f.numpy()` first. A reduction that collapses the entity axis is rejected when its length no
|
|
174
|
+
longer matches the pool's row count.
|
|
175
|
+
- **Operands must come from the same query.** Alignment is per-pool, not by flat index, so don't
|
|
176
|
+
mix a `_Field` from one `world.query(...)` into an op on another.
|
|
@@ -1,39 +1,38 @@
|
|
|
1
|
-
Metadata-Version: 2.1
|
|
2
|
-
Name: microecs
|
|
3
|
-
Version: 0.3.2
|
|
4
|
-
Summary: MicroECS: Minimal Entity Component System (ECS) in python and numpy
|
|
5
|
-
Home-page: https://gitlab.com/meehai/microecs
|
|
6
|
-
License: MIT
|
|
7
|
-
Requires-Python: >=3.12
|
|
8
|
-
Description-Content-Type: text/markdown
|
|
9
|
-
License-File: LICENSE.TXT
|
|
10
|
-
Requires-Dist: numpy>=2.2.0
|
|
11
|
-
Requires-Dist: loggez>=0.8
|
|
12
|
-
|
|
13
1
|
# MicroECS
|
|
14
2
|
|
|
15
3
|
Minimal (~300 LoC) Entity Component System in python and numpy. Examples also use raylib for rendering.
|
|
16
4
|
|
|
17
5
|
Usage:
|
|
18
6
|
|
|
19
|
-
- `pip install
|
|
20
|
-
-
|
|
21
|
-
|
|
7
|
+
- Via pip: `pip install microecs`
|
|
8
|
+
- From source code:
|
|
9
|
+
```bash
|
|
10
|
+
git clone https://gitlab.com/meehai/microecs # clone the source code
|
|
11
|
+
cd microecs # go in the cloned directory
|
|
12
|
+
python -m venv .venv && source .venv/bin/activate # make a virtual env, optional but useful
|
|
13
|
+
python -m pip install -e . # install micro ecs in this virtual env
|
|
14
|
+
python -m pytest test/ # run the unit & integration tests to verify installation
|
|
15
|
+
python examples/01-hello-world.py # run the basic hello world example (others in that dir)
|
|
16
|
+
```
|
|
17
|
+
|
|
18
|
+
Docs: [meehai.gitlab.io/microecs](https://meehai.gitlab.io/microecs/)
|
|
22
19
|
|
|
23
|
-
|
|
20
|
+
## Relevant primitives: `Component`, `Pool`, `QueryResult`, `World`
|
|
21
|
+
|
|
22
|
+
There are only 4 primitives (bottom up):
|
|
24
23
|
|
|
25
24
|
- `Component` is a simple python dataclass holding only data. All entries must be numpy arrays with metadata fields: shape and dtype. We support 5 dtypes only: `int32`, `float32`, `bool`, `str` and `object`. A component with no fields is a valid **tag** for querying (e.g. `class Frozen(Component): pass`).
|
|
26
25
|
- `Pool` is a simple 'archetype' dynamic array, holding entities of the same type (same set of components). Usses `Components` metadata to construct contiguous arrays for all entities of the same type.
|
|
27
|
-
- `QueryResult` is a list of pools that match some query on all the entities of the `World`. It acts as a contiguous numpy-like container that implements numpy's
|
|
26
|
+
- `QueryResult` is a list of pools that match some query on all the entities of the `World`. It acts as a contiguous numpy-like container that implements numpy's interface. For all intents and purposes it should feel like a `(N, ...)` view over all selected entities. To get a proper numpy array, use `qr.numpy()`. To iterate over each entity in a query result (e.g. rendering), use `for eid, position in zip(qr.entity_ids, qr.position): ...`.
|
|
28
27
|
- `World` is a manager of `Pools` and has an overview of all the entities in the scene. It also manages the migration of entities from one pool to the other. A `World` can also require extra metadata keys on every field via `World(extra_metadata=["serializable"])`, to enforce component-level behavior such as field serialization.
|
|
29
28
|
|
|
30
|
-
Few relevant concepts:
|
|
29
|
+
### Few relevant concepts:
|
|
31
30
|
|
|
32
31
|
- `Pool` operates on array indices, while `World` operates on entity IDs (also integers). This allows seamless movement between pools while the high-level systems still working as intended.
|
|
33
32
|
- All mutable operations on `World` are lazy. These are: `add_entity`, `remove_entity`, `add_component`, `remove_component`. They are added to a command buffer which is only executed when calling `world.update()`.
|
|
34
33
|
- `Systems` are a convention, they are not part of this library. They can be defined at application level and act as hooks or callbacks. The `World` object doesn't need to know more than entities and components.
|
|
35
34
|
|
|
36
|
-
Super simplified main loop structure
|
|
35
|
+
## Super simplified main loop structure
|
|
37
36
|
|
|
38
37
|
```python
|
|
39
38
|
from typing import Callable
|
|
@@ -89,40 +88,22 @@ def main():
|
|
|
89
88
|
rl.EndDrawing()
|
|
90
89
|
```
|
|
91
90
|
|
|
92
|
-
##
|
|
93
|
-
|
|
94
|
-
`qr.position` returns a `_Field`: a view over the matching pools that behaves like one `(N, *e)`
|
|
95
|
-
numpy array (e.g. `(N, 2)` for a `(2,)` field). It applies each op **per pool** and stitches the
|
|
96
|
-
result back. So the contract is exactly:
|
|
91
|
+
## Per-entity systems (e.g. rendering, foreign APIs)
|
|
97
92
|
|
|
98
|
-
|
|
99
|
-
> `(N, *e)` array — same values, same shape, and the same error on bad shapes.
|
|
93
|
+
Not every system vectorizes. A renderer calls a draw function per primitive; same for any per-entity foreign API. That's a per-entity system inside an otherwise-vectorized app. The cheapest way to iterate through all the entities is by using `zip()` on the `QueryResult` object on the fields you need, e.g:
|
|
100
94
|
|
|
101
|
-
|
|
102
|
-
|
|
103
|
-
|
|
104
|
-
|
|
105
|
-
|
|
106
|
-
|
|
107
|
-
Edge cases worth knowing:
|
|
95
|
+
```python
|
|
96
|
+
qr = world.query(HasPosition, HasColor, HasRadius)
|
|
97
|
+
for pos, color, radius in zip(qr.position, qr.color, qr.radius): # one entity per step, fields aligned
|
|
98
|
+
rl.DrawCircle(int(pos[0]), int(pos[1]), float(radius[0]), color) # per-entity by necessity (no "draw all")
|
|
99
|
+
```
|
|
108
100
|
|
|
109
|
-
|
|
110
|
-
`qr.f[i]` (`qr.f[:]`, `qr.f[2:4]`, `qr.f[mask]`, fancy), partial entity writes, and ndarray
|
|
111
|
-
methods/attrs (`.sum()`, `.mean()`, `.dtype`, `.ndim`, `.T`). Need any of these? Materialize
|
|
112
|
-
first with `qr.f.numpy()`.
|
|
113
|
-
- **Axis-0 ops are per-pool, not global (footgun).** `np.sort` / `np.cumsum` / `np.sum` over
|
|
114
|
-
`axis=0` run *within each pool* and reset at pool boundaries — they do **not** see all entities
|
|
115
|
-
at once, so they differ from numpy. They're allowed, but if you want a global result, do
|
|
116
|
-
`qr.f.numpy()` first. A reduction that collapses the entity axis is rejected when its length no
|
|
117
|
-
longer matches the pool's row count.
|
|
118
|
-
- **Operands must come from the same query.** Alignment is per-pool, not by flat index, so don't
|
|
119
|
-
mix a `_Field` from one `world.query(...)` into an op on another.
|
|
101
|
+
There are other ways to extract a single entity e.g. `qr.some_field[i]` or `e = world.get_entity(eid)`, but these are slower in the general case and should be avoided in expensive loops, like rendering, even if they are a bit more ergonomic. See benchmark below.
|
|
120
102
|
|
|
121
|
-
|
|
103
|
+
<details>
|
|
104
|
+
<summary> Microbenchmark: ECS vs OOP on a simple physics step </summary>
|
|
122
105
|
|
|
123
|
-
|
|
124
|
-
ways, all verified to produce the identical result. Reproduce with
|
|
125
|
-
`python test/manual/perf/bench_ecs_vs_oop.py` (it prints `{mode: avg_seconds_per_step}`).
|
|
106
|
+
Benchmark: we run the same physics step `pos += vel*dt` over N=100k entities split across 2 pools in various ways (ECS or OOP). All methods are verified to produce the identical result. Reproduce with `python test/manual/perf/bench_ecs_vs_oop.py` (it prints `{mode: avg_seconds_per_step}`).
|
|
126
107
|
|
|
127
108
|
| pattern | ns/entity | vs OOP-scalar |
|
|
128
109
|
|---|---:|---:|
|
|
@@ -135,8 +116,6 @@ ways, all verified to produce the identical result. Reproduce with
|
|
|
135
116
|
| `micro-ecs-get-entity` — `world.get_entity(eid)` per entity | 1674 | 35× slower |
|
|
136
117
|
| `micro-ecs-index` — `qr.f[i]` per entity (an `np.searchsorted` each) | 4573 | 95× slower |
|
|
137
118
|
|
|
138
|
-
*Intel Core Ultra 7 165H, single-threaded, python 3.12 / numpy 2.2. ns/entity = seconds/step ÷ N.*
|
|
139
|
-
|
|
140
119
|
Three things to take from it:
|
|
141
120
|
|
|
142
121
|
1. **Vectorized wins big.** Batched ops (`_Field` or per-pool) run at 1–2 ns/entity — **27–52×
|
|
@@ -152,3 +131,26 @@ Three things to take from it:
|
|
|
152
131
|
**Rule of thumb:** keep systems vectorized and push branches into `np.where` / `np.clip`. If a
|
|
153
132
|
workload is *irreducibly* per-entity (data-dependent control flow), plain python objects beat
|
|
154
133
|
microecs ~15× — use them there. microecs is the right tool for **vectorizable** simulation.
|
|
134
|
+
|
|
135
|
+
</details>
|
|
136
|
+
|
|
137
|
+
## How much are `Pool` and `QueryResult` numpy-like and corner cases
|
|
138
|
+
|
|
139
|
+
Given `qr=world.query(A, B)`, then `qr.position` returns a `_Field`: a view over the matching pools that behaves like one contiguous-like `(N, *e)`
|
|
140
|
+
numpy array (e.g. `(N, 2)` for a `(2,)` field). It applies each op **per pool** and stitches result back.
|
|
141
|
+
|
|
142
|
+
That covers elementwise math and ufuncs (e.g. `np.where`, `np.linalg.norm(..., axis=1)` etc.), broadcasting (every operand shape numpy accepts, and it raises on the ones numpy rejects). See `test/unit/test_field_numpy_parity.py` for a whole set of operations comparing both.
|
|
143
|
+
|
|
144
|
+
Edge cases worth knowing:
|
|
145
|
+
|
|
146
|
+
- **Not a full ndarray — these raise, never lie.** Entity-axis indexing beyond a single
|
|
147
|
+
`qr.f[i]` (`qr.f[:]`, `qr.f[2:4]`, `qr.f[mask]`, fancy), partial entity writes, and ndarray
|
|
148
|
+
methods/attrs (`.sum()`, `.mean()`, `.dtype`, `.ndim`, `.T`). Need any of these? Materialize
|
|
149
|
+
first with `qr.f.numpy()`.
|
|
150
|
+
- **Axis-0 ops are per-pool, not global (footgun).** `np.sort` / `np.cumsum` / `np.sum` over
|
|
151
|
+
`axis=0` run within each pool and reset at pool boundaries — they do **not** see all entities
|
|
152
|
+
at once, so they differ from numpy. They're allowed, but if you want a global result, do
|
|
153
|
+
`qr.f.numpy()` first. A reduction that collapses the entity axis is rejected when its length no
|
|
154
|
+
longer matches the pool's row count.
|
|
155
|
+
- **Operands must come from the same query.** Alignment is per-pool, not by flat index, so don't
|
|
156
|
+
mix a `_Field` from one `world.query(...)` into an op on another.
|
|
@@ -17,7 +17,7 @@ class Pool:
|
|
|
17
17
|
self.shapes = shapes
|
|
18
18
|
self.dtypes = dtypes
|
|
19
19
|
|
|
20
|
-
self.data: dict[str, np.ndarray] = {} # the actual data is stored in
|
|
20
|
+
self.data: dict[str, np.ndarray] = {} # the actual data is stored in dict of dynamic arrrays, one per field
|
|
21
21
|
self.size = 0
|
|
22
22
|
self.capacity = Pool.INITIAL_CAPACITY
|
|
23
23
|
for _field, shape, dtype in zip(fields, shapes, dtypes):
|
|
@@ -91,6 +91,9 @@ class _Field(np.lib.mixins.NDArrayOperatorsMixin):
|
|
|
91
91
|
def __len__(self):
|
|
92
92
|
return self.len
|
|
93
93
|
|
|
94
|
+
def __repr__(self):
|
|
95
|
+
return f"[Field] Shape: {self.shape} (across {len(self.parts)} pools)"
|
|
96
|
+
|
|
94
97
|
class QueryResult:
|
|
95
98
|
"""A list of pools seen as a contiguous view. Fields (qr.position) implement array interface to look like numpy"""
|
|
96
99
|
def __init__(self, pool_list: list[Pool], field_shapes: dict[str, Shape], field_dtypes: dict[str, np.dtype],
|
|
@@ -77,6 +77,12 @@ class World:
|
|
|
77
77
|
components = self.pool_to_components[pool]
|
|
78
78
|
return entity, components
|
|
79
79
|
|
|
80
|
+
def set_entity_data(self, entity_id: EntityId, field_name: str, value: np.ndarray):
|
|
81
|
+
"""Sets the value of one specific entity's field given an enttiy id. Non-vectorized operation, use rarely"""
|
|
82
|
+
assert entity_id in self._eid_to_pool_ix, f"Entity id {entity_id} not found. Perhaps you didn't world.update()"
|
|
83
|
+
pool, pool_ix = self._eid_to_pool_ix[entity_id]
|
|
84
|
+
pool.data[field_name][pool_ix] = value
|
|
85
|
+
|
|
80
86
|
def add_component(self, entity_id: EntityId, component: ComponentType, **kwargs):
|
|
81
87
|
"""Adds a component to an entity given its id. Component data is sent to kwargs. Lazy; call update()"""
|
|
82
88
|
assert entity_id in self.live_ids, f"Entity id: {entity_id} not in {self.live_ids=}"
|
|
@@ -1,27 +1,58 @@
|
|
|
1
|
+
Metadata-Version: 2.4
|
|
2
|
+
Name: microecs
|
|
3
|
+
Version: 0.3.3
|
|
4
|
+
Summary: MicroECS: Minimal Entity Component System (ECS) in python and numpy
|
|
5
|
+
Home-page: https://gitlab.com/meehai/microecs
|
|
6
|
+
License: MIT
|
|
7
|
+
Requires-Python: >=3.12
|
|
8
|
+
Description-Content-Type: text/markdown
|
|
9
|
+
License-File: LICENSE.TXT
|
|
10
|
+
Requires-Dist: numpy>=2.2.0
|
|
11
|
+
Requires-Dist: loggez>=0.8
|
|
12
|
+
Dynamic: description
|
|
13
|
+
Dynamic: description-content-type
|
|
14
|
+
Dynamic: home-page
|
|
15
|
+
Dynamic: license
|
|
16
|
+
Dynamic: license-file
|
|
17
|
+
Dynamic: requires-dist
|
|
18
|
+
Dynamic: requires-python
|
|
19
|
+
Dynamic: summary
|
|
20
|
+
|
|
1
21
|
# MicroECS
|
|
2
22
|
|
|
3
23
|
Minimal (~300 LoC) Entity Component System in python and numpy. Examples also use raylib for rendering.
|
|
4
24
|
|
|
5
25
|
Usage:
|
|
6
26
|
|
|
7
|
-
- `pip install
|
|
8
|
-
-
|
|
9
|
-
|
|
27
|
+
- Via pip: `pip install microecs`
|
|
28
|
+
- From source code:
|
|
29
|
+
```bash
|
|
30
|
+
git clone https://gitlab.com/meehai/microecs # clone the source code
|
|
31
|
+
cd microecs # go in the cloned directory
|
|
32
|
+
python -m venv .venv && source .venv/bin/activate # make a virtual env, optional but useful
|
|
33
|
+
python -m pip install -e . # install micro ecs in this virtual env
|
|
34
|
+
python -m pytest test/ # run the unit & integration tests to verify installation
|
|
35
|
+
python examples/01-hello-world.py # run the basic hello world example (others in that dir)
|
|
36
|
+
```
|
|
37
|
+
|
|
38
|
+
Docs: [meehai.gitlab.io/microecs](https://meehai.gitlab.io/microecs/)
|
|
10
39
|
|
|
11
|
-
|
|
40
|
+
## Relevant primitives: `Component`, `Pool`, `QueryResult`, `World`
|
|
41
|
+
|
|
42
|
+
There are only 4 primitives (bottom up):
|
|
12
43
|
|
|
13
44
|
- `Component` is a simple python dataclass holding only data. All entries must be numpy arrays with metadata fields: shape and dtype. We support 5 dtypes only: `int32`, `float32`, `bool`, `str` and `object`. A component with no fields is a valid **tag** for querying (e.g. `class Frozen(Component): pass`).
|
|
14
45
|
- `Pool` is a simple 'archetype' dynamic array, holding entities of the same type (same set of components). Usses `Components` metadata to construct contiguous arrays for all entities of the same type.
|
|
15
|
-
- `QueryResult` is a list of pools that match some query on all the entities of the `World`. It acts as a contiguous numpy-like container that implements numpy's
|
|
46
|
+
- `QueryResult` is a list of pools that match some query on all the entities of the `World`. It acts as a contiguous numpy-like container that implements numpy's interface. For all intents and purposes it should feel like a `(N, ...)` view over all selected entities. To get a proper numpy array, use `qr.numpy()`. To iterate over each entity in a query result (e.g. rendering), use `for eid, position in zip(qr.entity_ids, qr.position): ...`.
|
|
16
47
|
- `World` is a manager of `Pools` and has an overview of all the entities in the scene. It also manages the migration of entities from one pool to the other. A `World` can also require extra metadata keys on every field via `World(extra_metadata=["serializable"])`, to enforce component-level behavior such as field serialization.
|
|
17
48
|
|
|
18
|
-
Few relevant concepts:
|
|
49
|
+
### Few relevant concepts:
|
|
19
50
|
|
|
20
51
|
- `Pool` operates on array indices, while `World` operates on entity IDs (also integers). This allows seamless movement between pools while the high-level systems still working as intended.
|
|
21
52
|
- All mutable operations on `World` are lazy. These are: `add_entity`, `remove_entity`, `add_component`, `remove_component`. They are added to a command buffer which is only executed when calling `world.update()`.
|
|
22
53
|
- `Systems` are a convention, they are not part of this library. They can be defined at application level and act as hooks or callbacks. The `World` object doesn't need to know more than entities and components.
|
|
23
54
|
|
|
24
|
-
Super simplified main loop structure
|
|
55
|
+
## Super simplified main loop structure
|
|
25
56
|
|
|
26
57
|
```python
|
|
27
58
|
from typing import Callable
|
|
@@ -77,40 +108,22 @@ def main():
|
|
|
77
108
|
rl.EndDrawing()
|
|
78
109
|
```
|
|
79
110
|
|
|
80
|
-
##
|
|
81
|
-
|
|
82
|
-
`qr.position` returns a `_Field`: a view over the matching pools that behaves like one `(N, *e)`
|
|
83
|
-
numpy array (e.g. `(N, 2)` for a `(2,)` field). It applies each op **per pool** and stitches the
|
|
84
|
-
result back. So the contract is exactly:
|
|
111
|
+
## Per-entity systems (e.g. rendering, foreign APIs)
|
|
85
112
|
|
|
86
|
-
|
|
87
|
-
> `(N, *e)` array — same values, same shape, and the same error on bad shapes.
|
|
113
|
+
Not every system vectorizes. A renderer calls a draw function per primitive; same for any per-entity foreign API. That's a per-entity system inside an otherwise-vectorized app. The cheapest way to iterate through all the entities is by using `zip()` on the `QueryResult` object on the fields you need, e.g:
|
|
88
114
|
|
|
89
|
-
|
|
90
|
-
|
|
91
|
-
|
|
92
|
-
|
|
93
|
-
|
|
94
|
-
|
|
95
|
-
Edge cases worth knowing:
|
|
115
|
+
```python
|
|
116
|
+
qr = world.query(HasPosition, HasColor, HasRadius)
|
|
117
|
+
for pos, color, radius in zip(qr.position, qr.color, qr.radius): # one entity per step, fields aligned
|
|
118
|
+
rl.DrawCircle(int(pos[0]), int(pos[1]), float(radius[0]), color) # per-entity by necessity (no "draw all")
|
|
119
|
+
```
|
|
96
120
|
|
|
97
|
-
|
|
98
|
-
`qr.f[i]` (`qr.f[:]`, `qr.f[2:4]`, `qr.f[mask]`, fancy), partial entity writes, and ndarray
|
|
99
|
-
methods/attrs (`.sum()`, `.mean()`, `.dtype`, `.ndim`, `.T`). Need any of these? Materialize
|
|
100
|
-
first with `qr.f.numpy()`.
|
|
101
|
-
- **Axis-0 ops are per-pool, not global (footgun).** `np.sort` / `np.cumsum` / `np.sum` over
|
|
102
|
-
`axis=0` run *within each pool* and reset at pool boundaries — they do **not** see all entities
|
|
103
|
-
at once, so they differ from numpy. They're allowed, but if you want a global result, do
|
|
104
|
-
`qr.f.numpy()` first. A reduction that collapses the entity axis is rejected when its length no
|
|
105
|
-
longer matches the pool's row count.
|
|
106
|
-
- **Operands must come from the same query.** Alignment is per-pool, not by flat index, so don't
|
|
107
|
-
mix a `_Field` from one `world.query(...)` into an op on another.
|
|
121
|
+
There are other ways to extract a single entity e.g. `qr.some_field[i]` or `e = world.get_entity(eid)`, but these are slower in the general case and should be avoided in expensive loops, like rendering, even if they are a bit more ergonomic. See benchmark below.
|
|
108
122
|
|
|
109
|
-
|
|
123
|
+
<details>
|
|
124
|
+
<summary> Microbenchmark: ECS vs OOP on a simple physics step </summary>
|
|
110
125
|
|
|
111
|
-
|
|
112
|
-
ways, all verified to produce the identical result. Reproduce with
|
|
113
|
-
`python test/manual/perf/bench_ecs_vs_oop.py` (it prints `{mode: avg_seconds_per_step}`).
|
|
126
|
+
Benchmark: we run the same physics step `pos += vel*dt` over N=100k entities split across 2 pools in various ways (ECS or OOP). All methods are verified to produce the identical result. Reproduce with `python test/manual/perf/bench_ecs_vs_oop.py` (it prints `{mode: avg_seconds_per_step}`).
|
|
114
127
|
|
|
115
128
|
| pattern | ns/entity | vs OOP-scalar |
|
|
116
129
|
|---|---:|---:|
|
|
@@ -123,8 +136,6 @@ ways, all verified to produce the identical result. Reproduce with
|
|
|
123
136
|
| `micro-ecs-get-entity` — `world.get_entity(eid)` per entity | 1674 | 35× slower |
|
|
124
137
|
| `micro-ecs-index` — `qr.f[i]` per entity (an `np.searchsorted` each) | 4573 | 95× slower |
|
|
125
138
|
|
|
126
|
-
*Intel Core Ultra 7 165H, single-threaded, python 3.12 / numpy 2.2. ns/entity = seconds/step ÷ N.*
|
|
127
|
-
|
|
128
139
|
Three things to take from it:
|
|
129
140
|
|
|
130
141
|
1. **Vectorized wins big.** Batched ops (`_Field` or per-pool) run at 1–2 ns/entity — **27–52×
|
|
@@ -140,3 +151,26 @@ Three things to take from it:
|
|
|
140
151
|
**Rule of thumb:** keep systems vectorized and push branches into `np.where` / `np.clip`. If a
|
|
141
152
|
workload is *irreducibly* per-entity (data-dependent control flow), plain python objects beat
|
|
142
153
|
microecs ~15× — use them there. microecs is the right tool for **vectorizable** simulation.
|
|
154
|
+
|
|
155
|
+
</details>
|
|
156
|
+
|
|
157
|
+
## How much are `Pool` and `QueryResult` numpy-like and corner cases
|
|
158
|
+
|
|
159
|
+
Given `qr=world.query(A, B)`, then `qr.position` returns a `_Field`: a view over the matching pools that behaves like one contiguous-like `(N, *e)`
|
|
160
|
+
numpy array (e.g. `(N, 2)` for a `(2,)` field). It applies each op **per pool** and stitches result back.
|
|
161
|
+
|
|
162
|
+
That covers elementwise math and ufuncs (e.g. `np.where`, `np.linalg.norm(..., axis=1)` etc.), broadcasting (every operand shape numpy accepts, and it raises on the ones numpy rejects). See `test/unit/test_field_numpy_parity.py` for a whole set of operations comparing both.
|
|
163
|
+
|
|
164
|
+
Edge cases worth knowing:
|
|
165
|
+
|
|
166
|
+
- **Not a full ndarray — these raise, never lie.** Entity-axis indexing beyond a single
|
|
167
|
+
`qr.f[i]` (`qr.f[:]`, `qr.f[2:4]`, `qr.f[mask]`, fancy), partial entity writes, and ndarray
|
|
168
|
+
methods/attrs (`.sum()`, `.mean()`, `.dtype`, `.ndim`, `.T`). Need any of these? Materialize
|
|
169
|
+
first with `qr.f.numpy()`.
|
|
170
|
+
- **Axis-0 ops are per-pool, not global (footgun).** `np.sort` / `np.cumsum` / `np.sum` over
|
|
171
|
+
`axis=0` run within each pool and reset at pool boundaries — they do **not** see all entities
|
|
172
|
+
at once, so they differ from numpy. They're allowed, but if you want a global result, do
|
|
173
|
+
`qr.f.numpy()` first. A reduction that collapses the entity axis is rejected when its length no
|
|
174
|
+
longer matches the pool's row count.
|
|
175
|
+
- **Operands must come from the same query.** Alignment is per-pool, not by flat index, so don't
|
|
176
|
+
mix a `_Field` from one `world.query(...)` into an op on another.
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|