jev-style 0.2.0__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- jev_style-0.2.0/.gitignore +7 -0
- jev_style-0.2.0/CHANGELOG.md +27 -0
- jev_style-0.2.0/LICENSE +202 -0
- jev_style-0.2.0/NOTICE +16 -0
- jev_style-0.2.0/PKG-INFO +327 -0
- jev_style-0.2.0/README.md +277 -0
- jev_style-0.2.0/examples/support_tickets.jsonl +31 -0
- jev_style-0.2.0/jev_style/__init__.py +6 -0
- jev_style-0.2.0/jev_style/__main__.py +3 -0
- jev_style-0.2.0/jev_style/adapter.py +135 -0
- jev_style-0.2.0/jev_style/cli.py +163 -0
- jev_style-0.2.0/jev_style/client.py +167 -0
- jev_style-0.2.0/jev_style/data/guard_config.json +210 -0
- jev_style-0.2.0/jev_style/data/guard_examples/labelled_commands.jsonl +49 -0
- jev_style-0.2.0/jev_style/discovery.py +108 -0
- jev_style-0.2.0/jev_style/evaluate.py +464 -0
- jev_style-0.2.0/jev_style/ext/__init__.py +0 -0
- jev_style-0.2.0/jev_style/ext/agent_approval.py +258 -0
- jev_style-0.2.0/jev_style/fake.py +76 -0
- jev_style-0.2.0/jev_style/fastpath.py +77 -0
- jev_style-0.2.0/jev_style/guard.py +693 -0
- jev_style-0.2.0/jev_style/guard_replay.py +159 -0
- jev_style-0.2.0/jev_style/mcp_server.py +249 -0
- jev_style-0.2.0/jev_style/models.py +154 -0
- jev_style-0.2.0/jev_style/schema.py +210 -0
- jev_style-0.2.0/jev_style/server.py +122 -0
- jev_style-0.2.0/jev_style/web/common.css +99 -0
- jev_style-0.2.0/jev_style/web/common.js +203 -0
- jev_style-0.2.0/jev_style/web/confidence.html +72 -0
- jev_style-0.2.0/jev_style/web/demo-data/chinese/manifest.json +23 -0
- jev_style-0.2.0/jev_style/web/demo-data/chinese/massive_dev_subset.json +1 -0
- jev_style-0.2.0/jev_style/web/demos/agent-approval/LICENSES.md +14 -0
- jev_style-0.2.0/jev_style/web/demos/agent-approval/approval.css +180 -0
- jev_style-0.2.0/jev_style/web/demos/agent-approval/approval.js +531 -0
- jev_style-0.2.0/jev_style/web/demos/agent-approval/demo.json +9 -0
- jev_style-0.2.0/jev_style/web/demos/agent-approval/index.html +96 -0
- jev_style-0.2.0/jev_style/web/demos/chinese/LICENSES.md +13 -0
- jev_style-0.2.0/jev_style/web/demos/chinese/cases.json +391 -0
- jev_style-0.2.0/jev_style/web/demos/chinese/demo.json +9 -0
- jev_style-0.2.0/jev_style/web/demos/chinese/index.html +94 -0
- jev_style-0.2.0/jev_style/web/demos/chinese/zh.css +54 -0
- jev_style-0.2.0/jev_style/web/demos/chinese/zh.js +313 -0
- jev_style-0.2.0/jev_style/web/demos/snake/LICENSES.md +9 -0
- jev_style-0.2.0/jev_style/web/demos/snake/demo.json +9 -0
- jev_style-0.2.0/jev_style/web/demos/snake/index.html +145 -0
- jev_style-0.2.0/jev_style/web/demos/snake/snake-core.js +291 -0
- jev_style-0.2.0/jev_style/web/demos/snake/snake.css +92 -0
- jev_style-0.2.0/jev_style/web/demos/snake/snake.js +604 -0
- jev_style-0.2.0/jev_style/web/index.html +115 -0
- jev_style-0.2.0/jev_style/web/playground/LICENSES.md +20 -0
- jev_style-0.2.0/jev_style/web/playground/confidence.css +31 -0
- jev_style-0.2.0/jev_style/web/playground/confidence.js +124 -0
- jev_style-0.2.0/jev_style/web/playground/playground.css +92 -0
- jev_style-0.2.0/jev_style/web/playground/playground.js +716 -0
- jev_style-0.2.0/jev_style/web/playground/presets.json +716 -0
- jev_style-0.2.0/jev_style/web/playground/share.js +58 -0
- jev_style-0.2.0/pyproject.toml +63 -0
- jev_style-0.2.0/tests/conftest.py +14 -0
- jev_style-0.2.0/tests/test_api.py +104 -0
- jev_style-0.2.0/tests/test_cli.py +20 -0
- jev_style-0.2.0/tests/test_client.py +26 -0
- jev_style-0.2.0/tests/test_eval.py +104 -0
- jev_style-0.2.0/tests/test_guard.py +30 -0
- jev_style-0.2.0/tests/test_mcp.py +16 -0
- jev_style-0.2.0/tests/test_shortcuts.py +56 -0
|
@@ -0,0 +1,27 @@
|
|
|
1
|
+
# Changelog
|
|
2
|
+
|
|
3
|
+
Versions follow [semantic versioning](https://semver.org/). Each release pins the model revisions it loads
|
|
4
|
+
(`jev_style/models.py`), so upgrading the package is what changes the weights you get.
|
|
5
|
+
|
|
6
|
+
## 0.2.0 (unreleased)
|
|
7
|
+
|
|
8
|
+
- **On PyPI.** `pip install "jev-style[mlx]"` on Apple silicon, `pip install "jev-style[torch]"` elsewhere; the
|
|
9
|
+
README and the skills no longer install from a git URL.
|
|
10
|
+
- **`JevStyle.from_pretrained(repo_id)`**: load a release by its Hub repo id; the repo picks the backend (main repo =
|
|
11
|
+
PyTorch, `-MLX`, `-GGUF`). The three v3 repos load at their pinned revisions. Any other repo runs the runtime file it
|
|
12
|
+
ships, so it is refused unless you pass `trust_remote_code=True`.
|
|
13
|
+
- **Module-level shortcuts**: `jev_style.decide(...)`, `jev_style.classify(text, labels)` and `jev_style.configure(...)`
|
|
14
|
+
share one lazily created client (`$JEV_STYLE_URL`, else the local model).
|
|
15
|
+
- **`jev-style eval --server ...` compares engines**: the local model, other builds, or any server that implements
|
|
16
|
+
`POST /v1/systemone`, on the same questions, with 95 % paired bootstrap intervals for the accuracy and Brier
|
|
17
|
+
differences. `--key NAME=ENV_VAR` and `--model NAME=MODEL` per engine.
|
|
18
|
+
- MLX: the state is read once for many questions (bit-identical answers, up to 8x faster).
|
|
19
|
+
- Packaging: version read from `jev_style/__init__.py`; the source distribution now holds only the package, tests
|
|
20
|
+
and examples (about 210 KB instead of 6.6 MB); README links are absolute so they work on PyPI.
|
|
21
|
+
|
|
22
|
+
No change to answers: the pinned model revisions are the same as in 0.1.0.
|
|
23
|
+
|
|
24
|
+
## 0.1.0 (2026-09-26)
|
|
25
|
+
|
|
26
|
+
First release: `jev-style serve` (systemone-compatible API, Playground and demos; MLX, PyTorch and GGUF backends),
|
|
27
|
+
the Python client, six agent skills, the Claude Code guard, the MCP server and `jev-style eval`.
|
jev_style-0.2.0/LICENSE
ADDED
|
@@ -0,0 +1,202 @@
|
|
|
1
|
+
|
|
2
|
+
Apache License
|
|
3
|
+
Version 2.0, January 2004
|
|
4
|
+
http://www.apache.org/licenses/
|
|
5
|
+
|
|
6
|
+
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
|
7
|
+
|
|
8
|
+
1. Definitions.
|
|
9
|
+
|
|
10
|
+
"License" shall mean the terms and conditions for use, reproduction,
|
|
11
|
+
and distribution as defined by Sections 1 through 9 of this document.
|
|
12
|
+
|
|
13
|
+
"Licensor" shall mean the copyright owner or entity authorized by
|
|
14
|
+
the copyright owner that is granting the License.
|
|
15
|
+
|
|
16
|
+
"Legal Entity" shall mean the union of the acting entity and all
|
|
17
|
+
other entities that control, are controlled by, or are under common
|
|
18
|
+
control with that entity. For the purposes of this definition,
|
|
19
|
+
"control" means (i) the power, direct or indirect, to cause the
|
|
20
|
+
direction or management of such entity, whether by contract or
|
|
21
|
+
otherwise, or (ii) ownership of fifty percent (50%) or more of the
|
|
22
|
+
outstanding shares, or (iii) beneficial ownership of such entity.
|
|
23
|
+
|
|
24
|
+
"You" (or "Your") shall mean an individual or Legal Entity
|
|
25
|
+
exercising permissions granted by this License.
|
|
26
|
+
|
|
27
|
+
"Source" form shall mean the preferred form for making modifications,
|
|
28
|
+
including but not limited to software source code, documentation
|
|
29
|
+
source, and configuration files.
|
|
30
|
+
|
|
31
|
+
"Object" form shall mean any form resulting from mechanical
|
|
32
|
+
transformation or translation of a Source form, including but
|
|
33
|
+
not limited to compiled object code, generated documentation,
|
|
34
|
+
and conversions to other media types.
|
|
35
|
+
|
|
36
|
+
"Work" shall mean the work of authorship, whether in Source or
|
|
37
|
+
Object form, made available under the License, as indicated by a
|
|
38
|
+
copyright notice that is included in or attached to the work
|
|
39
|
+
(an example is provided in the Appendix below).
|
|
40
|
+
|
|
41
|
+
"Derivative Works" shall mean any work, whether in Source or Object
|
|
42
|
+
form, that is based on (or derived from) the Work and for which the
|
|
43
|
+
editorial revisions, annotations, elaborations, or other modifications
|
|
44
|
+
represent, as a whole, an original work of authorship. For the purposes
|
|
45
|
+
of this License, Derivative Works shall not include works that remain
|
|
46
|
+
separable from, or merely link (or bind by name) to the interfaces of,
|
|
47
|
+
the Work and Derivative Works thereof.
|
|
48
|
+
|
|
49
|
+
"Contribution" shall mean any work of authorship, including
|
|
50
|
+
the original version of the Work and any modifications or additions
|
|
51
|
+
to that Work or Derivative Works thereof, that is intentionally
|
|
52
|
+
submitted to Licensor for inclusion in the Work by the copyright owner
|
|
53
|
+
or by an individual or Legal Entity authorized to submit on behalf of
|
|
54
|
+
the copyright owner. For the purposes of this definition, "submitted"
|
|
55
|
+
means any form of electronic, verbal, or written communication sent
|
|
56
|
+
to the Licensor or its representatives, including but not limited to
|
|
57
|
+
communication on electronic mailing lists, source code control systems,
|
|
58
|
+
and issue tracking systems that are managed by, or on behalf of, the
|
|
59
|
+
Licensor for the purpose of discussing and improving the Work, but
|
|
60
|
+
excluding communication that is conspicuously marked or otherwise
|
|
61
|
+
designated in writing by the copyright owner as "Not a Contribution."
|
|
62
|
+
|
|
63
|
+
"Contributor" shall mean Licensor and any individual or Legal Entity
|
|
64
|
+
on behalf of whom a Contribution has been received by Licensor and
|
|
65
|
+
subsequently incorporated within the Work.
|
|
66
|
+
|
|
67
|
+
2. Grant of Copyright License. Subject to the terms and conditions of
|
|
68
|
+
this License, each Contributor hereby grants to You a perpetual,
|
|
69
|
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
|
70
|
+
copyright license to reproduce, prepare Derivative Works of,
|
|
71
|
+
publicly display, publicly perform, sublicense, and distribute the
|
|
72
|
+
Work and such Derivative Works in Source or Object form.
|
|
73
|
+
|
|
74
|
+
3. Grant of Patent License. Subject to the terms and conditions of
|
|
75
|
+
this License, each Contributor hereby grants to You a perpetual,
|
|
76
|
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
|
77
|
+
(except as stated in this section) patent license to make, have made,
|
|
78
|
+
use, offer to sell, sell, import, and otherwise transfer the Work,
|
|
79
|
+
where such license applies only to those patent claims licensable
|
|
80
|
+
by such Contributor that are necessarily infringed by their
|
|
81
|
+
Contribution(s) alone or by combination of their Contribution(s)
|
|
82
|
+
with the Work to which such Contribution(s) was submitted. If You
|
|
83
|
+
institute patent litigation against any entity (including a
|
|
84
|
+
cross-claim or counterclaim in a lawsuit) alleging that the Work
|
|
85
|
+
or a Contribution incorporated within the Work constitutes direct
|
|
86
|
+
or contributory patent infringement, then any patent licenses
|
|
87
|
+
granted to You under this License for that Work shall terminate
|
|
88
|
+
as of the date such litigation is filed.
|
|
89
|
+
|
|
90
|
+
4. Redistribution. You may reproduce and distribute copies of the
|
|
91
|
+
Work or Derivative Works thereof in any medium, with or without
|
|
92
|
+
modifications, and in Source or Object form, provided that You
|
|
93
|
+
meet the following conditions:
|
|
94
|
+
|
|
95
|
+
(a) You must give any other recipients of the Work or
|
|
96
|
+
Derivative Works a copy of this License; and
|
|
97
|
+
|
|
98
|
+
(b) You must cause any modified files to carry prominent notices
|
|
99
|
+
stating that You changed the files; and
|
|
100
|
+
|
|
101
|
+
(c) You must retain, in the Source form of any Derivative Works
|
|
102
|
+
that You distribute, all copyright, patent, trademark, and
|
|
103
|
+
attribution notices from the Source form of the Work,
|
|
104
|
+
excluding those notices that do not pertain to any part of
|
|
105
|
+
the Derivative Works; and
|
|
106
|
+
|
|
107
|
+
(d) If the Work includes a "NOTICE" text file as part of its
|
|
108
|
+
distribution, then any Derivative Works that You distribute must
|
|
109
|
+
include a readable copy of the attribution notices contained
|
|
110
|
+
within such NOTICE file, excluding those notices that do not
|
|
111
|
+
pertain to any part of the Derivative Works, in at least one
|
|
112
|
+
of the following places: within a NOTICE text file distributed
|
|
113
|
+
as part of the Derivative Works; within the Source form or
|
|
114
|
+
documentation, if provided along with the Derivative Works; or,
|
|
115
|
+
within a display generated by the Derivative Works, if and
|
|
116
|
+
wherever such third-party notices normally appear. The contents
|
|
117
|
+
of the NOTICE file are for informational purposes only and
|
|
118
|
+
do not modify the License. You may add Your own attribution
|
|
119
|
+
notices within Derivative Works that You distribute, alongside
|
|
120
|
+
or as an addendum to the NOTICE text from the Work, provided
|
|
121
|
+
that such additional attribution notices cannot be construed
|
|
122
|
+
as modifying the License.
|
|
123
|
+
|
|
124
|
+
You may add Your own copyright statement to Your modifications and
|
|
125
|
+
may provide additional or different license terms and conditions
|
|
126
|
+
for use, reproduction, or distribution of Your modifications, or
|
|
127
|
+
for any such Derivative Works as a whole, provided Your use,
|
|
128
|
+
reproduction, and distribution of the Work otherwise complies with
|
|
129
|
+
the conditions stated in this License.
|
|
130
|
+
|
|
131
|
+
5. Submission of Contributions. Unless You explicitly state otherwise,
|
|
132
|
+
any Contribution intentionally submitted for inclusion in the Work
|
|
133
|
+
by You to the Licensor shall be under the terms and conditions of
|
|
134
|
+
this License, without any additional terms or conditions.
|
|
135
|
+
Notwithstanding the above, nothing herein shall supersede or modify
|
|
136
|
+
the terms of any separate license agreement you may have executed
|
|
137
|
+
with Licensor regarding such Contributions.
|
|
138
|
+
|
|
139
|
+
6. Trademarks. This License does not grant permission to use the trade
|
|
140
|
+
names, trademarks, service marks, or product names of the Licensor,
|
|
141
|
+
except as required for reasonable and customary use in describing the
|
|
142
|
+
origin of the Work and reproducing the content of the NOTICE file.
|
|
143
|
+
|
|
144
|
+
7. Disclaimer of Warranty. Unless required by applicable law or
|
|
145
|
+
agreed to in writing, Licensor provides the Work (and each
|
|
146
|
+
Contributor provides its Contributions) on an "AS IS" BASIS,
|
|
147
|
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
|
148
|
+
implied, including, without limitation, any warranties or conditions
|
|
149
|
+
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
|
|
150
|
+
PARTICULAR PURPOSE. You are solely responsible for determining the
|
|
151
|
+
appropriateness of using or redistributing the Work and assume any
|
|
152
|
+
risks associated with Your exercise of permissions under this License.
|
|
153
|
+
|
|
154
|
+
8. Limitation of Liability. In no event and under no legal theory,
|
|
155
|
+
whether in tort (including negligence), contract, or otherwise,
|
|
156
|
+
unless required by applicable law (such as deliberate and grossly
|
|
157
|
+
negligent acts) or agreed to in writing, shall any Contributor be
|
|
158
|
+
liable to You for damages, including any direct, indirect, special,
|
|
159
|
+
incidental, or consequential damages of any character arising as a
|
|
160
|
+
result of this License or out of the use or inability to use the
|
|
161
|
+
Work (including but not limited to damages for loss of goodwill,
|
|
162
|
+
work stoppage, computer failure or malfunction, or any and all
|
|
163
|
+
other commercial damages or losses), even if such Contributor
|
|
164
|
+
has been advised of the possibility of such damages.
|
|
165
|
+
|
|
166
|
+
9. Accepting Warranty or Additional Liability. While redistributing
|
|
167
|
+
the Work or Derivative Works thereof, You may choose to offer,
|
|
168
|
+
and charge a fee for, acceptance of support, warranty, indemnity,
|
|
169
|
+
or other liability obligations and/or rights consistent with this
|
|
170
|
+
License. However, in accepting such obligations, You may act only
|
|
171
|
+
on Your own behalf and on Your sole responsibility, not on behalf
|
|
172
|
+
of any other Contributor, and only if You agree to indemnify,
|
|
173
|
+
defend, and hold each Contributor harmless for any liability
|
|
174
|
+
incurred by, or claims asserted against, such Contributor by reason
|
|
175
|
+
of your accepting any such warranty or additional liability.
|
|
176
|
+
|
|
177
|
+
END OF TERMS AND CONDITIONS
|
|
178
|
+
|
|
179
|
+
APPENDIX: How to apply the Apache License to your work.
|
|
180
|
+
|
|
181
|
+
To apply the Apache License to your work, attach the following
|
|
182
|
+
boilerplate notice, with the fields enclosed by brackets "[]"
|
|
183
|
+
replaced with your own identifying information. (Don't include
|
|
184
|
+
the brackets!) The text should be enclosed in the appropriate
|
|
185
|
+
comment syntax for the file format. We also recommend that a
|
|
186
|
+
file or class name and description of purpose be included on the
|
|
187
|
+
same "printed page" as the copyright notice for easier
|
|
188
|
+
identification within third-party archives.
|
|
189
|
+
|
|
190
|
+
Copyright 2026 Alibaba Cloud
|
|
191
|
+
|
|
192
|
+
Licensed under the Apache License, Version 2.0 (the "License");
|
|
193
|
+
you may not use this file except in compliance with the License.
|
|
194
|
+
You may obtain a copy of the License at
|
|
195
|
+
|
|
196
|
+
http://www.apache.org/licenses/LICENSE-2.0
|
|
197
|
+
|
|
198
|
+
Unless required by applicable law or agreed to in writing, software
|
|
199
|
+
distributed under the License is distributed on an "AS IS" BASIS,
|
|
200
|
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
201
|
+
See the License for the specific language governing permissions and
|
|
202
|
+
limitations under the License.
|
jev_style-0.2.0/NOTICE
ADDED
|
@@ -0,0 +1,16 @@
|
|
|
1
|
+
jev-style
|
|
2
|
+
Copyright 2026 chaoliangUNSW (GitHub: lawrence3699). Licensed under the Apache License, Version 2.0 (see LICENSE).
|
|
3
|
+
|
|
4
|
+
The model weights are downloaded at run time from the Hugging Face Hub
|
|
5
|
+
(chaoliangUNSW/Jev-Style-0.8B-Decision-v3 and its -MLX / -GGUF builds). They are a fine-tuned
|
|
6
|
+
derivative of Qwen3.5-0.8B (Copyright 2026 Alibaba Cloud, Apache-2.0); see the NOTICE file of each
|
|
7
|
+
model repository for the modifications.
|
|
8
|
+
|
|
9
|
+
The question types (choice / score / noul) and the request shape follow the public typed-decision
|
|
10
|
+
("systemone") convention so the same client code works against different servers.
|
|
11
|
+
|
|
12
|
+
Not affiliated with, endorsed by or connected to TypeSafe or Jev. "Jev-Style" only describes the kind
|
|
13
|
+
of model (a small typed-decision model in a similar style); no Jev weights, code or outputs are included.
|
|
14
|
+
Not affiliated with or endorsed by Alibaba Cloud / the Qwen team, the Laya authors or the Kev authors.
|
|
15
|
+
|
|
16
|
+
Web demos: see the LICENSES.md file inside each folder under jev_style/web/ for third-party data.
|
jev_style-0.2.0/PKG-INFO
ADDED
|
@@ -0,0 +1,327 @@
|
|
|
1
|
+
Metadata-Version: 2.5
|
|
2
|
+
Name: jev-style
|
|
3
|
+
Version: 0.2.0
|
|
4
|
+
Summary: Small, calibrated decision models you run on your own machine, with a systemone-compatible API, a Claude Code guard, an MCP server and agent skills.
|
|
5
|
+
Project-URL: Homepage, https://jevstyle.com
|
|
6
|
+
Project-URL: Repository, https://github.com/lawrence3699/jev-style
|
|
7
|
+
Project-URL: Changelog, https://github.com/lawrence3699/jev-style/blob/main/CHANGELOG.md
|
|
8
|
+
Project-URL: Issues, https://github.com/lawrence3699/jev-style/issues
|
|
9
|
+
Project-URL: Models, https://huggingface.co/collections/chaoliangUNSW/jev-style-08b-decision-v3-6ab58abb90ae4b7b55578b3e
|
|
10
|
+
Author: chaoliangUNSW
|
|
11
|
+
License-Expression: Apache-2.0
|
|
12
|
+
License-File: LICENSE
|
|
13
|
+
License-File: NOTICE
|
|
14
|
+
Keywords: agent-skills,calibration,classification,claude-code,decision-model,gguf,jev,mcp,mlx
|
|
15
|
+
Classifier: Development Status :: 4 - Beta
|
|
16
|
+
Classifier: Intended Audience :: Developers
|
|
17
|
+
Classifier: Operating System :: MacOS
|
|
18
|
+
Classifier: Operating System :: POSIX :: Linux
|
|
19
|
+
Classifier: Programming Language :: Python :: 3
|
|
20
|
+
Classifier: Programming Language :: Python :: 3.10
|
|
21
|
+
Classifier: Programming Language :: Python :: 3.11
|
|
22
|
+
Classifier: Programming Language :: Python :: 3.12
|
|
23
|
+
Classifier: Programming Language :: Python :: 3.13
|
|
24
|
+
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
|
|
25
|
+
Requires-Python: >=3.10
|
|
26
|
+
Requires-Dist: fastapi>=0.110
|
|
27
|
+
Requires-Dist: httpx>=0.27
|
|
28
|
+
Requires-Dist: huggingface-hub>=0.34
|
|
29
|
+
Requires-Dist: numpy>=1.26
|
|
30
|
+
Requires-Dist: tokenizers>=0.21
|
|
31
|
+
Requires-Dist: uvicorn>=0.29
|
|
32
|
+
Provides-Extra: all
|
|
33
|
+
Requires-Dist: mcp>=2.0; extra == 'all'
|
|
34
|
+
Requires-Dist: mlx-lm>=0.28; (sys_platform == 'darwin') and extra == 'all'
|
|
35
|
+
Requires-Dist: mlx>=0.29; (sys_platform == 'darwin') and extra == 'all'
|
|
36
|
+
Requires-Dist: torch>=2.4; extra == 'all'
|
|
37
|
+
Requires-Dist: transformers>=5.0; extra == 'all'
|
|
38
|
+
Provides-Extra: dev
|
|
39
|
+
Requires-Dist: mcp>=2.0; extra == 'dev'
|
|
40
|
+
Requires-Dist: pytest>=8; extra == 'dev'
|
|
41
|
+
Provides-Extra: mcp
|
|
42
|
+
Requires-Dist: mcp>=2.0; extra == 'mcp'
|
|
43
|
+
Provides-Extra: mlx
|
|
44
|
+
Requires-Dist: mlx-lm>=0.28; (sys_platform == 'darwin') and extra == 'mlx'
|
|
45
|
+
Requires-Dist: mlx>=0.29; (sys_platform == 'darwin') and extra == 'mlx'
|
|
46
|
+
Provides-Extra: torch
|
|
47
|
+
Requires-Dist: torch>=2.4; extra == 'torch'
|
|
48
|
+
Requires-Dist: transformers>=5.0; extra == 'torch'
|
|
49
|
+
Description-Content-Type: text/markdown
|
|
50
|
+
|
|
51
|
+
# Jev-Style
|
|
52
|
+
|
|
53
|
+
Small, calibrated decision models you run on your own machine, plus the tooling to put them to work in AI agents.
|
|
54
|
+
|
|
55
|
+
<p>
|
|
56
|
+
<a href="https://pypi.org/project/jev-style/"><img alt="PyPI" src="https://img.shields.io/pypi/v/jev-style?style=for-the-badge&labelColor=000000&color=0a0a0a" height="28"></a>
|
|
57
|
+
<a href="https://github.com/lawrence3699/jev-style/actions/workflows/ci.yml"><img alt="CI" src="https://img.shields.io/github/actions/workflow/status/lawrence3699/jev-style/ci.yml?style=for-the-badge&labelColor=000000" height="28"></a>
|
|
58
|
+
<a href="https://huggingface.co/collections/chaoliangUNSW/jev-style-08b-decision-v3-6ab58abb90ae4b7b55578b3e"><img alt="Weights: 0.8B · torch · MLX · GGUF" src="https://img.shields.io/badge/WEIGHTS-0.8B%20%C2%B7%20torch%20%C2%B7%20MLX%20%C2%B7%20GGUF-0a0a0a.svg?style=for-the-badge&labelColor=000000" height="28"></a>
|
|
59
|
+
<a href="https://huggingface.co/spaces/chaoliangUNSW/jev-style-v3"><img alt="Demo on Hugging Face Spaces" src="https://img.shields.io/badge/DEMO-HF%20Spaces-0a0a0a.svg?style=for-the-badge&labelColor=000000" height="28"></a>
|
|
60
|
+
<a href="#agent-skills"><img alt="Agent skills: 6" src="https://img.shields.io/badge/AGENT%20SKILLS-6-0a0a0a.svg?style=for-the-badge&labelColor=000000" height="28"></a>
|
|
61
|
+
<a href="LICENSE"><img alt="License: Apache-2.0" src="https://img.shields.io/badge/license-Apache--2.0-0a0a0a.svg?style=for-the-badge&labelColor=000000" height="28"></a>
|
|
62
|
+
</p>
|
|
63
|
+
|
|
64
|
+

|
|
65
|
+
|
|
66
|
+
Jev-Style is a family of small decision models built on Qwen3.5. The current model, [Jev-Style-0.8B-Decision-v3](https://huggingface.co/chaoliangUNSW/Jev-Style-0.8B-Decision-v3), is 0.53 GB at 4-bit. You give it text or JSON and some typed questions, and it returns a calibrated probability for every option in one forward pass. The server's API follows the public systemone request shape, so clients written for Jev-compatible servers can call your laptop instead.
|
|
67
|
+
|
|
68
|
+
This repository is the part that makes the model useful day to day:
|
|
69
|
+
|
|
70
|
+
- **`jev-style serve`**: a local API with a Playground and demos. It picks MLX on Apple silicon and PyTorch on CUDA or CPU; llama.cpp is optional.
|
|
71
|
+
- **Six agent skills**: install with one `npx skills add`. They serve the model, call it, evaluate it on your own labels, replace LLM calls that only return a label, add a guard to Claude Code, and add the MCP tools.
|
|
72
|
+
- **A Claude Code guard**: a `PreToolUse` hook where the local model checks every tool call before it runs and answers allow, ask or deny.
|
|
73
|
+
- **An MCP server**: tools `decide`, `noul`, `choice` and `score` for Claude Code, Cursor, Codex and any other MCP client.
|
|
74
|
+
- **`jev-style eval`**: measures accuracy and calibration on your own labelled data, and reports how many decisions you can automate at a 1, 5 or 10 % error budget.
|
|
75
|
+
|
|
76
|
+
No GPU, no API key and no training needed.
|
|
77
|
+
|
|
78
|
+
## Highlights
|
|
79
|
+
|
|
80
|
+
- **Three question types in one request.** Yes/no (`noul`), multiple choice (`choice`, up to 255 options) and ordered ratings (`score`, 2 to 10 levels). The model reads the text once and answers every question about it.
|
|
81
|
+
- **Probabilities, not just labels.** Each release ships temperatures fitted on held-out data, so your code can act on confident answers and send the rest to a person or an LLM.
|
|
82
|
+
- **Long inputs.** Up to 25,600 tokens per call. Nothing is truncated: an input that is too long is rejected with an error that says so.
|
|
83
|
+
- **Runs locally.** About 0.15 to 0.2 s for a short request with MLX on an M1 Max, after the first call. Nothing leaves your machine.
|
|
84
|
+
- **51 languages evaluated.** Training covers 19 languages. On MASSIVE intent the model beats Laya's multilingual checkpoint in all 51 evaluated languages.
|
|
85
|
+
- **Built for agents.** The skills, the MCP tools and the guard all work with Claude Code, Codex, Cursor and other agents.
|
|
86
|
+
|
|
87
|
+
## Model
|
|
88
|
+
|
|
89
|
+
| Model | Size | Banking77 (77 intents, never trained) | MASSIVE intent, 37 held-out languages | tweet_topic, zero-shot | JevBench v1.4.1 public (231) | Context |
|
|
90
|
+
|---|---|:---:|:---:|:---:|:---:|:---:|
|
|
91
|
+
| [Jev-Style-0.8B-Decision-v3](https://huggingface.co/chaoliangUNSW/Jev-Style-0.8B-Decision-v3) | 0.8B · 0.53 GB (Q4_K_M) | **68.2 %** | **65.5 %** | **75.5 %** | **64.1 %** | 25,600 tokens |
|
|
92
|
+
| Best official Laya checkpoint | 0.8B | 49.2 % | 36.1 % | 63.2 % | 58.4 % | 1,024 by default |
|
|
93
|
+
|
|
94
|
+
All numbers are from the [model card](https://huggingface.co/chaoliangUNSW/Jev-Style-0.8B-Decision-v3#results), which gives the full protocol and confidence intervals. The Laya rows are its official checkpoints re-run on the same rows, except tweet_topic and JevBench, which use published numbers. The hosted Jev API has higher accuracy than v3 on every one of these sets where its accuracy is published. Treat v3 as the small local option, not a replacement for the hosted model.
|
|
95
|
+
|
|
96
|
+
| Build | Size | Used by |
|
|
97
|
+
|---|---:|---|
|
|
98
|
+
| [safetensors (bf16)](https://huggingface.co/chaoliangUNSW/Jev-Style-0.8B-Decision-v3) | 1.50 GB | `--backend torch` (CUDA, Apple MPS, CPU) |
|
|
99
|
+
| [MLX bf16 / 8-bit](https://huggingface.co/chaoliangUNSW/Jev-Style-0.8B-Decision-v3-MLX) | 1.50 / 0.80 GB | `--backend mlx` (Apple silicon; `auto` picks it there) |
|
|
100
|
+
| [GGUF F16 / Q8_0 / Q4_K_M](https://huggingface.co/chaoliangUNSW/Jev-Style-0.8B-Decision-v3-GGUF) | 1.52 / 0.81 / 0.53 GB | `--backend gguf` (llama.cpp through the bundled `jev-score` scorer) |
|
|
101
|
+
|
|
102
|
+
Each build carries its own runtime file next to the weights. The server downloads a pinned revision and uses that file, so the answers here match what the model card documents. Earlier 2B generations, for use in LM Studio or Ollama without this server: [v1 GGUF](https://huggingface.co/chaoliangUNSW/Jev-Style-Qwen3.5-2B-Decision-GGUF) (LM Studio, llama.cpp) and [v2 GGUF](https://huggingface.co/chaoliangUNSW/Jev-Style-Qwen3.5-2B-Decision-v2-GGUF) (Ollama).
|
|
103
|
+
|
|
104
|
+
## Quick Start
|
|
105
|
+
|
|
106
|
+
### Try it in the browser
|
|
107
|
+
|
|
108
|
+
The [Hugging Face Space](https://huggingface.co/spaces/chaoliangUNSW/jev-style-v3) runs v3. There is nothing to install.
|
|
109
|
+
|
|
110
|
+
### Run it locally
|
|
111
|
+
|
|
112
|
+
You'll need Python 3.10 or newer.
|
|
113
|
+
|
|
114
|
+
```bash
|
|
115
|
+
pip install "jev-style[mlx]" # Apple silicon (MLX)
|
|
116
|
+
pip install "jev-style[torch]" # Linux, Windows or an Intel Mac (PyTorch on CUDA or CPU)
|
|
117
|
+
|
|
118
|
+
jev-style serve # downloads the model once (~1.5 GB), then serves http://127.0.0.1:8765
|
|
119
|
+
```
|
|
120
|
+
|
|
121
|
+
To install the command line tool on its own, with the MCP server, use [uv](https://docs.astral.sh/uv/): `uv tool install "jev-style[all]"` on Apple silicon, `uv tool install "jev-style[torch,mcp]"` elsewhere.
|
|
122
|
+
|
|
123
|
+
Open http://127.0.0.1:8765 for the Playground and the demos: agent action approval, Snake, and Chinese and 51 languages. In another terminal, send a ticket:
|
|
124
|
+
|
|
125
|
+
```bash
|
|
126
|
+
curl -s localhost:8765/v1/systemone -H 'content-type: application/json' -d '{
|
|
127
|
+
"state": "Shoes arrived two weeks late and in the wrong size. Also I see two charges on my card.",
|
|
128
|
+
"questions": {
|
|
129
|
+
"department": {"type": "choice", "instructions": "Which team should handle this?",
|
|
130
|
+
"criteria": {"returns": "Exchanges, refunds, wrong or damaged items",
|
|
131
|
+
"shipping": "Delivery status, delays, lost packages",
|
|
132
|
+
"billing": "Charges, invoices, payment problems"}},
|
|
133
|
+
"escalate": {"type": "noul", "instructions": "Does this need urgent human attention?"},
|
|
134
|
+
"frustration": {"type": "score", "instructions": "How frustrated is the customer?",
|
|
135
|
+
"criteria": ["Calm", "Frustrated", "Very angry"]}
|
|
136
|
+
}}'
|
|
137
|
+
```
|
|
138
|
+
|
|
139
|
+
This is the actual response from v3 with MLX on an Apple M1 Max, with probabilities rounded:
|
|
140
|
+
|
|
141
|
+
```json
|
|
142
|
+
{
|
|
143
|
+
"model": "jev-style-0.8b-decision-v3",
|
|
144
|
+
"answers": {
|
|
145
|
+
"department": { "type": "choice", "choice": "billing", "confidence": 0.46,
|
|
146
|
+
"probabilities": { "returns": 0.07, "shipping": 0.29, "billing": 0.64 } },
|
|
147
|
+
"escalate": { "type": "noul", "noul": 0.45 },
|
|
148
|
+
"frustration": { "type": "score", "score": 1.28, "confidence": 0.36,
|
|
149
|
+
"legend": { "0": "Calm", "1": "Frustrated", "2": "Very angry" },
|
|
150
|
+
"probabilities": { "0": 0.07, "1": 0.57, "2": 0.35 } }
|
|
151
|
+
},
|
|
152
|
+
"usage": { "input_tokens": 250, "state_tokens": 25, "output_tokens": 0 },
|
|
153
|
+
"latency_ms": 194.0,
|
|
154
|
+
"backend": "mlx"
|
|
155
|
+
}
|
|
156
|
+
```
|
|
157
|
+
|
|
158
|
+
The ticket raises both a billing problem and a late delivery, and the probabilities show it: billing 0.64, shipping 0.29. That is why the model returns probabilities rather than a single label. Your code can act on the confident answers and hand the rest to a person.
|
|
159
|
+
|
|
160
|
+
### Use it from Python
|
|
161
|
+
|
|
162
|
+
For a script, one line is enough. The first call loads the model in-process, or uses the server in `JEV_STYLE_URL` if you set it:
|
|
163
|
+
|
|
164
|
+
```python
|
|
165
|
+
import jev_style
|
|
166
|
+
|
|
167
|
+
jev_style.classify("Where is my parcel? It was due Monday.", ["billing", "shipping", "tech"])
|
|
168
|
+
# {'label': 'shipping', 'confidence': ..., 'probabilities': {'billing': ..., 'shipping': ..., 'tech': ...}}
|
|
169
|
+
```
|
|
170
|
+
|
|
171
|
+
For several questions about one text, and to choose the engine yourself:
|
|
172
|
+
|
|
173
|
+
```python
|
|
174
|
+
from jev_style import JevStyle, choice, noul, score
|
|
175
|
+
|
|
176
|
+
js = JevStyle.from_pretrained("chaoliangUNSW/Jev-Style-0.8B-Decision-v3-MLX") # in-process; the repo picks the backend
|
|
177
|
+
# js = JevStyle(base_url="http://127.0.0.1:8765") # or a running server
|
|
178
|
+
out = js.decide("I was charged twice. Please fix this ASAP.", {
|
|
179
|
+
"billing": noul("This ticket is about billing."),
|
|
180
|
+
"tone": choice("What is the customer's tone?", ["calm", "frustrated", "angry"]),
|
|
181
|
+
"urgency": score("How urgent is this ticket?", ["can wait", "this week", "today"]),
|
|
182
|
+
})
|
|
183
|
+
print(out["answers"]["billing"]["noul"], out["answers"]["tone"]["choice"])
|
|
184
|
+
```
|
|
185
|
+
|
|
186
|
+
`from_pretrained` takes the main repo (PyTorch), `-MLX` (`precision="8bit"` for the 0.8 GB weights) or `-GGUF` (`quant="Q4_K_M"`, needs the `jev-score` scorer, see [Backends](#backends)). The client is not tied to this model: `JevStyle(base_url=...)` works with any server that implements `POST /v1/systemone`, and a client written for another systemone-compatible server can call `http://127.0.0.1:8765` with any API key string.
|
|
187
|
+
|
|
188
|
+
### From the shell
|
|
189
|
+
|
|
190
|
+
```bash
|
|
191
|
+
jev-style decide "Refund still missing after 3 weeks" --url http://127.0.0.1:8765 \
|
|
192
|
+
--choice "Which team?::billing,shipping,returns" --noul "The customer is angry"
|
|
193
|
+
# without --url (or JEV_STYLE_URL) it loads its own copy of the model
|
|
194
|
+
```
|
|
195
|
+
|
|
196
|
+
## Agent Skills
|
|
197
|
+
|
|
198
|
+
The skills live in [`skills/`](https://github.com/lawrence3699/jev-style/tree/main/skills). Each one tells a coding agent how to do one job from start to finish, and ends with a check that the job worked.
|
|
199
|
+
|
|
200
|
+
```bash
|
|
201
|
+
npx skills add lawrence3699/jev-style # pick skills interactively
|
|
202
|
+
npx skills add lawrence3699/jev-style --skill '*' -y # all six
|
|
203
|
+
```
|
|
204
|
+
|
|
205
|
+
| Skill | What your agent does with it |
|
|
206
|
+
|---|---|
|
|
207
|
+
| [`jev-style-serve`](https://github.com/lawrence3699/jev-style/blob/main/skills/jev-style-serve/SKILL.md) | Installs the CLI, picks the backend for your machine, starts the server, checks it with a real request, and can optionally start it at login. |
|
|
208
|
+
| [`jev-style`](https://github.com/lawrence3699/jev-style/blob/main/skills/jev-style/SKILL.md) | Writes code that calls the model: request format, reading the probabilities, turning them into actions with thresholds, limits. |
|
|
209
|
+
| [`jev-style-eval`](https://github.com/lawrence3699/jev-style/blob/main/skills/jev-style-eval/SKILL.md) | Builds a labelled JSONL from your data and runs `jev-style eval`. It reports accuracy, Brier, ECE, how much you can automate at a 1, 5 or 10 % error budget, and a refitted temperature. |
|
|
210
|
+
| [`jev-style-adopt`](https://github.com/lawrence3699/jev-style/blob/main/skills/jev-style-adopt/SKILL.md) | Scans your code for LLM calls that only return a label, yes/no or a rating, and rewrites them as typed questions. The LLM stays as the fallback below a confidence threshold. It runs in shadow mode, measures agreement, then switches. |
|
|
211
|
+
| [`jev-style-guard`](https://github.com/lawrence3699/jev-style/blob/main/skills/jev-style-guard/SKILL.md) | Installs the Claude Code guard hook. It recommends a dry run first, then shows how to tune thresholds and measure them on labelled calls. |
|
|
212
|
+
| [`jev-style-mcp`](https://github.com/lawrence3699/jev-style/blob/main/skills/jev-style-mcp/SKILL.md) | Registers the MCP tools with Claude Code, Codex, Cursor, Claude Desktop or Windsurf, and checks that a tool call works. |
|
|
213
|
+
|
|
214
|
+
In Claude Code you can also install everything as plugins:
|
|
215
|
+
|
|
216
|
+
```text
|
|
217
|
+
/plugin marketplace add lawrence3699/jev-style
|
|
218
|
+
/plugin install jev-style@jev-style # the six skills + MCP tools
|
|
219
|
+
/plugin install jev-style-guard@jev-style # the PreToolUse guard
|
|
220
|
+
```
|
|
221
|
+
|
|
222
|
+
## Claude Code Guard
|
|
223
|
+
|
|
224
|
+
Before Claude Code runs a `Bash`, `Write`, `Edit`, `Read`, `WebFetch` or MCP call, `jev-style guard` sends the call to the local model. It asks whether the call is destructive, exfiltrates data, touches secrets or goes outside the project, plus a 0 to 4 risk score. It turns the answers into **allow / ask / deny**. Regex hard rules in code can only make a verdict stricter. If the server is down, times out or rejects the request, the verdict is **ask**, never a silent allow.
|
|
225
|
+
|
|
226
|
+
```bash
|
|
227
|
+
jev-style guard --check "git push --force origin main"
|
|
228
|
+
# decision: DENY (source: rule, 443 ms) destructive 0.79 ...
|
|
229
|
+
jev-style guard-replay --url http://127.0.0.1:8765 # the 49 bundled labelled tool calls
|
|
230
|
+
```
|
|
231
|
+
|
|
232
|
+
On the 49 bundled tool calls, which were written and labelled by hand, the default config agrees with the labels on **77.6 %**. **No call labelled deny was allowed.** 2 of the 16 calls labelled ask were allowed. The model alone, with no hard rules, agrees on 61.2 %. Use it as a second line of defence, not as a sandbox. The [skill](https://github.com/lawrence3699/jev-style/blob/main/skills/jev-style-guard/SKILL.md) covers installing, dry runs and tuning.
|
|
233
|
+
|
|
234
|
+
## MCP Server
|
|
235
|
+
|
|
236
|
+
```bash
|
|
237
|
+
claude mcp add jev-style --scope user -- jev-style mcp # Claude Code
|
|
238
|
+
```
|
|
239
|
+
|
|
240
|
+
`jev-style mcp` is a thin stdio server that forwards to the running `jev-style serve`, so one copy of the model serves every client. It provides `decide` (several questions about one input), `noul`, `choice`, `score` and `model_info`. Setup for Codex, Cursor and Claude Desktop is in [the skill](https://github.com/lawrence3699/jev-style/blob/main/skills/jev-style-mcp/SKILL.md).
|
|
241
|
+
|
|
242
|
+
## Evaluate on Your Own Data
|
|
243
|
+
|
|
244
|
+
The best evidence is your own labelled examples. `jev-style eval` takes JSONL in the request format, with a `label` on each question:
|
|
245
|
+
|
|
246
|
+
```bash
|
|
247
|
+
jev-style eval examples/support_tickets.jsonl --url http://127.0.0.1:8765
|
|
248
|
+
```
|
|
249
|
+
|
|
250
|
+
```
|
|
251
|
+
question n acc brier ece automate @1% / 5% / 10% error
|
|
252
|
+
team 30 93.3% 0.077 0.123 90.0% (p>=0.65) / 93.3% (p>=0.57) / 100.0% (p>=0.44)
|
|
253
|
+
escalate 30 96.7% 0.107 0.125 80.0% (p>=0.71) / 100.0% (p>=0.54) / 100.0% (p>=0.54)
|
|
254
|
+
mood 30 73.3% 0.433 0.174 40.0% (p>=0.56) / 40.0% (p>=0.56) / 46.7% (p>=0.54)
|
|
255
|
+
```
|
|
256
|
+
|
|
257
|
+
The 30 example tickets were written by hand for this repository. They demonstrate the format; they are not a benchmark. Read `automate @5%: 93.3% (p>=0.57)` like this: if you act only when the top probability is at least 0.57, the model handles 93.3 % of tickets with at most 5 % errors among them, and everything else goes to a person or an LLM. The report also refits a temperature on half the rows and shows its effect on the other half. See the [skill](https://github.com/lawrence3699/jev-style/blob/main/skills/jev-style-eval/SKILL.md) for building a proper evaluation set.
|
|
258
|
+
|
|
259
|
+
### Compare engines
|
|
260
|
+
|
|
261
|
+
Repeat `--server` to run the same file through several engines: this package's local model, another build or quantisation, or any other server that implements `POST /v1/systemone`. The first one is the reference.
|
|
262
|
+
|
|
263
|
+
```bash
|
|
264
|
+
jev-style eval examples/support_tickets.jsonl --server bf16=local:mlx --server q8=http://127.0.0.1:8799
|
|
265
|
+
```
|
|
266
|
+
|
|
267
|
+
```
|
|
268
|
+
90 questions answered by every engine; the table and the differences use only those.
|
|
269
|
+
|
|
270
|
+
engine answered failed rows acc brier log loss ece automate @5% error
|
|
271
|
+
bf16 90 0 87.8% 0.206 0.369 0.125 80.0% (p>=0.54)
|
|
272
|
+
q8 90 0 87.8% 0.206 0.370 0.117 78.9% (p>=0.54)
|
|
273
|
+
|
|
274
|
+
difference to bf16 (95 % paired bootstrap over rows; brier: lower is better):
|
|
275
|
+
q8 accuracy +0.0 pts [+0.0, +0.0] brier +0.001 [-0.001, +0.002]
|
|
276
|
+
```
|
|
277
|
+
|
|
278
|
+
That run compares the MLX bf16 weights in-process with `jev-style serve --precision 8bit` on an Apple M1 Max. Engine specs are `NAME=URL`, `NAME=local[:backend]`, `NAME=hf:<repo id>` or `NAME=fake`; `--key NAME=ENV_VAR` sends a bearer token from an environment variable and `--model NAME=MODEL` sets the request's `model` field. Every engine is scored on the same questions: if one engine rejects a row (too long, too many options), that row is dropped for all of them and counted under `failed rows`. `--json PATH` writes every answer.
|
|
279
|
+
|
|
280
|
+
## API
|
|
281
|
+
|
|
282
|
+
`POST /v1/systemone` with `{"state": text | object | array, "questions": {id: question}}`:
|
|
283
|
+
|
|
284
|
+
| `type` | `criteria` | Answer |
|
|
285
|
+
|---|---|---|
|
|
286
|
+
| `noul` | optional `{"true": "...", "false": "..."}` | `noul` = P(true) |
|
|
287
|
+
| `choice` | `{option: description or null}`, 1 to 255 options | `choice`, `probabilities`, `confidence` |
|
|
288
|
+
| `score` | 2 to 10 levels, lowest first: `"label"` or `{"label", "description"}` | `score` = expected level index, `legend`, `probabilities`, `confidence` |
|
|
289
|
+
|
|
290
|
+
`confidence = (k · p_max − 1) / (k − 1)` for k options: 0 when the probabilities are uniform, 1 when one option takes all of them. The other routes are `GET /v1/models`, `GET /healthz` and the Playground at `/`. Errors look like `{"error": {"code", "message", "question"?}}` and use HTTP 422 (`invalid_json`, `invalid_request`, `invalid_question`, `input_budget_exceeded`), 401 (`unauthorized`), 404 or 500. Start the server with `--api-key-env NAME` to require `Authorization: Bearer <key>`. The full reference is [skills/jev-style/reference.md](https://github.com/lawrence3699/jev-style/blob/main/skills/jev-style/reference.md).
|
|
291
|
+
|
|
292
|
+
## Backends
|
|
293
|
+
|
|
294
|
+
| Machine | Command |
|
|
295
|
+
|---|---|
|
|
296
|
+
| Apple silicon | `jev-style serve` (MLX bf16; add `--precision 8bit` for 0.8 GB) |
|
|
297
|
+
| NVIDIA GPU | `jev-style serve --backend torch` |
|
|
298
|
+
| CPU only | `jev-style serve --backend torch --device cpu` |
|
|
299
|
+
| llama.cpp | build `jev-score` once (`sh build_jev_score.sh /path/to/llama.cpp` from the GGUF repo), then `jev-style serve --backend gguf --scorer /absolute/path/printed/by/the/script --quant Q4_K_M` |
|
|
300
|
+
| Offline | `jev-style serve --model-dir /path/to/a/downloaded/model/repo` |
|
|
301
|
+
| No model (UI or plumbing work) | `jev-style serve --fake` (deterministic, meaningless answers) |
|
|
302
|
+
|
|
303
|
+
## Repository Layout
|
|
304
|
+
|
|
305
|
+
```
|
|
306
|
+
jev_style/ server, client, CLI, guard, MCP server, eval; web/ = Playground + demos
|
|
307
|
+
skills/ six agent skills (npx skills add lawrence3699/jev-style)
|
|
308
|
+
plugins/ Claude Code guard plugin (the root .claude-plugin/ is the marketplace)
|
|
309
|
+
examples/ labelled example data for jev-style eval
|
|
310
|
+
space/ source of the Hugging Face Space
|
|
311
|
+
tests/ pytest suite, runs on the fake engine (no model download)
|
|
312
|
+
```
|
|
313
|
+
|
|
314
|
+
## Development
|
|
315
|
+
|
|
316
|
+
```bash
|
|
317
|
+
git clone https://github.com/lawrence3699/jev-style && cd jev-style
|
|
318
|
+
uv venv && uv pip install -e ".[dev]"
|
|
319
|
+
uv run pytest -q # fake engine: no weights, no GPU
|
|
320
|
+
uv run jev-style serve --fake # UI work without the model
|
|
321
|
+
```
|
|
322
|
+
|
|
323
|
+
## Acknowledgements and License
|
|
324
|
+
|
|
325
|
+
Code: Apache-2.0 ([LICENSE](https://github.com/lawrence3699/jev-style/blob/main/LICENSE)). The weights are Apache-2.0 fine-tunes of [Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B); the NOTICE in each model repository lists the changes. The typed-question convention follows [Laya](https://github.com/NandhaKishorM/laya).
|
|
326
|
+
|
|
327
|
+
Not affiliated with, endorsed by or connected to TypeSafe or Jev. "Jev-Style" describes the kind of model: a small typed-decision model in a similar style. No Jev weights, code or outputs are included. Not affiliated with Alibaba Cloud or the Qwen team or the Laya authors.
|