quality.md 0.4.1 → 0.5.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +57 -135
- package/package.json +7 -7
package/README.md
CHANGED
|
@@ -1,23 +1,14 @@
|
|
|
1
1
|
# QUALITY.md
|
|
2
2
|
|
|
3
|
-
**QUALITY.md** is an
|
|
4
|
-
|
|
3
|
+
**QUALITY.md** is an [open format](./SPECIFICATION.md) for modeling quality:
|
|
4
|
+
what matters most, why, and how. Use it with the `/quality` agent skill to
|
|
5
|
+
continuously improve AI assistant and coding agent projects.
|
|
5
6
|
|
|
6
|
-
|
|
7
|
-
|
|
8
|
-
|
|
9
|
-
|
|
10
|
-
|
|
11
|
-
- **Technical debt** — code drifting from where it should be.
|
|
12
|
-
- **Cognitive debt** — the mounting burden of understanding complex or
|
|
13
|
-
under-documented systems.
|
|
14
|
-
- **Intent debt** — software diverging from what stakeholders actually need.
|
|
15
|
-
|
|
16
|
-
QUALITY.md makes a team's quality expectations explicit and checkable, so those
|
|
17
|
-
gaps stay visible and addressable instead of compounding.
|
|
18
|
-
|
|
19
|
-
> The three-debt framing draws on Margaret-Anne Storey, *The Triple Debt of
|
|
20
|
-
> Software Development* ([arXiv:2603.22106](https://arxiv.org/abs/2603.22106)).
|
|
7
|
+
A QUALITY.md file is a Markdown file with a quality model and supporting
|
|
8
|
+
context. The `/quality` skill helps set up the file, evaluate quality, and
|
|
9
|
+
evolve the model as you learn. The `qualitymd` CLI provides support tooling for
|
|
10
|
+
validating QUALITY.md files, managing quality evaluations, and maintaining a
|
|
11
|
+
QUALITY.md workspace.
|
|
21
12
|
|
|
22
13
|
## Install
|
|
23
14
|
|
|
@@ -30,27 +21,11 @@ npx skills add qualitymd/quality.md
|
|
|
30
21
|
2. Install the CLI:
|
|
31
22
|
|
|
32
23
|
```sh
|
|
33
|
-
npm install quality.md
|
|
24
|
+
npm install -g quality.md
|
|
34
25
|
```
|
|
35
26
|
|
|
36
27
|
## Usage
|
|
37
28
|
|
|
38
|
-
Create and check a first model with the CLI:
|
|
39
|
-
|
|
40
|
-
```sh
|
|
41
|
-
qualitymd init
|
|
42
|
-
qualitymd lint
|
|
43
|
-
```
|
|
44
|
-
|
|
45
|
-
Expected first result:
|
|
46
|
-
|
|
47
|
-
```text
|
|
48
|
-
Created QUALITY.md
|
|
49
|
-
|
|
50
|
-
Next: qualitymd lint QUALITY.md
|
|
51
|
-
QUALITY.md is valid.
|
|
52
|
-
```
|
|
53
|
-
|
|
54
29
|
Invoke the `/quality` skill to manage quality for your project:
|
|
55
30
|
|
|
56
31
|
```text
|
|
@@ -58,23 +33,40 @@ Invoke the `/quality` skill to manage quality for your project:
|
|
|
58
33
|
/quality wizard Have your AI assistant/agent help you manage quality
|
|
59
34
|
/quality evaluate Evaluate the quality of your project
|
|
60
35
|
/quality evaluate security Evaluate a specific quality factor or characteristic
|
|
61
|
-
/quality evaluate payments-api Evaluate specific target or project component
|
|
36
|
+
/quality evaluate payments-api Evaluate a specific target or project component
|
|
62
37
|
/quality evaluate payments-api maintainability Evaluate a target's specific quality
|
|
63
38
|
```
|
|
64
39
|
|
|
65
|
-
|
|
40
|
+
Most users should work with `QUALITY.md` through their coding agent, the
|
|
41
|
+
`/quality` skill, or direct edits. The CLI is primarily support tooling for
|
|
42
|
+
validation, status, and evaluation records.
|
|
66
43
|
|
|
67
|
-
|
|
68
|
-
|
|
69
|
-
factors matter, what requirements define those factors, and how each requirement
|
|
70
|
-
should be assessed. The Markdown body explains the context: what the work is,
|
|
71
|
-
what "good" means, where the boundaries are, and why these standards matter.
|
|
44
|
+
To keep the model visible to agents, add a short note to `AGENTS.md` or
|
|
45
|
+
`CLAUDE.md`:
|
|
72
46
|
|
|
73
|
-
|
|
47
|
+
```text
|
|
48
|
+
See [QUALITY.md](./QUALITY.md) for how this project models and evaluates quality.
|
|
49
|
+
```
|
|
74
50
|
|
|
75
|
-
|
|
51
|
+
## Why QUALITY.md
|
|
52
|
+
|
|
53
|
+
### Manage Quality Debt
|
|
76
54
|
|
|
77
|
-
|
|
55
|
+
As software — and the agents that write it — moves faster, quality erodes
|
|
56
|
+
quietly through three accumulating debts:
|
|
57
|
+
|
|
58
|
+
- **Technical debt** — code drifting from where it should be.
|
|
59
|
+
- **Cognitive debt** — the mounting burden of understanding complex or
|
|
60
|
+
under-documented systems.
|
|
61
|
+
- **Intent debt** — software diverging from what stakeholders actually need.
|
|
62
|
+
|
|
63
|
+
QUALITY.md makes a team's quality expectations explicit and checkable, so those
|
|
64
|
+
gaps stay visible and addressable instead of compounding.
|
|
65
|
+
|
|
66
|
+
> The three-debt framing draws on Margaret-Anne Storey, *The Triple Debt of
|
|
67
|
+
> Software Development* ([arXiv:2603.22106](https://arxiv.org/abs/2603.22106)).
|
|
68
|
+
|
|
69
|
+
## Example QUALITY.md
|
|
78
70
|
|
|
79
71
|
```markdown
|
|
80
72
|
---
|
|
@@ -133,41 +125,18 @@ This model covers message triage and written replies in the support workspace.
|
|
|
133
125
|
It does not cover billing system behavior or product incident response.
|
|
134
126
|
```
|
|
135
127
|
|
|
136
|
-
|
|
137
|
-
requirements, produce findings, and rate the results against the model's scale.
|
|
138
|
-
|
|
139
|
-
For a completed evaluation run, the CLI renders a concise summary and the full
|
|
140
|
-
report from records supplied by the `/quality` skill:
|
|
141
|
-
|
|
142
|
-
```text
|
|
143
|
-
Wrote quality/evaluations/0001-subject-quality-eval/report-summary.md, quality/evaluations/0001-subject-quality-eval/report.md, and quality/evaluations/0001-subject-quality-eval/report.json
|
|
144
|
-
```
|
|
145
|
-
|
|
146
|
-
A summary excerpt looks like this:
|
|
147
|
-
|
|
148
|
-
```md
|
|
149
|
-
# Quality Evaluation Summary
|
|
150
|
-
|
|
151
|
-
| Field | Value |
|
|
152
|
-
| -------------- | ------ |
|
|
153
|
-
| Overall rating | Target |
|
|
154
|
-
|
|
155
|
-
## Top Issues
|
|
156
|
-
|
|
157
|
-
None recorded.
|
|
158
|
-
```
|
|
128
|
+
## Format
|
|
159
129
|
|
|
160
|
-
|
|
130
|
+
### Specification
|
|
161
131
|
|
|
162
|
-
The full format
|
|
163
|
-
What follows is a condensed reference.
|
|
132
|
+
The full format is specified in [`SPECIFICATION.md`](SPECIFICATION.md).
|
|
164
133
|
|
|
165
134
|
### File Structure
|
|
166
135
|
|
|
167
|
-
A
|
|
136
|
+
A QUALITY.md file has two layers:
|
|
168
137
|
|
|
169
|
-
1. **YAML frontmatter**
|
|
170
|
-
2. **Markdown body**
|
|
138
|
+
1. **YAML frontmatter** — the structured quality model.
|
|
139
|
+
2. **Markdown body** — the context, rationale, scope, needs, risks, and known
|
|
171
140
|
gaps that help people and agents interpret the model.
|
|
172
141
|
|
|
173
142
|
The document begins with the YAML frontmatter. The Markdown body can be empty,
|
|
@@ -211,7 +180,7 @@ Targets can nest recursively. `ratingScale` exists only on the root model.
|
|
|
211
180
|
|
|
212
181
|
| Concept | Meaning |
|
|
213
182
|
| ------------ | --------------------------------------------------------------- |
|
|
214
|
-
| Model | The root quality model in a
|
|
183
|
+
| Model | The root quality model in a QUALITY.md file. |
|
|
215
184
|
| Target | The thing being evaluated. |
|
|
216
185
|
| Source | The material assessed for a target, such as a path or selector. |
|
|
217
186
|
| Factor | A quality dimension that matters for a target. |
|
|
@@ -220,72 +189,25 @@ Targets can nest recursively. `ratingScale` exists only on the root model.
|
|
|
220
189
|
| Finding | An observation produced by an assessment. |
|
|
221
190
|
| Rating Scale | The ordered model-wide scale used to rate results. |
|
|
222
191
|
|
|
223
|
-
|
|
224
|
-
|
|
225
|
-
Each requirement has exactly one `assessment`. An evaluator performs that
|
|
226
|
-
assessment against the target source, records findings, and rates the
|
|
227
|
-
requirement's findings against the model's `ratingScale`. A finding records what
|
|
228
|
-
was observed; the rating result records how that observation compares with the
|
|
229
|
-
model's scale.
|
|
230
|
-
|
|
231
|
-
```text
|
|
232
|
-
assessment -> findings -> rating result
|
|
233
|
-
```
|
|
234
|
-
|
|
235
|
-
## The CLI
|
|
236
|
-
|
|
237
|
-
> **The CLI is an early work in progress.** Today the binary ships
|
|
238
|
-
> `qualitymd init`, `qualitymd lint`, `qualitymd spec`, `qualitymd status`, and the
|
|
239
|
-
> `qualitymd evaluation` run-record surface.
|
|
240
|
-
|
|
241
|
-
`qualitymd` draws one hard line: the **CLI never asks an AI model to judge your
|
|
242
|
-
project.** It creates and checks `QUALITY.md` files, shows what the file covers,
|
|
243
|
-
writes evaluation records for the `/quality` skill, renders reports, and can
|
|
244
|
-
fail CI when ratings fall below your chosen bar. The judgment work happens in
|
|
245
|
-
the skill, not in the CLI.
|
|
246
|
-
|
|
247
|
-
### Common commands
|
|
248
|
-
|
|
249
|
-
| Goal | Command |
|
|
250
|
-
| ---------------------- | -------------------------------- |
|
|
251
|
-
| Show the format rules | `qualitymd spec` |
|
|
252
|
-
| Create a starter file | `qualitymd init [path]` |
|
|
253
|
-
| Check a file | `qualitymd lint [path]` |
|
|
254
|
-
| Fix simple lint issues | `qualitymd lint --fix [path]` |
|
|
255
|
-
| Show project status | `qualitymd status [path] --json` |
|
|
256
|
-
| Show version info | `qualitymd version --json` |
|
|
257
|
-
| Check for updates | `qualitymd upgrade --check` |
|
|
258
|
-
| Show command help | `qualitymd <command> --help` |
|
|
259
|
-
|
|
260
|
-
Typical local loop:
|
|
261
|
-
|
|
262
|
-
```sh
|
|
263
|
-
qualitymd spec
|
|
264
|
-
qualitymd init
|
|
265
|
-
qualitymd lint
|
|
266
|
-
qualitymd status --json
|
|
267
|
-
```
|
|
268
|
-
|
|
269
|
-
The `/quality` skill uses additional evaluation commands behind the scenes.
|
|
270
|
-
The detailed command guide lives in the bundled
|
|
271
|
-
[`CLI Quick Reference`](skills/quality/resources/cli-quick-reference.md).
|
|
272
|
-
|
|
273
|
-
## Conceptual model
|
|
192
|
+
## CLI Quick Reference
|
|
274
193
|
|
|
275
|
-
|
|
276
|
-
|
|
277
|
-
|
|
278
|
-
|
|
279
|
-
|
|
280
|
-
|
|
281
|
-
|
|
194
|
+
| Task | Command |
|
|
195
|
+
| --------------------- | -------------------------------- |
|
|
196
|
+
| Show format spec | `qualitymd spec` |
|
|
197
|
+
| Create a starter file | `qualitymd init [path]` |
|
|
198
|
+
| Validate a file | `qualitymd lint [path]` |
|
|
199
|
+
| Fix lint issues | `qualitymd lint --fix [path]` |
|
|
200
|
+
| Show project status | `qualitymd status [path] --json` |
|
|
201
|
+
| Show version info | `qualitymd version --json` |
|
|
202
|
+
| Check for updates | `qualitymd update --check` |
|
|
203
|
+
| Show command help | `qualitymd <command> --help` |
|
|
282
204
|
|
|
283
205
|
## Status
|
|
284
206
|
|
|
285
|
-
The
|
|
207
|
+
The QUALITY.md format, `qualitymd` CLI, and `/quality` skill are early and
|
|
208
|
+
under active development. Expect the format and tooling to change as they
|
|
209
|
+
mature.
|
|
286
210
|
|
|
287
211
|
## Contributing
|
|
288
212
|
|
|
289
213
|
Contributor setup and local tasks live in [`CONTRIBUTING.md`](CONTRIBUTING.md).
|
|
290
|
-
The release runbook lives in
|
|
291
|
-
[`docs/guides/cut-a-release.md`](docs/guides/cut-a-release.md).
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "quality.md",
|
|
3
|
-
"version": "0.
|
|
3
|
+
"version": "0.5.0",
|
|
4
4
|
"description": "Companion CLI for the QUALITY.md file format and /quality agent skill, used to evaluate and improve AI assistant projects and harnesses.",
|
|
5
5
|
"homepage": "https://getquality.md",
|
|
6
6
|
"keywords": [
|
|
@@ -34,12 +34,12 @@
|
|
|
34
34
|
"bin"
|
|
35
35
|
],
|
|
36
36
|
"optionalDependencies": {
|
|
37
|
-
"@qualitymd/cli-darwin-arm64": "0.
|
|
38
|
-
"@qualitymd/cli-darwin-x64": "0.
|
|
39
|
-
"@qualitymd/cli-linux-arm64": "0.
|
|
40
|
-
"@qualitymd/cli-linux-x64": "0.
|
|
41
|
-
"@qualitymd/cli-win32-arm64": "0.
|
|
42
|
-
"@qualitymd/cli-win32-x64": "0.
|
|
37
|
+
"@qualitymd/cli-darwin-arm64": "0.5.0",
|
|
38
|
+
"@qualitymd/cli-darwin-x64": "0.5.0",
|
|
39
|
+
"@qualitymd/cli-linux-arm64": "0.5.0",
|
|
40
|
+
"@qualitymd/cli-linux-x64": "0.5.0",
|
|
41
|
+
"@qualitymd/cli-win32-arm64": "0.5.0",
|
|
42
|
+
"@qualitymd/cli-win32-x64": "0.5.0"
|
|
43
43
|
},
|
|
44
44
|
"publishConfig": {
|
|
45
45
|
"access": "public"
|