@agentshouse/mdmodel 0.1.0-c4fe1bc82bc55 → 0.1.0-c520180b7a33f
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/API.md +264 -250
- package/README.md +21 -22
- package/dist/blocks.d.ts.map +1 -1
- package/dist/blocks.js +35 -20
- package/dist/definition.d.ts +17 -1
- package/dist/definition.d.ts.map +1 -1
- package/dist/definition.js +321 -45
- package/dist/divide.d.ts.map +1 -1
- package/dist/divide.js +27 -17
- package/dist/document.d.ts +6 -3
- package/dist/document.d.ts.map +1 -1
- package/dist/document.js +326 -171
- package/dist/event.d.ts +78 -0
- package/dist/event.d.ts.map +1 -0
- package/dist/event.js +230 -0
- package/dist/fields.d.ts +2 -0
- package/dist/fields.d.ts.map +1 -1
- package/dist/fields.js +7 -0
- package/dist/index.d.ts +24 -10
- package/dist/index.d.ts.map +1 -1
- package/dist/index.js +14 -7
- package/dist/kinds.d.ts +19 -0
- package/dist/kinds.d.ts.map +1 -0
- package/dist/kinds.js +161 -0
- package/dist/links.d.ts +3 -0
- package/dist/links.d.ts.map +1 -1
- package/dist/links.js +108 -51
- package/dist/paths.d.ts +10 -1
- package/dist/paths.d.ts.map +1 -1
- package/dist/paths.js +118 -12
- package/dist/pattern.d.ts +10 -0
- package/dist/pattern.d.ts.map +1 -0
- package/dist/pattern.js +355 -0
- package/dist/project.d.ts +1 -0
- package/dist/project.d.ts.map +1 -1
- package/dist/project.js +38 -15
- package/dist/query/language.d.ts +223 -0
- package/dist/query/language.d.ts.map +1 -0
- package/dist/query/language.js +565 -0
- package/dist/query/match.d.ts +14 -0
- package/dist/query/match.d.ts.map +1 -0
- package/dist/query/match.js +121 -0
- package/dist/query/rows.d.ts +32 -0
- package/dist/query/rows.d.ts.map +1 -0
- package/dist/query/rows.js +161 -0
- package/dist/query/sql.d.ts +39 -0
- package/dist/query/sql.d.ts.map +1 -0
- package/dist/query/sql.js +279 -0
- package/dist/references.d.ts +2 -2
- package/dist/references.d.ts.map +1 -1
- package/dist/references.js +6 -1
- package/dist/reserved.d.ts +5 -0
- package/dist/reserved.d.ts.map +1 -0
- package/dist/reserved.js +20 -0
- package/dist/schema.d.ts +1 -0
- package/dist/schema.d.ts.map +1 -1
- package/dist/schema.js +57 -6
- package/dist/types.d.ts +57 -2
- package/dist/types.d.ts.map +1 -1
- package/dist/validate.d.ts +31 -2
- package/dist/validate.d.ts.map +1 -1
- package/dist/validate.js +400 -115
- package/dist/yaml.d.ts +1 -2
- package/dist/yaml.d.ts.map +1 -1
- package/dist/yaml.js +75 -32
- package/fixtures/README.md +27 -7
- package/fixtures/cases/conditional-section/context.json +1 -0
- package/fixtures/cases/conditional-section/expected.json +6 -0
- package/fixtures/cases/conditional-section/library/questions/hosting.md +9 -0
- package/fixtures/cases/conditional-section/library/questions/payments.md +12 -0
- package/fixtures/cases/conditional-section/schema.yaml +14 -0
- package/fixtures/cases/cross-room-link/context.json +1 -0
- package/fixtures/cases/cross-room-link/expected.json +1 -0
- package/fixtures/cases/cross-room-link/library/clients/acme.md +6 -0
- package/fixtures/cases/cross-room-link/schema.yaml +3 -0
- package/fixtures/cases/cross-room-reference/context.json +1 -0
- package/fixtures/cases/cross-room-reference/expected.json +1 -0
- package/fixtures/cases/cross-room-reference/library/clients/acme.md +9 -0
- package/fixtures/cases/cross-room-reference/schema.yaml +9 -0
- package/fixtures/cases/link-into-a-reserved-name/context.json +1 -0
- package/fixtures/cases/link-into-a-reserved-name/expected.json +5 -0
- package/fixtures/cases/link-into-a-reserved-name/library/notes/a.md +6 -0
- package/fixtures/cases/link-into-a-reserved-name/schema.yaml +3 -0
- package/fixtures/cases/link-into-a-reserved-name-from-an-untyped-document/context.json +1 -0
- package/fixtures/cases/link-into-a-reserved-name-from-an-untyped-document/expected.json +5 -0
- package/fixtures/cases/link-into-a-reserved-name-from-an-untyped-document/library/notes/b.md +5 -0
- package/fixtures/cases/member-on-an-untyped-document/context.json +1 -0
- package/fixtures/cases/member-on-an-untyped-document/expected.json +6 -0
- package/fixtures/cases/member-on-an-untyped-document/library/note.md +4 -0
- package/fixtures/cases/member-on-another-type/context.json +1 -0
- package/fixtures/cases/member-on-another-type/expected.json +6 -0
- package/fixtures/cases/member-on-another-type/library/note.md +4 -0
- package/fixtures/cases/member-on-another-type/schema.yaml +7 -0
- package/fixtures/cases/reference-into-a-reserved-name/context.json +1 -0
- package/fixtures/cases/reference-into-a-reserved-name/expected.json +6 -0
- package/fixtures/cases/reference-into-a-reserved-name/library/notes/a.md +4 -0
- package/fixtures/cases/reference-into-a-reserved-name/library/settings/brief.md +1 -0
- package/fixtures/cases/reference-into-a-reserved-name/schema.yaml +3 -0
- package/fixtures/cases/room-md-declares-a-type/context.json +1 -0
- package/fixtures/cases/room-md-declares-a-type/expected.json +6 -0
- package/fixtures/cases/room-md-declares-a-type/library/ROOM.md +5 -0
- package/fixtures/cases/typed-path-names-another-type/context.json +11 -0
- package/fixtures/cases/typed-path-names-another-type/expected.json +6 -0
- package/fixtures/cases/typed-path-names-another-type/library/settings/prefs/one.md +3 -0
- package/fixtures/cases/typed-path-names-another-type/schema.yaml +6 -0
- package/fixtures/cases/typed-path-names-its-type/context.json +11 -0
- package/fixtures/cases/typed-path-names-its-type/expected.json +3 -0
- package/fixtures/cases/typed-path-names-its-type/library/settings/prefs/deeper/two.md +1 -0
- package/fixtures/cases/typed-path-names-its-type/library/settings/prefs/one.md +4 -0
- package/fixtures/cases/typed-path-names-its-type/schema.yaml +6 -0
- package/fixtures/cases/typed-path-names-no-type/context.json +11 -0
- package/fixtures/cases/typed-path-names-no-type/expected.json +6 -0
- package/fixtures/cases/typed-path-names-no-type/library/settings/prefs/one.md +1 -0
- package/fixtures/cases/typed-path-names-no-type/schema.yaml +6 -0
- package/fixtures/cases/unnamed-typed-path-checks-its-fields/context.json +11 -0
- package/fixtures/cases/unnamed-typed-path-checks-its-fields/expected.json +6 -0
- package/fixtures/cases/unnamed-typed-path-checks-its-fields/library/rooms/team/tasks/plan.md +4 -0
- package/fixtures/cases/unnamed-typed-path-checks-its-fields/schema.yaml +5 -0
- package/fixtures/cases/unnamed-typed-path-names-a-type/context.json +11 -0
- package/fixtures/cases/unnamed-typed-path-names-a-type/expected.json +6 -0
- package/fixtures/cases/unnamed-typed-path-names-a-type/library/rooms/team/tasks/plan.md +6 -0
- package/fixtures/cases/unnamed-typed-path-names-a-type/schema.yaml +5 -0
- package/fixtures/cases/unnamed-typed-path-reads-its-type/context.json +11 -0
- package/fixtures/cases/unnamed-typed-path-reads-its-type/expected.json +3 -0
- package/fixtures/cases/unnamed-typed-path-reads-its-type/library/rooms/team/plan.md +1 -0
- package/fixtures/cases/unnamed-typed-path-reads-its-type/library/rooms/team/tasks/plan.md +5 -0
- package/fixtures/cases/unnamed-typed-path-reads-its-type/schema.yaml +5 -0
- package/fixtures/cases/unnamed-typed-path-without-a-body/context.json +11 -0
- package/fixtures/cases/unnamed-typed-path-without-a-body/expected.json +5 -0
- package/fixtures/cases/unnamed-typed-path-without-a-body/library/rooms/team/tasks/plan.md +5 -0
- package/fixtures/cases/unnamed-typed-path-without-a-body/schema.yaml +5 -0
- package/fixtures/division.json +26 -26
- package/fixtures/queries.json +913 -0
- package/package.json +10 -3
- package/dist/condition.d.ts +0 -149
- package/dist/condition.d.ts.map +0 -1
- package/dist/condition.js +0 -491
package/API.md
CHANGED
|
@@ -26,30 +26,34 @@ if (checked.verdict === 'accept') {
|
|
|
26
26
|
}
|
|
27
27
|
const parsed = parse(content);
|
|
28
28
|
if (parsed.ok) {
|
|
29
|
-
|
|
30
|
-
|
|
31
|
-
|
|
32
|
-
|
|
33
|
-
href: link.href,
|
|
34
|
-
|
|
35
|
-
|
|
36
|
-
if (moved.outcome === 'applied') serialize(moved.document);
|
|
37
|
-
}
|
|
29
|
+
const moved = apply(
|
|
30
|
+
parsed.document,
|
|
31
|
+
links(parsed.document, 'tasks/two.md')
|
|
32
|
+
.filter((link) => link.target === 'data/export.csv')
|
|
33
|
+
.map((link) => ({ kind: 'link' as const, href: link.href, to: '../files/export.csv' })),
|
|
34
|
+
);
|
|
35
|
+
if (moved.outcome === 'applied') serialize(moved.document);
|
|
38
36
|
}
|
|
39
37
|
```
|
|
40
38
|
|
|
41
39
|
`MARKDOWN_SYNTAX_PROFILE` is the Markdown every reader here applies, GitHub Flavored Markdown
|
|
42
40
|
0.29, and `VERSION` is the MD model version.
|
|
43
41
|
|
|
44
|
-
`verify(schema)` reads one schema text, the MD Types of one Room or App: one
|
|
45
|
-
|
|
46
|
-
`$defs`
|
|
47
|
-
|
|
48
|
-
|
|
49
|
-
|
|
50
|
-
|
|
51
|
-
|
|
52
|
-
|
|
42
|
+
`verify(schema)` reads one schema text, the MD Types of one Room or App: one JSON Schema document
|
|
43
|
+
(draft 2020-12) in the YAML subset. Every top-level key but `$defs` names an MD Type holding the
|
|
44
|
+
JSON Schema of its frontmatter; `$defs` holds shapes the types reuse, reached by a `$ref` under
|
|
45
|
+
`#/$defs/` alone. `type` and the built-in `any` are never declared. The model adds its keywords:
|
|
46
|
+
`reference` on a string names one MD Type, several, `any` or `attachment`, and `cross_room: true`
|
|
47
|
+
beside it admits a Document in another Room, of a type that Room declares; `sections` declares a
|
|
48
|
+
type's H2 sections, each `{ kind: text }` or `{ kind: list, items }` over one string, number,
|
|
49
|
+
integer or boolean, optionally `required: true`, which the `then` or `else` of an `if` on the type,
|
|
50
|
+
in its `allOf` or in such a branch may repeat to ask a section for text, else `conditional-section`;
|
|
51
|
+
`member_document: true` marks at most one type. A type alone takes `create_roles` and
|
|
52
|
+
`delete_roles`, each a list of role names. `verify(schema, provided)` holds every type of a model
|
|
53
|
+
`provided` as its own, named only for those two and only if `provided.nameable` lists it. On a field
|
|
54
|
+
of a type's own `properties` alone, `change_roles` and `initial_roles` each list role names, and
|
|
55
|
+
`transitions` lists `{ from, to, roles? }`, each end a scalar or `null`, on a field whose `type`,
|
|
56
|
+
`enum`, `const`, `$ref`, `allOf`, `anyOf`, `oneOf`, `if` and `not` admit no list or object.
|
|
53
57
|
|
|
54
58
|
```yaml
|
|
55
59
|
$defs:
|
|
@@ -64,68 +68,72 @@ plan:
|
|
|
64
68
|
contact: { member_document: true }
|
|
65
69
|
```
|
|
66
70
|
|
|
67
|
-
The model's `types` expose each MD Type's `name`, `memberDocument`, `sections`,
|
|
68
|
-
|
|
69
|
-
|
|
70
|
-
|
|
71
|
-
|
|
72
|
-
`pattern` or `reference`. Facts join `$ref` and `allOf`
|
|
73
|
-
the variants of `anyOf`, `oneOf`, `then`, `else` and `dependentSchemas`, a
|
|
74
|
-
variant's own keys `conditional`; a path without one `type`, `null` aside, has
|
|
75
|
-
|
|
76
|
-
|
|
77
|
-
|
|
78
|
-
`
|
|
79
|
-
`
|
|
80
|
-
|
|
81
|
-
|
|
82
|
-
|
|
83
|
-
`
|
|
84
|
-
|
|
85
|
-
|
|
86
|
-
|
|
87
|
-
|
|
88
|
-
|
|
89
|
-
|
|
90
|
-
|
|
91
|
-
|
|
92
|
-
|
|
93
|
-
|
|
94
|
-
|
|
95
|
-
|
|
96
|
-
|
|
97
|
-
|
|
98
|
-
`
|
|
99
|
-
|
|
100
|
-
|
|
101
|
-
|
|
102
|
-
|
|
103
|
-
|
|
104
|
-
|
|
105
|
-
|
|
106
|
-
|
|
107
|
-
`
|
|
108
|
-
|
|
109
|
-
|
|
110
|
-
|
|
111
|
-
|
|
112
|
-
|
|
113
|
-
|
|
114
|
-
|
|
115
|
-
|
|
116
|
-
|
|
117
|
-
A
|
|
118
|
-
|
|
119
|
-
|
|
120
|
-
|
|
121
|
-
|
|
122
|
-
|
|
123
|
-
|
|
124
|
-
|
|
125
|
-
|
|
126
|
-
|
|
127
|
-
|
|
128
|
-
|
|
71
|
+
The model's `types` expose each MD Type's `name`, `memberDocument`, `sections`, `shape` (the type as
|
|
72
|
+
written, its rule keywords left out, with every `$defs` shape it reaches), `createRoles` and
|
|
73
|
+
`deleteRoles` when written, its `rules` by field as `changeRoles`, `initialRoles` and `transitions`,
|
|
74
|
+
the facts of its `frontmatter` and `fields`, its top-level ones: JSON `type`, `format`, `values`,
|
|
75
|
+
`reference` targets, `items`, `properties`, an open map's `patterns` and `additional`, and `prose`,
|
|
76
|
+
a string with no `enum`, `const`, `format`, `pattern` or `reference`. Facts join `$ref` and `allOf`
|
|
77
|
+
to their siblings and the variants of `anyOf`, `oneOf`, `then`, `else` and `dependentSchemas`, a
|
|
78
|
+
variant's own keys `conditional`; a path without one `type`, `null` aside, has none. A malformed
|
|
79
|
+
schema is refused whole, naming its `rule`, the keyword or the model's own, and the JSON Pointer
|
|
80
|
+
`location` it concerns, such as `/plan/properties/status/enum`, or `line <n>` outside the YAML
|
|
81
|
+
subset. `pointerFacts(definition, pointer)` reads the facts a frontmatter pointer reaches, `itemFacts`
|
|
82
|
+
and `memberFacts` take one step and `crossedFacts` reads a list's item facts; `JSON_POINTER` matches the
|
|
83
|
+
JSON Pointer grammar, `''` included, `pointerSegments` and `escapePointer` split and write a pointer,
|
|
84
|
+
`ARRAY_INDEX` matches an index segment, and `ATTACHMENT` is the `reference` that admits any path.
|
|
85
|
+
|
|
86
|
+
`validate(library, context?, model?)` takes the resulting text Library and one `ValidationContext` of
|
|
87
|
+
`binaryTargets: readonly string[]`, none when omitted. Library keys and binary targets share one
|
|
88
|
+
canonical collection-relative path namespace; a path declared text and binary is refused. House declares
|
|
89
|
+
every binary file of the Room as a binary target, and the model reads no bytes. Ordinary links and
|
|
90
|
+
images in typed Documents may resolve to either membership, relative to the source Document, and one to
|
|
91
|
+
a path neither holds is not refused: it dangles. One written `/rooms/<handle>/<path>` names a file in
|
|
92
|
+
another Room, which the caller checks; any other absolute path, or one that leaves the collection, is
|
|
93
|
+
`unresolved-link`. A binary target supplies no Document or MD Type. `model` types the Library. A typed
|
|
94
|
+
Document, `any` included, at an `isDocumentPath` (no `isReservedName` of `RESERVED_NAMES` first) linking
|
|
95
|
+
into a reserved name is `unresolved-link`; a typed `ROOM_DESCRIPTION` is `room-md-type`. The context's `typedPaths` bind each `path`, a name's one `*` standing for any nonempty part, to a `type` of `model`: a Document there naming another, or naming any unless `named`, is `unknown-type` at `/type`, one not `named` is checked as it and stays `any`, and one whose body is empty is `required-body` if `body`.
|
|
96
|
+
|
|
97
|
+
A typed Document's frontmatter satisfies its type's schema, every keyword with its JSON Schema
|
|
98
|
+
meaning, formats asserted and defaults never filled, except that an object schema declaring neither
|
|
99
|
+
`additionalProperties` nor `unevaluatedProperties` is closed: an undeclared key is refused as
|
|
100
|
+
`undeclared-field`. `TYPE_FIELD`, `SITE_FIELD` and `RECEIVED_FIELD` count as declared on every type,
|
|
101
|
+
and the string `MEMBER_FIELD` on the `member_document` type alone, else refused, `any` included;
|
|
102
|
+
`HOUSE_FIELDS` lists the four. A refusal names the keyword, such as `required`, and the value's JSON
|
|
103
|
+
Pointer, such as `/shipping/city`. Every occurrence of a declared list section is a list of values of
|
|
104
|
+
its item schema, else `structured-section`; a reference item is one ordinary link alone, such as
|
|
105
|
+
`- [Ada](ada.md)`. A reference, at any depth or a section item, reaching a URL, a binary target, another
|
|
106
|
+
Room without `cross_room` or the context's `anyRoom: true`, a Document of a type it does not name, or,
|
|
107
|
+
from an `isDocumentPath`, a reserved name is `unresolved-reference`, and a frontmatter one reaching no member is `referenced-missing-file`
|
|
108
|
+
naming its `referrers`; `attachment` admits any path, and no body link is a referrer. `validating` is
|
|
109
|
+
`validate` over a `ReadonlyMap` Library, yielding each path read with the references it `resolved`;
|
|
110
|
+
`assess(file, content, binary, model?, context?)` reads one member, naming its `type` and `targets`,
|
|
111
|
+
and `verdicts()` `add`s assessments in any order, its `verdict()` the one `validate` gives.
|
|
112
|
+
|
|
113
|
+
Validation returns acceptance or one refusal naming the file, the field or section, and the violated
|
|
114
|
+
rule. `parse`, `apply`, and `serialize` operate on a single text Document; they do not validate
|
|
115
|
+
collection membership or consume binary bytes. `apply(document, changes)` applies a list of changes
|
|
116
|
+
in one pass however many: each sets one typed field, a list or an object as a whole included,
|
|
117
|
+
replaces one existing section body or the preamble against its prior content, or rewrites one link
|
|
118
|
+
destination or one reference, as the given Document holds it. All apply or none: one refused refuses
|
|
119
|
+
all, and `{ outcome: 'stale', document, stale }` keeps the Document and lists the positions of each
|
|
120
|
+
change it does not hold and of each later change of a part an earlier one changes, such as a link
|
|
121
|
+
inside a replaced section. A section need not be declared by the Document's MD Type to be replaced.
|
|
122
|
+
A section or preamble replacement that would hide a section the Document carried behind a repeated,
|
|
123
|
+
merged or fenced heading is refused as `overlapping-section` naming that section. A field change
|
|
124
|
+
does not reformat the rest of the file: an inline value is replaced where it stands, and a value
|
|
125
|
+
written after the key's line, an empty one or a block mapping or list, is written after the key's
|
|
126
|
+
colon in its place. A field holds a `FrontmatterValue`: null, a string, a boolean, a finite number,
|
|
127
|
+
a list without holes or a plain object of them, no cycle, at most 63 deep. `frontmatterValue(value)`
|
|
128
|
+
is that test; `apply` refuses any other value and `parse` a frontmatter past 64 deep as
|
|
129
|
+
`frontmatter-fence`. `equalValue` compares two by value, whatever their key order, as `apply` does.
|
|
130
|
+
|
|
131
|
+
`Document.preamble` is a readonly string holding the exact source after frontmatter and before the
|
|
132
|
+
first section heading the section parser recognizes, `''` when empty, whitespace, newlines, a
|
|
133
|
+
leading H1 and any fenced text before the first section included. The closing frontmatter
|
|
134
|
+
delimiter and its line ending belong to frontmatter: `bodyAfterFrontmatter(content)` is the exact
|
|
135
|
+
source after them, the whole text when it opens no closed fence, and the preamble begins it.
|
|
136
|
+
`headingLines(content, from, to)` reads each ATX heading outside a fence, by `level` and `name`.
|
|
129
137
|
|
|
130
138
|
```ts
|
|
131
139
|
const parsed = parse(content);
|
|
@@ -135,81 +143,88 @@ if (parsed.ok) {
|
|
|
135
143
|
prior: parsed.document.preamble,
|
|
136
144
|
value: 'Updated introduction.\n\n',
|
|
137
145
|
};
|
|
138
|
-
const result = apply(parsed.document, change);
|
|
146
|
+
const result = apply(parsed.document, [change]);
|
|
139
147
|
if (result.outcome === 'applied') serialize(result.document);
|
|
140
148
|
}
|
|
141
149
|
```
|
|
142
150
|
|
|
143
|
-
`
|
|
144
|
-
current
|
|
145
|
-
|
|
146
|
-
|
|
147
|
-
|
|
148
|
-
|
|
149
|
-
|
|
150
|
-
|
|
151
|
-
|
|
152
|
-
|
|
153
|
-
|
|
154
|
-
compare its public `preamble` and `sections` to the original. Submit the changed values with their
|
|
155
|
-
original priors. Consumers need no source span calculation or private Model import. Collection
|
|
156
|
-
validation remains a separate call against the resulting Library.
|
|
151
|
+
A `{ kind: 'preamble', prior, value }` change compares `prior` to the current preamble exactly. A
|
|
152
|
+
mismatch is stale and leaves the current Document unchanged. A match replaces only that source span,
|
|
153
|
+
then parses a new immutable Document; the original is unchanged. Frontmatter and section source
|
|
154
|
+
outside the span retain their exact bytes, including newline and heading syntax. As with section
|
|
155
|
+
replacement, `value` is literal source: no newline or separator is inserted, and the resulting
|
|
156
|
+
source is parsed again. An invalid frontmatter result receives the existing parse refusal.
|
|
157
|
+
Independent field, section, and preamble edits keep their own prior values valid.
|
|
158
|
+
|
|
159
|
+
For moved links, use `links` and one `link` change per destination below, then compare the rewritten
|
|
160
|
+
Document's `preamble` and `sections` to the original and submit the changed values with their
|
|
161
|
+
original priors. Collection validation remains a separate call against the resulting Library.
|
|
157
162
|
|
|
158
163
|
`links(document, file)` is the inventory of that Document's ordinary link and image destinations
|
|
159
164
|
that resolve to a collection Path, each with the destination `href` exactly as written and the
|
|
160
165
|
`target` Path it resolves to relative to `file`. A `?query` or `#fragment` the destination carries
|
|
161
166
|
is part of `href` and not part of `target`. Entries are ordered by the position of the destination
|
|
162
167
|
text a rewrite would change, and one destination written the same way appears once however many
|
|
163
|
-
times it occurs. A destination that the syntax profile does not read as a link, one that is empty,
|
|
164
|
-
|
|
165
|
-
|
|
166
|
-
|
|
167
|
-
|
|
168
|
-
|
|
169
|
-
|
|
170
|
-
|
|
171
|
-
|
|
172
|
-
|
|
173
|
-
|
|
174
|
-
|
|
168
|
+
times it occurs. A destination that the syntax profile does not read as a link, one that is empty, a
|
|
169
|
+
bare fragment, or carries a URL scheme, and one that leaves the collection are not in the inventory.
|
|
170
|
+
Frontmatter values are never link destinations.
|
|
171
|
+
|
|
172
|
+
`target(file, href)` is the collection Path one written destination resolves to relative to `file`,
|
|
173
|
+
by the rule `links` and `validate` read: surrounding spaces and the `?query` or `#fragment` it
|
|
174
|
+
carries are not part of that Path. It reads backslash escapes and character references, strips as a
|
|
175
|
+
URL does, then percent-encodings, so `plan\.md`, `plan.md` and `pl%61n.md` all name `plan.md`;
|
|
176
|
+
an escaped or referenced `?` or `#` starts the suffix. A destination that is empty, a bare fragment,
|
|
177
|
+
carries a URL scheme, starts at `/` once read, encodes no UTF-8 text, or leaves the collection
|
|
178
|
+
resolves to `null`. It reads a destination written anywhere, such as a typed reference field value,
|
|
179
|
+
which `links` never enumerates. `roomTarget(href)` reads `/rooms/<handle>/<path>` as its `handle`
|
|
180
|
+
and `path`, else `null`, and `roomPath(href)` is its canonical text, the target `facts` resolves for
|
|
181
|
+
any reference written so. `retarget(href, to)` is that destination rewritten to `to`, keeping the
|
|
182
|
+
`?query` or `#fragment` it carried, which is the destination the `link` change below writes. It
|
|
183
|
+
percent-encodes in `to` what `target` would decode, so it resolves to `to` again.
|
|
184
|
+
|
|
185
|
+
`checkDocument(file, content, model, context?)` reads one Document as `validate` does in that
|
|
186
|
+
context: `ok: false` where it refuses, else its `type`, whether it is `typed`, and each reference's
|
|
187
|
+
`target` and `to`, which `resolves(reference, typeOf, binary)` says reaches a member `validate`
|
|
188
|
+
accepts. `sectionReferences(file, content, definition)` reads only its `list` sections' references;
|
|
189
|
+
neither names another Room's, which `roomReferences(file, content, definition?)` lists by `kind`.
|
|
190
|
+
`parseFrontmatter(content, file?)` is `parse` without the body: `content`, `type`, `fields`.
|
|
175
191
|
|
|
176
192
|
`references(document, definition)` lists each frontmatter `reference` string at any depth as
|
|
177
|
-
`pointer`, `value` and `to`; `
|
|
178
|
-
|
|
179
|
-
|
|
180
|
-
`relative(file, path)`, keeping its `?query` or `#fragment`. A text without
|
|
181
|
-
a captured body, is read from its first character: `relativizeBody(body, file, handle)` converts
|
|
182
|
-
|
|
183
|
-
is its `links
|
|
184
|
-
|
|
193
|
+
`pointer`, `value` and `to`; a `{ kind: 'reference', pointer, value, prior }` change rewrites one in
|
|
194
|
+
place, keeping its quotes, or is stale. `relativize(document, file, handle, definition?, kept?)`
|
|
195
|
+
rewrites, in one `apply`, each link destination and reference written `/rooms/<handle>/<path>` and
|
|
196
|
+
not in `kept` to `relative(file, path)`, keeping its `?query` or `#fragment`. A text without
|
|
197
|
+
frontmatter, such as a captured body, is read from its first character: `relativizeBody(body, file, handle)` converts it
|
|
198
|
+
so, refusing a `/rooms/` one naming no Room's file as `unresolved-link`; `bodyLinks(body, file)`
|
|
199
|
+
is its `links` and `bodyRoomLinks(body)` its other Rooms'. `relinkBody(body, file, moves)` writes,
|
|
200
|
+
in the `link` change's form, each destination whose Path keys `moves` as that value relative to
|
|
201
|
+
`file`, or as that value when it is a `/rooms/` path, and one whose `roomPath` does as that value.
|
|
185
202
|
|
|
186
203
|
```ts
|
|
187
204
|
target('items/six.md', ' ../projects/atlas.md#overview '); // 'projects/atlas.md'
|
|
188
205
|
retarget(' ../projects/atlas.md#overview ', '../archive/atlas.md'); // '../archive/atlas.md#overview'
|
|
189
206
|
```
|
|
190
207
|
|
|
191
|
-
`
|
|
192
|
-
|
|
193
|
-
|
|
208
|
+
A `{ kind: 'link', href, to }` change rewrites every body occurrence of that written destination
|
|
209
|
+
and changes nothing else, so a caller that moves Paths rewrites each referring Document in one
|
|
210
|
+
`apply` without a second Markdown parser. `to` is the Path the destination must resolve to
|
|
194
211
|
instead; the `?query` or `#fragment` the written destination carried is not part of that Path and
|
|
195
|
-
is kept. A Document that does not carry the destination is
|
|
212
|
+
is kept. A Document that does not carry the destination is stale. A reference definition is
|
|
196
213
|
rewritten once however many uses name it. The destination is written in the form the syntax
|
|
197
214
|
profile reads back: bare when it carries no whitespace, does not open with `<`, and balances its
|
|
198
215
|
parentheses, otherwise inside angle brackets, which the original form is kept in when it still
|
|
199
216
|
fits. A destination that neither form can carry is refused as `unwritable-link`.
|
|
200
217
|
|
|
201
|
-
`project(document, file, context?)` is the Embedding projection input of one
|
|
202
|
-
|
|
203
|
-
|
|
204
|
-
contributes its
|
|
205
|
-
|
|
206
|
-
|
|
207
|
-
|
|
208
|
-
|
|
209
|
-
|
|
210
|
-
|
|
211
|
-
them, exactly as written. The Path and every other value stay outside, so
|
|
212
|
-
changing them alone leaves the projection unchanged.
|
|
218
|
+
`project(document, file, context?)` is the Embedding projection input of one Document: the prose a
|
|
219
|
+
consumer embeds, with every internal Markdown-document link reduced to the label a reader sees. A
|
|
220
|
+
Document that declares no MD type contributes its body after the frontmatter fence. A typed one
|
|
221
|
+
contributes its prose values, its preamble, and every H2 section its MD type does not declare as
|
|
222
|
+
structure, each with its own heading line and every occurrence of a repeated name, in Document
|
|
223
|
+
order: a declared text section, a list section of prose items and an undeclared section are in; a
|
|
224
|
+
list section of any other item schema is not. A prose value is a frontmatter string at any depth
|
|
225
|
+
whose schema is prose, projected bare and followed by a blank line, in the order the Document writes
|
|
226
|
+
them, exactly as written. The Path and every other value stay outside, so changing them alone leaves
|
|
227
|
+
the projection unchanged.
|
|
213
228
|
|
|
214
229
|
```ts
|
|
215
230
|
const parsed = parse(content);
|
|
@@ -222,36 +237,29 @@ if (parsed.ok) {
|
|
|
222
237
|
}
|
|
223
238
|
```
|
|
224
239
|
|
|
225
|
-
`ProjectionContext` carries `documentTargets`, the collection-relative Paths the
|
|
226
|
-
|
|
227
|
-
|
|
228
|
-
|
|
229
|
-
|
|
230
|
-
|
|
231
|
-
|
|
232
|
-
|
|
233
|
-
|
|
234
|
-
|
|
235
|
-
|
|
236
|
-
|
|
237
|
-
|
|
238
|
-
|
|
239
|
-
|
|
240
|
-
supplied document target contributes its alt text the same way, because a move
|
|
241
|
-
rewrites that destination too. External URLs, binary targets,
|
|
242
|
-
unsupplied destinations, bare fragments, code spans, fenced code, and escaped
|
|
243
|
-
syntax stay exactly as authored, read through the same syntax profile `links`
|
|
244
|
-
and `validate` read. `project` returns text and never rewrites the Document.
|
|
240
|
+
`ProjectionContext` carries `documentTargets`, the collection-relative Paths the caller holds as
|
|
241
|
+
Markdown documents, and `definition`, the verified MD Type the Document's `type` names, taken from
|
|
242
|
+
the model `verify` returned. A Document that declares a type the caller supplies no definition for
|
|
243
|
+
is refused as `unknown-type`. `documentTargets` is what makes a destination internal: a destination
|
|
244
|
+
resolving to a supplied Path is internal, as is one into another Room, and every other stays text, a
|
|
245
|
+
binary target and a Path nobody supplied alike. The caller supplies that membership, as it does for
|
|
246
|
+
`validate`; the model reads no bytes, resolves no authority, and classifies nothing unsupplied.
|
|
247
|
+
|
|
248
|
+
An internal link contributes its visible label and no destination, fragment, or title, in the inline
|
|
249
|
+
`[label](path)`, full `[label][id]`, collapsed `[label][]`, and shortcut `[label]` forms, and the
|
|
250
|
+
link reference definition an enumerated use resolves through leaves the projection with it. An image
|
|
251
|
+
at a supplied document target contributes its alt text the same way, because a move rewrites that
|
|
252
|
+
destination too. External URLs, binary targets, unsupplied destinations, bare fragments, code spans,
|
|
253
|
+
fenced code, and escaped syntax stay exactly as authored, read through the same syntax profile
|
|
254
|
+
`links` and `validate` read. `project` returns text and never rewrites the Document.
|
|
245
255
|
|
|
246
256
|
A `link` change leaves the projection of every Document it rewrites
|
|
247
257
|
byte-identical, while a changed visible label changes it.
|
|
248
258
|
|
|
249
|
-
`divide(document, file, context)` divides that same Embedding projection input
|
|
250
|
-
|
|
251
|
-
|
|
252
|
-
|
|
253
|
-
positions, so a caller stores the extent and hydrates the text it shows from
|
|
254
|
-
the Document itself.
|
|
259
|
+
`divide(document, file, context)` divides that same Embedding projection input into ordered Spans
|
|
260
|
+
under the bound the caller supplies. Each Span carries the `text` to embed and the `start` and `end`
|
|
261
|
+
of the extent it addresses in the Document's own source, as UTF-8 byte offsets and never string
|
|
262
|
+
positions, so a caller stores the extent and hydrates the text it shows from the Document itself.
|
|
255
263
|
|
|
256
264
|
```ts
|
|
257
265
|
const parsed = parse(content);
|
|
@@ -259,101 +267,107 @@ if (parsed.ok) {
|
|
|
259
267
|
const divided = divide(parsed.document, 'tasks/two.md', {
|
|
260
268
|
documentTargets: ['plans/q3.md', 'people/ana.md'],
|
|
261
269
|
definition: model.types.task,
|
|
262
|
-
|
|
270
|
+
bound: 2000,
|
|
263
271
|
});
|
|
264
272
|
if (divided.ok) for (const span of divided.spans) embed(span.text);
|
|
265
273
|
}
|
|
266
274
|
```
|
|
267
275
|
|
|
268
|
-
`DivisionContext` is a `ProjectionContext` and one `
|
|
269
|
-
|
|
270
|
-
|
|
271
|
-
|
|
272
|
-
|
|
273
|
-
|
|
274
|
-
|
|
275
|
-
|
|
276
|
-
|
|
277
|
-
|
|
278
|
-
|
|
279
|
-
|
|
280
|
-
|
|
281
|
-
|
|
282
|
-
|
|
283
|
-
|
|
284
|
-
|
|
285
|
-
|
|
286
|
-
|
|
287
|
-
|
|
288
|
-
|
|
289
|
-
|
|
290
|
-
|
|
291
|
-
|
|
292
|
-
|
|
293
|
-
|
|
294
|
-
|
|
295
|
-
|
|
296
|
-
|
|
297
|
-
|
|
298
|
-
|
|
299
|
-
|
|
300
|
-
|
|
301
|
-
|
|
302
|
-
|
|
303
|
-
|
|
304
|
-
|
|
305
|
-
|
|
306
|
-
|
|
307
|
-
|
|
308
|
-
|
|
309
|
-
|
|
310
|
-
|
|
311
|
-
|
|
312
|
-
|
|
313
|
-
`
|
|
314
|
-
|
|
315
|
-
a
|
|
316
|
-
|
|
317
|
-
|
|
318
|
-
|
|
319
|
-
|
|
320
|
-
|
|
321
|
-
|
|
322
|
-
|
|
323
|
-
|
|
324
|
-
|
|
325
|
-
|
|
326
|
-
|
|
327
|
-
|
|
328
|
-
|
|
329
|
-
|
|
330
|
-
|
|
331
|
-
|
|
332
|
-
|
|
333
|
-
|
|
334
|
-
|
|
335
|
-
|
|
336
|
-
|
|
337
|
-
|
|
338
|
-
`
|
|
339
|
-
|
|
340
|
-
|
|
341
|
-
|
|
342
|
-
|
|
343
|
-
|
|
344
|
-
`
|
|
345
|
-
each
|
|
346
|
-
|
|
347
|
-
|
|
348
|
-
|
|
349
|
-
|
|
350
|
-
|
|
351
|
-
|
|
352
|
-
|
|
353
|
-
|
|
354
|
-
|
|
355
|
-
|
|
356
|
-
|
|
357
|
-
the prose and section paths whose text
|
|
358
|
-
|
|
359
|
-
`
|
|
276
|
+
`DivisionContext` is a `ProjectionContext` and one `bound`, the greatest number of characters a
|
|
277
|
+
Span's embedded text may carry, counted the way JavaScript counts a string's length and not in the
|
|
278
|
+
bytes the extent is measured in. No Span's text is ever longer than the bound. A bound cut never
|
|
279
|
+
divides a character: where the bound ends between the two halves of a surrogate pair, the cut falls
|
|
280
|
+
before the pair. A cut never falls inside link syntax either: it falls before an internal link, and
|
|
281
|
+
a label longer than a whole piece's room is divided at the bound like any other text. The smallest
|
|
282
|
+
bound is `2`, the length of one astral character; a bound that is not a whole number of at least
|
|
283
|
+
`2` is refused with `division-bound` before any division. The bound is the caller's number alone:
|
|
284
|
+
the model holds no tokenizer, counts nothing else, and refuses no input for being too long. A
|
|
285
|
+
Document the caller supplies no definition for carries the `unknown-type` refusal of `project`.
|
|
286
|
+
|
|
287
|
+
The division descends one level at a time, and only into the piece that does not fit: the whole
|
|
288
|
+
input, a heading node, adjacent sibling nodes packed under one parent, adjacent blocks inside a
|
|
289
|
+
node, sentences inside a block, and a bound cut inside a single sentence. A Span covers whole
|
|
290
|
+
heading nodes or one contiguous piece inside a single node, never a partial node beside another. A
|
|
291
|
+
Span that continues a node repeats that node's own heading line, projected like any other text and
|
|
292
|
+
so carrying an internal link's label rather than its destination, and never an ancestor's heading,
|
|
293
|
+
so renaming a heading costs what editing that heading's own body costs. A heading the bound cannot
|
|
294
|
+
hold beside any text is not repeated, a continuation piece that begins with an astral character the
|
|
295
|
+
room beside its heading cannot hold is carried without the heading, and a heading with no body of
|
|
296
|
+
its own leads its first child node rather than standing as a Span of nothing but itself. Overlap
|
|
297
|
+
exists at the sentence level alone, where each Span after the first repeats its predecessor's last
|
|
298
|
+
sentence whenever the bound holds both; when it cannot hold both, the Span carries its own sentence
|
|
299
|
+
alone. An untyped input arrives without a definition and descends the same ladder.
|
|
300
|
+
|
|
301
|
+
Division is total: every authored character of the input belongs to at least one Span, and an input
|
|
302
|
+
carrying no authored text divides into no Span at all. A Span's extent is the smallest range of the
|
|
303
|
+
source that contains everything the Span covers, so it spans what the input excludes between two
|
|
304
|
+
eligible pieces, and the extent addresses the authored source where the embedded text carries a
|
|
305
|
+
repeated heading, an internal link's visible label, or a frontmatter value the author quoted. A Span
|
|
306
|
+
divided out of one free-text field value addresses that whole value, because a YAML scalar's own
|
|
307
|
+
positions are the only ones its source has, and a Span carrying part of one internal link's label
|
|
308
|
+
addresses that whole link, because a cut never falls inside link syntax.
|
|
309
|
+
|
|
310
|
+
## Queries
|
|
311
|
+
|
|
312
|
+
`planOf(query, rooms)` checks one query against the MD Types of the Rooms `rooms` lists, each
|
|
313
|
+
`{ locator, available, types }` with `listed` when the list is whole, and answers its
|
|
314
|
+
`QueryPlan` or throws a `QueryError` whose `code` is `invalid-query`, `unknown-type`,
|
|
315
|
+
`unknown-field` or `wrong-kind`, whose message names where, whose `place` is that place as the
|
|
316
|
+
keys and indexes into the query, which `placeText` writes as its message does, and whose `accepts` lists what it would take there: the types or
|
|
317
|
+
fields the Rooms declare, a field's `kindWords`, or the parts and operators a query knows. A query
|
|
318
|
+
is data: `types`, `where`
|
|
319
|
+
field predicates by JSON Pointer (`$eq`, `$ne`, `$in`, `$nin`, `$gt`, `$gte`, `$lt`, `$lte`,
|
|
320
|
+
`$all`, `$size`, `$exists`, `$prefix`, `$and`, `$or`), `pathPrefix`, `folder`, `paths`,
|
|
321
|
+
`fileIds`, `hop`, `backlinks`, `text`, then `select` or `groupBy`, `orderBy`, `limit`, `after`
|
|
322
|
+
and `total`. `queryKey` and `identityOf` are a query's and a plan's canonical text, `bodied`
|
|
323
|
+
says a shape reads text, `cursorOf` and `decodedCursor` write and read the `after` a window
|
|
324
|
+
continues from, and `invalid`, `known` and `plain` are the check's refusal and tests.
|
|
325
|
+
|
|
326
|
+
`KINDS` is the one table of kinds a value compares as, `kindOf(facts)` a declared value's kind,
|
|
327
|
+
`kindWords(facts)` the values it takes in words, and `fitsKind(kind, facts, value)` whether a value
|
|
328
|
+
fits it: a `date`, `date-time` or `time` is
|
|
329
|
+
exactly what document validation admits as that format, a `date` is `dated`, a `date-time`
|
|
330
|
+
compares as the instant `instant` reads, which `instantKey` writes as text that sorts as the
|
|
331
|
+
instant does, and a `reference` as the Room Path it resolves to. `compared(left, right,
|
|
332
|
+
ordering)` orders plain values: numbers and booleans, then text by locale or `byCodePoint`,
|
|
333
|
+
then lists item by item.
|
|
334
|
+
|
|
335
|
+
Two evaluators answer a plan's tests on one Document alike, a test on a missing value false and
|
|
336
|
+
its negation (`$ne`, `$nin`, `$exists: false`) true. `matches(plan, candidate)` answers in
|
|
337
|
+
memory over one `Candidate`: its `path`, `type`, `fileId`, `fields`, `definition` and the
|
|
338
|
+
`text` held. The `sql` namespace compiles them to SQL over a collection: `indexed(path, fields,
|
|
339
|
+
definition)` derives a Document's values and field links, its date-times with their instants,
|
|
340
|
+
`sql.VALUE_TABLE` holds those values and `sql.insertedValues` writes them, and `sql.tests(alias,
|
|
341
|
+
plan)` tests a document row of `id`, `path`, `folder`, `type`, `file_id` and `content`, its
|
|
342
|
+
phrase through the function a connection registers as `sql.HOLDS_PHRASE` with `sql.holdsPhrase`.
|
|
343
|
+
`sql.scoped`, `sql.placed`, `sql.sorted`, `sql.beyond`, `sql.following` and `sql.sortValue`
|
|
344
|
+
render a scope, a pointer, an order and a window's continuation, a date-time ordering as its
|
|
345
|
+
instant between numbers and text; `sql.fragment`, `sql.joined`, `sql.all`, `sql.any`,
|
|
346
|
+
`sql.grouped`, `sql.listed` and `sql.exists` build statements, and `heldKind` is the index's value
|
|
347
|
+
kind. `fixtures/queries.json` holds both evaluators to one table.
|
|
348
|
+
|
|
349
|
+
## Events
|
|
350
|
+
|
|
351
|
+
`facts(document, { id, path }, model, resolve)` reads one Document as the `DocumentFacts` of a
|
|
352
|
+
change: its `id`, its `path` with a leading `/`, its `type` or `null`, its `sections`, and a `Fact`
|
|
353
|
+
for each frontmatter field it writes that its MD Type declares, held as its kind: `reference`,
|
|
354
|
+
`enum`, `number`, `boolean`, `date`, `time` (a `date-time`) or `string`. A prose value, or one of
|
|
355
|
+
no kind, is `prose`, a list or an object holds the facts of its members, and a value written
|
|
356
|
+
`null` is `null`. A
|
|
357
|
+
value that does not fit its kind, such as a string in a number field, a value outside its `enum` or
|
|
358
|
+
a reference `resolve` maps to no `{ id, member? }`, is `unreadable`; a readable reference holds that
|
|
359
|
+
`id` and the `member` it binds, which `members(facts, path)` lists at a `/members/<pointer>`.
|
|
360
|
+
|
|
361
|
+
`candidateOf(facts)` is that Document as the `Candidate` `matches` answers over, so a query tests
|
|
362
|
+
the Document as the change saw it: at its Room Path, by its file ID, a reference as the `id` it
|
|
363
|
+
named, a prose value as present alone, an unreadable value as missing and a date-time as an instant.
|
|
364
|
+
`heldAt(candidate, pointer)` lists the values a pointer reaches there, its date-times with their
|
|
365
|
+
instants. `prosePaths(facts)` lists the prose and section paths whose text a change compares, and
|
|
366
|
+
`TEXT_FIELD`, `/text`, names a Document's whole text; `WRITE_DOORS` are the ways a change is made.
|
|
367
|
+
`pointed(value, pointer)` reads a JSON Pointer, `undefined` where nothing is; `dated(value)` checks a
|
|
368
|
+
`YYYY-MM-DD` date, and `instant(value)` reads what validation admits as a `date-time` as epoch
|
|
369
|
+
nanoseconds, a `bigint`. Of one MD Type, `datePointers(definition)` lists, sorted, its date fields as
|
|
370
|
+
escaped pointers, `valuedChange(definition, pointer)` holds of a field read as one value, never
|
|
371
|
+
prose, a list or reached through one, the only field whose change is tested by its values, and
|
|
372
|
+
`memberPointers(definition, memberType)` the `/members/<name>` paths of the fields referring to
|
|
373
|
+
`memberType`, alone or in a list.
|