@devinnn/docdrift 0.1.7 → 0.1.11

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (2) hide show
  1. package/README.md +66 -166
  2. package/package.json +9 -2
package/README.md CHANGED
@@ -2,198 +2,98 @@
2
2
 
3
3
  Docs that never lie: detect drift between merged code and docs, then open low-noise, evidence-grounded remediation via Devin sessions.
4
4
 
5
+ ## Table of contents
6
+
7
+ - [Deliverables](#deliverables)
8
+ - [Quick start](#quick-start)
9
+ - [Modes & spec providers](#modes--spec-providers)
10
+ - [Guides](#guides)
11
+ - [Project docs layout](#project-docs-layout)
12
+
13
+ ---
14
+
5
15
  ## Deliverables
6
16
 
7
17
  - **npm package**: [@devinnn/docdrift](https://www.npmjs.com/package/@devinnn/docdrift) — TypeScript CLI (`docdrift`)
8
- - `validate`
9
- - `detect --base <sha> --head <sha>`
10
- - `run --base <sha> --head <sha>`
11
- - `status --since 24h`
18
+ - `validate` — Validate docdrift.yaml
19
+ - `detect --base <sha> --head <sha>` — Check for drift
20
+ - `run --base <sha> --head <sha>` — Full run with Devin
21
+ - `status --since 24h` — Show run status
12
22
  - `sla-check` — Check for doc-drift PRs open 7+ days and open a reminder issue
13
- - GitHub Action: `/Users/cameronking/Desktop/sideproject/docdrift/.github/workflows/devin-doc-drift.yml`
14
- - Repo-local config: `/Users/cameronking/Desktop/sideproject/docdrift/docdrift.yaml`
23
+ - `setup` Interactive setup (Devin analyzes repo, generates v2 docdrift.yaml)
24
+ - `generate-yaml` — Generate config from repo fingerprint `[--output path] [--force]`
25
+ - GitHub Action: `.github/workflows/devin-doc-drift.yml`
26
+ - Repo-local config: `docdrift.yaml`
15
27
  - Demo API + OpenAPI exporter + driftable docs
16
- - PR template + Loom script
17
-
18
- ## Why this is low-noise
19
-
20
- - **Single session, single PR** — One Devin session handles the whole docsite (API reference + guides).
21
- - **Gate on API spec diff** — We only run when OpenAPI drift is detected; no session for docs-check-only failures.
22
- - **requireHumanReview** — When the PR touches guides/prose, we open an issue after the PR to direct attention.
23
- - **7-day SLA** — If a doc-drift PR is open 7+ days, we open a reminder issue (configurable `slaDays`; use `sla-check` CLI or cron workflow).
24
- - Confidence gating and allowlist/exclude enforcement.
25
- - Idempotency key prevents duplicate actions for same repo/SHAs/action.
26
-
27
- ## Detection and gate
28
-
29
- - **Gate:** We only run a Devin session when **OpenAPI drift** is detected. No drift → no session.
30
- - Tier 1: OpenAPI drift (`openapi/generated.json` vs published spec)
31
- - Tier 2: Heuristic path impacts from docAreas (e.g. `apps/api/src/auth/**` → guides)
32
-
33
- Output artifacts (under `.docdrift/`):
34
-
35
- - `drift_report.json`
36
- - `metrics.json` (after `run`)
28
+ - PR template + [Loom script](loom.md)
37
29
 
38
- When you run docdrift as a package (e.g. `npx docdrift` or from another repo), all of this is written to **that repo’s** `.docdrift/` — i.e. the current working directory where the CLI is invoked, not inside the package. Add `.docdrift/` to the consuming repo’s `.gitignore` if you don’t want to commit run artifacts.
30
+ ---
39
31
 
40
- ## Core flow (`docdrift run`)
41
-
42
- 1. Validate config and command availability.
43
- 2. Build drift report. **Gate:** If no OpenAPI drift, exit (no session).
44
- 3. Policy decision (`OPEN_PR | UPDATE_EXISTING_PR | OPEN_ISSUE | NOOP`).
45
- 4. Build one aggregated evidence bundle for the whole docsite.
46
- 5. One Devin session with whole-docsite prompt; poll to terminal status.
47
- 6. If PR opened and touches `requireHumanReview` paths → create issue to direct attention.
48
- 7. Surface result via GitHub commit comment; open issue on blocked/low-confidence paths.
49
- 8. Persist state (including `lastDocDriftPrUrl` for SLA); write `.docdrift/metrics.json`.
50
-
51
- ## Where the docs are (this repo)
52
-
53
- | Path | Purpose |
54
- | ------------------------------------------ | ----------------------------------------------------------------------- |
55
- | `apps/docs-site/openapi/openapi.json` | Published OpenAPI spec (docdrift updates this when drift is detected). |
56
- | `apps/docs-site/docs/api/` | API reference MDX generated from the spec (`npm run docs:gen`). |
57
- | `apps/docs-site/docs/guides/auth.md` | Conceptual auth guide (updated only for conceptual drift). |
58
-
59
- The docsite is a Docusaurus app with `docusaurus-plugin-openapi-docs`. The **generated** spec from code lives at `openapi/generated.json` (from `npm run openapi:export`). Drift = generated vs published differ. Verification runs `docs:gen` and `docs:build` so the docsite actually builds.
60
-
61
- ## How Devin updates them
62
-
63
- 1. **Evidence bundle** — Docdrift builds a tarball with the drift report, OpenAPI diff, and impacted doc snippets, and uploads it to the Devin API as session attachments.
64
- 2. **Devin session** — Devin is prompted (see `src/devin/prompts.ts`) to update only files under the allowlist (`openapi/**`, `apps/docs-site/**`), make minimal correct edits, run verification (`npm run docs:gen`, `npm run docs:build`), and open **one PR** per doc area with a clear description.
65
- 3. **PR** — Devin updates `apps/docs-site/openapi/openapi.json` to match the current API, runs `docs:gen` to regenerate API reference MDX, and opens a pull request. You review and merge; the docsite builds and the docs are updated.
66
-
67
- So the “fix” is a **PR opened by Devin** that you merge; the repo’s docs don’t change until that PR is merged.
68
-
69
- ## Local usage
32
+ ## Quick start
70
33
 
71
34
  ```bash
72
- npm install
73
- npx tsx src/cli.ts validate
74
- npm run openapi:export
75
- npx tsx src/cli.ts detect --base <sha> --head <sha>
76
- DEVIN_API_KEY=... GITHUB_TOKEN=... GITHUB_REPOSITORY=owner/repo GITHUB_SHA=<sha> npx tsx src/cli.ts run --base <sha> --head <sha>
35
+ # Interactive setup (requires DEVIN_API_KEY; add repo in Devin Machine first)
36
+ npx @devinnn/docdrift setup
37
+
38
+ # Or generate config only (scriptable)
39
+ npx @devinnn/docdrift generate-yaml --output docdrift.yaml --force
77
40
  ```
78
41
 
79
- ## Local demo (no GitHub)
80
-
81
- You can run a full end-to-end demo locally with no remote repo. Ensure `.env` has `DEVIN_API_KEY` (and optionally `GITHUB_TOKEN` only when you have a real repo).
82
-
83
- 1. **One-time setup (already done if you have two commits with drift)**
84
- - Git is inited; baseline commit has docs in sync with API.
85
- - A later commit changes `apps/api/src/model.ts` (e.g. `name` → `fullName`) and runs `npm run openapi:export`, so `openapi/generated.json` drifts from `docs/reference/openapi.json`.
86
-
87
- 2. **Run the pipeline**
88
-
89
- ```bash
90
- npm install
91
- npx tsx src/cli.ts validate
92
- npx tsx src/cli.ts detect --base b0f624f --head 6030902
93
- ```
94
-
95
- - Use your own `git log --oneline -3` to get `base` (older) and `head` (newer) SHAs if you recreated the demo.
42
+ [**Setup guide**](docs/guides/setup.md) — Setup options, prerequisites
96
43
 
97
- 3. **Run with Devin (no GitHub calls)**
98
- Omit `GITHUB_TOKEN` so the CLI does not post comments or create issues. Devin session still runs; results are printed to stdout and written to `.docdrift/state.json` and `metrics.json`.
44
+ ---
99
45
 
100
- ```bash
101
- export $(grep -v '^#' .env | xargs)
102
- unset GITHUB_TOKEN GITHUB_REPOSITORY GITHUB_SHA
103
- npx tsx src/cli.ts run --base b0f624f --head 6030902
104
- ```
46
+ ## Modes & spec providers
105
47
 
106
- - `run` can take 1–3 minutes while the Devin session runs.
48
+ | Mode | When it runs |
49
+ | ---- | -------------- |
50
+ | **strict** (default) | Only when spec drift is detected (OpenAPI, GraphQL, etc.). No spec drift → no Devin session. |
51
+ | **auto** | Also when pathMappings match (file changes hit `match` patterns). |
107
52
 
108
- 4. **What you’ll see**
109
- - `.docdrift/drift_report.json` — drift items (e.g. OpenAPI `name` → `fullName`).
110
- - `.docdrift/evidence/<runId>/` — evidence bundles and OpenAPI diff.
111
- - Stdout — per–doc-area outcome (e.g. PR opened by Devin or blocked).
112
- - `.docdrift/metrics.json` — counts and timing.
53
+ | Spec formats | openapi3, swagger2, graphql, fern, postman |
113
54
 
114
- ## CI usage
55
+ [**Configuration**](docs/guides/configuration.md) — Modes, spec providers, full config
115
56
 
116
- - Add secret: `DEVIN_API_KEY`
117
- - Push to `main` or run `workflow_dispatch`
118
- - Action uploads:
119
- - `.docdrift/drift_report.json`
120
- - `.docdrift/evidence/**`
121
- - `.docdrift/metrics.json`
57
+ ---
122
58
 
123
- ## Run on GitHub
59
+ ## Guides
124
60
 
125
- 1. **Create a repo** on GitHub (e.g. `your-org/docdrift`), then add the remote and push:
61
+ | Guide | What’s inside |
62
+ | ----- | -------------- |
63
+ | [Setup](docs/guides/setup.md) | `setup` vs `generate-yaml`, prerequisites |
64
+ | [Configuration](docs/guides/configuration.md) | Modes, spec providers; links to full schema |
65
+ | [How it works](docs/guides/how-it-works.md) | Detection, gate, core flow, low-noise design |
66
+ | [Ecosystems](docs/guides/ecosystems.md) | OpenAPI, FastAPI, Fern, GraphQL, Mintlify, Postman, monorepos |
67
+ | [Local development](docs/guides/local-development.md) | Local usage, demo without GitHub |
68
+ | [CI & GitHub](docs/guides/ci-github.md) | GitHub Actions, secrets, demo on GitHub |
69
+ | [Using in another repo](docs/guides/consuming-repo.md) | Published package, CLI, GitHub Actions |
70
+ | [Publishing](docs/guides/publishing.md) | Publishing the npm package |
71
+ | [Loom script](loom.md) | Recording script for demos |
126
72
 
127
- ```bash
128
- git remote add origin https://github.com/your-org/docdrift.git
129
- git push -u origin main
130
- ```
73
+ ### Reference
131
74
 
132
- 2. **Add secret**
133
- Repo → **Settings** → **Secrets and variables** → **Actions** → **New repository secret**
134
- - Name: `DEVIN_API_KEY`
135
- - Value: your Devin API key (same as in `.env` locally)
75
+ - [docdrift.yaml](docdrift-yml.md) Full configuration schema and validation
136
76
 
137
- `GITHUB_TOKEN` is provided automatically; the workflow uses it for commit comments and issues.
77
+ ---
138
78
 
139
- 3. **Trigger the workflow**
140
- - **Push to `main`** — runs on every push (compares previous commit vs current).
141
- - **Manual run** — **Actions** tab → **devin-doc-drift** → **Run workflow** (uses `HEAD` and `HEAD^` as head/base).
79
+ ## Project docs layout (this repo)
142
80
 
143
- ## See it work (demo on GitHub)
81
+ | Path | Purpose |
82
+ | ---- | ------- |
83
+ | `apps/docs-site/openapi/openapi.json` | Published OpenAPI spec (docdrift updates when drift detected) |
84
+ | `apps/docs-site/docs/api/` | API reference MDX (`npm run docs:gen`) |
85
+ | `apps/docs-site/docs/guides/` | Conceptual guides (auth, etc.) |
144
86
 
145
- This repo has **intentional drift**: the API has been expanded (new fields `fullName`, `avatarUrl`, `createdAt`, `role` and new endpoint `GET /v1/users` with pagination), but **docs are unchanged** (`docs/reference/openapi.json` and `docs/reference/api.md` still describe the old single-endpoint, `id`/`name`/`email` only). Running docdrift will detect that and hand a large diff to Devin to fix via a PR. To see it:
87
+ Generated spec from code: `openapi/generated.json` (`npm run openapi:export`). Drift = generated vs published differ.
146
88
 
147
- 1. **Create a new GitHub repo** (e.g. `docdrift-demo`) so you have a clean place to run the workflow.
148
- 2. **Push this project with full history** (so both commits are on `main`):
149
- ```bash
150
- git remote add origin https://github.com/YOUR_ORG/docdrift-demo.git
151
- git push -u origin main
152
- ```
153
- 3. **Add secret** in that repo: **Settings** → **Secrets and variables** → **Actions** → `DEVIN_API_KEY` = your Devin API key.
154
- 4. **Trigger the workflow**
155
- - Either push another small commit (e.g. README tweak), or
156
- - **Actions** → **devin-doc-drift** → **Run workflow**.
157
- 5. **Where to look**
158
- - **Actions** → open the run → **Run Doc Drift** step: the step logs print JSON with `sessionUrl`, `prUrl`, and `outcome` per doc area. Open any `sessionUrl` in your browser to see the Devin session.
159
- - **Artifacts**: download **docdrift-artifacts** for `.docdrift/drift_report.json`, `.docdrift/metrics.json`, and evidence.
160
- - **Devin dashboard**: sessions are tagged `docdrift`; you’ll see the run there once the step completes (often 1–3 minutes).
89
+ ---
161
90
 
162
- ## Using in another repo (published package)
91
+ ## Why low-noise
163
92
 
164
- Once published to npm, any repo can use the CLI locally or in GitHub Actions.
93
+ - **Single session, single PR** One Devin session for the whole docsite
94
+ - **Gate on spec diff** — No session when no drift (strict mode)
95
+ - **requireHumanReview** — Issue when PR touches guides/prose
96
+ - **7-day SLA** — Reminder issue for stale doc-drift PRs
97
+ - **Confidence gating** — Allowlist, exclude, idempotency
165
98
 
166
- 1. **Setup** `npx @devinnn/docdrift setup` (requires `DEVIN_API_KEY`). Devin generates `docdrift.yaml`, `.docdrift/DocDrift.md`, and `.github/workflows/docdrift.yml`. Prerequisite: add your repo in Devin's Machine first. Or add `docdrift.yaml` manually (see `docdrift-yml.md`).
167
- 2. **CLI**
168
- ```bash
169
- npx @devinnn/docdrift validate
170
- npx @devinnn/docdrift detect --base <base-sha> --head <head-sha>
171
- # With env for run:
172
- DEVIN_API_KEY=... GITHUB_TOKEN=... GITHUB_REPOSITORY=owner/repo GITHUB_SHA=<sha> npx @devinnn/docdrift run --base <base-sha> --head <head-sha>
173
- ```
174
- 3. **GitHub Actions** — add a step that runs the CLI (e.g. after checkout and setting base/head):
175
- ```yaml
176
- - run: npx @devinnn/docdrift run --base ${{ steps.shas.outputs.base }} --head ${{ steps.shas.outputs.head }}
177
- env:
178
- DEVIN_API_KEY: ${{ secrets.DEVIN_API_KEY }}
179
- GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
180
- GITHUB_REPOSITORY: ${{ github.repository }}
181
- GITHUB_SHA: ${{ github.sha }}
182
- ```
183
- Add repo secret `DEVIN_API_KEY`; `GITHUB_TOKEN` is provided by the runner.
184
-
185
- ## Publishing the package
186
-
187
- - Set `"private": false` in `package.json` (or omit it).
188
- - Set `"repository": { "type": "git", "url": "https://github.com/your-org/docdrift.git" }`.
189
- - Run `pnpm build` (or `npm run build`), then `npm publish` (for a scoped package use `npm publish --access public`).
190
- - Only the `dist/` directory is included (`files` in `package.json`). Consumers get the built CLI; they provide their own `docdrift.yaml` in their repo.
191
-
192
- ## Demo scenario
193
-
194
- - Autogen drift: rename a field in `apps/api/src/model.ts`, merge to `main`, observe docs PR path.
195
- - Conceptual drift: change auth behavior under `apps/api/src/auth/**`, merge to `main`, observe single escalation issue.
196
-
197
- ## Loom
198
-
199
- See `/Users/cameronking/Desktop/sideproject/docdrift/loom.md` for the minute-by-minute recording script.
99
+ [**How it works**](docs/guides/how-it-works.md) Detection, flow, evidence bundle
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@devinnn/docdrift",
3
- "version": "0.1.7",
3
+ "version": "0.1.11",
4
4
  "private": false,
5
5
  "description": "Detect and remediate documentation drift with Devin sessions",
6
6
  "main": "dist/src/index.js",
@@ -17,7 +17,11 @@
17
17
  ],
18
18
  "repository": {
19
19
  "type": "git",
20
- "url": ""
20
+ "url": "git+https://github.com/cameronking4/docdrift.git"
21
+ },
22
+ "homepage": "https://github.com/cameronking4/docdrift#readme",
23
+ "bugs": {
24
+ "url": "https://github.com/cameronking4/docdrift/issues"
21
25
  },
22
26
  "keywords": [
23
27
  "docs",
@@ -27,6 +31,9 @@
27
31
  "github-actions"
28
32
  ],
29
33
  "license": "MIT",
34
+ "publishConfig": {
35
+ "access": "public"
36
+ },
30
37
  "scripts": {
31
38
  "build": "tsc -p tsconfig.json",
32
39
  "test": "vitest run",