@minniexcode/codex-switch 0.0.5 → 0.0.6

package/docs/test-report-0.0.5.md

@@ -0,0 +1,163 @@
+# Test Report: 0.0.5
+
+Date: 2026-05-13
+
+## Environment
+
+- Platform: Windows (`win32`)
+- Node.js: `v24.11.1`
+- npm: `11.13.0`
+- Workspace: `C:\Users\A200477427\Developers\Github\codex-switch`
+
+## Commands Run
+
+```bash
+npm run build
+npm test
+```
+
+## Overall Result
+
+- Build: PASS
+- Test suites: 5/5 PASS
+
+Suite results:
+
+- `domain`: PASS
+- `app`: PASS
+- `cli`: PASS
+- `dev-sandbox`: PASS
+- `e2e`: PASS
+
+## Coverage Added In This Pass
+
+New test assets:
+
+- `tests/dev-sandbox.spec.js`
+- `tests/e2e.spec.js`
+- `docs/testing.md`
+
+Updated wiring:
+
+- `tests/helpers.js`
+- `tests/run-tests.js`
+
+## Detailed Results
+
+### 1. Domain Suite
+
+Status: PASS
+
+Focus:
+
+- config patch planning
+- managed profile view generation
+- provider normalization and masking
+- runtime drift helpers
+- backup list helpers
+
+### 2. App Suite
+
+Status: PASS
+
+Focus:
+
+- list/current/status
+- add/edit/show/remove
+- import/export
+- switch/login/rollback
+- setup
+- doctor
+- lock conflict and rollback behavior
+
+### 3. CLI Suite
+
+Status: PASS
+
+Focus:
+
+- arg parsing
+- help rendering
+- JSON success/failure envelopes
+- interactive add/edit/remove/import/export/rollback/setup flows
+- config commands
+
+### 4. Dev Sandbox Suite
+
+Status: PASS
+
+Fixture:
+
+- `dev-codex/local-sandbox`
+
+Validated with the built CLI command dispatcher against the real development fixture:
+
+- `list --json`
+- `current --json`
+- `status --json`
+- `config show --json`
+- `backups list --json`
+- `doctor --json`
+
+Observed state during test:
+
+- active profile: `packycode`
+- managed providers: `freemodel`, `packycode`
+- status issues: `0`
+- backups found: `>= 1`
+
+### 5. End-to-End Suite
+
+Status: PASS
+
+Fixture strategy:
+
+- copy `dev-codex/local-sandbox` into a temp directory
+- run write commands against the temp copy
+- keep the repository fixture unchanged
+
+Validated flows:
+
+- `switch freemodel` updates active profile and refreshes `auth.json`
+- `rollback` restores `config.toml` and `auth.json`
+- `add` creates a provider in `providers.json`
+- `edit` updates note and tags
+- `remove --force` deletes a non-active provider
+- `add --create-profile` creates a managed profile section in `config.toml` when a same-named `[model_providers.*]` runtime section already exists
+- destructive removal of the active provider fails with `PROFILE_IN_USE`
+- `import --merge` replaces overlapping providers and keeps merged state valid
+- `export` writes a valid providers file
+- `backups list` skips corrupt backup folders with warnings
+- `rollback missing-backup` fails with `BACKUP_NOT_FOUND`
+- corrupt `backups/latest.json` fails with `ROLLBACK_FAILED`
+- `setup` adopt flow works through CLI dispatch with mocked Codex CLI availability
+
+Validated mixed workflows:
+
+- `add -> switch -> edit -> show -> config show -> export -> rollback`
+- `import --merge -> switch --no-login -> remove -> doctor -> backups list -> rollback <backup-id>`
+
+## Release Confidence
+
+Current confidence for `0.0.5`: medium-high.
+
+Why:
+
+- core read and write workflows now have automated coverage
+- the development fixture is exercised directly by the built CLI
+- backup/rollback behavior is covered by both existing and new tests
+
+## Residual Risks
+
+- `setup` is not yet covered as a true subprocess end-to-end command because it depends on interactive adopt input and external `codex` availability
+- `rollback-latest` still has no direct dedicated test case even though `rollback` coverage is strong
+- `README.md` still shows version `0.0.4` in the documentation text and should be updated separately
+
+## Recommended Pre-Release Checklist
+
+Before the next publish:
+
+- run `npm test`
+- run a manual smoke check of `node dist/cli.js --help`
+- run one real local `switch --no-login` against a temp `--codex-dir`
+- update user-facing docs if the package version changes

package/docs/testing.md

@@ -0,0 +1,131 @@
+# Testing Guide
+
+`codex-switch` now has four test layers:
+
+- `tests/domain.spec.js`: pure domain/unit coverage
+- `tests/app.spec.js`: file-backed application integration coverage
+- `tests/cli.spec.js`: CLI dispatch and prompt simulation coverage
+- `tests/dev-sandbox.spec.js`: real `node dist/cli.js` read-only smoke tests against `dev-codex/local-sandbox`
+- `tests/e2e.spec.js`: write-command regression tests against temporary copies of `dev-codex/local-sandbox`
+
+## Commands
+
+Build the CLI:
+
+```bash
+npm run build
+```
+
+Run the full suite:
+
+```bash
+npm test
+```
+
+Run a single suite manually:
+
+```bash
+node -e "require('./tests/dev-sandbox.spec').run()"
+node -e "require('./tests/e2e.spec').run()"
+```
+
+## Development Fixture
+
+The repository fixture lives at:
+
+```text
+dev-codex/local-sandbox/
+```
+
+It is used in two different ways:
+
+- read-only dispatcher tests point at it directly
+- mutation tests copy it into a temporary directory before running writes
+
+Do not point destructive automation directly at `dev-codex/local-sandbox` unless you intentionally want to update the fixture.
+
+## Read-Only Smoke Tests
+
+`tests/dev-sandbox.spec.js` verifies the built CLI against the real development fixture.
+
+Covered commands:
+
+- `list --json`
+- `current --json`
+- `status --json`
+- `config show --json`
+- `backups list --json`
+- `doctor --json`
+
+These tests check two execution styles:
+
+- development default resolution with `NODE_ENV=development`
+- explicit `--codex-dir dev-codex/local-sandbox`
+
+This is the fastest way to validate that `0.0.x` builds still read the repo sandbox correctly.
+
+## Mutation Regression Tests
+
+`tests/e2e.spec.js` uses `fs.cpSync()` to clone `dev-codex/local-sandbox` into a temp directory, then exercises the real CLI command dispatcher against the copy.
+
+Covered write scenarios:
+
+- `switch` with login and backup creation
+- `rollback` restoring `config.toml` and `auth.json`
+- `add`, `edit`, `remove`
+- `add --create-profile`
+- blocking destructive remove of the active profile provider
+- `import --merge`
+- `export`
+- `backups list` with corrupt backup entries
+- `rollback <missing-id>`
+- corrupt `backups/latest.json`
+
+It also includes mixed workflow scenarios where multiple commands operate on the same sandbox copy end-to-end, for example:
+
+- `add -> switch -> edit -> show -> config show -> export -> rollback`
+- `import --merge -> switch --no-login -> remove -> doctor -> backups list -> rollback <backup-id>`
+
+The setup flow is covered with `executeCommand()` plus mocked Codex CLI checks because `setup` currently depends on external `codex --version` availability and interactive adopt input.
+
+## Fixture Rules
+
+- Prefer `--codex-dir <temp-copy>` for all write tests.
+- Prefer `--json` when assertions need stable output.
+- Treat `show --json` output as sensitive because it includes unmasked API keys.
+- If a test needs `codex login` or `codex --version`, prefer mocking the spawn layer.
+- Keep fixture assertions focused on stable data such as provider names, active profile, backup count, and typed error codes.
+
+## Reporting Template
+
+Use this template for release checks:
+
+```text
+Version under test: 0.0.x
+Build: PASS/FAIL
+Suite results:
+- domain: PASS/FAIL
+- app: PASS/FAIL
+- cli: PASS/FAIL
+- dev-sandbox: PASS/FAIL
+- e2e: PASS/FAIL
+
+Read-only smoke checks:
+- list/current/status/config/backups/doctor
+
+Mutation checks:
+- switch/rollback/add/edit/remove/import/export/setup
+
+Open risks:
+- <risk 1>
+- <risk 2>
+```
+
+## Current Gaps
+
+Known areas that still deserve more coverage:
+
+- true subprocess coverage for `setup`
+- explicit tests for `rollback-latest`
+- more backup corruption cases inside historical manifests
+- README and release docs should stay in sync with the package version

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@minniexcode/codex-switch",
-  "version": "0.0.5",
+  "version": "0.0.6",
   "description": "Local-first CLI for managing and switching Codex provider/profile configuration.",
   "license": "MIT",
   "type": "commonjs",