mapterrain 0.1.0 → 0.1.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +13 -0
- package/package.json +2 -2
package/README.md
CHANGED
|
@@ -215,6 +215,18 @@ Terrain is framework-agnostic and language-aware. The same analysis model applie
|
|
|
215
215
|
|
|
216
216
|
The structural model is the same. The signals and recommendations adapt to the framework and test patterns detected.
|
|
217
217
|
|
|
218
|
+
## AI Testing in CI
|
|
219
|
+
|
|
220
|
+
Terrain gives AI components the same CI safety net as regular tests:
|
|
221
|
+
|
|
222
|
+
- **Surface discovery** — automatically detects prompts, contexts, datasets, tool definitions, RAG pipelines, and eval scenarios in your code
|
|
223
|
+
- **Impact-scoped selection** — `terrain ai run --base main` runs only the eval scenarios affected by your change
|
|
224
|
+
- **Protection gaps** — `terrain pr` flags changed AI surfaces that have no eval scenario covering them
|
|
225
|
+
- **Policy enforcement** — block PRs that modify uncovered AI surfaces, regress accuracy, or trigger safety failures
|
|
226
|
+
- **GitHub Action** — drop-in `terrain-ai.yml` workflow template for AI CI gates
|
|
227
|
+
|
|
228
|
+
The same structural graph that powers test selection for regular code also traces AI surface dependencies, so a change to a prompt template triggers the right eval scenarios automatically.
|
|
229
|
+
|
|
218
230
|
## How CI Optimization Emerges
|
|
219
231
|
|
|
220
232
|
Terrain does not start with CI optimization. It starts with understanding.
|
|
@@ -225,6 +237,7 @@ When you run `terrain analyze`, Terrain builds a structural model: which tests e
|
|
|
225
237
|
- **Redundancy reduction** — `terrain insights` surfaces duplicate test clusters. Removing or consolidating them directly reduces CI time without reducing coverage.
|
|
226
238
|
- **Fanout control** — High-fanout fixtures that trigger thousands of tests on any change are identified and prioritized for splitting.
|
|
227
239
|
- **Confidence-based runs** — Impact analysis assigns confidence scores. CI pipelines can run high-confidence tests immediately and defer low-confidence tests to nightly runs.
|
|
240
|
+
- **What to test next** — `terrain insights` ranks untested source files by dependency count, telling you which test to write first for maximum impact.
|
|
228
241
|
|
|
229
242
|
The result is faster CI that comes from *understanding the test system*, not from skipping tests and hoping for the best.
|
|
230
243
|
|
package/package.json
CHANGED