@databricks/appkit-ui 0.72.0 → 0.74.0

package/docs/api/appkit/Interface.RunEvalOptions.md

@@ -24,6 +24,17 @@ Stable id for the eval (e.g. its file path relative to the evals dir).
 
 ***
 
+### row?[​](#row "Direct link to row?")
+
+```ts
+optional row: DatasetRow;
+
+```
+
+Dataset row bound to `t.input`/`t.expected` for dataset-driven evals.
+
+***
+
 ### strict?[​](#strict "Direct link to strict?")
 
 ```ts
@@ -32,3 +43,14 @@ optional strict: boolean;
 ```
 
 When true, soft assertion failures also fail the eval.
+
+***
+
+### timeoutMs?[​](#timeoutms "Direct link to timeoutMs?")
+
+```ts
+optional timeoutMs: number;
+
+```
+
+Runner-level default per-eval timeout (ms). `def.timeoutMs` wins over this; when both are unset the eval runs unbounded (current behavior).

package/docs/api/appkit/Interface.RunEvalsOptions.md

@@ -160,6 +160,17 @@ Progress callback, invoked as evals are discovered, started, and finished.
 
 ***
 
+### retries?[​](#retries "Direct link to retries?")
+
+```ts
+optional retries: number;
+
+```
+
+Re-run an eval up to this many extra times when it fails on infrastructure — a thrown error/timeout (`result.error`) or a transport/agent turn failure (`result.infraFailure`). Assertion failures are never retried. Defaults to `0`.
+
+***
+
 ### rootDir?[​](#rootdir "Direct link to rootDir?")
 
 ```ts
@@ -182,6 +193,17 @@ Soft assertion failures also fail the eval.
 
 ***
 
+### tags?[​](#tags "Direct link to tags?")
+
+```ts
+optional tags: string[];
+
+```
+
+Only run evals whose `tags` intersect this list. Empty/undefined runs all. Tags live on the eval def, so filtering happens after each file is loaded.
+
+***
+
 ### timeoutMs?[​](#timeoutms "Direct link to timeoutMs?")
 
 ```ts
@@ -189,4 +211,26 @@ optional timeoutMs: number;
 
 ```
 
-Per-turn wall-clock timeout (ms) before a turn is failed. Defaults to 120s.
+Default per-eval timeout (ms): `runEval` races the whole test against it and it also caps each driver turn. A per-eval `def.timeoutMs` overrides it, and it wins over an agent's `evals.config.ts` `timeoutMs`. Unbounded when unset.
+
+***
+
+### warehouseId?[​](#warehouseid "Direct link to warehouseId?")
+
+```ts
+optional warehouseId: string;
+
+```
+
+SQL warehouse id used to read managed evaluation datasets.
+
+***
+
+### workspaceClient?[​](#workspaceclient "Direct link to workspaceClient?")
+
+```ts
+optional workspaceClient: WorkspaceClient;
+
+```
+
+Workspace client used to read managed evaluation datasets (for evals that declare `dataset`). Required alongside [warehouseId](#warehouseid) for those evals.

package/docs/api/appkit/Interface.TestContext.md

@@ -4,6 +4,28 @@ The `t` context passed to an eval's `test` function.
 
 ## Properties[​](#properties "Direct link to Properties")
 
+### expected[​](#expected "Direct link to expected")
+
+```ts
+readonly expected: Record<string, unknown> | undefined;
+
+```
+
+The current dataset row's `expectations` (ground truth / guidelines), or `undefined` when the row has none or the eval isn't dataset-driven.
+
+***
+
+### input[​](#input "Direct link to input")
+
+```ts
+readonly input: Record<string, unknown>;
+
+```
+
+The current dataset row's `inputs` when the eval is dataset-driven (see [EvalDefinition.dataset](./docs/api/appkit/Interface.EvalDefinition.md#dataset)); `{}` for a plain single-run eval.
+
+***
+
 ### judge[​](#judge "Direct link to judge")
 
 ```ts
@@ -15,7 +37,7 @@ judge: {
 
 ```
 
-LLM-as-judge scoring of the last reply (via autoevals → a Databricks judge model). Each returns a scored, soft-by-default assertion; chain `.atLeast(n)` to set the pass threshold or `.gate()` to make it a hard gate. Requires the judge to be configured (`--judge-model`).
+LLM-as-judge scoring of the last reply (via autoevals → a Databricks judge model). Each returns a scored assertion that gates by default (a miss fails the eval); chain `.atLeast(n)` to change the pass threshold or `.soft()` to demote to a tracked-only metric. Requires the judge to be configured (`--judge-model`).
 
 #### closedQA()[​](#closedqa "Direct link to closedQA()")
 
@@ -130,6 +152,28 @@ Assert a tool was called during the run (gate by default).
 
 ***
 
+### calledToolWith()[​](#calledtoolwith "Direct link to calledToolWith()")
+
+```ts
+calledToolWith(name: string, expected: Record<string, unknown>): AssertionHandle;
+
+```
+
+Assert a tool was called with arguments that deep-contain `expected`: every key in `expected` must equal the actual argument (recursively for nested objects; arrays match element-for-element), so extra arguments are ignored. Gate by default.
+
+#### Parameters[​](#parameters-4 "Direct link to Parameters")
+
+| Parameter  | Type                          |
+| ---------- | ----------------------------- |
+| `name`     | `string`                      |
+| `expected` | `Record`<`string`, `unknown`> |
+
+#### Returns[​](#returns-4 "Direct link to Returns")
+
+[`AssertionHandle`](./docs/api/appkit/Interface.AssertionHandle.md)
+
+***
+
 ### check()[​](#check "Direct link to check()")
 
 ```ts
@@ -139,19 +183,34 @@ check(value: string, matcher: Matcher): AssertionHandle;
 
 Assert a value against a matcher, e.g. `t.check(t.reply, includes("Sunny"))`.
 
-#### Parameters[​](#parameters-4 "Direct link to Parameters")
+#### Parameters[​](#parameters-5 "Direct link to Parameters")
 
 | Parameter | Type                                                      |
 | --------- | --------------------------------------------------------- |
 | `value`   | `string`                                                  |
 | `matcher` | [`Matcher`](./docs/api/appkit/TypeAlias.Matcher.md) |
 
-#### Returns[​](#returns-4 "Direct link to Returns")
+#### Returns[​](#returns-5 "Direct link to Returns")
 
 [`AssertionHandle`](./docs/api/appkit/Interface.AssertionHandle.md)
 
 ***
 
+### reset()[​](#reset "Direct link to reset()")
+
+```ts
+reset(): void;
+
+```
+
+Start a fresh conversation: the next `send` opens a new thread with no history. Use to run several independent one-shot checks in one test. Consecutive `send`s (without a `reset`) stay in one multi-turn conversation.
+
+#### Returns[​](#returns-6 "Direct link to Returns")
+
+`void`
+
+***
+
 ### send()[​](#send "Direct link to send()")
 
 ```ts
@@ -161,13 +220,13 @@ send(message: string): Promise<void>;
 
 Send a user message to the agent and capture its response.
 
-#### Parameters[​](#parameters-5 "Direct link to Parameters")
+#### Parameters[​](#parameters-6 "Direct link to Parameters")
 
 | Parameter | Type     |
 | --------- | -------- |
 | `message` | `string` |
 
-#### Returns[​](#returns-5 "Direct link to Returns")
+#### Returns[​](#returns-7 "Direct link to Returns")
 
 `Promise`<`void`>
 
@@ -182,13 +241,13 @@ skip(reason?: string): never;
 
 Skip this eval with an optional reason.
 
-#### Parameters[​](#parameters-6 "Direct link to Parameters")
+#### Parameters[​](#parameters-7 "Direct link to Parameters")
 
 | Parameter | Type     |
 | --------- | -------- |
 | `reason?` | `string` |
 
-#### Returns[​](#returns-6 "Direct link to Returns")
+#### Returns[​](#returns-8 "Direct link to Returns")
 
 `never`
 
@@ -203,6 +262,6 @@ succeeded(): AssertionHandle;
 
 Assert the last turn completed successfully (gate by default).
 
-#### Returns[​](#returns-7 "Direct link to Returns")
+#### Returns[​](#returns-9 "Direct link to Returns")
 
 [`AssertionHandle`](./docs/api/appkit/Interface.AssertionHandle.md)

package/docs/api/appkit/TypeAlias.DatabaseApiConfig.md

@@ -0,0 +1,53 @@
+# Type Alias: DatabaseApiConfig\<TSchema>
+
+```ts
+type DatabaseApiConfig<TSchema> = 
+  | boolean
+  | {
+  tables?: readonly SchemaTableName<TSchema>[];
+  writes?: DatabaseApiWritesConfig<TSchema>;
+};
+
+```
+
+Full generated CRUD for every declared table by default. Set false to disable all generated routes, or use an object to restrict tables and writes. Keyed routes require a public primary key; upsert stays programmatic. Route names must start with a letter, contain only letters, digits, `_`, or `-`, be at most 64 characters, and be unique ignoring case. Invalid names fail setup; exclude internal tables with `api.tables` or use `api: false`.
+
+Routes run as the app's service principal and apply no per-user filter, so anyone the app admits receives every enabled operation. An exposed table also becomes includable from its neighbours; a relation whose target stays off cannot be included.
+
+Text filters accept caller-supplied `like`/`ilike` patterns; a server-side `statement_timeout` cancels a pattern that would otherwise hold its pooled connection to completion.
+
+## Type Parameters[​](#type-parameters "Direct link to Type Parameters")
+
+| Type Parameter                                                              |
+| --------------------------------------------------------------------------- |
+| `TSchema` *extends* [`Schema`](./docs/api/appkit/Interface.Schema.md) |
+
+## Type Declaration[​](#type-declaration "Direct link to Type Declaration")
+
+`boolean`
+
+```ts
+{
+  tables?: readonly SchemaTableName<TSchema>[];
+  writes?: DatabaseApiWritesConfig<TSchema>;
+}
+
+```
+
+### tables?[​](#tables "Direct link to tables?")
+
+```ts
+readonly optional tables: readonly SchemaTableName<TSchema>[];
+
+```
+
+Tables that remain exposed. Defaults to every declared table.
+
+### writes?[​](#writes "Direct link to writes?")
+
+```ts
+readonly optional writes: DatabaseApiWritesConfig<TSchema>;
+
+```
+
+All writes by default. Set false for read-only routes.

package/docs/api/appkit/TypeAlias.DatabaseApiWriteOperation.md

@@ -0,0 +1,8 @@
+# Type Alias: DatabaseApiWriteOperation
+
+```ts
+type DatabaseApiWriteOperation = "create" | "update" | "delete";
+
+```
+
+Generated HTTP write operations.

package/docs/api/appkit/TypeAlias.DatabaseApiWritesConfig.md

@@ -0,0 +1,49 @@
+# Type Alias: DatabaseApiWritesConfig\<TSchema>
+
+```ts
+type DatabaseApiWritesConfig<TSchema> = 
+  | boolean
+  | {
+  operations?: readonly DatabaseApiWriteOperation[];
+  tables?: readonly SchemaTableName<TSchema>[];
+};
+
+```
+
+All writes by default; false keeps reads only, and an object narrows writes.
+
+## Type Parameters[​](#type-parameters "Direct link to Type Parameters")
+
+| Type Parameter                                                              |
+| --------------------------------------------------------------------------- |
+| `TSchema` *extends* [`Schema`](./docs/api/appkit/Interface.Schema.md) |
+
+## Type Declaration[​](#type-declaration "Direct link to Type Declaration")
+
+`boolean`
+
+```ts
+{
+  operations?: readonly DatabaseApiWriteOperation[];
+  tables?: readonly SchemaTableName<TSchema>[];
+}
+
+```
+
+### operations?[​](#operations "Direct link to operations?")
+
+```ts
+readonly optional operations: readonly DatabaseApiWriteOperation[];
+
+```
+
+Operations that remain enabled. Defaults to create, update, and delete.
+
+### tables?[​](#tables "Direct link to tables?")
+
+```ts
+readonly optional tables: readonly SchemaTableName<TSchema>[];
+
+```
+
+Tables that remain writable. Defaults to every exposed table.

package/docs/api/appkit/TypeAlias.DatabaseExports.md

@@ -26,9 +26,9 @@ transaction<T>(callback: (tx: TransactionClient) => Promise<T>): Promise<T>;
 
 #### Parameters[​](#parameters "Direct link to Parameters")
 
-| Parameter  | Type                                          |
-| ---------- | --------------------------------------------- |
-| `callback` | (`tx`: `TransactionClient`) => `Promise`<`T`> |
+| Parameter  | Type                                                                                                    |
+| ---------- | ------------------------------------------------------------------------------------------------------- |
+| `callback` | (`tx`: [`TransactionClient`](./docs/api/appkit/TypeAlias.TransactionClient.md)) => `Promise`<`T`> |
 
 #### Returns[​](#returns "Direct link to Returns")
 

package/docs/api/appkit/TypeAlias.EntityHooks.md

@@ -0,0 +1,25 @@
+# Type Alias: EntityHooks\<TTable>
+
+```ts
+type EntityHooks<TTable> = EntityMutationHooks<TTable> & {
+  serialize?: ReadSerializer;
+};
+
+```
+
+Response shaping and mutation lifecycle declared for one table.
+
+## Type Declaration[​](#type-declaration "Direct link to Type Declaration")
+
+### serialize?[​](#serialize "Direct link to serialize?")
+
+```ts
+readonly optional serialize: ReadSerializer;
+
+```
+
+## Type Parameters[​](#type-parameters "Direct link to Type Parameters")
+
+| Type Parameter              | Default type |
+| --------------------------- | ------------ |
+| `TTable` *extends* `string` | `string`     |

package/docs/api/appkit/TypeAlias.IDatabaseConfig.md

@@ -2,8 +2,8 @@
 
 ```ts
 type IDatabaseConfig<TSchema> = {
-  crudRoutes?: CrudRoutesConfig<TSchema>;
-  hooks?: { readonly [TTable in SchemaTableName<TSchema>]?: { serialize?: ReadSerializer } };
+  api?: DatabaseApiConfig<TSchema>;
+  hooks?: { readonly [TTable in SchemaTableName<TSchema>]?: EntityHooks<TTable> };
   schema: TSchema;
 };
 
@@ -19,10 +19,21 @@ Configuration for one schema-bound DatabasePlugin instance.
 
 ## Properties[​](#properties "Direct link to Properties")
 
-### crudRoutes?[​](#crudroutes "Direct link to crudRoutes?")
+### api?[​](#api "Direct link to api?")
 
 ```ts
-readonly optional crudRoutes: CrudRoutesConfig<TSchema>;
+readonly optional api: DatabaseApiConfig<TSchema>;
+
+```
+
+Generated HTTP CRUD is enabled for all tables by default, using the app's service principal. Every admitted caller receives the enabled operations; no per-user or per-row authorization is applied. This plugin does not support OBO. Use custom routes for application-specific authorization.
+
+Set `false` to disable routes, `{ writes: false }` for reads only, or `{ tables: ["notes"] }` to expose only selected tables. To disable delete, use `{ writes: { operations: ["create", "update"] } }`.
+
+#### Default Value[​](#default-value "Direct link to Default Value")
+
+```ts
+true
 
 ```
 
@@ -31,7 +42,7 @@ readonly optional crudRoutes: CrudRoutesConfig<TSchema>;
 ### hooks?[​](#hooks "Direct link to hooks?")
 
 ```ts
-readonly optional hooks: { readonly [TTable in SchemaTableName<TSchema>]?: { serialize?: ReadSerializer } };
+readonly optional hooks: { readonly [TTable in SchemaTableName<TSchema>]?: EntityHooks<TTable> };
 
 ```
 

package/docs/api/appkit/TypeAlias.ReadSerializer.md

@@ -0,0 +1,19 @@
+# Type Alias: ReadSerializer()
+
+```ts
+type ReadSerializer = (row: Record<string, unknown>, context: ReadSerializerContext) => Record<string, unknown>;
+
+```
+
+Shape one already private-safe row before it reaches the wire. A `Promise` is not assignable to the return type, so an async callback fails to compile: serializers run inside the response path and must not add latency there.
+
+## Parameters[​](#parameters "Direct link to Parameters")
+
+| Parameter | Type                                                                                  |
+| --------- | ------------------------------------------------------------------------------------- |
+| `row`     | `Record`<`string`, `unknown`>                                                         |
+| `context` | [`ReadSerializerContext`](./docs/api/appkit/Interface.ReadSerializerContext.md) |
+
+## Returns[​](#returns "Direct link to Returns")
+
+`Record`<`string`, `unknown`>

package/docs/api/appkit/TypeAlias.TransactionClient.md

@@ -0,0 +1,19 @@
+# Type Alias: TransactionClient
+
+```ts
+type TransactionClient = { readonly [K in EntityName]: TypedEntityClient<K> } & {
+  sql: SqlTag;
+};
+
+```
+
+Entity and SQL capabilities bound to one transaction.
+
+## Type Declaration[​](#type-declaration "Direct link to Type Declaration")
+
+### sql[​](#sql "Direct link to sql")
+
+```ts
+readonly sql: SqlTag;
+
+```