@grepr/cli 1.11.5-1b47e00 → 1.11.5-20d1a69

package/build/dist/docs-index/0137d948-f97e-4803-8acc-a926ce5e5f2c.txt

@@ -0,0 +1,14 @@
+# PromotionPolicyAttributeInclude
+
+**Type**: `object`
+
+## Properties
+
+- name: numeric (optional)
+  type: boolean
+
+- name: path (required)
+  type: string
+
+- name: prefix (optional)
+  type: boolean

package/build/dist/docs-index/{b566d70c-1cc3-4189-8b9f-5cbb552c1d3b.txt → 049c0ecd-523e-43c2-9d74-cd8a765fce9a.txt}

@@ -4,8 +4,6 @@
 
 **Operation ID**: `update_1`
 **Summary**: Update an organization skill
-## Tags
-- Skills
 ## Parameters
 
 - **id** (required) - path

package/build/dist/docs-index/{db1d562e-565a-4277-8f06-86f904b92e96.txt → 0b330b22-b9df-4080-9afa-06acdbbd9524.txt}

@@ -4,8 +4,6 @@
 
 **Operation ID**: `create_2`
 **Summary**: Create an organization skill
-## Tags
-- Skills
 ## Request Body
 
 **Content-Type**: `application/json`

package/build/dist/docs-index/34f2e299-7eb7-43c1-aea2-0be9688433fb.txt

@@ -0,0 +1,23 @@
+# PromotedTag
+
+Tag keys the table indexes, with the policy applied to each.
+
+**Type**: `object`
+
+## Properties
+
+- name: column (required)
+  type: string
+  description: The t_ index column for the key.
+
+- name: excluded (required)
+  type: boolean
+  description: Whether the stored policy leaves this key's column NULL.
+
+- name: key (required)
+  type: string
+  description: The tag key this column indexes.
+
+- name: protection (optional)
+  type: enum: `REQUIRED`, `PARTITION_SOURCE`
+  description: Why the key cannot be excluded: REQUIRED for service and host, PARTITION_SOURCE for a key the live partition spec buckets on. Absent when it can be.

package/build/dist/docs-index/4d12717a-ea53-4ac4-9783-7278633fd018.txt

@@ -0,0 +1,43 @@
+# Replace a dataset table promotion policy
+
+**PUT** `/v1/datasets/{id}/tables/{tableKey}/promotion`
+
+**Operation ID**: `putTablePromotion`
+**Summary**: Replace a dataset table promotion policy
+Validates and stores the complete promotion policy on the table. Newly included tag columns are added synchronously before the request returns, in the same commit as the policy. Send back the revision the policy was read at to be refused rather than overwrite a change made since; omit it to replace whatever is stored.
+
+## Tags
+- Datasets
+## Parameters
+
+- **id** (required) - path
+  - Type: string
+- **tableKey** (required) - path
+  - Type: string
+
+## Request Body
+
+The complete promotion policy document. It is decoded by the same strict codec that reads the stored policy: every field is typed exactly, no unknown field is accepted at any depth, and no value is coerced. It replaces the stored policy rather than patching it, and both groups are required -- a body that omits "tags" or "attributes" is rejected, not read as a request to stop discovery for that group. The cap is the switch: send a group with "cap": 0 to stop it promoting fields it has not seen before. That does not blank the group -- the columns the table already carries keep being written, and a path is stopped by naming it in that group's exclude list. Read the current policy and send it back whole, changing only what you mean to change.
+
+**Content-Type**: `application/json`
+
+**Schema**: `PromotionPolicy`
+
+## Responses
+
+### 200
+
+The persisted promotion policy.
+
+- **Content-Type**: `application/json` / `PromotionPolicy`
+### 400
+
+Invalid promotion policy.
+
+### 404
+
+Dataset or table not found.
+
+### 409
+
+The policy changed since the revision the request was made against; read it again and reapply the change. Or the table kept changing under the request, which a running writer's own evolution can cause; retry.

package/build/dist/docs-index/51c31549-968b-4dd0-968a-30c0bd8a07bb.txt

@@ -0,0 +1,102 @@
+Learn how Grepr indexes log attributes and tags as columns in the data lake, and the rules that decide which fields each dataset indexes.
+
+# Indexed columns
+
+Grepr stores each raw log's attributes as one JSON document and its tags as a map. A search that filters on one attribute reads every log's whole attribute document to find a match.
+
+An *indexed column* removes that cost for one field. Grepr writes the field into its own column in the dataset's data lake table, so a search that filters on the field reads that column and skips the files that can't contain a match. See [The Grepr data lake](/grepr-platform/data-lake).
+
+Searches don't change. The same search returns the same results whether or not a field is indexed, and runs faster when it is.
+
+## What Grepr indexes
+
+Each dataset's raw log table has indexing settings for two groups of fields:
+
+* Attributes, named by their dotted path, such as `http.method` or `kube.pod.name`. An indexed path has a column for its value, and a path that holds numbers can also have a numeric column, so that range filters skip files too.
+* Tags, named by their key, such as `region` or `pod_name`. An indexed tag key has a column for its value.
+
+Grepr always indexes the `service` and `host` tags, whatever the settings say.
+
+For each group, you choose whether Grepr discovers new fields, which fields it always indexes, and which fields it never indexes.
+
+## Discovery \[#discovery]
+
+When discovery is on, Grepr adds a column for a new field it finds in your logs, until the group has as many columns as its *discovery cap*. Your organization sets the largest cap you can choose. The tag cap doesn't count `service` and `host`.
+
+Discovery is off for a new dataset, so until you turn it on, Grepr indexes only `service`, `host`, and the fields on the always-index lists.
+
+When discovery is on and Grepr finds a number at an indexed path, the path also gets a numeric column. A numeric column doesn't count toward the cap.
+
+Turning discovery off stops Grepr from adding columns. Columns the table already has keep being written. To stop writing a column, add the field to the never-index list.
+
+## Always index and never index \[#lists]
+
+Grepr indexes a field on an always-index list whether discovery is on or off, and whether or not the group has reached its cap. Grepr stops writing a field on a never-index list.
+
+For attribute paths:
+
+* A path matches exactly and is case-sensitive. Write the path as it appears in the log.
+* An entry that includes nested paths covers the path and every path under it, split at dots. For example, `kube` with nested paths covers `kube` and `kube.pod.name`, but not `kubernetes`. Wildcards aren't supported.
+* An always-index entry marked numeric gets its numeric column the next time a pipeline writes the path, whether or not discovery is on. Use it for values that are numbers written as strings.
+* When a path is on both lists, always index wins. To stop indexing a subtree except for one path, add the subtree to the never-index list with nested paths, and add the one path to the always-index list.
+
+For tag keys:
+
+* A key matches exactly.
+* A key can't be on both lists.
+* `service`, `host`, and any key the table is partitioned on can't be on the never-index list.
+* To partition a table on a tag key, the key must be on the always-index list, and it stays there while the table is partitioned on it.
+
+## When changes take effect
+
+A change reaches running pipelines within about a minute, without a restart. A tag key you add to the always-index list gets its column when you save, so you can partition on it immediately. An attribute path gets its column the next time a pipeline writes a log that has it.
+
+## Excluded fields and removed columns \[#excluded]
+
+Grepr doesn't drop an indexed column. When you add a field to a never-index list, Grepr stops writing the field's column for new logs, and searches read the field from the log's attributes or tags instead, so they return the same results. The column and the data already written stay in the table, and the column still counts toward the discovery cap. To have columns removed, contact <support@grepr.ai>.
+
+## Change indexing through the API
+
+Reading a table's configuration returns its indexing settings with a `revision`. To change them, send the complete settings for both groups to the promotion endpoint, which replaces what's stored. Include the `revision` you read: if the settings changed since then, the request fails with a 409 error, and you read them again before you retry. Without a `revision`, the request replaces the stored settings whatever they are. See the [Datasets specification](/apis/api-spec#tag/Datasets).
+
+## Frequently Asked Questions
+
+### What is an indexed column in Grepr?
+
+An indexed column is a log attribute path or tag key that Grepr writes into its own column in the dataset's data lake table, instead of leaving it only in the log's attribute document or tags. Searches that filter on the field read that column and skip files that can't match, which makes them faster.
+
+### Do I have to list the fields I want indexed?
+
+No, if you turn on discovery. Grepr then adds a column for each new field it finds, up to the discovery cap. Discovery is off for a new dataset. List a field on the always-index list to index it whether or not discovery is on.
+
+### Do my searches change when a field is indexed?
+
+No. The same search returns the same results whether or not a field is indexed, and runs faster when it is.
+
+### What happens when I turn discovery off?
+
+Grepr stops adding columns. Every column the table already has keeps being written, and fields on the always-index list keep their columns.
+
+### How do I stop Grepr from writing a column?
+
+Add the field to the never-index list. Turning discovery off doesn't do it, because that only stops new columns. The column stays in the table, and the data already written stays searchable.
+
+### What if an attribute path is on both the always-index and never-index lists?
+
+Always index wins. You can exclude a subtree with a nested-paths entry and keep one path inside it indexed. A tag key can't be on both lists.
+
+### When do indexing changes take effect?
+
+Within about a minute on running pipelines, without a restart. A tag key you add gets its column when you save. An attribute path you add gets its column the next time a pipeline writes a log that has it.
+
+### Can I delete an indexed column?
+
+No. Adding the field to the never-index list stops Grepr from writing it, but the column stays in the table, the data already written stays searchable, and the column still counts toward the discovery cap. Contact support\@grepr.ai if you need columns removed.
+
+### Can I stop indexing service and host?
+
+No. Grepr always indexes the service and host tags, and neither key can be on the never-index list.
+
+### What does marking an always-index path numeric do?
+
+The path gets its numeric column the next time a pipeline writes it, whether or not discovery is on. Use it for values that are numbers written as strings.

package/build/dist/docs-index/6f36742d-4bcf-47ab-98f1-0c1c7747d238.txt

@@ -0,0 +1,19 @@
+# PromotionPolicy
+
+**Type**: `object`
+
+## Properties
+
+- name: attributes (required)
+  type: `PromotionPolicyAttributes`
+
+- name: revision (optional)
+  type: integer
+  description: Which store of the table's policy this is, assigned by the server: 0 when the table has none. Echo it on a PUT to be refused with 409 if the policy changed since it was read; omit it to replace whatever is stored.
+
+- name: tags (required)
+  type: `PromotionPolicyTags`
+
+- name: v (required)
+  type: integer
+  description: Promotion policy document version.

package/build/dist/docs-index/{8a440c58-50e5-4208-8806-aff0fd138ecf.txt → 70d92683-5e4f-4596-983f-bd461d7b2c79.txt}

@@ -4,8 +4,6 @@
 
 **Operation ID**: `list_3`
 **Summary**: List skills
-## Tags
-- Skills
 ## Parameters
 
 - **query** (optional) - query

package/build/dist/docs-index/{ace089c5-36d7-4e41-aa9c-45b8cb787df7.txt → 7421de86-15fa-46fd-a3ad-11492fcd5f60.txt}

@@ -9,10 +9,6 @@ Per-table configuration overrides. Read-only here; use /datasets/{id}/{tableKey}
 - name: partitionConfig (optional)
   type: `PartitionConfig`
 
-- name: promotedTagKeys (optional)
-  type: array of string
-  description: Bare tag keys to promote to top-level columns.
-
 - name: sortFields (optional)
   type: array of `SortFieldConfig`
   description: User-chosen sort fields, in precedence order.

package/build/dist/docs-index/9fc384c5-175d-4a1f-858d-113567e546fd.txt

@@ -0,0 +1,23 @@
+# PromotedAttribute
+
+Attribute paths the table indexes, with the policy applied to each.
+
+**Type**: `object`
+
+## Properties
+
+- name: excluded (required)
+  type: boolean
+  description: Whether the stored policy leaves this path's columns NULL.
+
+- name: numeric (required)
+  type: boolean
+  description: Whether the path also has an n_ numeric index column.
+
+- name: path (required)
+  type: string
+  description: The attribute path this column indexes.
+
+- name: valueColumn (required)
+  type: string
+  description: The a_ value index column for the path.

package/build/dist/docs-index/{d6244c0a-1a80-4acb-93de-b9ac65d0fc40.txt → aaac445d-0985-4128-bb55-3ce8ffd99ec5.txt}

@@ -37,6 +37,15 @@
 - name: maxPipelines (optional)
   type: integer
 
+- name: maxPromotedAttributeColumns (optional)
+  type: integer
+
+- name: maxPromotedTagColumns (optional)
+  type: integer
+
+- name: maxPromotionPolicyEntriesPerList (optional)
+  type: integer
+
 - name: maxS3DataWarehouseIntegrations (optional)
   type: integer
 

package/build/dist/docs-index/{0e6dc09f-7923-46fe-a4ae-d417184c9929.txt → ab5b5225-9232-429f-a087-1a5748b2b6ba.txt}

@@ -4,7 +4,7 @@
 
 **Operation ID**: `getTableConfig`
 **Summary**: Get a dataset table config
-Returns the configuration for one of the dataset's tables (e.g. logs_raw), including the system-controlled effective partition spec. Body's user fields are empty when no override has been configured.
+Returns the configuration for one of the dataset's tables (e.g. logs_raw), including the system-controlled effective partition spec. Without an override, the spec's editable rows are the table's defaults.
 
 ## Tags
 - Datasets

package/build/dist/docs-index/{df6558fc-d694-48a5-87b3-5466306dec52.txt → ab6ca54e-68b4-4eb4-aed8-b6772320df98.txt}

@@ -4,8 +4,6 @@
 
 **Operation ID**: `archive`
 **Summary**: Archive an organization skill
-## Tags
-- Skills
 ## Parameters
 
 - **id** (required) - path

package/build/dist/docs-index/{fbdc8623-cfb4-4dcb-8b9c-7930583ac981.txt → ac21d645-69ab-437f-a92b-c8e619098c6f.txt}

@@ -4,8 +4,6 @@
 
 **Operation ID**: `get_3`
 **Summary**: Get a skill
-## Tags
-- Skills
 ## Parameters
 
 - **id** (required) - path