vue-iaa-metrics 1.0.0

package/README.md

@@ -0,0 +1,168 @@
+# Vue IAA Metrics
+
+A **Vue component library, distributed as an npm package**, for browsing
+per-annotator annotations and computing inter-annotator agreement (IAA)
+metrics over a shared document set. Extracted from
+[Lawnotation](https://lawnotation.org)'s task metrics page so the same UI and
+orchestration logic can be reused by other projects, decoupled from
+Lawnotation's own data model (Supabase/tRPC) and UI stack (PrimeVue/Tailwind).
+
+---
+
+## 1. What this package does
+
+Given a set of documents that one or more annotators have labelled (spans of
+text, or whole-document tags) plus a per-item confidence rating, this package:
+
+- Lets a user filter and browse the raw annotations, grouped by document.
+- Sends the whole task to an external **IAA service** (the Go tool in
+  [`lawnotation-iaa`](../lawnotation-iaa)) to compute agreement metrics —
+  span-matching precision/recall/F1 and coverage agreement (Krippendorff's α,
+  Cohen's κ) — and displays the results.
+- Lets the user download the full report as a ZIP, optionally anonymizing
+  annotator identifiers first.
+
+It does **not** talk to any backend directly. Everything — fetching filter
+options, fetching annotations, and calling the IAA service — goes through a
+single delegate interface the host implements: `MetricsSource`.
+
+---
+
+## 2. Usage
+
+```vue
+<script setup lang="ts">
+import { MetricsPage, type MetricsSource } from "vue-iaa-metrics";
+import "vue-iaa-metrics/style.css";
+
+const source: MetricsSource = {
+  /* see contract below */
+};
+</script>
+
+<template>
+  <MetricsPage
+    :source="source"
+    report-filename="my-task.zip"
+    @error="(message) => toast.error(message)"
+    @open-document="(doc) => router.push(`/documents/${doc.id}`)"
+  />
+</template>
+```
+
+### Props
+
+| Prop | Type | Notes |
+|---|---|---|
+| `source` | `MetricsSource` | Required. The data/network delegate — see below. |
+| `reportFilename` | `string` | Optional. Filename used when saving a downloaded report. Defaults to `iaa_report.zip`. |
+
+### Events
+
+| Event | Payload | Notes |
+|---|---|---|
+| `error` | `message: string` | Fired whenever a `MetricsSource` call rejects. The package has no built-in toast — hosts surface this however they like. |
+| `open-document` | `{ id: string; name: string }` | Fired when the user clicks a document header in the annotation list. Not a real `<a href>` (the package can't assume `vue-router`/Nuxt) — the host decides how to navigate. |
+
+---
+
+## 3. The `MetricsSource` contract
+
+```ts
+interface MetricsSource {
+  getLabels(): Promise<LabelOption[]> | LabelOption[];
+  getAnnotators(): Promise<string[]> | string[];
+  getDocuments(): Promise<DocumentOption[]> | DocumentOption[];
+  getAnnotations(filters: AnnotationFilters): Promise<RichAnnotation[]>;
+  getIaaInputData(): Promise<IaaInputData>;
+  computeMetrics(input: IaaInputData, params: IaaParams): Promise<IaaMetricsResponse>;
+  downloadReport(input: IaaInputData, params: IaaParams): Promise<Blob>;
+}
+```
+
+- **`getLabels` / `getAnnotators` / `getDocuments`** — populate the filter
+  dropdowns. Called once, on mount.
+- **`getAnnotations(filters)`** — the browsable, filtered annotation list.
+  `filters` arrays are empty when nothing's selected for that facet (empty
+  means "all", not "none"). Called on mount and again whenever a filter
+  changes.
+- **`getIaaInputData()`** — the *whole* task (unfiltered), in the shape the
+  IAA service expects. Called once on mount and cached for the rest of the
+  session; also where `annotation_level` is read to decide whether to show
+  the span-matching criterion/granularity toggles (hidden for document-level
+  tasks).
+- **`computeMetrics` / `downloadReport`** — **host-implemented on purpose.**
+  The IAA Go service has no CORS or auth handling (see its own README), so
+  it's never meant to be called directly from a browser. Hosts proxy it
+  through their own backend — see Lawnotation's `/api/iaa/metrics` and
+  `/api/iaa/report-zip` server routes for a reference implementation (a thin
+  `fetch` pass-through with error normalization).
+
+### `IaaInputData` (the IAA service's input schema)
+
+```json
+{
+  "labelset": { "labels": [{ "name": "Actors" }] },
+  "documents": [
+    {
+      "name": "doc_001.txt",
+      "full_text": "The full document text.",
+      "assignments": [
+        {
+          "annotator": "alice@example.com",
+          "difficulty_rating": 4,
+          "annotations": [{ "start": 4, "end": 26, "label": "Actors", "text": "..." }]
+        }
+      ]
+    }
+  ],
+  "annotation_level": "document"
+}
+```
+
+`annotation_level` is omitted for span-level tasks; `"document"` for
+whole-document tagging (no `start`/`end`, one annotation per label).
+
+### `IaaMetricsResponse` (the IAA service's output schema)
+
+See `src/types.ts` for the full shape (`IaaReport` per label —
+`span_matching` + `coverage_agreement` — plus `confidence_metrics`, a
+`DifficultyRatingSummary`). Matches the Go service's `/metrics` response
+verbatim; the package never transforms it, only renders it.
+
+---
+
+## 4. Architecture
+
+- **No backend assumptions.** `computeMetrics`/`downloadReport` are the
+  host's problem — the package doesn't know or care whether that's a proxy
+  route, a direct fetch, or something else.
+- **Self-contained UI.** Own scoped CSS + CSS custom properties
+  (`--iaa-accent`, `--iaa-border`, etc.), no PrimeVue/Tailwind/other UI-kit
+  dependency — drop it into any Vue 3 app.
+- **The IAA JSON is the contract.** `IaaInputData`/`IaaMetricsResponse` match
+  the Go service's schema exactly; hosts map their own data model into/out of
+  it (see `RichAnnotation`, `LabelOption`, `DocumentOption` for the pieces the
+  UI itself needs).
+
+---
+
+## 5. Development
+
+```bash
+pnpm install
+pnpm dev      # serves src/dev/App.vue against a mock MetricsSource
+```
+
+`src/dev/mockSource.ts` proxies `computeMetrics`/`downloadReport` straight to
+`http://localhost:8080`, so run `lawnotation-iaa` locally to exercise real
+computation:
+
+```bash
+cd ../lawnotation-iaa
+go run main.go iaa.go server.go --serve --port 8080
+```
+
+```bash
+pnpm build    # type-checks (vue-tsc) then builds dist/ in library mode
+```

package/dist/components/AnnotationCard.vue.d.ts

@@ -0,0 +1,10 @@
+import { RichAnnotation } from '../types';
+type __VLS_Props = {
+    annotation: RichAnnotation;
+    labelColor: string;
+    /** Document-level tasks have no span text to show/collapse. */
+    documentLevel: boolean;
+};
+declare const __VLS_export: import('vue').DefineComponent<__VLS_Props, {}, {}, {}, {}, import('vue').ComponentOptionsMixin, import('vue').ComponentOptionsMixin, {}, string, import('vue').PublicProps, Readonly<__VLS_Props> & Readonly<{}>, {}, {}, {}, {}, string, import('vue').ComponentProvideOptions, false, {}, any>;
+declare const _default: typeof __VLS_export;
+export default _default;

package/dist/components/AnnotationsList.vue.d.ts

@@ -0,0 +1,20 @@
+import { LabelOption, RichAnnotation } from '../types';
+type __VLS_Props = {
+    annotations: RichAnnotation[];
+    labels: LabelOption[];
+    loading: boolean;
+    documentLevel: boolean;
+};
+declare const __VLS_export: import('vue').DefineComponent<__VLS_Props, {}, {}, {}, {}, import('vue').ComponentOptionsMixin, import('vue').ComponentOptionsMixin, {
+    "open-document": (doc: {
+        id: string;
+        name: string;
+    }) => any;
+}, string, import('vue').PublicProps, Readonly<__VLS_Props> & Readonly<{
+    "onOpen-document"?: ((doc: {
+        id: string;
+        name: string;
+    }) => any) | undefined;
+}>, {}, {}, {}, {}, string, import('vue').ComponentProvideOptions, false, {}, any>;
+declare const _default: typeof __VLS_export;
+export default _default;

package/dist/components/ConfirmModal.vue.d.ts

@@ -0,0 +1,17 @@
+type __VLS_Props = {
+    title: string;
+    message: string;
+    yesLabel?: string;
+    noLabel?: string;
+};
+declare const __VLS_export: import('vue').DefineComponent<__VLS_Props, {}, {}, {}, {}, import('vue').ComponentOptionsMixin, import('vue').ComponentOptionsMixin, {
+    cancel: () => any;
+    yes: () => any;
+    no: () => any;
+}, string, import('vue').PublicProps, Readonly<__VLS_Props> & Readonly<{
+    onCancel?: (() => any) | undefined;
+    onYes?: (() => any) | undefined;
+    onNo?: (() => any) | undefined;
+}>, {}, {}, {}, {}, string, import('vue').ComponentProvideOptions, false, {}, any>;
+declare const _default: typeof __VLS_export;
+export default _default;

package/dist/components/FilterSelect.vue.d.ts

@@ -0,0 +1,20 @@
+export type FilterOption = {
+    value: string;
+    label: string;
+    color?: string;
+};
+type __VLS_Props = {
+    options: FilterOption[];
+    placeholder?: string;
+};
+type __VLS_ModelProps = {
+    modelValue: string[];
+};
+type __VLS_PublicProps = __VLS_Props & __VLS_ModelProps;
+declare const __VLS_export: import('vue').DefineComponent<__VLS_PublicProps, {}, {}, {}, {}, import('vue').ComponentOptionsMixin, import('vue').ComponentOptionsMixin, {
+    "update:modelValue": (value: string[]) => any;
+}, string, import('vue').PublicProps, Readonly<__VLS_PublicProps> & Readonly<{
+    "onUpdate:modelValue"?: ((value: string[]) => any) | undefined;
+}>, {}, {}, {}, {}, string, import('vue').ComponentProvideOptions, false, {}, any>;
+declare const _default: typeof __VLS_export;
+export default _default;

package/dist/components/LabelChip.vue.d.ts

@@ -0,0 +1,7 @@
+import { LabelOption } from '../types';
+type __VLS_Props = {
+    label: LabelOption;
+};
+declare const __VLS_export: import('vue').DefineComponent<__VLS_Props, {}, {}, {}, {}, import('vue').ComponentOptionsMixin, import('vue').ComponentOptionsMixin, {}, string, import('vue').PublicProps, Readonly<__VLS_Props> & Readonly<{}>, {}, {}, {}, {}, string, import('vue').ComponentProvideOptions, false, {}, any>;
+declare const _default: typeof __VLS_export;
+export default _default;

package/dist/components/MetricsPage.vue.d.ts

@@ -0,0 +1,21 @@
+import { MetricsSource } from '../model/source';
+type __VLS_Props = {
+    source: MetricsSource;
+    /** Filename used when saving a downloaded report. */
+    reportFilename?: string;
+};
+declare const __VLS_export: import('vue').DefineComponent<__VLS_Props, {}, {}, {}, {}, import('vue').ComponentOptionsMixin, import('vue').ComponentOptionsMixin, {
+    error: (message: string) => any;
+    "open-document": (doc: {
+        id: string;
+        name: string;
+    }) => any;
+}, string, import('vue').PublicProps, Readonly<__VLS_Props> & Readonly<{
+    onError?: ((message: string) => any) | undefined;
+    "onOpen-document"?: ((doc: {
+        id: string;
+        name: string;
+    }) => any) | undefined;
+}>, {}, {}, {}, {}, string, import('vue').ComponentProvideOptions, false, {}, any>;
+declare const _default: typeof __VLS_export;
+export default _default;

package/dist/components/ParametersColumn.vue.d.ts

@@ -0,0 +1,37 @@
+import { DocumentOption, LabelOption } from '../types';
+type __VLS_Props = {
+    labelsOptions: LabelOption[];
+    documentsOptions: DocumentOption[];
+    annotatorsOptions: string[];
+    /** Document-level tasks have no span text, so span-matching params don't apply. */
+    documentLevel: boolean;
+    computingMetrics: boolean;
+    downloading: boolean;
+};
+type __VLS_ModelProps = {
+    "selectedLabels": string[];
+    "selectedDocuments": string[];
+    "selectedAnnotators": string[];
+    "criterion": "exact" | "contained";
+    "granularity": "char" | "word";
+};
+type __VLS_PublicProps = __VLS_Props & __VLS_ModelProps;
+declare const __VLS_export: import('vue').DefineComponent<__VLS_PublicProps, {}, {}, {}, {}, import('vue').ComponentOptionsMixin, import('vue').ComponentOptionsMixin, {
+    "compute-metrics": () => any;
+    "download-all": () => any;
+    "update:selectedLabels": (value: string[]) => any;
+    "update:selectedDocuments": (value: string[]) => any;
+    "update:selectedAnnotators": (value: string[]) => any;
+    "update:criterion": (value: "exact" | "contained") => any;
+    "update:granularity": (value: "char" | "word") => any;
+}, string, import('vue').PublicProps, Readonly<__VLS_PublicProps> & Readonly<{
+    "onCompute-metrics"?: (() => any) | undefined;
+    "onDownload-all"?: (() => any) | undefined;
+    "onUpdate:selectedLabels"?: ((value: string[]) => any) | undefined;
+    "onUpdate:selectedDocuments"?: ((value: string[]) => any) | undefined;
+    "onUpdate:selectedAnnotators"?: ((value: string[]) => any) | undefined;
+    "onUpdate:criterion"?: ((value: "exact" | "contained") => any) | undefined;
+    "onUpdate:granularity"?: ((value: "char" | "word") => any) | undefined;
+}>, {}, {}, {}, {}, string, import('vue').ComponentProvideOptions, false, {}, any>;
+declare const _default: typeof __VLS_export;
+export default _default;

package/dist/components/ResultsAgreement.vue.d.ts

@@ -0,0 +1,9 @@
+import { IaaReport, LabelOption } from '../types';
+type __VLS_Props = {
+    report: IaaReport | undefined;
+    labelsOptions: LabelOption[];
+    loading: boolean;
+};
+declare const __VLS_export: import('vue').DefineComponent<__VLS_Props, {}, {}, {}, {}, import('vue').ComponentOptionsMixin, import('vue').ComponentOptionsMixin, {}, string, import('vue').PublicProps, Readonly<__VLS_Props> & Readonly<{}>, {}, {}, {}, {}, string, import('vue').ComponentProvideOptions, false, {}, any>;
+declare const _default: typeof __VLS_export;
+export default _default;

package/dist/components/ResultsConfidence.vue.d.ts

@@ -0,0 +1,8 @@
+import { DifficultyRatingSummary } from '../types';
+type __VLS_Props = {
+    results: DifficultyRatingSummary | undefined;
+    loading: boolean;
+};
+declare const __VLS_export: import('vue').DefineComponent<__VLS_Props, {}, {}, {}, {}, import('vue').ComponentOptionsMixin, import('vue').ComponentOptionsMixin, {}, string, import('vue').PublicProps, Readonly<__VLS_Props> & Readonly<{}>, {}, {}, {}, {}, string, import('vue').ComponentProvideOptions, false, {}, any>;
+declare const _default: typeof __VLS_export;
+export default _default;

package/dist/components/ResultsModal.vue.d.ts

@@ -0,0 +1,17 @@
+import { IaaMetricsResponse, LabelOption } from '../types';
+type __VLS_Props = {
+    metricResults: IaaMetricsResponse | undefined;
+    labelsOptions: LabelOption[];
+    loading: boolean;
+};
+type __VLS_ModelProps = {
+    "visible": boolean;
+};
+type __VLS_PublicProps = __VLS_Props & __VLS_ModelProps;
+declare const __VLS_export: import('vue').DefineComponent<__VLS_PublicProps, {}, {}, {}, {}, import('vue').ComponentOptionsMixin, import('vue').ComponentOptionsMixin, {
+    "update:visible": (value: boolean) => any;
+}, string, import('vue').PublicProps, Readonly<__VLS_PublicProps> & Readonly<{
+    "onUpdate:visible"?: ((value: boolean) => any) | undefined;
+}>, {}, {}, {}, {}, string, import('vue').ComponentProvideOptions, false, {}, any>;
+declare const _default: typeof __VLS_export;
+export default _default;

package/dist/components/Spinner.vue.d.ts

@@ -0,0 +1,6 @@
+type __VLS_Props = {
+    size?: number;
+};
+declare const __VLS_export: import('vue').DefineComponent<__VLS_Props, {}, {}, {}, {}, import('vue').ComponentOptionsMixin, import('vue').ComponentOptionsMixin, {}, string, import('vue').PublicProps, Readonly<__VLS_Props> & Readonly<{}>, {}, {}, {}, {}, string, import('vue').ComponentProvideOptions, false, {}, any>;
+declare const _default: typeof __VLS_export;
+export default _default;

package/dist/components/StarRating.vue.d.ts

@@ -0,0 +1,7 @@
+type __VLS_Props = {
+    value: number;
+    max?: number;
+};
+declare const __VLS_export: import('vue').DefineComponent<__VLS_Props, {}, {}, {}, {}, import('vue').ComponentOptionsMixin, import('vue').ComponentOptionsMixin, {}, string, import('vue').PublicProps, Readonly<__VLS_Props> & Readonly<{}>, {}, {}, {}, {}, string, import('vue').ComponentProvideOptions, false, {}, any>;
+declare const _default: typeof __VLS_export;
+export default _default;

package/dist/components/Toggle.vue.d.ts

@@ -0,0 +1,10 @@
+type __VLS_ModelProps = {
+    modelValue: boolean;
+};
+declare const __VLS_export: import('vue').DefineComponent<__VLS_ModelProps, {}, {}, {}, {}, import('vue').ComponentOptionsMixin, import('vue').ComponentOptionsMixin, {
+    "update:modelValue": (value: boolean) => any;
+}, string, import('vue').PublicProps, Readonly<__VLS_ModelProps> & Readonly<{
+    "onUpdate:modelValue"?: ((value: boolean) => any) | undefined;
+}>, {}, {}, {}, {}, string, import('vue').ComponentProvideOptions, false, {}, any>;
+declare const _default: typeof __VLS_export;
+export default _default;

package/dist/index.d.ts

@@ -0,0 +1,6 @@
+export { default as MetricsPage } from './components/MetricsPage.vue';
+export * from './types';
+export * from './model/source';
+export { useMetricsPage } from './model/useMetricsPage';
+export { anonymizeAnnotators } from './model/anonymize';
+export { stripAnnotatorPrefix, formatNullableFloat, sortByDocumentAndRange } from './model/format';

package/dist/model/anonymize.d.ts

@@ -0,0 +1,4 @@
+import { IaaInputData } from '../types';
+/** Replaces each annotator identifier with a sequential number (first-seen
+ * order, starting at 1) so a downloaded report doesn't contain real names. */
+export declare function anonymizeAnnotators(input: IaaInputData): IaaInputData;

package/dist/model/format.d.ts

@@ -0,0 +1,4 @@
+import { NullableFloat, RichAnnotation } from '../types';
+export declare function stripAnnotatorPrefix(annotator: string): string;
+export declare function formatNullableFloat(value: NullableFloat, digits?: number): string;
+export declare function sortByDocumentAndRange(ranges: RichAnnotation[]): void;

package/dist/model/saveBlob.d.ts

@@ -0,0 +1,2 @@
+/** Triggers a browser download for a Blob, without pulling in file-saver. */
+export declare function saveBlob(blob: Blob, filename: string): void;

package/dist/model/source.d.ts

@@ -0,0 +1,34 @@
+import { DocumentOption, IaaInputData, IaaMetricsResponse, LabelOption, RichAnnotation } from '../types';
+export type AnnotationFilters = {
+    labels: string[];
+    documents: string[];
+    annotators: string[];
+};
+export type IaaParams = {
+    criterion: "exact" | "contained";
+    granularity: "char" | "word";
+};
+/**
+ * The host's data-access contract. The package only ever asks for filter
+ * options, a filtered annotation list, the whole-task IAA input, and to
+ * compute/download a report — whether those resolve via tRPC + Supabase, a
+ * REST API, or an in-memory fixture is entirely up to the implementation.
+ *
+ * computeMetrics/downloadReport are host-implemented on purpose: the IAA Go
+ * service has no CORS or auth handling, so it's never meant to be called
+ * directly from the browser — hosts proxy it through their own backend.
+ */
+export interface MetricsSource {
+    getLabels(): Promise<LabelOption[]> | LabelOption[];
+    getAnnotators(): Promise<string[]> | string[];
+    getDocuments(): Promise<DocumentOption[]> | DocumentOption[];
+    /** The browsable, filtered annotation list for the right-hand panel. */
+    getAnnotations(filters: AnnotationFilters): Promise<RichAnnotation[]>;
+    /**
+     * The whole-task IAA input — always unfiltered, built once and cached by
+     * the package for the rest of the session (a refresh drops the cache).
+     */
+    getIaaInputData(): Promise<IaaInputData>;
+    computeMetrics(input: IaaInputData, params: IaaParams): Promise<IaaMetricsResponse>;
+    downloadReport(input: IaaInputData, params: IaaParams): Promise<Blob>;
+}

package/dist/model/useMetricsPage.d.ts

@@ -0,0 +1,65 @@
+import { DocumentOption, IaaMetricsResponse, LabelOption, RichAnnotation } from '../types';
+import { MetricsSource } from './source';
+/**
+ * Drives the metrics page's state and IAA orchestration through a
+ * MetricsSource. Owns filter/options state, the browsable annotation list,
+ * the cached whole-task IAA input, and the Compute Metrics / Download All
+ * flows — the view layer only renders what this exposes.
+ */
+export declare function useMetricsPage(source: MetricsSource, onError: (message: string) => void): {
+    loading: import('vue').ComputedRef<boolean>;
+    labelsOptions: import('vue').Ref<{
+        name: string;
+        color: string;
+    }[], LabelOption[] | {
+        name: string;
+        color: string;
+    }[]>;
+    documentsOptions: import('vue').Ref<{
+        value: string;
+        label: string;
+    }[], DocumentOption[] | {
+        value: string;
+        label: string;
+    }[]>;
+    annotatorsOptions: import('vue').Ref<string[], string[]>;
+    selectedLabels: import('vue').Ref<string[], string[]>;
+    selectedDocuments: import('vue').Ref<string[], string[]>;
+    selectedAnnotators: import('vue').Ref<string[], string[]>;
+    criterion: import('vue').Ref<"exact" | "contained", "exact" | "contained">;
+    granularity: import('vue').Ref<"char" | "word", "char" | "word">;
+    isDocumentLevel: import('vue').ComputedRef<boolean>;
+    annotations: import('vue').Ref<{
+        start: number;
+        end: number;
+        text: string;
+        label: string;
+        annotator: string;
+        ann_id: number;
+        doc_id: string;
+        doc_name?: string | undefined;
+        confidence: number;
+        metadata?: string | undefined;
+    }[], RichAnnotation[] | {
+        start: number;
+        end: number;
+        text: string;
+        label: string;
+        annotator: string;
+        ann_id: number;
+        doc_id: string;
+        doc_name?: string | undefined;
+        confidence: number;
+        metadata?: string | undefined;
+    }[]>;
+    loadingAnnotations: import('vue').Ref<boolean, boolean>;
+    metricsModalVisible: import('vue').Ref<boolean, boolean>;
+    metricsResult: import('vue').Ref<IaaMetricsResponse | undefined, IaaMetricsResponse | undefined>;
+    computingMetrics: import('vue').Ref<boolean, boolean>;
+    computeMetrics: () => Promise<void>;
+    anonymizeConfirmVisible: import('vue').Ref<boolean, boolean>;
+    resolveAnonymizeConfirm: (choice: boolean | undefined) => void;
+    downloadReport: (filename?: string) => Promise<void>;
+    downloading: import('vue').Ref<boolean, boolean>;
+    init: () => Promise<void>;
+};

package/dist/types.d.ts

@@ -0,0 +1,95 @@
+export type IaaAnnotation = {
+    start: number;
+    end: number;
+    label: string;
+    text: string;
+};
+export type IaaAssignment = {
+    annotator: string;
+    difficulty_rating: number;
+    annotations: IaaAnnotation[];
+};
+export type IaaDocument = {
+    name: string;
+    full_text: string;
+    assignments: IaaAssignment[];
+};
+export type IaaInputData = {
+    labelset: {
+        labels: {
+            name: string;
+        }[];
+    };
+    documents: IaaDocument[];
+    /** Omitted for span-level tasks; "document" for whole-document tagging. */
+    annotation_level?: "document";
+};
+export type NullableFloat = number | null;
+export type PairResult = {
+    true_positives: number;
+    ref_span_count: number;
+    sys_span_count: number;
+    documents_compared: number;
+    precision: NullableFloat;
+    recall: NullableFloat;
+    f1: NullableFloat;
+};
+export type SpanMatchingSummary = {
+    macro_f1: NullableFloat;
+    pairs: Record<string, Record<string, PairResult>> | null;
+};
+export type CoverageAgreement = {
+    matrix_items: number;
+    krippendorff_alpha: NullableFloat;
+    cohen_kappa_pairs: Record<string, NullableFloat>;
+};
+export type LabelResult = {
+    span_counts_per_annotator: Record<string, number>;
+    span_matching: SpanMatchingSummary;
+    coverage_agreement: CoverageAgreement;
+};
+export type IaaMeta = {
+    input_file: string;
+    annotation_level: string;
+    criterion: string;
+    granularity: string;
+    annotators: string[];
+    num_documents: number;
+    notes: Record<string, string>;
+};
+export type IaaReport = {
+    meta: IaaMeta;
+    per_label: Record<string, LabelResult>;
+};
+export type DifficultyRatingSummary = {
+    total: number;
+    rated: number;
+    mean: NullableFloat;
+    counts: Record<string, number>;
+    krippendorff_alpha: NullableFloat;
+    krippendorff_alpha_pairs: Record<string, NullableFloat>;
+};
+export type IaaMetricsResponse = {
+    annotation_metrics: IaaReport;
+    confidence_metrics: DifficultyRatingSummary;
+};
+export type RichAnnotation = {
+    start: number;
+    end: number;
+    text: string;
+    label: string;
+    annotator: string;
+    ann_id: number;
+    doc_id: string;
+    doc_name?: string;
+    confidence: number;
+    metadata?: string;
+};
+export type LabelOption = {
+    name: string;
+    color: string;
+};
+export type DocumentOption = {
+    value: string;
+    label: string;
+};

package/dist/vue-iaa-metrics.css

@@ -0,0 +1 @@
+.filter-select[data-v-d4862aa0]{position:relative;width:100%}.filter-select__control[data-v-d4862aa0]{display:flex;align-items:center;gap:.4rem;width:100%;font:inherit;font-size:.85rem;padding:.4rem .55rem;border:1px solid var(--iaa-border, rgba(0, 0, 0, .15));border-radius:6px;background:#fff;cursor:pointer;text-align:left}.filter-select__summary[data-v-d4862aa0]{flex:1;min-width:0;overflow:hidden;text-overflow:ellipsis;white-space:nowrap}.filter-select__summary--placeholder[data-v-d4862aa0]{color:var(--iaa-muted, #6b7280)}.filter-select__caret[data-v-d4862aa0]{color:var(--iaa-muted, #6b7280);font-size:.7rem}.filter-select__swatch[data-v-d4862aa0]{width:.7rem;height:.7rem;border-radius:3px;flex-shrink:0}.filter-select__panel[data-v-d4862aa0]{position:absolute;top:calc(100% + .25rem);left:0;right:0;z-index:20;background:#fff;border:1px solid var(--iaa-border, rgba(0, 0, 0, .15));border-radius:6px;box-shadow:0 6px 20px #00000026;max-height:16rem;display:flex;flex-direction:column}.filter-select__filter[data-v-d4862aa0]{font:inherit;font-size:.82rem;padding:.4rem .55rem;border:none;border-bottom:1px solid var(--iaa-border, rgba(0, 0, 0, .15))}.filter-select__filter[data-v-d4862aa0]:focus{outline:none}.filter-select__options[data-v-d4862aa0]{list-style:none;margin:0;padding:.25rem;overflow-y:auto}.filter-select__option[data-v-d4862aa0]{display:flex;align-items:center;gap:.4rem;padding:.3rem .4rem;border-radius:4px;cursor:pointer;font-size:.82rem}.filter-select__option[data-v-d4862aa0]:hover{background:#0000000d}.filter-select__option-label[data-v-d4862aa0]{overflow:hidden;text-overflow:ellipsis;white-space:nowrap}.filter-select__empty[data-v-d4862aa0]{padding:.5rem;font-size:.8rem;color:var(--iaa-muted, #6b7280)}.toggle[data-v-56d850bf]{position:relative;width:2.2rem;height:1.2rem;border-radius:999px;border:none;background:var(--iaa-border, rgba(0, 0, 0, .15));cursor:pointer;padding:0;flex-shrink:0;transition:background .15s ease}.toggle--on[data-v-56d850bf]{background:var(--iaa-accent, #1e4e79)}.toggle__knob[data-v-56d850bf]{position:absolute;top:2px;left:2px;width:1rem;height:1rem;border-radius:50%;background:#fff;box-shadow:0 1px 2px #00000059;transition:transform .15s ease}.toggle--on .toggle__knob[data-v-56d850bf]{transform:translate(1rem)}.params[data-v-72d0b699]{display:flex;flex-direction:column;gap:1rem;font-size:.85rem}.params__title[data-v-72d0b699]{display:flex;align-items:center;gap:.3rem;margin:0 0 .6rem;font-size:.72rem;font-weight:700;text-transform:uppercase;letter-spacing:.03em;color:var(--iaa-muted, #6b7280)}.params__info[data-v-72d0b699]{cursor:help;color:var(--iaa-muted, #6b7280);font-size:.8rem}.params__field[data-v-72d0b699]{margin-bottom:.6rem}.params__label[data-v-72d0b699]{display:block;margin-bottom:.3rem;font-size:.82rem;font-weight:600}.params__divider[data-v-72d0b699]{border:none;border-top:1px solid var(--iaa-border, rgba(0, 0, 0, .15));margin:0}.params__toggles[data-v-72d0b699]{margin-bottom:.75rem}.params__toggle-row[data-v-72d0b699]{display:flex;align-items:center;gap:.5rem;margin-bottom:.6rem}.params__toggle-label[data-v-72d0b699]{font-size:.82rem;font-weight:600;min-width:4.2rem}.params__toggle-label--right[data-v-72d0b699]{text-align:right}.params__btn[data-v-72d0b699]{display:block;width:100%;font:inherit;font-size:.85rem;font-weight:600;padding:.5rem;border-radius:6px;border:1px solid var(--iaa-accent, #1e4e79);cursor:pointer;margin-top:.5rem}.params__btn[data-v-72d0b699]:disabled{opacity:.5;cursor:default}.params__btn--primary[data-v-72d0b699]{background:var(--iaa-accent, #1e4e79);color:#fff}.params__btn--outline[data-v-72d0b699]{background:transparent;color:var(--iaa-accent, #1e4e79)}.chip[data-v-a86af93f]{display:inline-block;max-width:100%;padding:.15rem .55rem;border-radius:4px;font-size:.8rem;white-space:nowrap;overflow:hidden;text-overflow:ellipsis;vertical-align:middle}.stars[data-v-c5894f0c]{display:inline-flex;gap:1px;line-height:1}.star[data-v-c5894f0c]{color:var(--iaa-star-empty, #d2cece);font-size:.9em}.star--on[data-v-c5894f0c]{color:var(--iaa-star-on, #f5b301)}.ann-card[data-v-5bca2986]{border:1px solid var(--iaa-border, rgba(0, 0, 0, .15));border-radius:8px;margin-bottom:.5rem;overflow:hidden}.ann-card__header[data-v-5bca2986]{display:flex;align-items:center;gap:.5rem;width:100%;font:inherit;padding:.5rem .6rem;background:#fff;border:none;text-align:left}.ann-card__header--clickable[data-v-5bca2986]{cursor:pointer}.ann-card__header--clickable[data-v-5bca2986]:hover{background:#00000008}.ann-card__meta[data-v-5bca2986]{display:flex;align-items:center;gap:.4rem;font-size:.75rem;color:var(--iaa-muted, #6b7280);overflow:hidden}.ann-card__metadata[data-v-5bca2986]{overflow:hidden;text-overflow:ellipsis;white-space:nowrap}.ann-card__caret[data-v-5bca2986]{margin-left:auto;color:var(--iaa-muted, #6b7280);font-size:.7rem;flex-shrink:0}.ann-card__not-annotated[data-v-5bca2986]{font-size:.8rem;font-style:italic;color:var(--iaa-muted, #6b7280)}.ann-card__text[data-v-5bca2986]{padding:.1rem .6rem .6rem;white-space:pre-wrap;word-break:break-word;font-size:.85rem}.spinner[data-v-aaa362fe]{display:inline-block;border:3px solid var(--iaa-border, rgba(0, 0, 0, .15));border-top-color:var(--iaa-accent, #1e4e79);border-radius:50%;animation:iaa-spin-aaa362fe .7s linear infinite}@keyframes iaa-spin-aaa362fe{to{transform:rotate(360deg)}}.ann-list[data-v-30603c02]{position:relative;height:100%;overflow-y:auto;padding:.75rem}.ann-list__loading[data-v-30603c02]{display:flex;justify-content:center;padding:3rem 0}.ann-list__count[data-v-30603c02]{font-size:1.1rem;font-weight:700;text-align:center;margin-bottom:.75rem}.ann-list__doc-btn[data-v-30603c02]{display:block;font:inherit;font-size:.85rem;font-weight:600;color:var(--iaa-accent, #1e4e79);background:transparent;border:1px solid var(--iaa-accent, #1e4e79);border-radius:6px;padding:.3rem .6rem;margin:.75rem 0 .4rem;cursor:pointer}.ann-list__doc-btn[data-v-30603c02]:hover{background:color-mix(in srgb,var(--iaa-accent, #1e4e79) 8%,transparent)}.ann-list__empty[data-v-30603c02]{text-align:center;color:var(--iaa-muted, #6b7280);padding:2rem 0}.ann-list__sentinel[data-v-30603c02]{height:1px}.ann-list__up[data-v-30603c02]{position:sticky;bottom:.75rem;left:100%;display:flex;align-items:center;justify-content:center;width:2.2rem;height:2.2rem;border-radius:999px;background:var(--iaa-accent, #1e4e79);color:#fff;text-decoration:none;box-shadow:0 2px 8px #00000040}.results-agreement__empty[data-v-905e9258]{text-align:center;color:var(--iaa-muted, #6b7280);padding:2.5rem 0}.results-agreement__picker[data-v-905e9258]{display:flex;align-items:center;justify-content:space-between;margin-bottom:1rem}.results-agreement__picker-label[data-v-905e9258]{font-size:.85rem;font-weight:600}.results-agreement__select[data-v-905e9258]{font:inherit;font-size:.85rem;padding:.35rem .5rem;border:1px solid var(--iaa-border, rgba(0, 0, 0, .15));border-radius:6px;width:65%}.results-agreement__sections[data-v-905e9258]{display:flex;flex-direction:column;gap:1.5rem}.results-agreement__heading[data-v-905e9258]{font-size:.85rem;font-weight:700;margin:0 0 .5rem}.results-agreement__subtle[data-v-905e9258]{font-weight:400;color:var(--iaa-muted, #6b7280)}.results-agreement__table[data-v-905e9258]{width:100%;border-collapse:collapse;font-size:.82rem;text-align:left}.results-agreement__table th[data-v-905e9258],.results-agreement__table td[data-v-905e9258]{padding:.4rem .6rem;border-bottom:1px solid var(--iaa-border, rgba(0, 0, 0, .15))}.results-agreement__table thead th[data-v-905e9258]{font-size:.72rem;text-transform:uppercase;color:var(--iaa-muted, #6b7280);background:#00000008}.results-agreement__center[data-v-905e9258]{text-align:center}.results-agreement__note[data-v-905e9258]{font-size:.72rem;color:var(--iaa-muted, #6b7280)}.results-agreement__footnote[data-v-905e9258]{font-size:.75rem;font-style:italic;color:var(--iaa-muted, #6b7280);margin:.5rem 0 0}.results-confidence[data-v-b81d6b67]{font-size:.85rem}.results-confidence__summary[data-v-b81d6b67]{display:flex;justify-content:space-between;align-items:center;margin-bottom:.75rem}.results-confidence__average[data-v-b81d6b67]{display:flex;align-items:center;gap:.5rem}.results-confidence__count[data-v-b81d6b67]{color:var(--iaa-muted, #6b7280)}.results-confidence__subtle[data-v-b81d6b67]{color:var(--iaa-muted, #6b7280);font-size:.8rem}.results-confidence__bar-row[data-v-b81d6b67]{display:flex;align-items:center;gap:.6rem;margin:.5rem 0}.results-confidence__bar-label[data-v-b81d6b67]{width:2rem;flex-shrink:0}.results-confidence__bar-track[data-v-b81d6b67]{flex:1;height:.9rem;background:var(--iaa-progress-track, #e2e8f0);border-radius:999px;overflow:hidden}.results-confidence__bar-fill[data-v-b81d6b67]{height:100%;background:var(--iaa-star-on, #f5b301)}.results-confidence__alpha[data-v-b81d6b67]{text-align:center;margin-top:1.25rem}.results-confidence__alpha-total[data-v-b81d6b67]{font-weight:700}.results-confidence__table[data-v-b81d6b67]{width:100%;border-collapse:collapse;margin-top:.5rem;text-align:left}.results-confidence__table th[data-v-b81d6b67],.results-confidence__table td[data-v-b81d6b67]{padding:.4rem .6rem;border-bottom:1px solid var(--iaa-border, rgba(0, 0, 0, .15))}.results-confidence__center[data-v-b81d6b67]{text-align:center}.results-modal__overlay[data-v-1ad42970]{position:fixed;top:0;right:0;bottom:0;left:0;background:#00000073;display:flex;align-items:center;justify-content:center;z-index:1000;font-family:system-ui,sans-serif}.results-modal[data-v-1ad42970]{background:#fff;border-radius:10px;width:min(640px,calc(100% - 2rem));max-height:calc(100vh - 4rem);display:flex;flex-direction:column;box-shadow:0 10px 40px #00000040}.results-modal__header[data-v-1ad42970]{display:flex;align-items:center;justify-content:space-between;padding:1rem 1.25rem;border-bottom:1px solid var(--iaa-border, rgba(0, 0, 0, .15))}.results-modal__title[data-v-1ad42970]{margin:0;font-size:1.05rem}.results-modal__close[data-v-1ad42970]{border:none;background:none;font-size:1.4rem;line-height:1;cursor:pointer;color:var(--iaa-muted, #6b7280)}.results-modal__loading[data-v-1ad42970]{min-height:26rem;display:flex;align-items:center;justify-content:center}.results-modal__tabs[data-v-1ad42970]{display:flex;gap:.5rem;padding:0 1.25rem;border-bottom:1px solid var(--iaa-border, rgba(0, 0, 0, .15))}.results-modal__tab[data-v-1ad42970]{font:inherit;font-size:.85rem;font-weight:600;padding:.7rem .4rem;border:none;border-bottom:2px solid transparent;background:none;cursor:pointer;color:var(--iaa-muted, #6b7280)}.results-modal__tab--active[data-v-1ad42970]{color:var(--iaa-accent, #1e4e79);border-bottom-color:var(--iaa-accent, #1e4e79)}.results-modal__panel[data-v-1ad42970]{padding:1.25rem;overflow-y:auto;min-height:26rem}.confirm-modal__overlay[data-v-b29c6ef7]{position:fixed;top:0;right:0;bottom:0;left:0;background:#00000073;display:flex;align-items:center;justify-content:center;z-index:1000;font-family:system-ui,sans-serif}.confirm-modal[data-v-b29c6ef7]{background:#fff;border-radius:10px;padding:1.25rem 1.5rem;max-width:24rem;width:calc(100% - 2rem);box-shadow:0 10px 40px #00000040}.confirm-modal__title[data-v-b29c6ef7]{margin:0 0 .5rem;font-size:1rem;color:#111}.confirm-modal__message[data-v-b29c6ef7]{margin:0 0 1.25rem;font-size:.88rem;color:#4b5563;line-height:1.4;white-space:pre-line}.confirm-modal__actions[data-v-b29c6ef7]{display:flex;justify-content:flex-end;gap:.5rem}.confirm-modal__btn[data-v-b29c6ef7]{font:inherit;font-size:.85rem;cursor:pointer;border-radius:6px;padding:.4rem .9rem;border:1px solid transparent}.confirm-modal__btn--no[data-v-b29c6ef7]{background:transparent;border-color:#d1d5db;color:#374151}.confirm-modal__btn--yes[data-v-b29c6ef7]{background:var(--iaa-accent, #1e4e79);color:#fff}.metrics-page[data-v-b8704e29]{--iaa-accent: #1e4e79;--iaa-success: #16a34a;--iaa-danger: #dc2626;--iaa-border: rgba(0, 0, 0, .12);--iaa-muted: #6b7280;--iaa-star-empty: #d2cece;--iaa-star-on: #f5b301;--iaa-progress-track: #e2e8f0;display:flex;flex-direction:column;height:100%;min-height:0;font-family:system-ui,sans-serif;color:#111;background:var(--iaa-bg, #fff)}.metrics-page__body[data-v-b8704e29]{display:grid;grid-template-columns:280px 1fr;flex:1;min-height:0}.metrics-page__sidebar[data-v-b8704e29]{border-right:1px solid var(--iaa-border);padding:.75rem;overflow-y:auto}.metrics-page__main[data-v-b8704e29]{position:relative;min-height:0}.metrics-page__dimmer[data-v-b8704e29]{position:absolute;top:0;right:0;bottom:0;left:0;background:#ffffffa6;display:flex;align-items:center;justify-content:center}