@mailwoman/corpus 9.4.0 → 10.1.0

package/out/lv/adapters/varis/adapter.js

@@ -0,0 +1,404 @@
+/**
+ * @copyright Sister Software
+ * @license AGPL-3.0
+ * @author Teffen Ellis, et al.
+ *
+ * `lv-varis`: Latvia's State Address Register (`Valsts adrešu reģistrs`), read from the open data
+ * Valsts zemes dienests publishes as the data.gov.lv dataset `varis-atvertie-dati`.
+ *
+ * Input is the directory `fetchVaris` writes: six of the dataset's CSV tables, each under the file
+ * name the portal serves it as, `aw_eka.csv` and the five tables its parent codes point into. Every table is
+ * UTF-8 with a byte-order mark, comma-separated, and quotes every field, doubling a quote inside a
+ * value. The column metadata the publisher posts beside each table declares `ISO-8859-1`; the bytes
+ * are UTF-8, and the reader decodes them as UTF-8. Over the 2026-09-30 edition no value in
+ * `aw_eka.csv` holds a line break, 0 of 610,876 records.
+ *
+ * ## One row per building or land-unit address
+ *
+ * `aw_eka.csv` holds the addresses of buildings and of land units intended for building, one record
+ * per address. Of its 610,876 records, `STATUSS` is `EKS` (existing) on 550,652, `DEL` (removed) on
+ * 32,448 and `ERR` (erroneous) on 27,776. Only `EKS` records become rows. The two other states are
+ * counted under {@linkcode VarisRefusal}.
+ *
+ * Each record names its immediate parent by `VKUR_CD` and `VKUR_TIPS`, and the parent names its own
+ * the same way, up to the country. The type codes are the register's: `104` city (`pilsēta`), `105`
+ * parish (`pagasts`), `106` village (`ciems`), `107` street (`iela`), `113` municipality (`novads`)
+ * and `101` Latvia, whose code `100000000` no table holds as a row. Over the 550,652 active records the
+ * chains take seven shapes, written from the parent upward. The rows column counts what the adapter
+ * emits after the refusals below:
+ *
+ * | Chain                         | Records |    Rows | {@linkcode VarisAddressType}  |
+ * | ----------------------------- | ------: | ------: | ----------------------------- |
+ * | parish, municipality          | 116,225 | 116,225 | `parish-named-house`          |
+ * | street, city, municipality    | 113,906 | 113,905 | `town-street`                 |
+ * | street, city                  | 111,218 | 111,217 | `state-city-street`           |
+ * | village, parish, municipality | 108,164 | 108,164 | `village-named-house`         |
+ * | street, village, parish, mun. |  98,192 |  98,179 | `village-street`              |
+ * | city, municipality            |   2,814 |   2,814 | `city-named-house`            |
+ * | city                          |     133 |     133 | `city-named-house`            |
+ *
+ * No active record has an unresolved or inactive ancestor, 0 of 550,652.
+ *
+ * ## The written form is the publisher's
+ *
+ * `STD` holds the register's own full address string: `Krišjāņa Barona iela 1, Rīga, LV-1050` or
+ * `"Riņņi", Vecates pag., Valmieras nov., LV-4211`. Each
+ * part is the `NOSAUKUMS` of one object in the chain, in chain order, joined by a comma and a space,
+ * with the postcode `ATRIB` last. A building on a street writes the street name and the house number
+ * as one part, and a named building writes its name inside ASCII double quotes. The adapter composes
+ * that string from the chain and compares it with `STD`. Over the 550,637 active records the adapter
+ * does not refuse first, the two are equal on 550,637. A record where they differ is refused, so every
+ * row's `raw` is `STD` unchanged and every component's position in it is known. The row's surface is
+ * `attested`. Aligning the 550,637 rows with `alignRow` at edit distance 0 quarantines none and places
+ * every component in the order above.
+ *
+ * The comparison reads values as stored. 25 building names end in a space, and `STD` keeps it inside the
+ * quotes, `"Vilidža "`, so the reader turns off the CSV reader's trimming, composes from the stored
+ * values and trims only the labels.
+ *
+ * The codex renderer cannot produce this order. libaddressinput's Latvian layout prints the region
+ * line before the locality, `Siguldas nov., Sigulda, LV-2150`, where the register writes `Sigulda,
+ * Siguldas nov., LV-2150`, so `formatAddressRow` is not called.
+ *
+ * ## Which tag each part takes
+ *
+ * - The street's `NOSAUKUMS` is `street`, type word included: `Brīvības iela`, `Vidusceļš`. No Latvian
+ *   street-type split exists in this repository, and the register stores the name whole.
+ * - The house number is `house_number`, its building-block suffix included: `195 k-1` is house 195,
+ *   block (`korpuss`) 1, one address in the register. Over the 323,316 street addresses, 249,783 are
+ *   bare digits and 56,374 digits and a letter. 15 hold no digit, such as `Bauskas iela Ozoli`, where
+ *   a house name stands in the number's place. Those are refused, because the name is not a number
+ *   and labeling it a venue would place a venue after a street, which no other Latvian row does.
+ * - A building's name is `venue`. SCHEMA.mdx defines `venue` as a named place and keeps
+ *   `building_name` for Japan, and the Estonian register adapter labels a farm name `venue` for the same
+ *   reason. The quotes are punctuation and lie outside the span. 236 names hold a quote of their own,
+ *   such as `Stacija "Biksti"`, which the register writes `"Stacija "Biksti""`.
+ * - A city and a parish are `locality`. Both are direct parts of a municipality, so they are the same
+ *   tier, and a rural address without a village still writes the parish it lies in. The
+ *   parish is written with the register's abbreviation, `Vecates pag.`, and the span includes it, as a
+ *   `subregion` of `Multnomah County` includes `County`.
+ * - A village is `dependent_locality`. It lies inside a parish, and the Estonian adapter labels a
+ *   village inside a rural municipality the same way.
+ * - A municipality is `region`, abbreviation included: `Valmieras nov.`. The register holds no tier
+ *   above it: the parent of all 35 active municipalities is Latvia. The 7 active cities whose parent is
+ *   Latvia, the state cities such as Rīga and Daugavpils, write no municipality, so their rows carry no
+ *   region.
+ * - `ATRIB` is `postcode`, prefix included: `LV-4211`.
+ *
+ * ## Premises and apartments
+ *
+ * The register's premises table, `aw_dziv.csv`, holds 868,669 active apartment and premises addresses
+ * in 57,285 buildings, more than the 550,652 building addresses. A tenth of those buildings hold 50.1%
+ * of the apartments, and one building holds 681. Rows for every apartment would make a few large blocks
+ * the commonest Latvian address, so the adapter reads no premises.
+ *
+ * ## Personal data, identity and license
+ *
+ * The register records places and names no owner or occupant, so no row carries a natural person's
+ * name. A building name is the name of the property, as on a map.
+ *
+ * The row id is the register's own object code, `lv-varis-<KODS>`. Five `STD` strings are each written
+ * by two codes, so two rows can share a `raw` while their ids differ.
+ *
+ * data.gov.lv publishes the dataset under `CC-BY-4.0`, the `license_id` its CKAN record names for the
+ * publisher Valsts zemes dienests, and the column metadata posted beside `aw_dziv.csv` names
+ * `https://creativecommons.org/licenses/by/4.0/` as `dc:license`. CC BY 4.0 requires credit, a link to the license and
+ * a statement that changes were made, so every row records the license and
+ * {@linkcode LV_VARIS_ATTRIBUTION} is the credit the model card carries.
+ *
+ * The adapter honors `opts.limit` and `opts.signal`. `opts.country` is optional and accepts only `LV`.
+ */
+import { PathBuilder } from "path-ts";
+import { CSVSpliterator } from "spliterator";
+import { UnsupportedCountryError } from "#adapters/errors";
+import { SourceRegister } from "#registers";
+import { AddressRole, countDropped, SurfaceOrigin, } from "#types";
+/**
+ * Registry id for this adapter, stamped into every row it emits.
+ */
+export const LV_VARIS_ADAPTER_ID = "lv-varis";
+/**
+ * The one jurisdiction this adapter emits.
+ */
+export const LV_VARIS_COUNTRIES = ["LV"];
+/**
+ * The license data.gov.lv names for the dataset.
+ */
+export const LV_VARIS_LICENSE = "CC-BY-4.0";
+/**
+ * The credit CC BY 4.0 obliges.
+ */
+export const LV_VARIS_ATTRIBUTION = "Valsts zemes dienests, Valsts adrešu reģistra atvērtie dati, via data.gov.lv";
+/**
+ * The register tables the adapter reads, by the file name the portal serves each under.
+ */
+export const VARIS_TABLES = {
+    Building: "aw_eka.csv",
+    Street: "aw_iela.csv",
+    Village: "aw_ciems.csv",
+    Parish: "aw_pagasts.csv",
+    Municipality: "aw_novads.csv",
+    City: "aw_pilseta.csv",
+};
+/**
+ * The register's addressing-object type codes, `TIPS_CD` and `VKUR_TIPS`.
+ */
+export const VarisObjectType = {
+    Country: "101",
+    City: "104",
+    Parish: "105",
+    Village: "106",
+    Street: "107",
+    Building: "108",
+    Municipality: "113",
+};
+/**
+ * The status the register writes on an existing address.
+ */
+const ACTIVE = "EKS";
+/**
+ * Why a building record did not become a row.
+ */
+export const VarisRefusal = {
+    /**
+     * `STATUSS` is `DEL`: the address was removed.
+     */
+    Removed: "row:status-removed",
+    /**
+     * `STATUSS` is `ERR`: the register marks the address erroneous.
+     */
+    Erroneous: "row:status-erroneous",
+    /**
+     * `STATUSS` holds a value the register's documentation does not list.
+     */
+    UnknownStatus: "row:status-unknown",
+    /**
+     * A code in the parent chain names no object in the tables read.
+     */
+    ParentUnresolved: "row:parent-unresolved",
+    /**
+     * An object in the parent chain is not active.
+     */
+    AncestorInactive: "row:ancestor-inactive",
+    /**
+     * The chain holds an object type in a place no address shape allows.
+     */
+    UnexpectedHierarchy: "row:unexpected-hierarchy",
+    /**
+     * The record carries no `LV-` postcode.
+     */
+    PostcodeAbsent: "row:postcode-absent",
+    /**
+     * A building on a street carries a name with no digit where its number belongs.
+     */
+    NamedHouseOnStreet: "row:named-house-on-street",
+    /**
+     * The string composed from the chain differs from the register's `STD`.
+     */
+    StandardFormMismatch: "row:standard-form-mismatch",
+};
+/**
+ * The shape of an address, read from its parent chain.
+ */
+export const VarisAddressType = {
+    /**
+     * A street address in one of the state cities, which lie under no municipality.
+     */
+    StateCityStreet: "state-city-street",
+    /**
+     * A street address in a town of a municipality.
+     */
+    TownStreet: "town-street",
+    /**
+     * A street address in a village.
+     */
+    VillageStreet: "village-street",
+    /**
+     * A named house in a city, on no street.
+     */
+    CityNamedHouse: "city-named-house",
+    /**
+     * A named house in a village.
+     */
+    VillageNamedHouse: "village-named-house",
+    /**
+     * A named house in a parish, in no village.
+     */
+    ParishNamedHouse: "parish-named-house",
+};
+const TAG_OF_PLACE = {
+    [VarisObjectType.City]: "locality",
+    [VarisObjectType.Parish]: "locality",
+    [VarisObjectType.Village]: "dependent_locality",
+    [VarisObjectType.Municipality]: "region",
+};
+/**
+ * The object code the register gives Latvia, the parent of every municipality and state city.
+ * No table read holds it as a row.
+ */
+export const VARIS_COUNTRY_CODE = "100000000";
+const MAX_CHAIN = 4;
+const POSTCODE = /^LV-\d{4}$/u;
+const DIGIT = /\d/u;
+function refusalOfStatus(status) {
+    if (status === "DEL")
+        return VarisRefusal.Removed;
+    if (status === "ERR")
+        return VarisRefusal.Erroneous;
+    return VarisRefusal.UnknownStatus;
+}
+function addressTypeOf(parentType, chain) {
+    const settlement = parentType === VarisObjectType.Street ? chain[1] : chain[0];
+    const underMunicipality = chain.some((place) => place.type === VarisObjectType.Municipality);
+    if (parentType === VarisObjectType.Street) {
+        if (settlement?.type === VarisObjectType.Village)
+            return VarisAddressType.VillageStreet;
+        return underMunicipality ? VarisAddressType.TownStreet : VarisAddressType.StateCityStreet;
+    }
+    if (settlement?.type === VarisObjectType.Village)
+        return VarisAddressType.VillageNamedHouse;
+    if (settlement?.type === VarisObjectType.Parish)
+        return VarisAddressType.ParishNamedHouse;
+    return VarisAddressType.CityNamedHouse;
+}
+/**
+ * Reads one building record into a row or the reason it is refused.
+ */
+export function readVarisBuilding(record, places) {
+    if (record.STATUSS !== ACTIVE)
+        return { refused: refusalOfStatus(record.STATUSS) };
+    const chain = [];
+    for (let code = record.VKUR_CD; code !== VARIS_COUNTRY_CODE;) {
+        const place = places.get(code);
+        if (!place)
+            return { refused: VarisRefusal.ParentUnresolved };
+        if (!place.active)
+            return { refused: VarisRefusal.AncestorInactive };
+        chain.push(place);
+        // The deepest chain is street, village, parish, municipality.
+        // A longer one is a cycle.
+        if (chain.length > MAX_CHAIN)
+            return { refused: VarisRefusal.UnexpectedHierarchy };
+        code = place.parentCode;
+    }
+    if (!chain.length)
+        return { refused: VarisRefusal.ParentUnresolved };
+    const postcode = record.ATRIB;
+    if (!POSTCODE.test(postcode))
+        return { refused: VarisRefusal.PostcodeAbsent };
+    // The parts are composed from the values as stored, because `STD` repeats a stored trailing space.
+    // The labels are trimmed.
+    const name = record.NOSAUKUMS;
+    const components = {};
+    const parts = [];
+    let administrative = chain;
+    if (chain[0].type === VarisObjectType.Street) {
+        if (!DIGIT.test(name))
+            return { refused: VarisRefusal.NamedHouseOnStreet };
+        components.street = chain[0].name;
+        components.house_number = name;
+        parts.push(`${chain[0].name} ${name}`);
+        administrative = chain.slice(1);
+    }
+    else {
+        components.venue = name;
+        parts.push(`"${name}"`);
+    }
+    for (const place of administrative) {
+        const tag = TAG_OF_PLACE[place.type];
+        if (!tag || components[tag])
+            return { refused: VarisRefusal.UnexpectedHierarchy };
+        components[tag] = place.name;
+        parts.push(place.name);
+    }
+    components.postcode = postcode;
+    parts.push(postcode);
+    const raw = record.STD.normalize("NFC");
+    if (parts.join(", ").normalize("NFC") !== raw)
+        return { refused: VarisRefusal.StandardFormMismatch };
+    for (const [tag, value] of Object.entries(components)) {
+        components[tag] = value.trim().normalize("NFC");
+    }
+    return {
+        addressType: addressTypeOf(chain[0].type, chain),
+        admitted: {
+            raw,
+            components,
+            country: "LV",
+            locale: "lv-LV",
+            source: LV_VARIS_ADAPTER_ID,
+            source_id: `${LV_VARIS_ADAPTER_ID}-${record.KODS}`,
+            corpus_version: "",
+            license: LV_VARIS_LICENSE,
+        },
+    };
+}
+/**
+ * Streams one table's records, each value as stored.
+ *
+ * Trimming is off because `STD` keeps a stored trailing space inside a building
+ * name's quotes, and the composition check compares the two.
+ */
+export function readVarisTable(path) {
+    return CSVSpliterator.fromAsync(path, { normalizeKeys: false, trim: false });
+}
+/**
+ * Reads the five parent tables into one map keyed by object code.
+ */
+export async function readVarisPlaces(directory) {
+    const dir = PathBuilder.from(directory);
+    const places = new Map();
+    for (const table of [
+        VARIS_TABLES.Street,
+        VARIS_TABLES.Village,
+        VARIS_TABLES.Parish,
+        VARIS_TABLES.Municipality,
+        VARIS_TABLES.City,
+    ]) {
+        for await (const record of readVarisTable(dir(table))) {
+            places.set(record.KODS, {
+                type: record.TIPS_CD,
+                name: record.NOSAUKUMS,
+                parentCode: record.VKUR_CD,
+                active: record.STATUSS === ACTIVE,
+            });
+        }
+    }
+    return places;
+}
+export function createVarisAdapter() {
+    return {
+        id: LV_VARIS_ADAPTER_ID,
+        defaultLicense: LV_VARIS_LICENSE,
+        addressRole: AddressRole.Premise,
+        register: SourceRegister.VARIS,
+        surface: SurfaceOrigin.Attested,
+        description: "Latvia's State Address Register: every active building and land-unit address, as the register writes it.",
+        async *rows(opts) {
+            if (opts.country && !LV_VARIS_COUNTRIES.includes(opts.country)) {
+                throw new UnsupportedCountryError(LV_VARIS_ADAPTER_ID, LV_VARIS_COUNTRIES, opts.country);
+            }
+            const dir = PathBuilder.from(opts.inputPath);
+            const places = await readVarisPlaces(dir);
+            let emitted = 0;
+            for await (const record of readVarisTable(dir(VARIS_TABLES.Building))) {
+                if (opts.signal?.aborted)
+                    break;
+                if (opts.limit !== undefined && emitted >= opts.limit)
+                    break;
+                const reading = readVarisBuilding(record, places);
+                if ("refused" in reading) {
+                    countDropped(opts, reading.refused);
+                    continue;
+                }
+                yield reading.admitted;
+                emitted++;
+            }
+        },
+    };
+}
+/**
+ * The configured adapter instance registered with the corpus builder.
+ */
+export const varisAdapter = createVarisAdapter();
+//# sourceMappingURL=adapter.js.map

package/out/lv/adapters/varis/adapter.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"adapter.js","sourceRoot":"","sources":["../../../../lib/lv/adapters/varis/adapter.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GA6GG;AAIH,OAAO,EAAE,WAAW,EAAE,MAAM,SAAS,CAAA;AACrC,OAAO,EAAE,cAAc,EAAE,MAAM,aAAa,CAAA;AAE5C,OAAO,EAAE,uBAAuB,EAAE,MAAM,kBAAkB,CAAA;AAC1D,OAAO,EAAE,cAAc,EAAE,MAAM,YAAY,CAAA;AAC3C,OAAO,EACN,WAAW,EAIX,YAAY,EACZ,aAAa,GACb,MAAM,QAAQ,CAAA;AAEf;;GAEG;AACH,MAAM,CAAC,MAAM,mBAAmB,GAAG,UAAU,CAAA;AAE7C;;GAEG;AACH,MAAM,CAAC,MAAM,kBAAkB,GAAsB,CAAC,IAAI,CAAC,CAAA;AAE3D;;GAEG;AACH,MAAM,CAAC,MAAM,gBAAgB,GAAG,WAAW,CAAA;AAE3C;;GAEG;AACH,MAAM,CAAC,MAAM,oBAAoB,GAAG,8EAA8E,CAAA;AAElH;;GAEG;AACH,MAAM,CAAC,MAAM,YAAY,GAAG;IAC3B,QAAQ,EAAE,YAAY;IACtB,MAAM,EAAE,aAAa;IACrB,OAAO,EAAE,cAAc;IACvB,MAAM,EAAE,gBAAgB;IACxB,YAAY,EAAE,eAAe;IAC7B,IAAI,EAAE,gBAAgB;CACb,CAAA;AAIV;;GAEG;AACH,MAAM,CAAC,MAAM,eAAe,GAAG;IAC9B,OAAO,EAAE,KAAK;IACd,IAAI,EAAE,KAAK;IACX,MAAM,EAAE,KAAK;IACb,OAAO,EAAE,KAAK;IACd,MAAM,EAAE,KAAK;IACb,QAAQ,EAAE,KAAK;IACf,YAAY,EAAE,KAAK;CACV,CAAA;AAIV;;GAEG;AACH,MAAM,MAAM,GAAG,KAAK,CAAA;AAEpB;;GAEG;AACH,MAAM,CAAC,MAAM,YAAY,GAAG;IAC3B;;OAEG;IACH,OAAO,EAAE,oBAAoB;IAC7B;;OAEG;IACH,SAAS,EAAE,sBAAsB;IACjC;;OAEG;IACH,aAAa,EAAE,oBAAoB;IACnC;;OAEG;IACH,gBAAgB,EAAE,uBAAuB;IACzC;;OAEG;IACH,gBAAgB,EAAE,uBAAuB;IACzC;;OAEG;IACH,mBAAmB,EAAE,0BAA0B;IAC/C;;OAEG;IACH,cAAc,EAAE,qBAAqB;IACrC;;OAEG;IACH,kBAAkB,EAAE,2BAA2B;IAC/C;;OAEG;IACH,oBAAoB,EAAE,4BAA4B;CACzC,CAAA;AAIV;;GAEG;AACH,MAAM,CAAC,MAAM,gBAAgB,GAAG;IAC/B;;OAEG;IACH,eAAe,EAAE,mBAAmB;IACpC;;OAEG;IACH,UAAU,EAAE,aAAa;IACzB;;OAEG;IACH,aAAa,EAAE,gBAAgB;IAC/B;;OAEG;IACH,cAAc,EAAE,kBAAkB;IAClC;;OAEG;IACH,iBAAiB,EAAE,qBAAqB;IACxC;;OAEG;IACH,gBAAgB,EAAE,oBAAoB;CAC7B,CAAA;AAqCV,MAAM,YAAY,GAA2C;IAC5D,CAAC,eAAe,CAAC,IAAI,CAAC,EAAE,UAAU;IAClC,CAAC,eAAe,CAAC,MAAM,CAAC,EAAE,UAAU;IACpC,CAAC,eAAe,CAAC,OAAO,CAAC,EAAE,oBAAoB;IAC/C,CAAC,eAAe,CAAC,YAAY,CAAC,EAAE,QAAQ;CACxC,CAAA;AAED;;;GAGG;AACH,MAAM,CAAC,MAAM,kBAAkB,GAAG,WAAW,CAAA;AAE7C,MAAM,SAAS,GAAG,CAAC,CAAA;AAEnB,MAAM,QAAQ,GAAG,aAAa,CAAA;AAE9B,MAAM,KAAK,GAAG,KAAK,CAAA;AAEnB,SAAS,eAAe,CAAC,MAAc;IACtC,IAAI,MAAM,KAAK,KAAK;QAAE,OAAO,YAAY,CAAC,OAAO,CAAA;IAEjD,IAAI,MAAM,KAAK,KAAK;QAAE,OAAO,YAAY,CAAC,SAAS,CAAA;IAEnD,OAAO,YAAY,CAAC,aAAa,CAAA;AAClC,CAAC;AAED,SAAS,aAAa,CAAC,UAAkB,EAAE,KAA4B;IACtE,MAAM,UAAU,GAAG,UAAU,KAAK,eAAe,CAAC,MAAM,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,CAAA;IAC9E,MAAM,iBAAiB,GAAG,KAAK,CAAC,IAAI,CAAC,CAAC,KAAK,EAAE,EAAE,CAAC,KAAK,CAAC,IAAI,KAAK,eAAe,CAAC,YAAY,CAAC,CAAA;IAE5F,IAAI,UAAU,KAAK,eAAe,CAAC,MAAM,EAAE,CAAC;QAC3C,IAAI,UAAU,EAAE,IAAI,KAAK,eAAe,CAAC,OAAO;YAAE,OAAO,gBAAgB,CAAC,aAAa,CAAA;QAEvF,OAAO,iBAAiB,CAAC,CAAC,CAAC,gBAAgB,CAAC,UAAU,CAAC,CAAC,CAAC,gBAAgB,CAAC,eAAe,CAAA;IAC1F,CAAC;IAED,IAAI,UAAU,EAAE,IAAI,KAAK,eAAe,CAAC,OAAO;QAAE,OAAO,gBAAgB,CAAC,iBAAiB,CAAA;IAE3F,IAAI,UAAU,EAAE,IAAI,KAAK,eAAe,CAAC,MAAM;QAAE,OAAO,gBAAgB,CAAC,gBAAgB,CAAA;IAEzF,OAAO,gBAAgB,CAAC,cAAc,CAAA;AACvC,CAAC;AAED;;GAEG;AACH,MAAM,UAAU,iBAAiB,CAAC,MAAmB,EAAE,MAAmB;IACzE,IAAI,MAAM,CAAC,OAAO,KAAK,MAAM;QAAE,OAAO,EAAE,OAAO,EAAE,eAAe,CAAC,MAAM,CAAC,OAAO,CAAC,EAAE,CAAA;IAElF,MAAM,KAAK,GAAiB,EAAE,CAAA;IAE9B,KAAK,IAAI,IAAI,GAAG,MAAM,CAAC,OAAO,EAAE,IAAI,KAAK,kBAAkB,GAAG,CAAC;QAC9D,MAAM,KAAK,GAAG,MAAM,CAAC,GAAG,CAAC,IAAI,CAAC,CAAA;QAE9B,IAAI,CAAC,KAAK;YAAE,OAAO,EAAE,OAAO,EAAE,YAAY,CAAC,gBAAgB,EAAE,CAAA;QAE7D,IAAI,CAAC,KAAK,CAAC,MAAM;YAAE,OAAO,EAAE,OAAO,EAAE,YAAY,CAAC,gBAAgB,EAAE,CAAA;QAEpE,KAAK,CAAC,IAAI,CAAC,KAAK,CAAC,CAAA;QAEjB,8DAA8D;QAC9D,2BAA2B;QAC3B,IAAI,KAAK,CAAC,MAAM,GAAG,SAAS;YAAE,OAAO,EAAE,OAAO,EAAE,YAAY,CAAC,mBAAmB,EAAE,CAAA;QAElF,IAAI,GAAG,KAAK,CAAC,UAAU,CAAA;IACxB,CAAC;IAED,IAAI,CAAC,KAAK,CAAC,MAAM;QAAE,OAAO,EAAE,OAAO,EAAE,YAAY,CAAC,gBAAgB,EAAE,CAAA;IAEpE,MAAM,QAAQ,GAAG,MAAM,CAAC,KAAK,CAAA;IAE7B,IAAI,CAAC,QAAQ,CAAC,IAAI,CAAC,QAAQ,CAAC;QAAE,OAAO,EAAE,OAAO,EAAE,YAAY,CAAC,cAAc,EAAE,CAAA;IAE7E,mGAAmG;IACnG,0BAA0B;IAC1B,MAAM,IAAI,GAAG,MAAM,CAAC,SAAS,CAAA;IAC7B,MAAM,UAAU,GAA+B,EAAE,CAAA;IACjD,MAAM,KAAK,GAAa,EAAE,CAAA;IAC1B,IAAI,cAAc,GAA0B,KAAK,CAAA;IAEjD,IAAI,KAAK,CAAC,CAAC,CAAE,CAAC,IAAI,KAAK,eAAe,CAAC,MAAM,EAAE,CAAC;QAC/C,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,IAAI,CAAC;YAAE,OAAO,EAAE,OAAO,EAAE,YAAY,CAAC,kBAAkB,EAAE,CAAA;QAE1E,UAAU,CAAC,MAAM,GAAG,KAAK,CAAC,CAAC,CAAE,CAAC,IAAI,CAAA;QAClC,UAAU,CAAC,YAAY,GAAG,IAAI,CAAA;QAC9B,KAAK,CAAC,IAAI,CAAC,GAAG,KAAK,CAAC,CAAC,CAAE,CAAC,IAAI,IAAI,IAAI,EAAE,CAAC,CAAA;QACvC,cAAc,GAAG,KAAK,CAAC,KAAK,CAAC,CAAC,CAAC,CAAA;IAChC,CAAC;SAAM,CAAC;QACP,UAAU,CAAC,KAAK,GAAG,IAAI,CAAA;QACvB,KAAK,CAAC,IAAI,CAAC,IAAI,IAAI,GAAG,CAAC,CAAA;IACxB,CAAC;IAED,KAAK,MAAM,KAAK,IAAI,cAAc,EAAE,CAAC;QACpC,MAAM,GAAG,GAAG,YAAY,CAAC,KAAK,CAAC,IAAI,CAAC,CAAA;QAEpC,IAAI,CAAC,GAAG,IAAI,UAAU,CAAC,GAAG,CAAC;YAAE,OAAO,EAAE,OAAO,EAAE,YAAY,CAAC,mBAAmB,EAAE,CAAA;QAEjF,UAAU,CAAC,GAAG,CAAC,GAAG,KAAK,CAAC,IAAI,CAAA;QAC5B,KAAK,CAAC,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,CAAA;IACvB,CAAC;IAED,UAAU,CAAC,QAAQ,GAAG,QAAQ,CAAA;IAC9B,KAAK,CAAC,IAAI,CAAC,QAAQ,CAAC,CAAA;IAEpB,MAAM,GAAG,GAAG,MAAM,CAAC,GAAG,CAAC,SAAS,CAAC,KAAK,CAAC,CAAA;IAEvC,IAAI,KAAK,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC,SAAS,CAAC,KAAK,CAAC,KAAK,GAAG;QAAE,OAAO,EAAE,OAAO,EAAE,YAAY,CAAC,oBAAoB,EAAE,CAAA;IAEpG,KAAK,MAAM,CAAC,GAAG,EAAE,KAAK,CAAC,IAAI,MAAM,CAAC,OAAO,CAAC,UAAU,CAAC,EAAE,CAAC;QACvD,UAAU,CAAC,GAAmB,CAAC,GAAG,KAAK,CAAC,IAAI,EAAE,CAAC,SAAS,CAAC,KAAK,CAAC,CAAA;IAChE,CAAC;IAED,OAAO;QACN,WAAW,EAAE,aAAa,CAAC,KAAK,CAAC,CAAC,CAAE,CAAC,IAAI,EAAE,KAAK,CAAC;QACjD,QAAQ,EAAE;YACT,GAAG;YACH,UAAU;YACV,OAAO,EAAE,IAAI;YACb,MAAM,EAAE,OAAO;YACf,MAAM,EAAE,mBAAmB;YAC3B,SAAS,EAAE,GAAG,mBAAmB,IAAI,MAAM,CAAC,IAAI,EAAE;YAClD,cAAc,EAAE,EAAE;YAClB,OAAO,EAAE,gBAAgB;SACzB;KACD,CAAA;AACF,CAAC;AAED;;;;;GAKG;AACH,MAAM,UAAU,cAAc,CAAC,IAAqB;IACnD,OAAO,cAAc,CAAC,SAAS,CAAC,IAAI,EAAE,EAAE,aAAa,EAAE,KAAK,EAAE,IAAI,EAAE,KAAK,EAAE,CAA+B,CAAA;AAC3G,CAAC;AAED;;GAEG;AACH,MAAM,CAAC,KAAK,UAAU,eAAe,CAAC,SAA0B;IAC/D,MAAM,GAAG,GAAG,WAAW,CAAC,IAAI,CAAC,SAAS,CAAC,CAAA;IACvC,MAAM,MAAM,GAAG,IAAI,GAAG,EAAsB,CAAA;IAE5C,KAAK,MAAM,KAAK,IAAI;QACnB,YAAY,CAAC,MAAM;QACnB,YAAY,CAAC,OAAO;QACpB,YAAY,CAAC,MAAM;QACnB,YAAY,CAAC,YAAY;QACzB,YAAY,CAAC,IAAI;KACjB,EAAE,CAAC;QACH,IAAI,KAAK,EAAE,MAAM,MAAM,IAAI,cAAc,CAAC,GAAG,CAAC,KAAK,CAAC,CAAC,EAAE,CAAC;YACvD,MAAM,CAAC,GAAG,CAAC,MAAM,CAAC,IAAI,EAAE;gBACvB,IAAI,EAAE,MAAM,CAAC,OAAO;gBACpB,IAAI,EAAE,MAAM,CAAC,SAAS;gBACtB,UAAU,EAAE,MAAM,CAAC,OAAO;gBAC1B,MAAM,EAAE,MAAM,CAAC,OAAO,KAAK,MAAM;aACjC,CAAC,CAAA;QACH,CAAC;IACF,CAAC;IAED,OAAO,MAAM,CAAA;AACd,CAAC;AAED,MAAM,UAAU,kBAAkB;IACjC,OAAO;QACN,EAAE,EAAE,mBAAmB;QACvB,cAAc,EAAE,gBAAgB;QAChC,WAAW,EAAE,WAAW,CAAC,OAAO;QAChC,QAAQ,EAAE,cAAc,CAAC,KAAK;QAC9B,OAAO,EAAE,aAAa,CAAC,QAAQ;QAC/B,WAAW,EACV,0GAA0G;QAE3G,KAAK,CAAC,CAAC,IAAI,CAAC,IAAoB;YAC/B,IAAI,IAAI,CAAC,OAAO,IAAI,CAAC,kBAAkB,CAAC,QAAQ,CAAC,IAAI,CAAC,OAAO,CAAC,EAAE,CAAC;gBAChE,MAAM,IAAI,uBAAuB,CAAC,mBAAmB,EAAE,kBAAkB,EAAE,IAAI,CAAC,OAAO,CAAC,CAAA;YACzF,CAAC;YAED,MAAM,GAAG,GAAG,WAAW,CAAC,IAAI,CAAC,IAAI,CAAC,SAAS,CAAC,CAAA;YAC5C,MAAM,MAAM,GAAG,MAAM,eAAe,CAAC,GAAG,CAAC,CAAA;YACzC,IAAI,OAAO,GAAG,CAAC,CAAA;YAEf,IAAI,KAAK,EAAE,MAAM,MAAM,IAAI,cAAc,CAAC,GAAG,CAAC,YAAY,CAAC,QAAQ,CAAC,CAAC,EAAE,CAAC;gBACvE,IAAI,IAAI,CAAC,MAAM,EAAE,OAAO;oBAAE,MAAK;gBAE/B,IAAI,IAAI,CAAC,KAAK,KAAK,SAAS,IAAI,OAAO,IAAI,IAAI,CAAC,KAAK;oBAAE,MAAK;gBAE5D,MAAM,OAAO,GAAG,iBAAiB,CAAC,MAAM,EAAE,MAAM,CAAC,CAAA;gBAEjD,IAAI,SAAS,IAAI,OAAO,EAAE,CAAC;oBAC1B,YAAY,CAAC,IAAI,EAAE,OAAO,CAAC,OAAO,CAAC,CAAA;oBAEnC,SAAQ;gBACT,CAAC;gBAED,MAAM,OAAO,CAAC,QAAQ,CAAA;gBAEtB,OAAO,EAAE,CAAA;YACV,CAAC;QACF,CAAC;KACD,CAAA;AACF,CAAC;AAED;;GAEG;AACH,MAAM,CAAC,MAAM,YAAY,GAAG,kBAAkB,EAAE,CAAA"}

package/out/lv/tools/fetch/varis.d.ts

@@ -0,0 +1,80 @@
+/**
+ * @copyright Sister Software
+ * @license AGPL-3.0
+ * @author Teffen Ellis, et al.
+ *
+ * Downloads the State Address Register's open data (`Valsts adrešu reģistra atvērtie dati`) for the
+ * `lv-varis` adapter.
+ *
+ * Valsts zemes dienests republishes every table of the dataset `varis-atvertie-dati` on data.gov.lv,
+ * and a republish can move a resource's URL. The fetcher therefore asks the portal's CKAN API for the
+ * dataset's resources and picks each table by the file name its URL ends in, rather than holding URLs
+ * that the next republish may retire. The manifest records, per file, the resource URL, the CKAN
+ * `last_modified`, the byte count and the SHA-256, and once for the dataset the license id the portal
+ * states, so a corpus row traces to one publication.
+ */
+import { APIClient } from "@mailwoman/core/api";
+import { type PathBuilderLike } from "path-ts";
+import { type VarisTable } from "#lv/adapters/varis/adapter";
+import type { CKANResource } from "#ro/tools/fetch/retea-scolara";
+import type { BaseFetchOptions, FetchSummary, SourceManifest } from "#tools/fetch/download";
+/**
+ * The data.gov.lv dataset that holds the register's tables.
+ */
+export declare const LV_VARIS_DATASET_ID = "varis-atvertie-dati";
+/**
+ * The CKAN call that lists the dataset's resources and its license.
+ */
+export declare const LV_VARIS_PACKAGE_URL = "https://data.gov.lv/dati/api/3/action/package_show?id=varis-atvertie-dati";
+/**
+ * One downloaded table, as the manifest records it.
+ */
+export interface VarisFileManifest extends SourceManifest {
+    resource_name: string | null;
+    last_modified: string | null;
+}
+/**
+ * The manifest written beside the tables.
+ */
+export interface VarisManifest {
+    source: string;
+    dataset_url: string;
+    publisher: string | null;
+    license_id: string | null;
+    license_title: string | null;
+    files: VarisFileManifest[];
+}
+/**
+ * The resource whose URL path ends in `/<filename>`.
+ *
+ * The dataset also lists each table's `_his` history file and a `_metadata.json` beside it,
+ * so the match is on the whole final path segment rather than on a prefix.
+ *
+ * @throws When the dataset lists no resource for `filename`.
+ */
+export declare function resourceForFile(resources: readonly CKANResource[], filename: string): CKANResource;
+export interface DownloadVarisOptions {
+    outputDir: PathBuilderLike;
+    /**
+     * The tables to download.
+     * Defaults to every table the adapter reads.
+     */
+    tables?: readonly VarisTable[];
+    force?: boolean;
+    retries?: number;
+    retryDelayMs?: number;
+    signal?: AbortSignal;
+    report?: (line: string) => void;
+}
+export declare function downloadVaris(client: Pick<APIClient, "fetch">, options: DownloadVarisOptions): Promise<FetchSummary>;
+/**
+ * The directory the adapter reads under a fetch root.
+ */
+export declare function varisInputPath(outRoot: BaseFetchOptions["outRoot"]): PathBuilderLike;
+export interface FetchVarisOptions extends BaseFetchOptions {
+    force?: boolean;
+    retries?: number;
+    signal?: AbortSignal;
+}
+export declare function fetchVaris(options: FetchVarisOptions, report?: (line: string) => void): Promise<FetchSummary>;
+//# sourceMappingURL=varis.d.ts.map

package/out/lv/tools/fetch/varis.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"varis.d.ts","sourceRoot":"","sources":["../../../../lib/lv/tools/fetch/varis.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;GAcG;AAEH,OAAO,EAAE,SAAS,EAAE,MAAM,qBAAqB,CAAA;AAK/C,OAAO,EAAe,KAAK,eAAe,EAAE,MAAM,SAAS,CAAA;AAE3D,OAAO,EAAuD,KAAK,UAAU,EAAE,MAAM,4BAA4B,CAAA;AACjH,OAAO,KAAK,EAAE,YAAY,EAAE,MAAM,+BAA+B,CAAA;AACjE,OAAO,KAAK,EAAE,gBAAgB,EAAE,YAAY,EAAE,cAAc,EAAE,MAAM,uBAAuB,CAAA;AAG3F;;GAEG;AACH,eAAO,MAAM,mBAAmB,wBAAwB,CAAA;AAExD;;GAEG;AACH,eAAO,MAAM,oBAAoB,8EAAiF,CAAA;AAWlH;;GAEG;AACH,MAAM,WAAW,iBAAkB,SAAQ,cAAc;IACxD,aAAa,EAAE,MAAM,GAAG,IAAI,CAAA;IAC5B,aAAa,EAAE,MAAM,GAAG,IAAI,CAAA;CAC5B;AAED;;GAEG;AACH,MAAM,WAAW,aAAa;IAC7B,MAAM,EAAE,MAAM,CAAA;IACd,WAAW,EAAE,MAAM,CAAA;IACnB,SAAS,EAAE,MAAM,GAAG,IAAI,CAAA;IACxB,UAAU,EAAE,MAAM,GAAG,IAAI,CAAA;IACzB,aAAa,EAAE,MAAM,GAAG,IAAI,CAAA;IAC5B,KAAK,EAAE,iBAAiB,EAAE,CAAA;CAC1B;AAED;;;;;;;GAOG;AACH,wBAAgB,eAAe,CAAC,SAAS,EAAE,SAAS,YAAY,EAAE,EAAE,QAAQ,EAAE,MAAM,GAAG,YAAY,CAUlG;AAED,MAAM,WAAW,oBAAoB;IACpC,SAAS,EAAE,eAAe,CAAA;IAC1B;;;OAGG;IACH,MAAM,CAAC,EAAE,SAAS,UAAU,EAAE,CAAA;IAC9B,KAAK,CAAC,EAAE,OAAO,CAAA;IACf,OAAO,CAAC,EAAE,MAAM,CAAA;IAChB,YAAY,CAAC,EAAE,MAAM,CAAA;IACrB,MAAM,CAAC,EAAE,WAAW,CAAA;IACpB,MAAM,CAAC,EAAE,CAAC,IAAI,EAAE,MAAM,KAAK,IAAI,CAAA;CAC/B;AAED,wBAAsB,aAAa,CAClC,MAAM,EAAE,IAAI,CAAC,SAAS,EAAE,OAAO,CAAC,EAChC,OAAO,EAAE,oBAAoB,GAC3B,OAAO,CAAC,YAAY,CAAC,CAkFvB;AAED;;GAEG;AACH,wBAAgB,cAAc,CAAC,OAAO,EAAE,gBAAgB,CAAC,SAAS,CAAC,GAAG,eAAe,CAEpF;AAED,MAAM,WAAW,iBAAkB,SAAQ,gBAAgB;IAC1D,KAAK,CAAC,EAAE,OAAO,CAAA;IACf,OAAO,CAAC,EAAE,MAAM,CAAA;IAChB,MAAM,CAAC,EAAE,WAAW,CAAA;CACpB;AAED,wBAAsB,UAAU,CAAC,OAAO,EAAE,iBAAiB,EAAE,MAAM,CAAC,EAAE,CAAC,IAAI,EAAE,MAAM,KAAK,IAAI,GAAG,OAAO,CAAC,YAAY,CAAC,CAYnH"}

package/out/lv/tools/fetch/varis.js

@@ -0,0 +1,133 @@
+/**
+ * @copyright Sister Software
+ * @license AGPL-3.0
+ * @author Teffen Ellis, et al.
+ *
+ * Downloads the State Address Register's open data (`Valsts adrešu reģistra atvērtie dati`) for the
+ * `lv-varis` adapter.
+ *
+ * Valsts zemes dienests republishes every table of the dataset `varis-atvertie-dati` on data.gov.lv,
+ * and a republish can move a resource's URL. The fetcher therefore asks the portal's CKAN API for the
+ * dataset's resources and picks each table by the file name its URL ends in, rather than holding URLs
+ * that the next republish may retire. The manifest records, per file, the resource URL, the CKAN
+ * `last_modified`, the byte count and the SHA-256, and once for the dataset the license id the portal
+ * states, so a corpus row traces to one publication.
+ */
+import { APIClient } from "@mailwoman/core/api";
+import { ByteFormatter } from "@mailwoman/core/fs/formatters";
+import { tryStat } from "@mailwoman/core/fs/readers";
+import { makeDirectories } from "@mailwoman/core/fs/writers";
+import { sha256File } from "@mailwoman/core/hash";
+import { PathBuilder } from "path-ts";
+import { LV_VARIS_ADAPTER_ID, LV_VARIS_LICENSE, VARIS_TABLES } from "#lv/adapters/varis/adapter";
+import { downloadToFile, readManifest, writeManifest } from "#tools/fetch/download";
+/**
+ * The data.gov.lv dataset that holds the register's tables.
+ */
+export const LV_VARIS_DATASET_ID = "varis-atvertie-dati";
+/**
+ * The CKAN call that lists the dataset's resources and its license.
+ */
+export const LV_VARIS_PACKAGE_URL = `https://data.gov.lv/dati/api/3/action/package_show?id=${LV_VARIS_DATASET_ID}`;
+const SLUG = LV_VARIS_ADAPTER_ID;
+/**
+ * The resource whose URL path ends in `/<filename>`.
+ *
+ * The dataset also lists each table's `_his` history file and a `_metadata.json` beside it,
+ * so the match is on the whole final path segment rather than on a prefix.
+ *
+ * @throws When the dataset lists no resource for `filename`.
+ */
+export function resourceForFile(resources, filename) {
+    const found = resources.find((resource) => {
+        const path = URL.canParse(resource.url) ? new URL(resource.url).pathname : resource.url;
+        return path.split("/").at(-1) === filename;
+    });
+    if (!found)
+        throw new Error(`${SLUG}: dataset ${LV_VARIS_DATASET_ID} lists no resource named ${filename}`);
+    return found;
+}
+export async function downloadVaris(client, options) {
+    const { report } = options;
+    const destDir = PathBuilder.from(options.outputDir);
+    const manifestPath = destDir("MANIFEST.json");
+    await makeDirectories(destDir);
+    report?.(`=== ${SLUG}`);
+    const response = await client.fetch({ url: LV_VARIS_PACKAGE_URL, signal: options.signal });
+    const pkg = response.data.result;
+    if (pkg.license_id !== LV_VARIS_LICENSE) {
+        report?.(`  the portal now states license ${pkg.license_id ?? "none"}, not ${LV_VARIS_LICENSE}`);
+    }
+    const recorded = await readManifest(manifestPath);
+    const recordedFiles = new Map((recorded?.files ?? []).map((entry) => [entry.filename, entry]));
+    const files = [];
+    const summary = { fetched: 0, skipped: 0, failed: 0, failedCodes: [] };
+    for (const table of options.tables ?? Object.values(VARIS_TABLES)) {
+        if (options.signal?.aborted)
+            break;
+        const resource = resourceForFile(pkg.resources ?? [], table);
+        const lastModified = resource.last_modified ?? resource.created ?? null;
+        const dest = destDir(table);
+        const previous = recordedFiles.get(table);
+        const stat = await tryStat(dest);
+        if (!options.force &&
+            previous &&
+            stat &&
+            previous.source_url === resource.url &&
+            previous.last_modified === lastModified &&
+            previous.bytes === stat.size) {
+            report?.(`  ${table} present, and the portal lists the same upload`);
+            files.push(previous);
+            summary.skipped++;
+            continue;
+        }
+        const { bytes } = await downloadToFile({
+            url: resource.url,
+            dest,
+            retries: options.retries,
+            retryDelayMs: options.retryDelayMs,
+            report,
+        });
+        const sha256 = await sha256File(dest);
+        report?.(`  ✓ ${table} ${ByteFormatter.formatIEC(bytes)} sha256=${sha256}`);
+        files.push({
+            source_url: resource.url,
+            filename: table,
+            bytes,
+            sha256,
+            downloaded_at: new Date().toISOString(),
+            resource_name: resource.name?.trim() ?? null,
+            last_modified: lastModified,
+        });
+        summary.fetched++;
+    }
+    const manifest = {
+        source: SLUG,
+        dataset_url: LV_VARIS_PACKAGE_URL,
+        publisher: pkg.organization?.title ?? null,
+        license_id: pkg.license_id ?? null,
+        license_title: pkg.license_title ?? null,
+        files,
+    };
+    await writeManifest(manifestPath, manifest);
+    return summary;
+}
+/**
+ * The directory the adapter reads under a fetch root.
+ */
+export function varisInputPath(outRoot) {
+    return outRoot(SLUG);
+}
+export async function fetchVaris(options, report) {
+    await using client = new APIClient({ displayName: SLUG, retry: true });
+    // Awaited rather than returned, so the client is disposed after the downloads finish.
+    return await downloadVaris(client, {
+        outputDir: options.outRoot(SLUG),
+        force: options.force,
+        retries: options.retries,
+        retryDelayMs: options.retryDelayMs,
+        signal: options.signal,
+        report,
+    });
+}
+//# sourceMappingURL=varis.js.map

package/out/lv/tools/fetch/varis.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"varis.js","sourceRoot":"","sources":["../../../../lib/lv/tools/fetch/varis.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;GAcG;AAEH,OAAO,EAAE,SAAS,EAAE,MAAM,qBAAqB,CAAA;AAC/C,OAAO,EAAE,aAAa,EAAE,MAAM,+BAA+B,CAAA;AAC7D,OAAO,EAAE,OAAO,EAAE,MAAM,4BAA4B,CAAA;AACpD,OAAO,EAAE,eAAe,EAAE,MAAM,4BAA4B,CAAA;AAC5D,OAAO,EAAE,UAAU,EAAE,MAAM,sBAAsB,CAAA;AACjD,OAAO,EAAE,WAAW,EAAwB,MAAM,SAAS,CAAA;AAE3D,OAAO,EAAE,mBAAmB,EAAE,gBAAgB,EAAE,YAAY,EAAmB,MAAM,4BAA4B,CAAA;AAGjH,OAAO,EAAE,cAAc,EAAE,YAAY,EAAE,aAAa,EAAE,MAAM,uBAAuB,CAAA;AAEnF;;GAEG;AACH,MAAM,CAAC,MAAM,mBAAmB,GAAG,qBAAqB,CAAA;AAExD;;GAEG;AACH,MAAM,CAAC,MAAM,oBAAoB,GAAG,yDAAyD,mBAAmB,EAAE,CAAA;AAElH,MAAM,IAAI,GAAG,mBAAmB,CAAA;AA6BhC;;;;;;;GAOG;AACH,MAAM,UAAU,eAAe,CAAC,SAAkC,EAAE,QAAgB;IACnF,MAAM,KAAK,GAAG,SAAS,CAAC,IAAI,CAAC,CAAC,QAAQ,EAAE,EAAE;QACzC,MAAM,IAAI,GAAG,GAAG,CAAC,QAAQ,CAAC,QAAQ,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,IAAI,GAAG,CAAC,QAAQ,CAAC,GAAG,CAAC,CAAC,QAAQ,CAAC,CAAC,CAAC,QAAQ,CAAC,GAAG,CAAA;QAEvF,OAAO,IAAI,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC,CAAC,KAAK,QAAQ,CAAA;IAC3C,CAAC,CAAC,CAAA;IAEF,IAAI,CAAC,KAAK;QAAE,MAAM,IAAI,KAAK,CAAC,GAAG,IAAI,aAAa,mBAAmB,4BAA4B,QAAQ,EAAE,CAAC,CAAA;IAE1G,OAAO,KAAK,CAAA;AACb,CAAC;AAgBD,MAAM,CAAC,KAAK,UAAU,aAAa,CAClC,MAAgC,EAChC,OAA6B;IAE7B,MAAM,EAAE,MAAM,EAAE,GAAG,OAAO,CAAA;IAC1B,MAAM,OAAO,GAAG,WAAW,CAAC,IAAI,CAAC,OAAO,CAAC,SAAS,CAAC,CAAA;IACnD,MAAM,YAAY,GAAG,OAAO,CAAC,eAAe,CAAC,CAAA;IAE7C,MAAM,eAAe,CAAC,OAAO,CAAC,CAAA;IAC9B,MAAM,EAAE,CAAC,OAAO,IAAI,EAAE,CAAC,CAAA;IAEvB,MAAM,QAAQ,GAAG,MAAM,MAAM,CAAC,KAAK,CAA0B,EAAE,GAAG,EAAE,oBAAoB,EAAE,MAAM,EAAE,OAAO,CAAC,MAAM,EAAE,CAAC,CAAA;IACnH,MAAM,GAAG,GAAG,QAAQ,CAAC,IAAI,CAAC,MAAM,CAAA;IAEhC,IAAI,GAAG,CAAC,UAAU,KAAK,gBAAgB,EAAE,CAAC;QACzC,MAAM,EAAE,CAAC,mCAAmC,GAAG,CAAC,UAAU,IAAI,MAAM,SAAS,gBAAgB,EAAE,CAAC,CAAA;IACjG,CAAC;IAED,MAAM,QAAQ,GAAG,MAAM,YAAY,CAAgB,YAAY,CAAC,CAAA;IAChE,MAAM,aAAa,GAAG,IAAI,GAAG,CAAC,CAAC,QAAQ,EAAE,KAAK,IAAI,EAAE,CAAC,CAAC,GAAG,CAAC,CAAC,KAAK,EAAE,EAAE,CAAC,CAAC,KAAK,CAAC,QAAQ,EAAE,KAAK,CAAC,CAAC,CAAC,CAAA;IAC9F,MAAM,KAAK,GAAwB,EAAE,CAAA;IACrC,MAAM,OAAO,GAAiB,EAAE,OAAO,EAAE,CAAC,EAAE,OAAO,EAAE,CAAC,EAAE,MAAM,EAAE,CAAC,EAAE,WAAW,EAAE,EAAE,EAAE,CAAA;IAEpF,KAAK,MAAM,KAAK,IAAI,OAAO,CAAC,MAAM,IAAI,MAAM,CAAC,MAAM,CAAC,YAAY,CAAC,EAAE,CAAC;QACnE,IAAI,OAAO,CAAC,MAAM,EAAE,OAAO;YAAE,MAAK;QAElC,MAAM,QAAQ,GAAG,eAAe,CAAC,GAAG,CAAC,SAAS,IAAI,EAAE,EAAE,KAAK,CAAC,CAAA;QAC5D,MAAM,YAAY,GAAG,QAAQ,CAAC,aAAa,IAAI,QAAQ,CAAC,OAAO,IAAI,IAAI,CAAA;QACvE,MAAM,IAAI,GAAG,OAAO,CAAC,KAAK,CAAC,CAAA;QAC3B,MAAM,QAAQ,GAAG,aAAa,CAAC,GAAG,CAAC,KAAK,CAAC,CAAA;QACzC,MAAM,IAAI,GAAG,MAAM,OAAO,CAAC,IAAI,CAAC,CAAA;QAEhC,IACC,CAAC,OAAO,CAAC,KAAK;YACd,QAAQ;YACR,IAAI;YACJ,QAAQ,CAAC,UAAU,KAAK,QAAQ,CAAC,GAAG;YACpC,QAAQ,CAAC,aAAa,KAAK,YAAY;YACvC,QAAQ,CAAC,KAAK,KAAK,IAAI,CAAC,IAAI,EAC3B,CAAC;YACF,MAAM,EAAE,CAAC,KAAK,KAAK,gDAAgD,CAAC,CAAA;YACpE,KAAK,CAAC,IAAI,CAAC,QAAQ,CAAC,CAAA;YAEpB,OAAO,CAAC,OAAO,EAAE,CAAA;YAEjB,SAAQ;QACT,CAAC;QAED,MAAM,EAAE,KAAK,EAAE,GAAG,MAAM,cAAc,CAAC;YACtC,GAAG,EAAE,QAAQ,CAAC,GAAG;YACjB,IAAI;YACJ,OAAO,EAAE,OAAO,CAAC,OAAO;YACxB,YAAY,EAAE,OAAO,CAAC,YAAY;YAClC,MAAM;SACN,CAAC,CAAA;QAEF,MAAM,MAAM,GAAG,MAAM,UAAU,CAAC,IAAI,CAAC,CAAA;QAErC,MAAM,EAAE,CAAC,OAAO,KAAK,IAAI,aAAa,CAAC,SAAS,CAAC,KAAK,CAAC,WAAW,MAAM,EAAE,CAAC,CAAA;QAE3E,KAAK,CAAC,IAAI,CAAC;YACV,UAAU,EAAE,QAAQ,CAAC,GAAG;YACxB,QAAQ,EAAE,KAAK;YACf,KAAK;YACL,MAAM;YACN,aAAa,EAAE,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE;YACvC,aAAa,EAAE,QAAQ,CAAC,IAAI,EAAE,IAAI,EAAE,IAAI,IAAI;YAC5C,aAAa,EAAE,YAAY;SAC3B,CAAC,CAAA;QAEF,OAAO,CAAC,OAAO,EAAE,CAAA;IAClB,CAAC;IAED,MAAM,QAAQ,GAAkB;QAC/B,MAAM,EAAE,IAAI;QACZ,WAAW,EAAE,oBAAoB;QACjC,SAAS,EAAE,GAAG,CAAC,YAAY,EAAE,KAAK,IAAI,IAAI;QAC1C,UAAU,EAAE,GAAG,CAAC,UAAU,IAAI,IAAI;QAClC,aAAa,EAAE,GAAG,CAAC,aAAa,IAAI,IAAI;QACxC,KAAK;KACL,CAAA;IAED,MAAM,aAAa,CAAC,YAAY,EAAE,QAAQ,CAAC,CAAA;IAE3C,OAAO,OAAO,CAAA;AACf,CAAC;AAED;;GAEG;AACH,MAAM,UAAU,cAAc,CAAC,OAAoC;IAClE,OAAO,OAAO,CAAC,IAAI,CAAC,CAAA;AACrB,CAAC;AAQD,MAAM,CAAC,KAAK,UAAU,UAAU,CAAC,OAA0B,EAAE,MAA+B;IAC3F,YAAY,MAAM,GAAG,IAAI,SAAS,CAAC,EAAE,WAAW,EAAE,IAAI,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC,CAAA;IAEtE,sFAAsF;IACtF,OAAO,MAAM,aAAa,CAAC,MAAM,EAAE;QAClC,SAAS,EAAE,OAAO,CAAC,OAAO,CAAC,IAAI,CAAC;QAChC,KAAK,EAAE,OAAO,CAAC,KAAK;QACpB,OAAO,EAAE,OAAO,CAAC,OAAO;QACxB,YAAY,EAAE,OAAO,CAAC,YAAY;QAClC,MAAM,EAAE,OAAO,CAAC,MAAM;QACtB,MAAM;KACN,CAAC,CAAA;AACH,CAAC"}