@golemio/chmu 1.1.1-dev.2637274244 → 1.1.1-dev.2644315801

package/docs/implementation_documentation.md

@@ -2,120 +2,62 @@
 
 ## Záměr
 
-Modul slouží ke stažení ČHMÚ meteorologických dat ze dvou zdrojů:
-
-- **FTP pipeline** - hodinová CSV data z interního FTP (`data_source = 'ftp'`)
-- **Opendata pipeline** - desetiminutová JSON data z veřejného ČHMÚ opendata API (`data_source = 'opendata'`)
-
-Data z obou zdrojů se ukládají do stejné tabulky `chmu.measurements` pomocí UPSERT (PK: `measured_at`, `station_id`, `data_source`).
+Modul slouží ke stažení chmu dat z ftp agregovaných po hodině do csv souborů.
 
 ## Vstupní data
 
 ### Data aktivně stahujeme
 
-#### *ChmuDatasource* (FTP)
+Popis dat, jak je pomocí cronu a integration-engine stahujeme. Pokud jsou data stahována z více zdrojů, každý zdroj je popsán zvlášť.
+
+#### *ChmuDatasource*
 
 - zdroj dat
-  - golemio FTP
+  - golemio ftp
 - formát dat
-  - CSV soubor, oddělovač `;`, kódování UTF-8
-  - [validační schéma](https://gitlab.com/operator-ict/golemio/code/modules/chmu/-/blob/development/src/schema-definitions/datasources/ChmuSchemaProvider.ts)
+  - csv soubor
+  - [validační schéma: ](https://gitlab.com/operator-ict/golemio/code/modules/chmu/-/blob/development/src/schema-definitions/datasources/ChmuSchemaProvider.ts)
   - [příklad vstupních dat](https://gitlab.com/operator-ict/golemio/code/modules/chmu/-/blob/development/test/data/6443_2023020215.txt)
 - frekvence stahování
   - jednou za hodinu
-- název RabbitMQ fronty
+- název rabbitmq fronty
   - `chmu.downloadMeasurementsTask`
 
-#### *OpendataDatasource* (opendata)
-
-- zdroj dat
-  - ČHMÚ opendata
-  - URL: `https://opendata.chmi.cz/meteorology/climate/now/data/10m-{WSI}-{YYYYMMDD}.json`
-  - soubor pokrývá celý den; každou hodinu přibývají nové záznamy za uplynulou hodinu
-- formát dat
-  - JSON, long-format záznamy: `[STATION, ELEMENT, DT, VAL, FLAG, QUALITY]`
-  - FLAG: kód podmínky pro zvláštní meteorologické situace (např. `"V"`, `"A"`); typicky `""`
-  - QUALITY: `0.0` = dobrá, `1.0` = podezřelá, `2.0` = nízká kvalita, `3.0` = odhadnutá, `4.0` = chybějící, `5.0` = neznámá
-  - VAL: číselná hodnota, nebo `""` při chybějícím měření (QUALITY = 4.0)
-  - DT ve formátu ISO 8601 UTC (`2026-06-25T10:00:00Z`)
-- frekvence stahování
-  - jednou denně (soubor pokrývá celý předchozí den)
-- název RabbitMQ fronty
-  - `chmu.downloadOpendataMeasurementsTask`
-- poznámka
-  - Zpracovány jsou pouze stanice s vyplněným sloupcem `wsi` v `chmu.stations`; ostatní jsou přeskočeny.
-
 ## Zpracování dat / transformace
 
+Popis transformace a případného obohacení dat. Zaměřeno hlavně na workery a jejich metody.
+
 ### *ChmuWorker*
 
-#### *DownloadMeasurementsTask* (FTP)
+Stručný popis workeru.
 
-- vstupní RabbitMQ fronta
-  - `chmu.downloadMeasurementsTask`
-  - parametry `from` a `to` - volitelné ISO 8601 timestampy; bez parametrů stáhne aktuální hodinu; s rozsahem generuje subtasky po hodinách
+#### *DownloadMeasurementsTask*
+
+- vstupní rabbitmq fronta
+  - název `chmu.downloadMeasurementsTask`
+  - parametry `from` and `to` volitelné parametry v iso formátu
 - datové zdroje
-  - `ChmuDatasource` - stáhne hodinový CSV soubor z FTP
+  - `ChmuDatasource`
 - transformace
-  - [MeasurementsTransformation](https://gitlab.com/operator-ict/golemio/code/modules/chmu/-/blob/development/src/integration-engine/transformations/MeasurementsTransformation.ts)
-  - mapování CSV polí na DB sloupce, převod desetinné čárky, `data_source = 'ftp'`
+  - odkaz na transformaci dat, případně stručný popis tranformace
+  - [transformace dat](https://gitlab.com/operator-ict/golemio/code/modules/chmu/-/blob/development/src/integration-engine/transformations/MeasurementsTransformation.ts)
 - data modely
   - [MeasurementModel](https://gitlab.com/operator-ict/golemio/code/modules/chmu/-/blob/development/src/schema-definitions/definitions/models/MeasurementModel.ts)
 
-#### *DownloadOpendataMeasurementsTask* (opendata)
-
-- vstupní RabbitMQ fronta
-  - `chmu.downloadOpendataMeasurementsTask`
-  - parametr `date` - volitelný ISO 8601 datum; bez parametru stáhne aktuální den
-- tok zpracování
-  1. `StationsRepository` - načte stanice s vyplněným WSI z `chmu.stations`
-  2. `OpendataDatasource` - pro každou stanici stáhne denní 10m JSON soubor
-  3. Přiřazení `station_id` dle WSI -> `station_id` mappingu
-  4. `OpendataMeasurementsTransformation` - pivot long->wide; skupinování dle `(station_id, DT)`; `data_source = 'opendata'`
-  5. `MeasurementsRepository` - UPSERT do `chmu.measurements`
-- mapování ELEMENT -> DB sloupec
-
-  | ELEMENT | DB sloupec | Poznámka |
-  |---------|-----------|---------|
-  | T | air_temp | |
-  | H | air_hum | |
-  | P | air_pressure | |
-  | F | wind_speed | |
-  | D | wind_dir | |
-  | SRA10M | precip | |
-  | SSV10M | sunlight | ÷ 360 (s -> desetinné hodiny) |
-  | TMA | air_temp_max | |
-  | TMI | air_temp_min | |
-  | TPM | air_temp_ground | |
-  | Fprum | wind_speed_avg | |
-  | Dprum | wind_dir_avg | |
-  | Fmax | wind_gust | |
-  | Dmax | wind_gust_dir | |
-  | Casmax | wind_gust_time | |
-  | SCEa | snow_depth | |
-  | SVHa | snow_water | |
-  | RGLB10 | radiation_glob | |
-  | REUV10 / REUV25 | radiation_uv | |
-  | T05–T100 | soil_temp_5cm–soil_temp_100cm | |
 
-- data modely
-  - [MeasurementModel](https://gitlab.com/operator-ict/golemio/code/modules/chmu/-/blob/development/src/schema-definitions/definitions/models/MeasurementModel.ts)
 
 ## Uložení dat
 
+Popis ukládání dat.
+
 ### Obecné
 
 - typ databáze
-  - PostgreSQL
-- databázové schéma
+  - PSQL
+- datábázové schéma
   - schéma: `chmu`
   ![chmu er diagram](assets/chmu.erd.png)
 - retence dat
   - data jsou zachována
 - AsyncApi dokumentace
   - [AsyncApi](./asyncapi.yaml)
-
-### Poznámky k datové kvalitě
-
-- Sloupce `soil_hum_0_10`, `soil_hum_10_50`, `soil_hum_50_100` zůstávají v DB, ale opendata zdroj půdní vlhkost neobsahuje - všechny záznamy s `data_source = 'opendata'` mají tyto sloupce `NULL`.
-- Timezone: DT z opendata přichází jako UTC a je převedeno do Europe/Prague pro výpočet zobrazovacích polí (`time`, `year`, `month`, `day`).

package/package.json

@@ -1,33 +1,15 @@
 {
     "name": "@golemio/chmu",
-    "version": "1.1.1-dev.2637274244",
+    "version": "1.1.1-dev.2644315801",
     "description": "Golemio CHMU module",
     "main": "dist/index.js",
     "types": "dist/index.d.ts",
-    "imports": {
-        "#ie": {
-            "development": "./src/integration-engine/index.ts",
-            "default": "./dist/integration-engine/index.js"
-        },
-        "#ie/*": {
-            "development": "./src/integration-engine/*.ts",
-            "default": "./dist/integration-engine/*.js"
-        },
-        "#sch": {
-            "development": "./src/schema-definitions/index.ts",
-            "default": "./dist/schema-definitions/index.js"
-        },
-        "#sch/*": {
-            "development": "./src/schema-definitions/*.ts",
-            "default": "./dist/schema-definitions/*.js"
-        }
-    },
     "scripts": {
-        "build": "rimraf ./dist && tsc -p ./tsconfig.build.json",
+        "build": "rimraf ./dist && tspc -p ./tsconfig.build.json",
         "build-minimal": "run-s 'build -- --sourceMap false --declaration false'",
         "build-watch": "run-s 'build -- --watch --preserveWatchOutput'",
         "prepare-db": "golemio import-db-data --postgres",
-        "test:only": "cross-env NODE_ENV=test NODE_OPTIONS=\"--conditions=development --import=tsx\" mocha --exit --check-leaks --timeout 120000 -r dotenv/config --file 'test/setup.ts' 'test/**/*.test.ts'",
+        "test:only": "cross-env NODE_ENV=test mocha --exit --check-leaks --timeout 120000 -r ts-node/register -r tsconfig-paths/register -r dotenv/config --file 'test/setup.ts' 'test/**/*.test.ts'",
         "test": "run-s prepare-db test:only",
         "test-debug": "run-s 'test -- --inspect-brk=9230'",
         "coverage:only": "nyc --reporter=text --reporter=lcov npm run test:only -- -r source-map-support/register",
@@ -53,10 +35,9 @@
         "@commitlint/cli": "^11.0.0",
         "@commitlint/config-conventional": "^11.0.0",
         "@golemio/cli": "1.11.2",
-        "@golemio/core": "3.2.2-dev.2622707631",
+        "@golemio/core": "3.1.1",
         "@golemio/db-common": "1.2.2",
         "@golemio/eslint-config": "1.1.4",
-        "@swc/core": "^1.15.33",
         "@types/chai": "^5.2.3",
         "@types/chai-as-promised": "^8.0.2",
         "@types/mocha": "^10.0.10",
@@ -78,9 +59,12 @@
         "sinon": "^21.0.1",
         "source-map-support": "0.5.21",
         "supertest": "^7.1.4",
-        "tsx": "^4.20.6",
+        "ts-node": "^10.9.1",
+        "ts-patch": "3.0.0-beta3",
+        "tsconfig-paths": "^4.2.0",
         "typedoc": "^0.24.8",
-        "typescript": "6.0.3"
+        "typescript": "5.1.3",
+        "typescript-transform-paths": "^3.4.6"
     },
     "peerDependencies": {
         "@golemio/core": ">=1.7.0"

package/db/migrations/postgresql/20260619120000-opendata-columns.js

@@ -1,49 +0,0 @@
-'use strict';
-
-var dbm;
-var type;
-var seed;
-var fs = require('fs');
-var path = require('path');
-var Promise;
-
-exports.setup = function(options, seedLink) {
-  dbm = options.dbmigrate;
-  type = dbm.dataType;
-  seed = seedLink;
-  Promise = options.Promise;
-};
-
-exports.up = function(db) {
-  var filePath = path.join(__dirname, 'sqls', '20260619120000-opendata-columns-up.sql');
-  return new Promise( function( resolve, reject ) {
-    fs.readFile(filePath, {encoding: 'utf-8'}, function(err,data){
-      if (err) return reject(err);
-      console.log('received data: ' + data);
-
-      resolve(data);
-    });
-  })
-  .then(function(data) {
-    return db.runSql(data);
-  });
-};
-
-exports.down = function(db) {
-  var filePath = path.join(__dirname, 'sqls', '20260619120000-opendata-columns-down.sql');
-  return new Promise( function( resolve, reject ) {
-    fs.readFile(filePath, {encoding: 'utf-8'}, function(err,data){
-      if (err) return reject(err);
-      console.log('received data: ' + data);
-
-      resolve(data);
-    });
-  })
-  .then(function(data) {
-    return db.runSql(data);
-  });
-};
-
-exports._meta = {
-  "version": 1
-};

package/db/migrations/postgresql/sqls/20260619120000-opendata-columns-down.sql

@@ -1,36 +0,0 @@
-ALTER TABLE measurements
-    DROP CONSTRAINT measurements_pk,
-    ADD CONSTRAINT measurements_pk PRIMARY KEY (measured_at, station_id);
-
-ALTER TABLE measurements
-    DROP COLUMN IF EXISTS air_temp_max,
-    DROP COLUMN IF EXISTS air_temp_min,
-    DROP COLUMN IF EXISTS air_temp_ground,
-    DROP COLUMN IF EXISTS wind_speed_avg,
-    DROP COLUMN IF EXISTS wind_dir_avg,
-    DROP COLUMN IF EXISTS wind_gust,
-    DROP COLUMN IF EXISTS wind_gust_dir,
-    DROP COLUMN IF EXISTS wind_gust_time,
-    DROP COLUMN IF EXISTS snow_depth,
-    DROP COLUMN IF EXISTS snow_water,
-    DROP COLUMN IF EXISTS radiation_glob,
-    DROP COLUMN IF EXISTS radiation_uv,
-    DROP COLUMN IF EXISTS soil_temp_5cm,
-    DROP COLUMN IF EXISTS soil_temp_10cm,
-    DROP COLUMN IF EXISTS soil_temp_20cm,
-    DROP COLUMN IF EXISTS soil_temp_50cm,
-    DROP COLUMN IF EXISTS soil_temp_100cm,
-    DROP COLUMN IF EXISTS data_source;
-
-ALTER TABLE stations
-    DROP COLUMN IF EXISTS wsi,
-    DROP COLUMN IF EXISTS air_temp_max,
-    DROP COLUMN IF EXISTS air_temp_min,
-    DROP COLUMN IF EXISTS air_temp_ground,
-    DROP COLUMN IF EXISTS wind_speed_avg,
-    DROP COLUMN IF EXISTS wind_gust,
-    DROP COLUMN IF EXISTS snow_depth,
-    DROP COLUMN IF EXISTS snow_water,
-    DROP COLUMN IF EXISTS radiation_glob,
-    DROP COLUMN IF EXISTS radiation_uv,
-    DROP COLUMN IF EXISTS soil_temp;

package/db/migrations/postgresql/sqls/20260619120000-opendata-columns-up.sql

@@ -1,40 +0,0 @@
--- Add WSI identifier and boolean flags for new measurement elements to stations
--- NOTE: Populate chmu.stations.wsi and the boolean flag columns (manually) before running the opendata pipeline.
-ALTER TABLE stations
-    ADD COLUMN wsi             varchar NULL,
-    ADD COLUMN air_temp_max    boolean NULL,
-    ADD COLUMN air_temp_min    boolean NULL,
-    ADD COLUMN air_temp_ground boolean NULL,
-    ADD COLUMN wind_speed_avg  boolean NULL,
-    ADD COLUMN wind_gust       boolean NULL,
-    ADD COLUMN snow_depth      boolean NULL,
-    ADD COLUMN snow_water      boolean NULL,
-    ADD COLUMN radiation_glob  boolean NULL,
-    ADD COLUMN radiation_uv    boolean NULL,
-    ADD COLUMN soil_temp       boolean NULL;
-
--- Add new measurement columns and data_source to measurements
-ALTER TABLE measurements
-    ADD COLUMN air_temp_max     double precision NULL,
-    ADD COLUMN air_temp_min     double precision NULL,
-    ADD COLUMN air_temp_ground  double precision NULL,
-    ADD COLUMN wind_speed_avg   double precision NULL,
-    ADD COLUMN wind_dir_avg     double precision NULL,
-    ADD COLUMN wind_gust        double precision NULL,
-    ADD COLUMN wind_gust_dir    double precision NULL,
-    ADD COLUMN wind_gust_time   integer          NULL,
-    ADD COLUMN snow_depth       double precision NULL,
-    ADD COLUMN snow_water       double precision NULL,
-    ADD COLUMN radiation_glob   double precision NULL,
-    ADD COLUMN radiation_uv     double precision NULL,
-    ADD COLUMN soil_temp_5cm    double precision NULL,
-    ADD COLUMN soil_temp_10cm   double precision NULL,
-    ADD COLUMN soil_temp_20cm   double precision NULL,
-    ADD COLUMN soil_temp_50cm   double precision NULL,
-    ADD COLUMN soil_temp_100cm  double precision NULL,
-    ADD COLUMN data_source      varchar(10)      NOT NULL DEFAULT 'ftp';
-
--- Add data_source to PK to prevent FTP/opendata record collision at shared timestamps
-ALTER TABLE measurements
-    DROP CONSTRAINT measurements_pk,
-    ADD CONSTRAINT measurements_pk PRIMARY KEY (measured_at, station_id, data_source);

package/dist/integration-engine/data-access/StationsRepository.d.ts

@@ -1,8 +0,0 @@
-import { IModel, PostgresModel } from "@golemio/core/dist/integration-engine";
-export declare class StationsRepository extends PostgresModel implements IModel {
-    constructor();
-    getStationsWithWsi: () => Promise<Array<{
-        station_id: string;
-        wsi: string;
-    }>>;
-}

package/dist/integration-engine/data-access/StationsRepository.js

@@ -1,57 +0,0 @@
-"use strict";
-var __decorate = (this && this.__decorate) || function (decorators, target, key, desc) {
-    var c = arguments.length, r = c < 3 ? target : desc === null ? desc = Object.getOwnPropertyDescriptor(target, key) : desc, d;
-    if (typeof Reflect === "object" && typeof Reflect.decorate === "function") r = Reflect.decorate(decorators, target, key, desc);
-    else for (var i = decorators.length - 1; i >= 0; i--) if (d = decorators[i]) r = (c < 3 ? d(r) : c > 3 ? d(target, key, r) : d(target, key)) || r;
-    return c > 3 && r && Object.defineProperty(target, key, r), r;
-};
-var __metadata = (this && this.__metadata) || function (k, v) {
-    if (typeof Reflect === "object" && typeof Reflect.metadata === "function") return Reflect.metadata(k, v);
-};
-Object.defineProperty(exports, "__esModule", { value: true });
-exports.StationsRepository = void 0;
-const integration_engine_1 = require("@golemio/core/dist/integration-engine");
-const golemio_validator_1 = require("@golemio/core/dist/shared/golemio-validator");
-const sequelize_1 = require("@golemio/core/dist/shared/sequelize");
-const tsyringe_1 = require("@golemio/core/dist/shared/tsyringe");
-const const_1 = require("../../const");
-class StationWsiModel extends sequelize_1.Model {
-}
-StationWsiModel.attributeModel = {
-    station_id: { type: sequelize_1.DataTypes.STRING, primaryKey: true },
-    wsi: { type: sequelize_1.DataTypes.STRING, allowNull: true },
-};
-let StationsRepository = class StationsRepository extends integration_engine_1.PostgresModel {
-    constructor() {
-        super("ChmuStationsRepository", {
-            outputSequelizeAttributes: StationWsiModel.attributeModel,
-            pgTableName: "stations",
-            pgSchema: const_1.SCHEMA_NAME,
-            savingType: "insertOrUpdate",
-        }, new golemio_validator_1.JSONSchemaValidator("ChmuStationsValidator", {
-            type: "array",
-            items: {
-                type: "object",
-                properties: {
-                    station_id: { type: "string" },
-                    wsi: { oneOf: [{ type: "string" }, { type: "null", nullable: true }] },
-                },
-                required: ["station_id"],
-            },
-        }));
-        this.getStationsWithWsi = async () => {
-            const rows = await this.sequelizeModel.findAll({
-                where: { wsi: { [sequelize_1.Op.not]: null } },
-                attributes: ["station_id", "wsi"],
-                raw: true,
-            });
-            return rows;
-        };
-    }
-};
-exports.StationsRepository = StationsRepository;
-exports.StationsRepository = StationsRepository = __decorate([
-    (0, tsyringe_1.injectable)(),
-    __metadata("design:paramtypes", [])
-], StationsRepository);
-//# sourceMappingURL=StationsRepository.js.map

package/dist/integration-engine/data-access/StationsRepository.js.map

@@ -1 +0,0 @@
-{"version":3,"file":"StationsRepository.js","sourceRoot":"","sources":["../../../src/integration-engine/data-access/StationsRepository.ts"],"names":[],"mappings":";;;;;;;;;;;;AAAA,8EAA8E;AAC9E,mFAAkF;AAClF,mEAA4F;AAC5F,iEAAgE;AAChE,uCAA0C;AAO1C,MAAM,eAAgB,SAAQ,iBAAkB;;AAI9B,8BAAc,GAAkD;IAC1E,UAAU,EAAE,EAAE,IAAI,EAAE,qBAAS,CAAC,MAAM,EAAE,UAAU,EAAE,IAAI,EAAE;IACxD,GAAG,EAAE,EAAE,IAAI,EAAE,qBAAS,CAAC,MAAM,EAAE,SAAS,EAAE,IAAI,EAAE;CACnD,CAAC;AAIC,IAAM,kBAAkB,GAAxB,MAAM,kBAAmB,SAAQ,kCAAa;IACjD;QACI,KAAK,CACD,wBAAwB,EACxB;YACI,yBAAyB,EAAE,eAAe,CAAC,cAAc;YACzD,WAAW,EAAE,UAAU;YACvB,QAAQ,EAAE,mBAAW;YACrB,UAAU,EAAE,gBAAgB;SAC/B,EACD,IAAI,uCAAmB,CAAC,uBAAuB,EAAE;YAC7C,IAAI,EAAE,OAAO;YACb,KAAK,EAAE;gBACH,IAAI,EAAE,QAAQ;gBACd,UAAU,EAAE;oBACR,UAAU,EAAE,EAAE,IAAI,EAAE,QAAQ,EAAE;oBAC9B,GAAG,EAAE,EAAE,KAAK,EAAE,CAAC,EAAE,IAAI,EAAE,QAAQ,EAAE,EAAE,EAAE,IAAI,EAAE,MAAM,EAAE,QAAQ,EAAE,IAAI,EAAE,CAAC,EAAE;iBACzE;gBACD,QAAQ,EAAE,CAAC,YAAY,CAAC;aAC3B;SACJ,CAAC,CACL,CAAC;QAGC,uBAAkB,GAAG,KAAK,IAAyD,EAAE;YACxF,MAAM,IAAI,GAAG,MAAM,IAAI,CAAC,cAAc,CAAC,OAAO,CAAkB;gBAC5D,KAAK,EAAE,EAAE,GAAG,EAAE,EAAE,CAAC,cAAE,CAAC,GAAG,CAAC,EAAE,IAAI,EAAE,EAAE;gBAClC,UAAU,EAAE,CAAC,YAAY,EAAE,KAAK,CAAC;gBACjC,GAAG,EAAE,IAAI;aACZ,CAAC,CAAC;YACH,OAAO,IAA6D,CAAC;QACzE,CAAC,CAAC;IATF,CAAC;CAUJ,CAAA;AAhCY,gDAAkB;6BAAlB,kBAAkB;IAD9B,IAAA,qBAAU,GAAE;;GACA,kBAAkB,CAgC9B"}

package/dist/integration-engine/datasources/OpendataDatasource.d.ts

@@ -1,30 +0,0 @@
-import { ISimpleConfig } from "@golemio/core/dist/helpers/configuration/ISimpleConfig";
-/** Raw record shape as returned by the ČHMÚ opendata API after unpacking values rows. */
-interface IRawOpendataRecord {
-    STATION: string;
-    ELEMENT: string;
-    DT: string;
-    VAL: number | "";
-    FLAG: string;
-    QUALITY: number;
-}
-export default class OpendataDatasource {
-    name: string;
-    private readonly responseValidator;
-    private readonly recordValidator;
-    private readonly baseUrl;
-    constructor(config: ISimpleConfig);
-    /**
-     * Fetches the 10-minute JSON file for one station from ČHMÚ opendata.
-     * Returns unpacked records with named fields (STATION = WSI).
-     *
-     * @param wsi    Station WSI identifier (e.g. "0-20000-0-11520")
-     * @param date   Date for which to fetch data (defaults to today)
-     */
-    getData(wsi: string, date?: Date): Promise<IRawOpendataRecord[]>;
-    private getDatasource;
-    private parseHeader;
-    private mapToRecords;
-    private buildUrl;
-}
-export {};

package/dist/integration-engine/datasources/OpendataDatasource.js

@@ -1,80 +0,0 @@
-"use strict";
-var __decorate = (this && this.__decorate) || function (decorators, target, key, desc) {
-    var c = arguments.length, r = c < 3 ? target : desc === null ? desc = Object.getOwnPropertyDescriptor(target, key) : desc, d;
-    if (typeof Reflect === "object" && typeof Reflect.decorate === "function") r = Reflect.decorate(decorators, target, key, desc);
-    else for (var i = decorators.length - 1; i >= 0; i--) if (d = decorators[i]) r = (c < 3 ? d(r) : c > 3 ? d(target, key, r) : d(target, key)) || r;
-    return c > 3 && r && Object.defineProperty(target, key, r), r;
-};
-var __metadata = (this && this.__metadata) || function (k, v) {
-    if (typeof Reflect === "object" && typeof Reflect.metadata === "function") return Reflect.metadata(k, v);
-};
-var __param = (this && this.__param) || function (paramIndex, decorator) {
-    return function (target, key) { decorator(target, key, paramIndex); }
-};
-var __importDefault = (this && this.__importDefault) || function (mod) {
-    return (mod && mod.__esModule) ? mod : { "default": mod };
-};
-Object.defineProperty(exports, "__esModule", { value: true });
-const CoreToken_1 = require("@golemio/core/dist/helpers/ioc/CoreToken");
-const datasources_1 = require("@golemio/core/dist/integration-engine/datasources");
-const HTTPFetchProtocolStrategy_1 = require("@golemio/core/dist/integration-engine/datasources/protocol-strategy/HTTPFetchProtocolStrategy");
-const luxon_1 = require("@golemio/core/dist/shared/luxon");
-const golemio_validator_1 = require("@golemio/core/dist/shared/golemio-validator");
-const tsyringe_1 = require("@golemio/core/dist/shared/tsyringe");
-const OpendataSchemaProvider_1 = __importDefault(require("#sch/datasources/OpendataSchemaProvider"));
-const REQUIRED_COLUMNS = ["STATION", "ELEMENT", "DT", "VAL", "FLAG", "QUALITY"];
-let OpendataDatasource = class OpendataDatasource {
-    constructor(config) {
-        this.name = "OpendataDatasource";
-        this.responseValidator = new golemio_validator_1.JSONSchemaValidator("OpendataResponseValidator", OpendataSchemaProvider_1.default.getResponseSchema());
-        this.recordValidator = new golemio_validator_1.JSONSchemaValidator("OpendataRecordValidator", OpendataSchemaProvider_1.default.get());
-        this.baseUrl = config.getValue("module.chmu.opendata.baseUrl");
-    }
-    /**
-     * Fetches the 10-minute JSON file for one station from ČHMÚ opendata.
-     * Returns unpacked records with named fields (STATION = WSI).
-     *
-     * @param wsi    Station WSI identifier (e.g. "0-20000-0-11520")
-     * @param date   Date for which to fetch data (defaults to today)
-     */
-    async getData(wsi, date = new Date()) {
-        const { header, values } = await this.getDatasource(this.buildUrl(wsi, date)).getAll();
-        const colIndex = this.parseHeader(header);
-        const records = this.mapToRecords(values, colIndex);
-        await this.recordValidator.Validate(records);
-        return records;
-    }
-    getDatasource(url) {
-        return new datasources_1.DataSource("OpendataHttpDataSource", new HTTPFetchProtocolStrategy_1.HTTPFetchProtocolStrategy({ url, method: "GET", responseType: "json" }), new datasources_1.JSONDataTypeStrategy({ resultsPath: "data.data" }), this.responseValidator);
-    }
-    parseHeader(header) {
-        const colIndex = Object.fromEntries(header.split(",").map((c, i) => [c, i]));
-        const missing = REQUIRED_COLUMNS.filter((c) => colIndex[c] === undefined);
-        if (missing.length > 0) {
-            throw new Error(`OpendataDatasource: missing columns in header: ${missing.join(", ")}`);
-        }
-        return colIndex;
-    }
-    mapToRecords(values, colIndex) {
-        return values.map((row) => ({
-            STATION: row[colIndex["STATION"]],
-            ELEMENT: row[colIndex["ELEMENT"]],
-            DT: row[colIndex["DT"]],
-            VAL: row[colIndex["VAL"]],
-            FLAG: row[colIndex["FLAG"]],
-            QUALITY: row[colIndex["QUALITY"]],
-        }));
-    }
-    buildUrl(wsi, date) {
-        const dt = luxon_1.DateTime.fromJSDate(date).setZone("Europe/Prague");
-        const yyyymmdd = dt.toFormat("yyyyMMdd");
-        return `${this.baseUrl}/10m-${wsi}-${yyyymmdd}.json`;
-    }
-};
-OpendataDatasource = __decorate([
-    (0, tsyringe_1.injectable)(),
-    __param(0, (0, tsyringe_1.inject)(CoreToken_1.CoreToken.SimpleConfig)),
-    __metadata("design:paramtypes", [Object])
-], OpendataDatasource);
-exports.default = OpendataDatasource;
-//# sourceMappingURL=OpendataDatasource.js.map

package/dist/integration-engine/datasources/OpendataDatasource.js.map

@@ -1 +0,0 @@
-{"version":3,"file":"OpendataDatasource.js","sourceRoot":"","sources":["../../../src/integration-engine/datasources/OpendataDatasource.ts"],"names":[],"mappings":";;;;;;;;;;;;;;;;;AACA,wEAAqE;AACrE,mFAAqG;AACrG,6IAA0I;AAC1I,2DAA2D;AAC3D,mFAAkF;AAClF,iEAAwE;AACxE,qGAA6E;AAY7E,MAAM,gBAAgB,GAA4C,CAAC,SAAS,EAAE,SAAS,EAAE,IAAI,EAAE,KAAK,EAAE,MAAM,EAAE,SAAS,CAAC,CAAC;AAG1G,IAAM,kBAAkB,GAAxB,MAAM,kBAAkB;IAWnC,YAA4C,MAAqB;QAV1D,SAAI,GAAG,oBAAoB,CAAC;QAElB,sBAAiB,GAAG,IAAI,uCAAmB,CACxD,2BAA2B,EAC3B,gCAAsB,CAAC,iBAAiB,EAAE,CAC7C,CAAC;QACe,oBAAe,GAAG,IAAI,uCAAmB,CAAC,yBAAyB,EAAE,gCAAsB,CAAC,GAAG,EAAE,CAAC,CAAC;QAKhH,IAAI,CAAC,OAAO,GAAG,MAAM,CAAC,QAAQ,CAAC,8BAA8B,CAAC,CAAC;IACnE,CAAC;IAED;;;;;;OAMG;IACI,KAAK,CAAC,OAAO,CAAC,GAAW,EAAE,OAAa,IAAI,IAAI,EAAE;QACrD,MAAM,EAAE,MAAM,EAAE,MAAM,EAAE,GAAG,MAAM,IAAI,CAAC,aAAa,CAAC,IAAI,CAAC,QAAQ,CAAC,GAAG,EAAE,IAAI,CAAC,CAAC,CAAC,MAAM,EAAE,CAAC;QACvF,MAAM,QAAQ,GAAG,IAAI,CAAC,WAAW,CAAC,MAAM,CAAC,CAAC;QAC1C,MAAM,OAAO,GAAG,IAAI,CAAC,YAAY,CAAC,MAAM,EAAE,QAAQ,CAAC,CAAC;QACpD,MAAM,IAAI,CAAC,eAAe,CAAC,QAAQ,CAAC,OAAO,CAAC,CAAC;QAC7C,OAAO,OAAO,CAAC;IACnB,CAAC;IAEO,aAAa,CAAC,GAAW;QAC7B,OAAO,IAAI,wBAAU,CACjB,wBAAwB,EACxB,IAAI,qDAAyB,CAAC,EAAE,GAAG,EAAE,MAAM,EAAE,KAAK,EAAE,YAAY,EAAE,MAAM,EAAE,CAAC,EAC3E,IAAI,kCAAoB,CAAC,EAAE,WAAW,EAAE,WAAW,EAAE,CAAC,EACtD,IAAI,CAAC,iBAAiB,CACzB,CAAC;IACN,CAAC;IAEO,WAAW,CAAC,MAAc;QAC9B,MAAM,QAAQ,GAAG,MAAM,CAAC,WAAW,CAAC,MAAM,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC,CAAC,CAAC;QAC7E,MAAM,OAAO,GAAG,gBAAgB,CAAC,MAAM,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,QAAQ,CAAC,CAAC,CAAC,KAAK,SAAS,CAAC,CAAC;QAC1E,IAAI,OAAO,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;YACrB,MAAM,IAAI,KAAK,CAAC,kDAAkD,OAAO,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CAAC,CAAC;QAC5F,CAAC;QACD,OAAO,QAAQ,CAAC;IACpB,CAAC;IAEO,YAAY,CAAC,MAAmB,EAAE,QAAgC;QACtE,OAAO,MAAM,CAAC,GAAG,CAAC,CAAC,GAAG,EAAE,EAAE,CAAC,CAAC;YACxB,OAAO,EAAE,GAAG,CAAC,QAAQ,CAAC,SAAS,CAAC,CAAW;YAC3C,OAAO,EAAE,GAAG,CAAC,QAAQ,CAAC,SAAS,CAAC,CAAW;YAC3C,EAAE,EAAE,GAAG,CAAC,QAAQ,CAAC,IAAI,CAAC,CAAW;YACjC,GAAG,EAAE,GAAG,CAAC,QAAQ,CAAC,KAAK,CAAC,CAAgB;YACxC,IAAI,EAAE,GAAG,CAAC,QAAQ,CAAC,MAAM,CAAC,CAAW;YACrC,OAAO,EAAE,GAAG,CAAC,QAAQ,CAAC,SAAS,CAAC,CAAW;SAC9C,CAAC,CAAC,CAAC;IACR,CAAC;IAEO,QAAQ,CAAC,GAAW,EAAE,IAAU;QACpC,MAAM,EAAE,GAAG,gBAAQ,CAAC,UAAU,CAAC,IAAI,CAAC,CAAC,OAAO,CAAC,eAAe,CAAC,CAAC;QAC9D,MAAM,QAAQ,GAAG,EAAE,CAAC,QAAQ,CAAC,UAAU,CAAC,CAAC;QACzC,OAAO,GAAG,IAAI,CAAC,OAAO,QAAQ,GAAG,IAAI,QAAQ,OAAO,CAAC;IACzD,CAAC;CACJ,CAAA;AAhEoB,kBAAkB;IADtC,IAAA,qBAAU,GAAE;IAYI,WAAA,IAAA,iBAAM,EAAC,qBAAS,CAAC,YAAY,CAAC,CAAA;;GAX1B,kBAAkB,CAgEtC;kBAhEoB,kBAAkB"}

package/dist/integration-engine/transformations/OpendataMeasurementsTransformation.d.ts

@@ -1,15 +0,0 @@
-import IInputOpendataRecord from "#sch/datasources/interfaces/IInputOpendataRecord";
-import { IMeasurementDto } from "#sch/definitions/interfaces/IMeasurementDto";
-import { ITransformation } from "@golemio/core/dist/integration-engine";
-import { AbstractTransformation } from "@golemio/core/dist/helpers/transformation/AbstractTransformation";
-export declare class OpendataMeasurementsTransformation extends AbstractTransformation<IInputOpendataRecord[], IMeasurementDto | null> implements ITransformation {
-    name: string;
-    /**
-     * Pivots long-format opendata records into wide IMeasurementDto rows.
-     * Groups by (station_id, DT) and maps each ELEMENT to its DB column.
-     * DT is UTC ISO 8601; year/month/day/time are expressed in Europe/Prague local time.
-     */
-    transform(data: IInputOpendataRecord[]): Promise<IMeasurementDto[]>;
-    protected transformInternal: (records: IInputOpendataRecord[]) => IMeasurementDto | null;
-    private groupByStationAndDt;
-}