@tricoteuses/senat 2.9.1 → 2.9.6

package/LICENSE.md

@@ -1,22 +1,22 @@
-# Tricoteuses-Senat
-
-## _Handle French Sénat's open data_
-
-By: Emmanuel Raviart <mailto:emmanuel@raviart.com>
-
-Copyright (C) 2019, 2020, 2021 Emmanuel Raviart
-
-https://git.tricoteuses.fr/logiciels/tricoteuses-senat
-
-> Tricoteuses-Senat is free software; you can redistribute it and/or modify
-> it under the terms of the GNU Affero General Public License as
-> published by the Free Software Foundation, either version 3 of the
-> License, or (at your option) any later version.
->
-> Tricoteuses-Senat is distributed in the hope that it will be useful,
-> but WITHOUT ANY WARRANTY; without even the implied warranty of
-> MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
-> GNU Affero General Public License for more details.
->
-> You should have received a copy of the GNU Affero General Public License
-> along with this program. If not, see <http://www.gnu.org/licenses/>.
+# Tricoteuses-Senat
+
+## _Handle French Sénat's open data_
+
+By: Emmanuel Raviart <mailto:emmanuel@raviart.com>
+
+Copyright (C) 2019, 2020, 2021 Emmanuel Raviart
+
+https://git.tricoteuses.fr/logiciels/tricoteuses-senat
+
+> Tricoteuses-Senat is free software; you can redistribute it and/or modify
+> it under the terms of the GNU Affero General Public License as
+> published by the Free Software Foundation, either version 3 of the
+> License, or (at your option) any later version.
+>
+> Tricoteuses-Senat is distributed in the hope that it will be useful,
+> but WITHOUT ANY WARRANTY; without even the implied warranty of
+> MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+> GNU Affero General Public License for more details.
+>
+> You should have received a copy of the GNU Affero General Public License
+> along with this program. If not, see <http://www.gnu.org/licenses/>.

package/README.md

@@ -1,116 +1,116 @@
-# Tricoteuses-Senat
-
-## _Retrieve, clean up & handle  French Sénat's open data_
-
-## Requirements
-
-- Node >= 22
-
-## Installation
-
-```bash
-git clone https://git.tricoteuses.fr/logiciels/tricoteuses-senat
-cd tricoteuses-senat/
-```
-
-Create a `.env` file to set PostgreSQL database informations and other configuration variables (you can use `example.env` as a template). Then
-
-```bash
-npm install
-```
-
-### Database creation (not needed if downloading with Docker image)
-
-#### Using Docker
-
-```bash
-docker run --name local-postgres -d -p 5432:5432 -e POSTGRES_PASSWORD=$YOUR_CUSTOM_DB_PASSWORD postgres
-# Default Postgres user is postgres
-# But scripts require an "opendata" role
-docker exec -it local-postgres psql -U postgres -c "CREATE ROLE opendata;"
-```
-
-## Download data
-
-Create a folder where the data will be downloaded and run the following command to download the data and convert it into JSON files.
-
-```bash
-mkdir ../senat-data/
-
-# Available options for optional `categories` parameter : All,  Ameli, Debats, DosLeg, Questions, Sens
-npm run data:download ../senat-data -- [--categories All]
-```
-
-Data from other sources is also available :
-```bash
-# Retrieval of textes and rapports from Sénat's website
-# Available options for optional `formats` parameter : xml, html, pdf
-# Available options for optional `types` parameter : textes, rapports
-npm run data:retrieve_documents ../senat-data -- --fromSession 2022 [--formats xml pdf] [--types textes]
-
-# Retrieval & parsing (textes in xml format only for now)
-npm run data:retrieve_documents ../senat-data -- --fromSession 2022 --parseDocuments
-
-# Parsing only
-npm run data:parse_textes_lois ../senat-data
-
-# Retrieval (& parsing) of agenda from Sénat's website
-npm run data:retrieve_agenda ../senat-data -- --fromSession 2022 [--parseAgenda]
-
-# Retrieval (& parsing) of comptes-rendus des débats from Sénat's website
-npm run data:retrieve_comptes_rendus ../senat-data -- [--parseDebats]
-
-# Retrieval of sénateurs' pictures from Sénat's website
-npm run data:retrieve_senateurs_photos ../senat-data
-```
-
-## Data download using Docker
-
-A Docker image that downloads and converts the data all at once is available. Build it locally or run it from the container registry.
-Use the environment variables `FROM_SESSION` and `CATEGORIES` if needed.
-
-```bash
-docker run --pull always --name tricoteuses-senat -v ../senat-data:/app/senat-data -d git.tricoteuses.fr/logiciels/tricoteuses-senat:latest
-```
-
-Use the environment variable `CATEGORIES` and `FROM_SESSION` if needed.
-
-## Using the data
-
-Once the data is downloaded, you can use loaders to retrieve it.
-To use loaders in your project, you can install the _@tricoteuses/senat_ package, and import the iterator functions that you need.
-
-```bash
-npm install @tricoteuses/senat
-```
-
-```js
-import { iterLoadSenatQuestions } from "@tricoteuses/senat/loaders"
-
-// Pass data directory and legislature as arguments
-for (const { item: question } of iterLoadSenatQuestions("../senat-data", 17)) {
-  console.log(question.id)
-}
-```
-
-## Generation of raw types from SQL schema (for contributors only)
-
-```bash
-npm run data:generate_schemas ../senat-data
-```
-
-## Publishing
-
-To publish a new version of this package onto npm, bump the package version and publish.
-
-```bash
-npm version x.y.z # Bumps version in package.json and creates a new tag x.y.z
-npx tsc
-npm publish
-```
-
-The Docker image will be automatically built during a CI Workflow if you push the tag to the remote repository.
-
-```bash
-git push --tags
-```
+# Tricoteuses-Senat
+
+## _Retrieve, clean up & handle  French Sénat's open data_
+
+## Requirements
+
+- Node >= 22
+
+## Installation
+
+```bash
+git clone https://git.tricoteuses.fr/logiciels/tricoteuses-senat
+cd tricoteuses-senat/
+```
+
+Create a `.env` file to set PostgreSQL database informations and other configuration variables (you can use `example.env` as a template). Then
+
+```bash
+npm install
+```
+
+### Database creation (not needed if downloading with Docker image)
+
+#### Using Docker
+
+```bash
+docker run --name local-postgres -d -p 5432:5432 -e POSTGRES_PASSWORD=$YOUR_CUSTOM_DB_PASSWORD postgres
+# Default Postgres user is postgres
+# But scripts require an "opendata" role
+docker exec -it local-postgres psql -U postgres -c "CREATE ROLE opendata;"
+```
+
+## Download data
+
+Create a folder where the data will be downloaded and run the following command to download the data and convert it into JSON files.
+
+```bash
+mkdir ../senat-data/
+
+# Available options for optional `categories` parameter : All,  Ameli, Debats, DosLeg, Questions, Sens
+npm run data:download ../senat-data -- [--categories All]
+```
+
+Data from other sources is also available :
+```bash
+# Retrieval of textes and rapports from Sénat's website
+# Available options for optional `formats` parameter : xml, html, pdf
+# Available options for optional `types` parameter : textes, rapports
+npm run data:retrieve_documents ../senat-data -- --fromSession 2022 [--formats xml pdf] [--types textes]
+
+# Retrieval & parsing (textes in xml format only for now)
+npm run data:retrieve_documents ../senat-data -- --fromSession 2022 --parseDocuments
+
+# Parsing only
+npm run data:parse_textes_lois ../senat-data
+
+# Retrieval (& parsing) of agenda from Sénat's website
+npm run data:retrieve_agenda ../senat-data -- --fromSession 2022 [--parseAgenda]
+
+# Retrieval (& parsing) of comptes-rendus des débats from Sénat's website
+npm run data:retrieve_comptes_rendus ../senat-data -- [--parseDebats]
+
+# Retrieval of sénateurs' pictures from Sénat's website
+npm run data:retrieve_senateurs_photos ../senat-data
+```
+
+## Data download using Docker
+
+A Docker image that downloads and converts the data all at once is available. Build it locally or run it from the container registry.
+Use the environment variables `FROM_SESSION` and `CATEGORIES` if needed.
+
+```bash
+docker run --pull always --name tricoteuses-senat -v ../senat-data:/app/senat-data -d git.tricoteuses.fr/logiciels/tricoteuses-senat:latest
+```
+
+Use the environment variable `CATEGORIES` and `FROM_SESSION` if needed.
+
+## Using the data
+
+Once the data is downloaded, you can use loaders to retrieve it.
+To use loaders in your project, you can install the _@tricoteuses/senat_ package, and import the iterator functions that you need.
+
+```bash
+npm install @tricoteuses/senat
+```
+
+```js
+import { iterLoadSenatQuestions } from "@tricoteuses/senat/loaders"
+
+// Pass data directory and legislature as arguments
+for (const { item: question } of iterLoadSenatQuestions("../senat-data", 17)) {
+  console.log(question.id)
+}
+```
+
+## Generation of raw types from SQL schema (for contributors only)
+
+```bash
+npm run data:generate_schemas ../senat-data
+```
+
+## Publishing
+
+To publish a new version of this package onto npm, bump the package version and publish.
+
+```bash
+npm version x.y.z # Bumps version in package.json and creates a new tag x.y.z
+npx tsc
+npm publish
+```
+
+The Docker image will be automatically built during a CI Workflow if you push the tag to the remote repository.
+
+```bash
+git push --tags
+```

package/lib/loaders.d.ts

@@ -5,6 +5,7 @@ import { QuestionResult } from "./model/questions";
 import { CirconscriptionResult, OrganismeResult, SenateurResult } from "./model/sens";
 import { AgendaEvent } from "./types/agenda";
 import { FlatTexte } from "./types/texte";
+import { CompteRendu } from "./types/compte_rendu";
 export { EnabledDatasets } from "./datasets";
 export declare const AGENDA_FOLDER = "agenda";
 export declare const COMPTES_RENDUS_FOLDER = "seances";
@@ -17,7 +18,7 @@ export declare const TEXTE_FOLDER = "leg";
 export declare const DATA_ORIGINAL_FOLDER = "original";
 export declare const DATA_TRANSFORMED_FOLDER = "transformed";
 export declare const DOCUMENT_METADATA_FILE = "metadata.json";
-type IterItem<T> = {
+export type IterItem<T> = {
     item: T;
     filePathFromDataset?: string;
     legislature?: number;
@@ -69,6 +70,9 @@ export declare function iterLoadSenatDossiersLegislatifsDocuments(dataDir: strin
 export declare function iterLoadSenatDossiersLegislatifsRapports(dataDir: string, session: number | undefined, options?: {}): Generator<IterItem<DossierLegislatifDocumentResult>>;
 export declare function iterLoadSenatDossiersLegislatifsTextes(dataDir: string, session: number | undefined, options?: {}): Generator<IterItem<DossierLegislatifDocumentResult>>;
 export declare function loadSenatTexteContent(dataDir: string, textePathFromDataset: string): IterItem<FlatTexte | null>;
+export declare function loadSenatCompteRenduContent(dataDir: string, session: number, debatId: string | number): {
+    item: CompteRendu | null;
+};
 export declare function iterLoadSenatAgendas(dataDir: string, session: number | undefined, options?: {}): Generator<IterItem<AgendaEvent[]>>;
 export declare function iterLoadSenatEvenements(dataDir: string, session: number | undefined, options?: {}): Generator<IterItem<AgendaEvent>>;
 export declare function iterLoadSenatCirconscriptions(dataDir: string, options?: {}): Generator<IterItem<CirconscriptionResult>>;

package/lib/loaders.js

@@ -144,6 +144,14 @@ export function loadSenatTexteContent(dataDir, textePathFromDataset) {
     const texteJson = fs.readFileSync(fullTextePath, { encoding: "utf8" });
     return { item: JSON.parse(texteJson) };
 }
+export function loadSenatCompteRenduContent(dataDir, session, debatId) {
+    const fullPath = path.join(dataDir, COMPTES_RENDUS_FOLDER, DATA_TRANSFORMED_FOLDER, String(session), `${debatId}.json`);
+    if (!fs.existsSync(fullPath)) {
+        return { item: null };
+    }
+    const json = fs.readFileSync(fullPath, { encoding: "utf8" });
+    return { item: JSON.parse(json) };
+}
 export function* iterLoadSenatAgendas(dataDir, session, options = {}) {
     for (const evenementsItem of iterLoadSenatItems(dataDir, AGENDA_FOLDER, session, DATA_TRANSFORMED_FOLDER, options)) {
         yield evenementsItem;

package/lib/model/agenda.js

@@ -119,6 +119,8 @@ function transformAgenda(document, fileName) {
             captationVideo: videoElement !== null,
             urlDossierSenat: urlDossierSenat,
             quantieme: eventIsSeance(eventElement) ? getQuantieme(eventElement, seanceElements) : null,
+            urlVideo: null,
+            timecodeDebutVideo: null
         });
     }
     return agendaEvents;

package/lib/model/compte_rendu.d.ts

@@ -1,3 +1,2 @@
 import { CompteRendu } from "../types/compte_rendu";
-import { DebatResult } from "./debats";
-export declare function parseCompteRenduFromFile(htmlFilePath: string, debat: DebatResult): Promise<CompteRendu | null>;
+export declare function parseCompteRenduFromFile(htmlFilePath: string): Promise<CompteRendu | null>;

package/lib/model/compte_rendu.js

@@ -1,32 +1,313 @@
 import { JSDOM } from "jsdom";
-function transformCompteRendu(document, debat) {
-    const compteRendu = {
-        sections: [],
+import * as cheerio from "cheerio";
+const norm = (s) => s.replace(/\u00A0/g, " ").replace(/\s+/g, " ").trim();
+const toTexte = (s) => ({ _: s });
+function extractSommaire($) {
+    const root = $("#wysiwyg").length ? $("#wysiwyg") : $("#cri");
+    const sommaire = {
+        presidentSeance: toTexte(""),
+        sommaire1: [],
     };
-    for (const section of debat.sections) {
-        const compteRenduSection = {
-            id: section.id,
-            interventions: [],
+    // (1) presidency line (e.g., "Présidence de Mme …")
+    const pres = root.find("p.tm2").filter((_, el) => /présidence/i.test($(el).text())).first();
+    if (pres.length) {
+        sommaire.presidentSeance = toTexte(norm(pres.text()));
+    }
+    // (2) extra info lines like "Secrétaires :" (tm5)
+    const paras = [];
+    root.find("p.tm5").each((_, el) => {
+        const t = norm($(el).text());
+        if (t)
+            paras.push(toTexte(t));
+    });
+    if (paras.length) {
+        sommaire.para = paras.length === 1 ? paras[0] : paras;
+    }
+    // (3) first-level items (tm3)
+    const items = [];
+    root.find("p.tm3").each((_, el) => {
+        const $p = $(el);
+        const full = norm($p.text());
+        // try to extract the numeric order at the start: "1. ..." or "2 – ..." etc.
+        const numMatch = full.match(/^(\d+)\s*[.\-–—]/);
+        const valeur = numMatch ? numMatch[1] : undefined;
+        // prefer the linked title text; fallback to full text
+        const a = $p.find("a").first();
+        const intitule = norm(a.text() || full.replace(/^(\d+)\s*[.\-–—]\s*/, ""));
+        // id_syceron = href target without '#' ? TODO verify
+        const href = a.attr("href") || "";
+        const idSyceron = href.startsWith("#") ? href.slice(1) : href;
+        const titreStruct = {
+            id_syceron: idSyceron || "",
+            intitule,
         };
-        compteRendu.sections.push(compteRenduSection);
-        for (const sectionIntervention of section.interventions) {
-            const interventionAnchor = document.querySelector(`a[name="int${sectionIntervention.id}"]`);
-            const interventionParent = interventionAnchor?.parentElement;
-            compteRenduSection.interventions.push({
-                id: sectionIntervention.id,
-                texteHtml: interventionParent?.outerHTML || null,
-            });
+        const elem = {
+            valeur_pts_odj: valeur,
+            titreStruct,
+            // sommaire2/3 undefined (first level only)
+        };
+        items.push(elem);
+    });
+    if (items.length) {
+        sommaire.sommaire1 = items;
+    }
+    return sommaire;
+}
+function stripTrailingPunct(s) {
+    return s.replace(/\s*([:,.;])\s*$/u, "").trim();
+}
+function dedupeSpeaker(raw) {
+    let s = norm(raw);
+    s = stripTrailingPunct(s);
+    const dupPatterns = [
+        /^(.+?)\s*[.]\s*\1$/u,
+        /^(.+?)\s*,\s*\1,?$/u,
+        /^(.+?)\s+\1$/u,
+    ];
+    for (const re of dupPatterns) {
+        const m = s.match(re);
+        if (m) {
+            s = m[1];
+            break;
         }
     }
-    return compteRendu;
+    return s.replace(/\.\s*$/, "");
 }
-export async function parseCompteRenduFromFile(htmlFilePath, debat) {
+function decodeHtmlEntities(s) {
+    return s
+        .replace(/&#(\d+);/g, (_, d) => String.fromCharCode(parseInt(d, 10)))
+        .replace(/&#x([0-9a-fA-F]+);/g, (_, h) => String.fromCharCode(parseInt(h, 16)));
+}
+function fixApostrophes(s) {
+    // Tighten spacing around French apostrophes and punctuation
+    let out = s;
+    out = out.replace(/\s*’\s*/g, "’");
+    out = out.replace(/\b([dljctmsn])\s*’/gi, (_, m) => m + "’");
+    out = out.replace(/’\s+([A-Za-zÀ-ÖØ-öø-ÿ])/g, "’$1");
+    out = out.replace(/\s+([,;:.!?])/g, "$1");
+    return out;
+}
+function normalizeTitle(text) {
+    return text.replace(/^PR[ÉE]SIDENCE DE\b/i, "Présidence de ");
+}
+function roleForSpeaker(labelOrQualite) {
+    const s = labelOrQualite.toLowerCase();
+    if (/^(m\.|mme)?\s*(le|la)\s+pr[ée]sident(e)?\b/.test(s) ||
+        /\bpr[ée]sident[e]?\s+de\s+séance\b/.test(s)) {
+        return "président";
+    }
+    return "";
+}
+// ---------------- DOM helpers ----------------
+function parseCriIntervenantComment(html) {
+    // From <!-- cri:intervenant mat="..." nom="..." qua="..." ... -->
+    const m = html.match(/<!--\s*cri:intervenant\b([^>]+)-->/i);
+    if (!m)
+        return {};
+    const attrs = m[1];
+    const out = {};
+    const re = /(\w+)="([^"]*)"/g;
+    let a;
+    while ((a = re.exec(attrs))) {
+        out[a[1]] = decodeHtmlEntities(a[2]);
+    }
+    return { mat: out["mat"], nom: out["nom"], qua: out["qua"] };
+}
+/**
+ * Extract leading .orateur_qualite chunks from the FIRST <p> only,
+ * concatenate them, clean punctuation/apostrophes, and REMOVE those nodes
+ * (and .orateur_nom) from the first paragraph so the speech starts cleanly.
+ */
+function extractAndRemoveLeadingQualite($, $block) {
+    const firstP = $block.find("p").first();
+    if (firstP.length === 0)
+        return "";
+    const parts = [];
+    // Iterate over the first <p>'s children from the start
+    let stop = false;
+    firstP.contents().each((_, node) => {
+        if (stop)
+            return;
+        if (node.type === "tag") {
+            const $node = $(node);
+            if ($node.hasClass("orateur_nom")) {
+                // speaker label node — remove it
+                $node.remove();
+                return;
+            }
+            if ($node.hasClass("orateur_qualite")) {
+                parts.push($node.text() || "");
+                $node.remove();
+                return;
+            }
+            // Non-qualite tag: if it has meaningful text, we reached the speech
+            const t = norm($node.text() || "");
+            if (t) {
+                stop = true;
+            }
+            else {
+                // empty-ish node; remove to avoid stray punctuation
+                $node.remove();
+            }
+        }
+        else if (node.type === "text") {
+            const t = norm(node.data || "");
+            if (!t) {
+                // whitespace only — drop it
+                ;
+                node.data = "";
+                return;
+            }
+            // boundary punctuation like ":" just after label — drop it
+            if (/^[:.,;–—-]+$/.test(t)) {
+                ;
+                node.data = "";
+                return;
+            }
+            // any other text means speech starts here
+            stop = true;
+        }
+        else {
+            // comment or others — ignore
+        }
+    });
+    const qual = fixApostrophes(norm(parts.join(" ")));
+    return qual;
+}
+function sanitizeInterventionHtml($, $block) {
+    // Clone to avoid mutating outer tree order
+    const $clone = $block.clone();
+    // Remove navigation / anchors / images
+    $clone.find('a[name]').remove();
+    $clone.find('div[align="right"]').remove();
+    $clone.find('a.link').remove();
+    $clone.find('img').remove();
+    // Remove technical anchors inside interventions
+    $clone.find('a#ameli_amendement_cri_phrase, a#ameli_amendement_cra_contenu, a#ameli_amendement_cra_objet').remove();
+    // Remove any remaining speaker label / quality spans anywhere
+    $clone.find(".orateur_nom").remove();
+    $clone.find(".orateur_qualite").remove();
+    // Strip HTML comments
+    let html = $clone.html() || "";
+    html = html.replace(/<!--[\s\S]*?-->/g, "");
+    return html.trim();
+}
+function extractMetadonnees($) {
+    const headerText = norm($("h1.page-title").text() || "");
+    const dateMatch = headerText.match(/\b(\d{1,2}\s+\w+\s+\d{4})\b/i);
+    const bodyText = norm($("#cri").text() || "");
+    const sessionMatch = bodyText.match(/\bsession\s+(\d{4}-\d{4})\b/i);
+    return {
+        dateSeance: dateMatch?.[1] || "",
+        dateSeanceJour: dateMatch?.[1] || "",
+        numSeanceJour: "",
+        numSeance: "",
+        typeAssemblee: "SN",
+        legislature: "",
+        session: sessionMatch?.[1] || "",
+        nomFichierJo: "",
+        validite: "",
+        etat: "",
+        diffusion: "",
+        version: "1.0",
+        environnement: "",
+        heureGeneration: new Date(),
+        sommaire: extractSommaire($)
+    };
+}
+// ---------------- main transform ----------------
+export async function parseCompteRenduFromFile(htmlFilePath) {
     try {
-        const { document } = (await JSDOM.fromFile(htmlFilePath, { contentType: "text/html" })).window;
-        return transformCompteRendu(document, debat);
+        const { window } = await JSDOM.fromFile(htmlFilePath, { contentType: "text/html" });
+        const $ = cheerio.load(window.document.documentElement.outerHTML);
+        const metadonnees = extractMetadonnees($);
+        const points = [];
+        let ordre = 0;
+        const addPoint = (p) => points.push({ ...p, ordre_absolu_seance: String(++ordre) });
+        // (1) Global section titles (common high-level headings)
+        let lastTitle = "";
+        $("#cri p[class^='titre_S']").each((_, el) => {
+            const t = normalizeTitle(norm($(el).text() || ""));
+            if (t && t !== lastTitle) {
+                addPoint({ code_grammaire: "TITRE_TEXTE_DISCUSSION", texte: { _: t }, code_style: "Titre" });
+                lastTitle = t;
+            }
+        });
+        // (2) Interventions
+        $("#cri div.intervenant").each((_, block) => {
+            const $block = $(block);
+            // (2.a) Extract internal structural titles inside this block (and remove them)
+            const structuralSel = [
+                "p[class^='titre_S']",
+                "p.mention_titre",
+                "p.intitule_titre",
+                "p.mention_chapitre",
+                "p.intitule_chapitre",
+                "p.mention_article",
+                "p.intitule_article",
+                "p.mention_section",
+                "p.intitule_section",
+            ].join(",");
+            $block.find(structuralSel).each((__, el) => {
+                const title = normalizeTitle(norm($(el).text() || ""));
+                if (title && title !== lastTitle) {
+                    addPoint({ code_grammaire: "TITRE_TEXTE_DISCUSSION", texte: { _: title }, code_style: "Titre" });
+                    lastTitle = title;
+                }
+                $(el).remove();
+            });
+            // (2.b) Speaker label & quality
+            const firstP = $block.find("p").first();
+            const speakerLabelRaw = firstP.find(".orateur_nom").text() ||
+                firstP.find("a.lien_senfic").text() ||
+                "";
+            const speakerLabel = dedupeSpeaker(speakerLabelRaw);
+            // Prefer <!--cri:intervenant ...--> for id/name/qualite when available
+            const rawHtml = $block.html() || "";
+            const { mat, nom: nomFromComment, qua: quaFromCommentRaw } = parseCriIntervenantComment(rawHtml);
+            // Extract and remove leading .orateur_qualite chunks from first <p>
+            const qualFromSpans = extractAndRemoveLeadingQualite($, $block);
+            const qualite = norm(decodeHtmlEntities(quaFromCommentRaw || "")) ||
+                qualFromSpans;
+            const canonicalName = dedupeSpeaker(nomFromComment || speakerLabel);
+            const role = roleForSpeaker(speakerLabel) ||
+                roleForSpeaker(qualite) ||
+                roleForSpeaker(quaFromCommentRaw || "");
+            // (2.c) Build cleaned speech HTML
+            let speechHtml = sanitizeInterventionHtml($, $block);
+            // If nothing meaningful remains, skip
+            if (!norm(cheerio.load(speechHtml).text() || ""))
+                return;
+            addPoint({
+                code_grammaire: "PAROLE_GENERIQUE",
+                roledebat: role,
+                orateurs: {
+                    orateur: {
+                        nom: canonicalName,
+                        id: mat || "",
+                        qualite: qualite,
+                    },
+                },
+                texte: { _: speechHtml },
+            });
+        });
+        const contenu = {
+            quantiemes: {
+                journee: metadonnees.dateSeance,
+                session: metadonnees.session,
+            },
+            point: points,
+        };
+        return {
+            uid: htmlFilePath.replace(/^.*?(\d{8}).*$/i, "$1"),
+            seanceRef: htmlFilePath.replace(/^.*?(\d{8}).*$/i, "$1"),
+            sessionRef: metadonnees.session,
+            metadonnees,
+            contenu,
+        };
     }
-    catch (error) {
-        console.error(`Could not parse compte-rendu with error ${error}`);
+    catch (e) {
+        console.error("Could not parse compte-rendu with error", e);
+        return null;
     }
-    return null;
 }