cjm-transcript-decomp-core 0.0.1__tar.gz → 0.0.2__tar.gz

{cjm_transcript_decomp_core-0.0.1/cjm_transcript_decomp_core.egg-info → cjm_transcript_decomp_core-0.0.2}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: cjm-transcript-decomp-core
-Version: 0.0.1
+Version: 0.0.2
 Summary: A frontend-agnostic core for the transcript decomposition workflow — composes isolated capability workers (forced alignment, VAD, graph storage) into a headless pipeline that decomposes transcription run manifests into a VAD-aligned context-graph spine with traceable provenance, and a CLI as its first driver.
 Author-email: "Christian J. Mills" <9126128+cj-mills@users.noreply.github.com>
 License: Apache-2.0
@@ -13,7 +13,7 @@ License-File: LICENSE
 Requires-Dist: cjm_substrate>=0.0.51
 Requires-Dist: cjm_context_graph_primitives>=0.0.12
 Requires-Dist: cjm_capability_primitives>=0.0.10
-Requires-Dist: cjm-context-graph-layer>=0.0.8
+Requires-Dist: cjm-context-graph-layer>=0.0.10
 Requires-Dist: cjm-transcript-graph-schema>=0.0.7
 Dynamic: license-file
 
@@ -26,15 +26,10 @@ A frontend-agnostic core for the transcript decomposition workflow — composes
 ## Modules
 
 - **`cjm_transcript_decomp_core.alignment`** — Pure forced-alignment logic (no capability calls): map FA words back to character spans in the original text, assign words to VAD chunks by timestamp, and build one text segment per VAD chunk. Extracted from the page-centric ForcedAlignmentService (Tier-1 logic).
-- **`cjm_transcript_decomp_core.cli`** — The CLI driver — the decomposition core's first (and currently only) frontend. Ships in-package as the cjm-transcript-decomp-core console script so the driver can never skew from the core. GUI presentation drivers come later and consume the same pipeline module; they never reimplement it (CLI-first / headless-core principle).
+- **`cjm_transcript_decomp_core.cli`** — The CLI driver — the decomposition core's first (and currently only) frontend.
 - **`cjm_transcript_decomp_core.graph`** — Graph-spine EXTENSION + skeptical-lens verification (stage 5, CR-18 revolution 2). Decomp no longer creates a Document: it RECOMPUTES the transcription-emitted root's deterministic node ids from the consumed manifest (no search), verifies the root exists, and attaches the fine Segment spine under the existing AudioSegment nodes — PART_OF to the owning rendition, STARTS_WITH per rendition (the coarse-seam jump anchor), source-wide NEXT. Each Segment carries the audio TimeSlice ref plus per-transcriber CharSlice refs into the Transcript nodes (the D4/P10 framing, finally expressible). Commit goes through the layer's idempotent extend_graph.
 - **`cjm_transcript_decomp_core.models`** — Lean data shapes for the transcript-decomposition pipeline: in-core mirrors of the forced-alignment / VAD / text DTOs (no FastHTML deps), run configuration, the committed graph-segment carrier, and the decomposition run manifest (proto-bundle).
 - **`cjm_transcript_decomp_core.pipeline`** — The headless decomposition pipeline (stage 5: decomp is an EXTENDER). Load a transcription run manifest, verify the transcription-emitted graph root exists (the graph begins at transcription), then per source per pipeline-segment run VAD + per-transcriber forced alignment, build one aligned segment per VAD chunk with per-transcriber text variants, and attach the fine spine under the existing AudioSegment nodes via the layer's idempotent extend_graph — with HITL approval seams between alignment, commit, and the next source.
-- **`tests.test_alignment`** — Tests for cjm_transcript_decomp_core.alignment — pure forced-alignment logic.
-- **`tests.test_graph`** — Tests for cjm_transcript_decomp_core.graph — fine-spine extension payload.
-- **`tests.test_models`** — Tests for cjm_transcript_decomp_core.models — decomposition data shapes.
-- **`tests_manual.measure_cold_fanout_overlap_e2e`** — Cold-run M×(VAD ∥ T×FA) fan-out overlap measurement (stage-5 closeout;
-- **`tests_manual.validate_stage7_volume_journal_e2e`** — Stage-7 stress part 6 — volume regression on the REAL corpus.
 
 ## API
 
@@ -83,43 +78,6 @@ A frontend-agnostic core for the transcript decomposition workflow — composes
 - `submit_and_wait` _function_ — Submit one capability job, wait for it, and return its result (raise on failure).
 - `vad_chunks_from_result` _function_ — Normalize a typed VAD result into segment-local VAD chunks.
 
-### `tests.test_alignment`
-
-- `test_assign_words_to_chunks_by_timestamp` _function_
-- `test_build_segments_per_chunk` _function_
-- `test_empty_chunk_yields_empty_segment_warning` _function_
-- `test_map_fa_words_to_text_spans` _function_
-
-### `tests.test_graph`
-
-- `test_edge_topology_spans_coarse_boundary` _function_
-- `test_extension_payload_deterministic_ids` _function_
-- `test_preprocessed_manifest_distinct_renditions_same_boundaries` _function_
-- `test_provenance_refs_and_text_from` _function_
-- `test_resolve_root_ids_recomputation` _function_
-
-### `tests.test_models`
-
-- `test_faword_from_wire_tolerates_extra_keys` _function_
-- `test_manifest_save_round_trip` _function_
-- `test_manifest_shape_and_run_id` _function_
-- `test_stage5_segment_shape` _function_
-- `test_vad_chunk_duration` _function_
-
-### `tests_manual.measure_cold_fanout_overlap_e2e`
-
-- `lane_intervals` _function_ — (start, end) UTC intervals for completed jobs of one instance.
-- `main` _function_
-- `merge` _function_ — Merge overlapping intervals so a side can't double-count itself.
-- `overlap_seconds` _function_ — Total seconds where any interval of A overlaps any interval of B.
-- `self_overlap_max` _function_ — Max simultaneously in-flight jobs within one lane + seconds at depth >= 2.
-
-### `tests_manual.validate_stage7_volume_journal_e2e`
-
-- `checkpoint_copy` _function_ — Checkpoint-then-copy (the stage-3 G3 backup discipline — never copy
-- `journal_rows` _function_
-- `main` _function_
-
 ## Dependencies
 
-**Depends on:** `cjm-substrate`
+**Depends on:** `cjm-capability-primitives`, `cjm-context-graph-layer`, `cjm-context-graph-primitives`, `cjm-substrate`, `cjm-transcript-graph-schema`

{cjm_transcript_decomp_core-0.0.1 → cjm_transcript_decomp_core-0.0.2}/README.md

@@ -7,15 +7,10 @@ A frontend-agnostic core for the transcript decomposition workflow — composes
 ## Modules
 
 - **`cjm_transcript_decomp_core.alignment`** — Pure forced-alignment logic (no capability calls): map FA words back to character spans in the original text, assign words to VAD chunks by timestamp, and build one text segment per VAD chunk. Extracted from the page-centric ForcedAlignmentService (Tier-1 logic).
-- **`cjm_transcript_decomp_core.cli`** — The CLI driver — the decomposition core's first (and currently only) frontend. Ships in-package as the cjm-transcript-decomp-core console script so the driver can never skew from the core. GUI presentation drivers come later and consume the same pipeline module; they never reimplement it (CLI-first / headless-core principle).
+- **`cjm_transcript_decomp_core.cli`** — The CLI driver — the decomposition core's first (and currently only) frontend.
 - **`cjm_transcript_decomp_core.graph`** — Graph-spine EXTENSION + skeptical-lens verification (stage 5, CR-18 revolution 2). Decomp no longer creates a Document: it RECOMPUTES the transcription-emitted root's deterministic node ids from the consumed manifest (no search), verifies the root exists, and attaches the fine Segment spine under the existing AudioSegment nodes — PART_OF to the owning rendition, STARTS_WITH per rendition (the coarse-seam jump anchor), source-wide NEXT. Each Segment carries the audio TimeSlice ref plus per-transcriber CharSlice refs into the Transcript nodes (the D4/P10 framing, finally expressible). Commit goes through the layer's idempotent extend_graph.
 - **`cjm_transcript_decomp_core.models`** — Lean data shapes for the transcript-decomposition pipeline: in-core mirrors of the forced-alignment / VAD / text DTOs (no FastHTML deps), run configuration, the committed graph-segment carrier, and the decomposition run manifest (proto-bundle).
 - **`cjm_transcript_decomp_core.pipeline`** — The headless decomposition pipeline (stage 5: decomp is an EXTENDER). Load a transcription run manifest, verify the transcription-emitted graph root exists (the graph begins at transcription), then per source per pipeline-segment run VAD + per-transcriber forced alignment, build one aligned segment per VAD chunk with per-transcriber text variants, and attach the fine spine under the existing AudioSegment nodes via the layer's idempotent extend_graph — with HITL approval seams between alignment, commit, and the next source.
-- **`tests.test_alignment`** — Tests for cjm_transcript_decomp_core.alignment — pure forced-alignment logic.
-- **`tests.test_graph`** — Tests for cjm_transcript_decomp_core.graph — fine-spine extension payload.
-- **`tests.test_models`** — Tests for cjm_transcript_decomp_core.models — decomposition data shapes.
-- **`tests_manual.measure_cold_fanout_overlap_e2e`** — Cold-run M×(VAD ∥ T×FA) fan-out overlap measurement (stage-5 closeout;
-- **`tests_manual.validate_stage7_volume_journal_e2e`** — Stage-7 stress part 6 — volume regression on the REAL corpus.
 
 ## API
 
@@ -64,43 +59,6 @@ A frontend-agnostic core for the transcript decomposition workflow — composes
 - `submit_and_wait` _function_ — Submit one capability job, wait for it, and return its result (raise on failure).
 - `vad_chunks_from_result` _function_ — Normalize a typed VAD result into segment-local VAD chunks.
 
-### `tests.test_alignment`
-
-- `test_assign_words_to_chunks_by_timestamp` _function_
-- `test_build_segments_per_chunk` _function_
-- `test_empty_chunk_yields_empty_segment_warning` _function_
-- `test_map_fa_words_to_text_spans` _function_
-
-### `tests.test_graph`
-
-- `test_edge_topology_spans_coarse_boundary` _function_
-- `test_extension_payload_deterministic_ids` _function_
-- `test_preprocessed_manifest_distinct_renditions_same_boundaries` _function_
-- `test_provenance_refs_and_text_from` _function_
-- `test_resolve_root_ids_recomputation` _function_
-
-### `tests.test_models`
-
-- `test_faword_from_wire_tolerates_extra_keys` _function_
-- `test_manifest_save_round_trip` _function_
-- `test_manifest_shape_and_run_id` _function_
-- `test_stage5_segment_shape` _function_
-- `test_vad_chunk_duration` _function_
-
-### `tests_manual.measure_cold_fanout_overlap_e2e`
-
-- `lane_intervals` _function_ — (start, end) UTC intervals for completed jobs of one instance.
-- `main` _function_
-- `merge` _function_ — Merge overlapping intervals so a side can't double-count itself.
-- `overlap_seconds` _function_ — Total seconds where any interval of A overlaps any interval of B.
-- `self_overlap_max` _function_ — Max simultaneously in-flight jobs within one lane + seconds at depth >= 2.
-
-### `tests_manual.validate_stage7_volume_journal_e2e`
-
-- `checkpoint_copy` _function_ — Checkpoint-then-copy (the stage-3 G3 backup discipline — never copy
-- `journal_rows` _function_
-- `main` _function_
-
 ## Dependencies
 
-**Depends on:** `cjm-substrate`
+**Depends on:** `cjm-capability-primitives`, `cjm-context-graph-layer`, `cjm-context-graph-primitives`, `cjm-substrate`, `cjm-transcript-graph-schema`

cjm_transcript_decomp_core-0.0.2/cjm_transcript_decomp_core/__init__.py

@@ -0,0 +1 @@
+__version__ = "0.0.2"

{cjm_transcript_decomp_core-0.0.1 → cjm_transcript_decomp_core-0.0.2}/cjm_transcript_decomp_core/pipeline.py

@@ -10,7 +10,8 @@ from typing import Any, Dict, List, Optional, Tuple
 from cjm_capability_primitives.forced_alignment import ForcedAlignResult
 from cjm_capability_primitives.vad import VADResult
 from cjm_context_graph_layer.declare import Derivation, derivation_to_graph
-from cjm_context_graph_layer.ops import extend_graph, graph_task
+from cjm_context_graph_layer.journal import journal_extend, sidecar_journal_path
+from cjm_context_graph_layer.ops import graph_task
 from cjm_substrate.core.empirical_store import compute_config_hash
 from cjm_substrate.core.journal_store import JournalEvent, SubstrateEventType
 from cjm_substrate.core.manager import CapabilityManager
@@ -380,6 +381,10 @@ async def run_decomp(
         capabilities=collect_capability_info(manager, [cfg.vad_capability, cfg.fa_capability, cfg.graph_capability]),
     )
     vad_config_hash = str((manifest.capabilities.get(cfg.vad_capability) or {}).get("config_hash") or "")
+    # Pipeline writes append through to the graph db's SIDECAR journal (DEC ccbab9f5 /
+    # finding 4219da27): unjournaled ingestion would erode db-rebuildability.
+    graph_db_path = (manifest.capabilities.get(cfg.graph_capability) or {}).get("db_path")
+    graph_journal_path = sidecar_journal_path(str(graph_db_path)) if graph_db_path else None
 
     sources = src.get("sources", []) or []
     status = "completed"
@@ -419,7 +424,12 @@ async def run_decomp(
                 status = "aborted"
                 break
 
-            res = await extend_graph(queue, cfg.graph_capability, nodes, edges)
+            res = await journal_extend(queue, cfg.graph_capability, nodes, edges,
+                                       journal_path=graph_journal_path, verb="spine-extension",
+                                       actor="pipeline:cjm-transcript-decomp-core", run=run_id,
+                                       args={"source_id": ids["source"],
+                                             "segments": len(ids["segments"]),
+                                             "text_from": text_from})
             logger.info(f"[src {i}] extension: +{res.nodes_added} node(s) "
                         f"({res.nodes_verified} verified present), +{res.edges_added} edge(s) "
                         f"({res.edges_existing} existing)")
@@ -431,7 +441,10 @@ async def run_decomp(
                                 "text_from": text_from},
                 )
                 dn, de = derivation_to_graph(d)
-                await extend_graph(queue, cfg.graph_capability, [dn], de)
+                await journal_extend(queue, cfg.graph_capability, [dn], de,
+                                     journal_path=graph_journal_path, verb="derivation",
+                                     actor="pipeline:cjm-transcript-decomp-core", run=run_id,
+                                     args={"method": "alignment-fold/v1"})
 
             # Fine spine hangs under the run's renditions — verify scopes there.
             vr = await verify_source(queue, cfg.graph_capability, ids["source"], ids["renditions"])

{cjm_transcript_decomp_core-0.0.1 → cjm_transcript_decomp_core-0.0.2/cjm_transcript_decomp_core.egg-info}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: cjm-transcript-decomp-core
-Version: 0.0.1
+Version: 0.0.2
 Summary: A frontend-agnostic core for the transcript decomposition workflow — composes isolated capability workers (forced alignment, VAD, graph storage) into a headless pipeline that decomposes transcription run manifests into a VAD-aligned context-graph spine with traceable provenance, and a CLI as its first driver.
 Author-email: "Christian J. Mills" <9126128+cj-mills@users.noreply.github.com>
 License: Apache-2.0
@@ -13,7 +13,7 @@ License-File: LICENSE
 Requires-Dist: cjm_substrate>=0.0.51
 Requires-Dist: cjm_context_graph_primitives>=0.0.12
 Requires-Dist: cjm_capability_primitives>=0.0.10
-Requires-Dist: cjm-context-graph-layer>=0.0.8
+Requires-Dist: cjm-context-graph-layer>=0.0.10
 Requires-Dist: cjm-transcript-graph-schema>=0.0.7
 Dynamic: license-file
 
@@ -26,15 +26,10 @@ A frontend-agnostic core for the transcript decomposition workflow — composes
 ## Modules
 
 - **`cjm_transcript_decomp_core.alignment`** — Pure forced-alignment logic (no capability calls): map FA words back to character spans in the original text, assign words to VAD chunks by timestamp, and build one text segment per VAD chunk. Extracted from the page-centric ForcedAlignmentService (Tier-1 logic).
-- **`cjm_transcript_decomp_core.cli`** — The CLI driver — the decomposition core's first (and currently only) frontend. Ships in-package as the cjm-transcript-decomp-core console script so the driver can never skew from the core. GUI presentation drivers come later and consume the same pipeline module; they never reimplement it (CLI-first / headless-core principle).
+- **`cjm_transcript_decomp_core.cli`** — The CLI driver — the decomposition core's first (and currently only) frontend.
 - **`cjm_transcript_decomp_core.graph`** — Graph-spine EXTENSION + skeptical-lens verification (stage 5, CR-18 revolution 2). Decomp no longer creates a Document: it RECOMPUTES the transcription-emitted root's deterministic node ids from the consumed manifest (no search), verifies the root exists, and attaches the fine Segment spine under the existing AudioSegment nodes — PART_OF to the owning rendition, STARTS_WITH per rendition (the coarse-seam jump anchor), source-wide NEXT. Each Segment carries the audio TimeSlice ref plus per-transcriber CharSlice refs into the Transcript nodes (the D4/P10 framing, finally expressible). Commit goes through the layer's idempotent extend_graph.
 - **`cjm_transcript_decomp_core.models`** — Lean data shapes for the transcript-decomposition pipeline: in-core mirrors of the forced-alignment / VAD / text DTOs (no FastHTML deps), run configuration, the committed graph-segment carrier, and the decomposition run manifest (proto-bundle).
 - **`cjm_transcript_decomp_core.pipeline`** — The headless decomposition pipeline (stage 5: decomp is an EXTENDER). Load a transcription run manifest, verify the transcription-emitted graph root exists (the graph begins at transcription), then per source per pipeline-segment run VAD + per-transcriber forced alignment, build one aligned segment per VAD chunk with per-transcriber text variants, and attach the fine spine under the existing AudioSegment nodes via the layer's idempotent extend_graph — with HITL approval seams between alignment, commit, and the next source.
-- **`tests.test_alignment`** — Tests for cjm_transcript_decomp_core.alignment — pure forced-alignment logic.
-- **`tests.test_graph`** — Tests for cjm_transcript_decomp_core.graph — fine-spine extension payload.
-- **`tests.test_models`** — Tests for cjm_transcript_decomp_core.models — decomposition data shapes.
-- **`tests_manual.measure_cold_fanout_overlap_e2e`** — Cold-run M×(VAD ∥ T×FA) fan-out overlap measurement (stage-5 closeout;
-- **`tests_manual.validate_stage7_volume_journal_e2e`** — Stage-7 stress part 6 — volume regression on the REAL corpus.
 
 ## API
 
@@ -83,43 +78,6 @@ A frontend-agnostic core for the transcript decomposition workflow — composes
 - `submit_and_wait` _function_ — Submit one capability job, wait for it, and return its result (raise on failure).
 - `vad_chunks_from_result` _function_ — Normalize a typed VAD result into segment-local VAD chunks.
 
-### `tests.test_alignment`
-
-- `test_assign_words_to_chunks_by_timestamp` _function_
-- `test_build_segments_per_chunk` _function_
-- `test_empty_chunk_yields_empty_segment_warning` _function_
-- `test_map_fa_words_to_text_spans` _function_
-
-### `tests.test_graph`
-
-- `test_edge_topology_spans_coarse_boundary` _function_
-- `test_extension_payload_deterministic_ids` _function_
-- `test_preprocessed_manifest_distinct_renditions_same_boundaries` _function_
-- `test_provenance_refs_and_text_from` _function_
-- `test_resolve_root_ids_recomputation` _function_
-
-### `tests.test_models`
-
-- `test_faword_from_wire_tolerates_extra_keys` _function_
-- `test_manifest_save_round_trip` _function_
-- `test_manifest_shape_and_run_id` _function_
-- `test_stage5_segment_shape` _function_
-- `test_vad_chunk_duration` _function_
-
-### `tests_manual.measure_cold_fanout_overlap_e2e`
-
-- `lane_intervals` _function_ — (start, end) UTC intervals for completed jobs of one instance.
-- `main` _function_
-- `merge` _function_ — Merge overlapping intervals so a side can't double-count itself.
-- `overlap_seconds` _function_ — Total seconds where any interval of A overlaps any interval of B.
-- `self_overlap_max` _function_ — Max simultaneously in-flight jobs within one lane + seconds at depth >= 2.
-
-### `tests_manual.validate_stage7_volume_journal_e2e`
-
-- `checkpoint_copy` _function_ — Checkpoint-then-copy (the stage-3 G3 backup discipline — never copy
-- `journal_rows` _function_
-- `main` _function_
-
 ## Dependencies
 
-**Depends on:** `cjm-substrate`
+**Depends on:** `cjm-capability-primitives`, `cjm-context-graph-layer`, `cjm-context-graph-primitives`, `cjm-substrate`, `cjm-transcript-graph-schema`

{cjm_transcript_decomp_core-0.0.1 → cjm_transcript_decomp_core-0.0.2}/cjm_transcript_decomp_core.egg-info/requires.txt

@@ -1,5 +1,5 @@
 cjm_substrate>=0.0.51
 cjm_context_graph_primitives>=0.0.12
 cjm_capability_primitives>=0.0.10
-cjm-context-graph-layer>=0.0.8
+cjm-context-graph-layer>=0.0.10
 cjm-transcript-graph-schema>=0.0.7

{cjm_transcript_decomp_core-0.0.1 → cjm_transcript_decomp_core-0.0.2}/pyproject.toml

@@ -14,7 +14,7 @@ classifiers = [
     "Programming Language :: Python :: 3",
     "Programming Language :: Python :: 3 :: Only",
 ]
-dependencies = ['cjm_substrate>=0.0.51', 'cjm_context_graph_primitives>=0.0.12', 'cjm_capability_primitives>=0.0.10', 'cjm-context-graph-layer>=0.0.8', 'cjm-transcript-graph-schema>=0.0.7']
+dependencies = ['cjm_substrate>=0.0.51', 'cjm_context_graph_primitives>=0.0.12', 'cjm_capability_primitives>=0.0.10', 'cjm-context-graph-layer>=0.0.10', 'cjm-transcript-graph-schema>=0.0.7']
 
 [project.urls]
 Repository = "https://github.com/cj-mills/cjm-transcript-decomp-core"

cjm_transcript_decomp_core-0.0.1/cjm_transcript_decomp_core/__init__.py

@@ -1 +0,0 @@
-__version__ = "0.0.1"