easyaligner 0.2.1__tar.gz → 0.3.0__tar.gz

{easyaligner-0.2.1/src/easyaligner.egg-info → easyaligner-0.3.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: easyaligner
-Version: 0.2.1
+Version: 0.3.0
 Summary: Forced alignment pipeline designed for efficiency and ease of use.
 Author: Faton Rekathati
 Project-URL: Repository, https://github.com/kb-labb/easyaligner
@@ -8,12 +8,12 @@ Requires-Python: >=3.10
 Description-Content-Type: text/markdown
 License-File: LICENSE
 Requires-Dist: transformers>=4.45.0
-Requires-Dist: torch!=2.9.*,>=2.7.0
-Requires-Dist: torchaudio!=2.9.*,>=2.7.0
+Requires-Dist: torch<2.9,>=2.7.0
+Requires-Dist: torchaudio<2.9,>=2.7.0
 Requires-Dist: tqdm>=4.66.1
 Requires-Dist: soundfile>=0.12.1
 Requires-Dist: nltk>=3.8.2
-Requires-Dist: pyannote-audio>=3.3.1
+Requires-Dist: pyannote-audio<4.0.4,>=3.3.1
 Requires-Dist: silero-vad~=6.0
 Requires-Dist: msgspec
 Requires-Dist: rapidfuzz
@@ -27,8 +27,9 @@ Dynamic: license-file
 
 * **GPU accelerated forced alignment**. Uses [Pytorch's forced alignment API](https://docs.pytorch.org/audio/main/tutorials/ctc_forced_alignment_api_tutorial.html) with a GPU based implementation of the Viterbi algorithm. Enables fast and memory-efficient forced alignment of long audio segments ([Pratap et al., 2024](https://jmlr.org/papers/volume25/23-1318/23-1318.pdf#page=8)). 
 * **Flexible text normalization for improved alignment quality**. Users can supply custom regex-based text normalization functions to preprocess transcripts before alignment. A mapping from the original text to the normalized text is maintained internally. All of the applied normalizations and transformations are consequently **non-destructive and reversible after alignment**.  
-* **Batch processing support for emission extraction**. `easyaligner` supports batched inference for wav2vec2-based models, keeping track of non-padded logits when doing alignment.   
-* **Modular pipeline design**. The library has separate, independent, pipelines for VAD, emission extraction, and forced alignment. Users can run everything end-to-end, or run the separate stages individually. 
+* **Batch processing support for emission extraction**. `easyaligner` supports batched inference for wav2vec2-based models, keeping track of non-padded logits when doing alignment. 
+
+Check out the [documentation](https://kb-labb.github.io/easyaligner/) for more details and tutorials!
 
 ## Installation
 
@@ -68,13 +69,21 @@ from easyaligner.pipelines import pipeline
 from easyaligner.text import text_normalizer
 from easyaligner.vad.pyannote import load_vad_model
 
+filepath_pattern = "tale-of-two-cities_align-en/taleoftwocities_01_dickens_64kb_align.mp3"
+
+# Download mp3 from Hugging Face Hub
 snapshot_download(
     "Lauler/easytranscriber_tutorials",
     repo_type="dataset",
     local_dir="data/tutorials",
-    allow_patterns="tale-of-two-cities_align-en/*", 
+    allow_patterns=filepath_pattern,
 )
 
+# File(s) to align
+filepath = Path("data/tutorials") / filepath_pattern
+audio_dir = filepath.parent
+audio_files = [filepath.name]
+
 text = """
 It was the best of times, it was the worst of times, it was the age of
 wisdom, it was the age of foolishness, it was the epoch of belief, it
@@ -90,26 +99,21 @@ evil, in the superlative degree of comparison only.
 text = text.strip()
 
 # The alignments will be organized according to how the text is tokenized
-tokenizer = load_tokenizer(language="english") # sentence tokenizer 
-span_list = list(tokenizer.span_tokenize(text)) # start, end character indices for each sentence
+tokenizer = load_tokenizer(language="english")  # sentence tokenizer
+span_list = list(tokenizer.span_tokenize(text))  # start, end character indices for each sentence
 speeches = [[SpeechSegment(speech_id=0, text=text, text_spans=span_list, start=None, end=None)]]
 
 # Load models and run pipeline
 model_vad = load_vad_model()
-model = (
-    AutoModelForCTC.from_pretrained("facebook/wav2vec2-base-960h").to("cuda").half()
-)
+model = AutoModelForCTC.from_pretrained("facebook/wav2vec2-base-960h").to("cuda").half()
 processor = Wav2Vec2Processor.from_pretrained("facebook/wav2vec2-base-960h")
 
-# File(s) to align
-audio_files = [file.name for file in Path("data/tutorials/tale-of-two-cities_align-en").glob("*")]
-
 pipeline(
     vad_model=model_vad,
     emissions_model=model,
     processor=processor,
     audio_paths=audio_files,
-    audio_dir="data/tutorials/tale-of-two-cities_align-en",
+    audio_dir=audio_dir,
     speeches=speeches,
     alignment_strategy="speech",
     text_normalizer_fn=text_normalizer,
@@ -148,3 +152,16 @@ The `output/emissions` directory will, in addition to the JSON files, also conta
 
 All intermediate files can safely be deleted, assuming there is no need to re-run the pipeline from a specific intermediate stage. 
 
+## Citation
+
+If you use `easyaligner` in your research, consider citing the following blog post:
+
+```
+@online{rekathati2026,
+  author = {Rekathati, Faton},
+  title = {Easyaligner: {Forced} Alignment of Text and Audio, Made Easy},
+  date = {2026-04-08},
+  url = {https://kb-labb.github.io/posts/2026-04-08-easyaligner/},
+  langid = {en}
+}
+```

{easyaligner-0.2.1 → easyaligner-0.3.0}/README.md

@@ -6,8 +6,9 @@
 
 * **GPU accelerated forced alignment**. Uses [Pytorch's forced alignment API](https://docs.pytorch.org/audio/main/tutorials/ctc_forced_alignment_api_tutorial.html) with a GPU based implementation of the Viterbi algorithm. Enables fast and memory-efficient forced alignment of long audio segments ([Pratap et al., 2024](https://jmlr.org/papers/volume25/23-1318/23-1318.pdf#page=8)). 
 * **Flexible text normalization for improved alignment quality**. Users can supply custom regex-based text normalization functions to preprocess transcripts before alignment. A mapping from the original text to the normalized text is maintained internally. All of the applied normalizations and transformations are consequently **non-destructive and reversible after alignment**.  
-* **Batch processing support for emission extraction**. `easyaligner` supports batched inference for wav2vec2-based models, keeping track of non-padded logits when doing alignment.   
-* **Modular pipeline design**. The library has separate, independent, pipelines for VAD, emission extraction, and forced alignment. Users can run everything end-to-end, or run the separate stages individually. 
+* **Batch processing support for emission extraction**. `easyaligner` supports batched inference for wav2vec2-based models, keeping track of non-padded logits when doing alignment. 
+
+Check out the [documentation](https://kb-labb.github.io/easyaligner/) for more details and tutorials!
 
 ## Installation
 
@@ -47,13 +48,21 @@ from easyaligner.pipelines import pipeline
 from easyaligner.text import text_normalizer
 from easyaligner.vad.pyannote import load_vad_model
 
+filepath_pattern = "tale-of-two-cities_align-en/taleoftwocities_01_dickens_64kb_align.mp3"
+
+# Download mp3 from Hugging Face Hub
 snapshot_download(
     "Lauler/easytranscriber_tutorials",
     repo_type="dataset",
     local_dir="data/tutorials",
-    allow_patterns="tale-of-two-cities_align-en/*", 
+    allow_patterns=filepath_pattern,
 )
 
+# File(s) to align
+filepath = Path("data/tutorials") / filepath_pattern
+audio_dir = filepath.parent
+audio_files = [filepath.name]
+
 text = """
 It was the best of times, it was the worst of times, it was the age of
 wisdom, it was the age of foolishness, it was the epoch of belief, it
@@ -69,26 +78,21 @@ evil, in the superlative degree of comparison only.
 text = text.strip()
 
 # The alignments will be organized according to how the text is tokenized
-tokenizer = load_tokenizer(language="english") # sentence tokenizer 
-span_list = list(tokenizer.span_tokenize(text)) # start, end character indices for each sentence
+tokenizer = load_tokenizer(language="english")  # sentence tokenizer
+span_list = list(tokenizer.span_tokenize(text))  # start, end character indices for each sentence
 speeches = [[SpeechSegment(speech_id=0, text=text, text_spans=span_list, start=None, end=None)]]
 
 # Load models and run pipeline
 model_vad = load_vad_model()
-model = (
-    AutoModelForCTC.from_pretrained("facebook/wav2vec2-base-960h").to("cuda").half()
-)
+model = AutoModelForCTC.from_pretrained("facebook/wav2vec2-base-960h").to("cuda").half()
 processor = Wav2Vec2Processor.from_pretrained("facebook/wav2vec2-base-960h")
 
-# File(s) to align
-audio_files = [file.name for file in Path("data/tutorials/tale-of-two-cities_align-en").glob("*")]
-
 pipeline(
     vad_model=model_vad,
     emissions_model=model,
     processor=processor,
     audio_paths=audio_files,
-    audio_dir="data/tutorials/tale-of-two-cities_align-en",
+    audio_dir=audio_dir,
     speeches=speeches,
     alignment_strategy="speech",
     text_normalizer_fn=text_normalizer,
@@ -127,3 +131,16 @@ The `output/emissions` directory will, in addition to the JSON files, also conta
 
 All intermediate files can safely be deleted, assuming there is no need to re-run the pipeline from a specific intermediate stage. 
 
+## Citation
+
+If you use `easyaligner` in your research, consider citing the following blog post:
+
+```
+@online{rekathati2026,
+  author = {Rekathati, Faton},
+  title = {Easyaligner: {Forced} Alignment of Text and Audio, Made Easy},
+  date = {2026-04-08},
+  url = {https://kb-labb.github.io/posts/2026-04-08-easyaligner/},
+  langid = {en}
+}
+```

{easyaligner-0.2.1 → easyaligner-0.3.0}/pyproject.toml

@@ -3,7 +3,7 @@ requires = ["setuptools>=67.0.0"]
 build-backend = "setuptools.build_meta"
 
 [project]
-version = "0.2.1"
+version = "0.3.0"
 name = "easyaligner"
 requires-python = ">= 3.10"
 description = "Forced alignment pipeline designed for efficiency and ease of use."
@@ -12,12 +12,12 @@ authors = [{ name = "Faton Rekathati" }]
 
 dependencies = [
   "transformers>=4.45.0",
-  "torch>=2.7.0,!=2.9.*",
-  "torchaudio>=2.7.0,!=2.9.*",
+  "torch>=2.7.0,<2.9",
+  "torchaudio>=2.7.0,<2.9",
   "tqdm>=4.66.1",
   "soundfile>=0.12.1",
   "nltk>=3.8.2",
-  "pyannote-audio>=3.3.1",
+  "pyannote-audio>=3.3.1,<4.0.4",
   "silero-vad~=6.0",
   "msgspec",
   "rapidfuzz"

{easyaligner-0.2.1 → easyaligner-0.3.0}/src/easyaligner/pipelines.py

@@ -44,7 +44,6 @@ def vad_pipeline_generator(
     chunk_size: int = 30,
     sample_rate: int = 16000,
     metadata: list[dict] | None = None,
-    batch_size: int = 1,
     num_workers: int = 1,
     prefetch_factor: int = 2,
     save_json: bool = True,
@@ -73,8 +72,6 @@ def vad_pipeline_generator(
         The sample rate to resample the audio to before running VAD.
     metadata : list[dict] or None, optional
         Optional list of additional file level metadata to include.
-    batch_size : int, default 1
-        The batch size for the DataLoader.
     num_workers : int, default 1
         The number of workers for the DataLoader.
     prefetch_factor : int, default 2
@@ -99,7 +96,7 @@ def vad_pipeline_generator(
     )
     vad_dataloader = torch.utils.data.DataLoader(
         vad_dataset,
-        batch_size=batch_size,
+        batch_size=1,
         shuffle=False,
         collate_fn=vad_collate_fn,
         num_workers=num_workers,
@@ -163,7 +160,6 @@ def vad_pipeline(
     chunk_size: int = 30,
     sample_rate: int = 16000,
     metadata: list[dict] | None = None,
-    batch_size: int = 1,
     num_workers: int = 1,
     prefetch_factor: int = 2,
     save_json: bool = True,
@@ -192,8 +188,6 @@ def vad_pipeline(
         The sample rate to resample the audio to before running VAD.
     metadata : list[dict] or None, optional
         Optional list of additional file level metadata to include.
-    batch_size : int, default 1
-        The batch size for the DataLoader.
     num_workers : int, default 1
         The number of workers for the DataLoader.
     prefetch_factor : int, default 2
@@ -222,7 +216,6 @@ def vad_pipeline(
         chunk_size=chunk_size,
         sample_rate=sample_rate,
         metadata=metadata,
-        batch_size=batch_size,
         num_workers=num_workers,
         prefetch_factor=prefetch_factor,
         save_json=save_json,
@@ -249,7 +242,6 @@ def emissions_pipeline_generator(
     sample_rate: int = 16000,
     chunk_size: int = 30,
     alignment_strategy: str = "speech",
-    batch_size_files: int = 1,
     num_workers_files: int = 1,
     prefetch_factor_files: int = 2,
     batch_size_features: int = 8,
@@ -287,8 +279,6 @@ def emissions_pipeline_generator(
         Strategy for aligning features to text. One of 'speech' or 'chunk'.
         If `speech`, audio is split into `chunk_size` sized chunks based on SpeechSegments.
         If `chunk`, audio is taken from existing VAD chunks.
-    batch_size_files : int, default 1
-        Batch size for the file DataLoader.
     num_workers_files : int, default 1
         Number of workers for the file DataLoader.
     prefetch_factor_files : int, default 2
@@ -333,7 +323,7 @@ def emissions_pipeline_generator(
 
     file_dataloader = torch.utils.data.DataLoader(
         file_dataset,
-        batch_size=batch_size_files,
+        batch_size=1,
         shuffle=False,
         collate_fn=audiofile_collate_fn,
         num_workers=num_workers_files,
@@ -372,7 +362,7 @@ def emissions_pipeline_generator(
         speech_ids = []
 
         for batch in feature_dataloader:
-            features = batch["features"].half().to(device)
+            features = batch["features"].to(device=device, dtype=model.dtype)
 
             with torch.inference_mode():
                 logits = model(features).logits
@@ -420,7 +410,6 @@ def emissions_pipeline(
     sample_rate: int = 16000,
     chunk_size: int = 30,
     alignment_strategy: str = "speech",
-    batch_size_files: int = 1,
     num_workers_files: int = 1,
     prefetch_factor_files: int = 2,
     batch_size_features: int = 8,
@@ -455,8 +444,6 @@ def emissions_pipeline(
         Strategy for aligning features to text. One of 'speech' or 'chunk'.
         If `speech`, audio is split into `chunk_size` sized chunks based on SpeechSegments.
         If `chunk`, audio is taken from existing VAD chunks.
-    batch_size_files : int, default 1
-        Batch size for the file DataLoader.
     num_workers_files : int, default 1
         Number of workers for the file DataLoader.
     prefetch_factor_files : int, default 2
@@ -495,7 +482,6 @@ def emissions_pipeline(
         sample_rate=sample_rate,
         chunk_size=chunk_size,
         alignment_strategy=alignment_strategy,
-        batch_size_files=batch_size_files,
         num_workers_files=num_workers_files,
         prefetch_factor_files=prefetch_factor_files,
         batch_size_features=batch_size_features,
@@ -773,7 +759,6 @@ def pipeline(
     word_boundary: str = "|",
     indent: int = 2,
     ndigits: int = 5,
-    batch_size_files: int = 1,
     num_workers_files: int = 2,
     prefetch_factor_files: int = 1,
     batch_size_features: int = 8,
@@ -839,8 +824,6 @@ def pipeline(
         Indentation level for saved JSON files. `None` to disable pretty formatting.
     ndigits : int, default 5
         Number of decimal digits to round the alignment times and scores to.
-    batch_size_files : int, default 1
-        Batch size for the file DataLoader.
     num_workers_files : int, default 2
         Number of workers for the file DataLoader.
     prefetch_factor_files : int, default 1
@@ -887,7 +870,6 @@ def pipeline(
         speeches=speeches,
         chunk_size=chunk_size,
         sample_rate=sample_rate,
-        batch_size=batch_size_files,
         num_workers=num_workers_files,
         prefetch_factor=prefetch_factor_files,
         save_json=save_json,
@@ -909,7 +891,6 @@ def pipeline(
         sample_rate=sample_rate,
         chunk_size=chunk_size,
         alignment_strategy=alignment_strategy,
-        batch_size_files=batch_size_files,
         num_workers_files=num_workers_files,
         prefetch_factor_files=prefetch_factor_files,
         batch_size_features=batch_size_features,
@@ -929,7 +910,7 @@ def pipeline(
     )
     json_dataloader = torch.utils.data.DataLoader(
         json_dataset,
-        batch_size=batch_size_files,
+        batch_size=1,
         shuffle=False,
         collate_fn=metadata_collate_fn,
         num_workers=num_workers_files,

{easyaligner-0.2.1 → easyaligner-0.3.0}/src/easyaligner/vad/pyannote.py

@@ -431,7 +431,7 @@ def run_vad_pipeline(metadata: AudioMetadata, model, audio, sample_rate=16000, c
         # Run VAD on entire audio
         vad_segments = model(
             {
-                "waveform": torch.tensor(audio).unsqueeze(0).to(torch.float32),
+                "waveform": torch.as_tensor(audio).unsqueeze(0).to(torch.float32),
                 "sample_rate": sample_rate,
             }
         )
@@ -455,7 +455,7 @@ def run_vad_pipeline(metadata: AudioMetadata, model, audio, sample_rate=16000, c
 
             vad_segments = model(
                 {
-                    "waveform": torch.tensor(speech_audio).unsqueeze(0).to(torch.float32),
+                    "waveform": torch.as_tensor(speech_audio).unsqueeze(0).to(torch.float32),
                     "sample_rate": sample_rate,
                 }
             )

{easyaligner-0.2.1 → easyaligner-0.3.0/src/easyaligner.egg-info}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: easyaligner
-Version: 0.2.1
+Version: 0.3.0
 Summary: Forced alignment pipeline designed for efficiency and ease of use.
 Author: Faton Rekathati
 Project-URL: Repository, https://github.com/kb-labb/easyaligner
@@ -8,12 +8,12 @@ Requires-Python: >=3.10
 Description-Content-Type: text/markdown
 License-File: LICENSE
 Requires-Dist: transformers>=4.45.0
-Requires-Dist: torch!=2.9.*,>=2.7.0
-Requires-Dist: torchaudio!=2.9.*,>=2.7.0
+Requires-Dist: torch<2.9,>=2.7.0
+Requires-Dist: torchaudio<2.9,>=2.7.0
 Requires-Dist: tqdm>=4.66.1
 Requires-Dist: soundfile>=0.12.1
 Requires-Dist: nltk>=3.8.2
-Requires-Dist: pyannote-audio>=3.3.1
+Requires-Dist: pyannote-audio<4.0.4,>=3.3.1
 Requires-Dist: silero-vad~=6.0
 Requires-Dist: msgspec
 Requires-Dist: rapidfuzz
@@ -27,8 +27,9 @@ Dynamic: license-file
 
 * **GPU accelerated forced alignment**. Uses [Pytorch's forced alignment API](https://docs.pytorch.org/audio/main/tutorials/ctc_forced_alignment_api_tutorial.html) with a GPU based implementation of the Viterbi algorithm. Enables fast and memory-efficient forced alignment of long audio segments ([Pratap et al., 2024](https://jmlr.org/papers/volume25/23-1318/23-1318.pdf#page=8)). 
 * **Flexible text normalization for improved alignment quality**. Users can supply custom regex-based text normalization functions to preprocess transcripts before alignment. A mapping from the original text to the normalized text is maintained internally. All of the applied normalizations and transformations are consequently **non-destructive and reversible after alignment**.  
-* **Batch processing support for emission extraction**. `easyaligner` supports batched inference for wav2vec2-based models, keeping track of non-padded logits when doing alignment.   
-* **Modular pipeline design**. The library has separate, independent, pipelines for VAD, emission extraction, and forced alignment. Users can run everything end-to-end, or run the separate stages individually. 
+* **Batch processing support for emission extraction**. `easyaligner` supports batched inference for wav2vec2-based models, keeping track of non-padded logits when doing alignment. 
+
+Check out the [documentation](https://kb-labb.github.io/easyaligner/) for more details and tutorials!
 
 ## Installation
 
@@ -68,13 +69,21 @@ from easyaligner.pipelines import pipeline
 from easyaligner.text import text_normalizer
 from easyaligner.vad.pyannote import load_vad_model
 
+filepath_pattern = "tale-of-two-cities_align-en/taleoftwocities_01_dickens_64kb_align.mp3"
+
+# Download mp3 from Hugging Face Hub
 snapshot_download(
     "Lauler/easytranscriber_tutorials",
     repo_type="dataset",
     local_dir="data/tutorials",
-    allow_patterns="tale-of-two-cities_align-en/*", 
+    allow_patterns=filepath_pattern,
 )
 
+# File(s) to align
+filepath = Path("data/tutorials") / filepath_pattern
+audio_dir = filepath.parent
+audio_files = [filepath.name]
+
 text = """
 It was the best of times, it was the worst of times, it was the age of
 wisdom, it was the age of foolishness, it was the epoch of belief, it
@@ -90,26 +99,21 @@ evil, in the superlative degree of comparison only.
 text = text.strip()
 
 # The alignments will be organized according to how the text is tokenized
-tokenizer = load_tokenizer(language="english") # sentence tokenizer 
-span_list = list(tokenizer.span_tokenize(text)) # start, end character indices for each sentence
+tokenizer = load_tokenizer(language="english")  # sentence tokenizer
+span_list = list(tokenizer.span_tokenize(text))  # start, end character indices for each sentence
 speeches = [[SpeechSegment(speech_id=0, text=text, text_spans=span_list, start=None, end=None)]]
 
 # Load models and run pipeline
 model_vad = load_vad_model()
-model = (
-    AutoModelForCTC.from_pretrained("facebook/wav2vec2-base-960h").to("cuda").half()
-)
+model = AutoModelForCTC.from_pretrained("facebook/wav2vec2-base-960h").to("cuda").half()
 processor = Wav2Vec2Processor.from_pretrained("facebook/wav2vec2-base-960h")
 
-# File(s) to align
-audio_files = [file.name for file in Path("data/tutorials/tale-of-two-cities_align-en").glob("*")]
-
 pipeline(
     vad_model=model_vad,
     emissions_model=model,
     processor=processor,
     audio_paths=audio_files,
-    audio_dir="data/tutorials/tale-of-two-cities_align-en",
+    audio_dir=audio_dir,
     speeches=speeches,
     alignment_strategy="speech",
     text_normalizer_fn=text_normalizer,
@@ -148,3 +152,16 @@ The `output/emissions` directory will, in addition to the JSON files, also conta
 
 All intermediate files can safely be deleted, assuming there is no need to re-run the pipeline from a specific intermediate stage. 
 
+## Citation
+
+If you use `easyaligner` in your research, consider citing the following blog post:
+
+```
+@online{rekathati2026,
+  author = {Rekathati, Faton},
+  title = {Easyaligner: {Forced} Alignment of Text and Audio, Made Easy},
+  date = {2026-04-08},
+  url = {https://kb-labb.github.io/posts/2026-04-08-easyaligner/},
+  langid = {en}
+}
+```

{easyaligner-0.2.1 → easyaligner-0.3.0}/src/easyaligner.egg-info/requires.txt

@@ -1,10 +1,10 @@
 transformers>=4.45.0
-torch!=2.9.*,>=2.7.0
-torchaudio!=2.9.*,>=2.7.0
+torch<2.9,>=2.7.0
+torchaudio<2.9,>=2.7.0
 tqdm>=4.66.1
 soundfile>=0.12.1
 nltk>=3.8.2
-pyannote-audio>=3.3.1
+pyannote-audio<4.0.4,>=3.3.1
 silero-vad~=6.0
 msgspec
 rapidfuzz