echogarden 2.7.0 → 2.8.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/data/lexicons/heteronyms.en.json +6 -2
- package/data/lexicons/words.en.json +379 -19
- package/dist/alignment/SemanticTextAlignment.js +6 -7
- package/dist/alignment/SemanticTextAlignment.js.map +1 -1
- package/dist/api/Alignment.js +2 -2
- package/dist/api/Alignment.js.map +1 -1
- package/dist/api/Recognition.js +2 -2
- package/dist/api/Recognition.js.map +1 -1
- package/dist/api/SpeechTranslation.js +2 -2
- package/dist/api/SpeechTranslation.js.map +1 -1
- package/dist/api/Synthesis.js +7 -7
- package/dist/api/Synthesis.js.map +1 -1
- package/dist/api/TimelineTranslationAlignment.js +2 -2
- package/dist/api/TimelineTranslationAlignment.js.map +1 -1
- package/dist/api/TranslationAlignment.js +2 -2
- package/dist/api/TranslationAlignment.js.map +1 -1
- package/dist/audio/AudioPlayer.js +2 -2
- package/dist/audio/AudioPlayer.js.map +1 -1
- package/dist/audio/AudioUtilities.d.ts +1 -1
- package/dist/cli/CLI.js +4 -4
- package/dist/cli/CLI.js.map +1 -1
- package/dist/denoising/RNNoise.js +5 -5
- package/dist/denoising/RNNoise.js.map +1 -1
- package/dist/dsp/FFT.js +13 -19
- package/dist/dsp/FFT.js.map +1 -1
- package/dist/dsp/Rubberband.js +5 -5
- package/dist/dsp/Rubberband.js.map +1 -1
- package/dist/dsp/Sonic.js +6 -6
- package/dist/dsp/Sonic.js.map +1 -1
- package/dist/dsp/SpeexResampler.js +11 -11
- package/dist/dsp/SpeexResampler.js.map +1 -1
- package/dist/nlp/EspeakPhonemizer.js +1 -1
- package/dist/nlp/EspeakPhonemizer.js.map +1 -1
- package/dist/nlp/Segmentation.d.ts +13 -10
- package/dist/nlp/Segmentation.js +129 -106
- package/dist/nlp/Segmentation.js.map +1 -1
- package/dist/nlp/TextNormalizer.js +74 -42
- package/dist/nlp/TextNormalizer.js.map +1 -1
- package/dist/recognition/AmazonTranscribeSTT.js +2 -2
- package/dist/recognition/AmazonTranscribeSTT.js.map +1 -1
- package/dist/recognition/SileroSTT.js +2 -2
- package/dist/recognition/SileroSTT.js.map +1 -1
- package/dist/recognition/WhisperSTT.js +4 -16
- package/dist/recognition/WhisperSTT.js.map +1 -1
- package/dist/subtitles/Subtitles.js +52 -7
- package/dist/subtitles/Subtitles.js.map +1 -1
- package/dist/synthesis/ElevenLabsTTS.js +11 -10
- package/dist/synthesis/ElevenLabsTTS.js.map +1 -1
- package/dist/synthesis/EspeakTTS.js +8 -8
- package/dist/synthesis/EspeakTTS.js.map +1 -1
- package/dist/synthesis/KokoroTTS.js +21 -10
- package/dist/synthesis/KokoroTTS.js.map +1 -1
- package/dist/synthesis/SvoxPicoTTS.js +24 -23
- package/dist/synthesis/SvoxPicoTTS.js.map +1 -1
- package/dist/text-translation/DeepLTextTranslation.js +4 -3
- package/dist/text-translation/DeepLTextTranslation.js.map +1 -1
- package/dist/text-translation/NLLBTextTranslation.js +7 -6
- package/dist/text-translation/NLLBTextTranslation.js.map +1 -1
- package/dist/utilities/StringUtilities.d.ts +1 -1
- package/dist/utilities/StringUtilities.js +5 -5
- package/dist/utilities/StringUtilities.js.map +1 -1
- package/dist/utilities/Timeline.d.ts +2 -3
- package/dist/utilities/Timeline.js +96 -147
- package/dist/utilities/Timeline.js.map +1 -1
- package/dist/utilities/WikipediaReader.js +3 -3
- package/dist/utilities/WikipediaReader.js.map +1 -1
- package/dist/voice-activity-detection/WebRtcVAD.js +4 -4
- package/dist/voice-activity-detection/WebRtcVAD.js.map +1 -1
- package/docs/Tasklist.md +1 -6
- package/package.json +13 -11
- package/src/alignment/SemanticTextAlignment.ts +6 -7
- package/src/api/Alignment.ts +2 -2
- package/src/api/Recognition.ts +2 -2
- package/src/api/SpeechTranslation.ts +2 -2
- package/src/api/Synthesis.ts +7 -7
- package/src/api/TimelineTranslationAlignment.ts +2 -2
- package/src/api/TranslationAlignment.ts +2 -2
- package/src/audio/AudioPlayer.ts +2 -2
- package/src/cli/CLI.ts +4 -4
- package/src/denoising/RNNoise.ts +5 -5
- package/src/dsp/FFT.ts +22 -19
- package/src/dsp/Rubberband.ts +5 -5
- package/src/dsp/Sonic.ts +6 -6
- package/src/dsp/SpeexResampler.ts +11 -11
- package/src/nlp/EspeakPhonemizer.ts +1 -1
- package/src/nlp/Segmentation.ts +146 -111
- package/src/nlp/TextNormalizer.ts +94 -52
- package/src/recognition/AmazonTranscribeSTT.ts +2 -2
- package/src/recognition/SileroSTT.ts +2 -2
- package/src/recognition/WhisperSTT.ts +4 -18
- package/src/subtitles/Subtitles.ts +69 -8
- package/src/synthesis/ElevenLabsTTS.ts +12 -11
- package/src/synthesis/EspeakTTS.ts +9 -8
- package/src/synthesis/KokoroTTS.ts +24 -12
- package/src/synthesis/SvoxPicoTTS.ts +26 -23
- package/src/text-translation/DeepLTextTranslation.ts +4 -3
- package/src/text-translation/NLLBTextTranslation.ts +8 -6
- package/src/typings/Fillers.d.ts +0 -16
- package/src/utilities/StringUtilities.ts +5 -6
- package/src/utilities/Timeline.ts +100 -170
- package/src/utilities/WikipediaReader.ts +3 -3
- package/src/voice-activity-detection/WebRtcVAD.ts +5 -4
- package/dist/nlp/CompromiseNLP.d.ts +0 -15
- package/dist/nlp/CompromiseNLP.js +0 -79
- package/dist/nlp/CompromiseNLP.js.map +0 -1
- package/dist/utilities/WasmMemoryManager.d.ts +0 -153
- package/dist/utilities/WasmMemoryManager.js +0 -440
- package/dist/utilities/WasmMemoryManager.js.map +0 -1
- package/src/nlp/CompromiseNLP.ts +0 -119
- package/src/utilities/WasmMemoryManager.ts +0 -566
|
@@ -1 +1 @@
|
|
|
1
|
-
{"version":3,"file":"NLLBTextTranslation.js","sourceRoot":"","sources":["../../src/text-translation/NLLBTextTranslation.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,MAAM,OAAO,CAAA;AAEzB,OAAO,EAAE,gBAAgB,EAAE,MAAM,wBAAwB,CAAA;AACzD,OAAO,EAAE,MAAM,EAAE,MAAM,wBAAwB,CAAA;AAC/C,OAAO,EAAE,WAAW,EAAE,MAAM,gCAAgC,CAAA;AAE5D,MAAM,CAAC,KAAK,UAAU,aAAa,CAAC,UAAkB,EAAE,cAAsB,EAAE,cAAsB;IACrG,MAAM,MAAM,GAAG,IAAI,MAAM,EAAE,CAAA;IAE3B,2DAA2D;IAE3D,2BAA2B;IAE3B,MAAM,CAAC,KAAK,CAAC,6BAA6B,CAAC,CAAA;IAC3C,MAAM,EAAE,aAAa,EAAE,8BAA8B,EAAE,GAAG,MAAM,MAAM,CAAC,sCAAsC,CAAC,CAAA;IAE9G,MAAM,CAAC,KAAK,CAAC,mBAAmB,CAAC,CAAA;IACjC,MAAM,SAAS,GAAG,MAAM,WAAW,CAAC,mCAAmC,CAAC,CAAA;IAExE,MAAM,CAAC,KAAK,CAAC,qBAAqB,CAAC,CAAA;IACnC,MAAM,SAAS,GAAG,MAAM,aAAa,CAAC,eAAe,CAAC,SAAS,CAAC,CAAA;IAEhE,MAAM,CAAC,KAAK,CAAC,iBAAiB,CAAC,CAAA;IAC/B,MAAM,KAAK,GAAG,MAAM,8BAA8B,CAAC,eAAe,CAAC,SAAS,CAAC,CAAA;IAE7E,MAAM,CAAC,KAAK,CAAC,oBAAoB,CAAC,CAAA;IAElC,MAAM,MAAM,GAAG;QACd,QAAQ,EAAE,UAAU;QACpB,QAAQ,EAAE,UAAU;KACpB,CAAA;IAED,MAAM,SAAS,GAAG,gBAAgB,CAAC,UAAU,EAAE,cAAc,CAAC,CAAA;IAE9D,MAAM,CAAC,GAAG,EAAE,CAAA;IAEZ,MAAM,gBAAgB,GAAsB,EAAE,CAAA;IAE9C,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,SAAS,CAAC,MAAM,EAAE,CAAC,EAAE,EAAE,CAAC;QAC3C,MAAM,QAAQ,GAAG,SAAS,CAAC,CAAC,CAAC,CAAA;QAE7B,MAAM,CAAC,gBAAgB,CAAC,sBAAsB,CAAC,GAAG,CAAC,IAAI,SAAS,CAAC,MAAM,EAAE,EAAE,IAAI,QAAQ,CAAC,IAAI,EAAE,GAAG,EAAE,KAAK,CAAC,aAAa,CAAC,CAAA;QAEvH,MAAM,CAAC,KAAK,CAAC,mBAAmB,CAAC,CAAA;QACjC,MAAM,MAAM,GAAI,SAAiB,CAAC,yBAAyB,CAAC,QAAQ,EAAE;YACrE,OAAO,EAAE,IAAI;YACb,UAAU,EAAE,IAAI;SAChB,EAAE,MAAM,CAAC,CAAA;QAEV,MAAM,CAAC,KAAK,CAAC,oCAAoC,CAAC,CAAA;QAClD,MAAM,mBAAmB,GAAG,MAAM,KAAK,CAAC,QAAQ,CAAC,MAAM,CAAC,SAAS,EAAE,MAAM,CAAC,CAAA;QAE1E,MAAM,CAAC,KAAK,CAAC,gBAAgB,CAAC,CAAA;QAE9B,MAAM,iBAAiB,GAAG,SAAS,CAAC,KAAK,CAAC,qBAAqB,CAAC,mBAAmB,CAAC,CAAC,CAAC,CAAC,CAAA;QAEvF,MAAM,cAAc,GAAG,iBAAiB;aACtC,KAAK,CAAC,CAAC,EAAE,iBAAiB,CAAC,MAAM,GAAG,CAAC,CAAC;aACtC,GAAG,CAAC,KAAK,CAAC,EAAE;YACZ,IAAI,KAAK,CAAC,UAAU,CAAC,GAAG,CAAC,EAAE,CAAC;gBAC3B,OAAO,KAAK,CAAC,UAAU,CAAC,GAAG,EAAE,GAAG,CAAC,CAAA;YAClC,CAAC;YAED,OAAO,KAAK,CAAA;QACb,CAAC,CAAC;aACD,IAAI,CAAC,EAAE,CAAC;aACR,IAAI,EAAE,CAAA;QAER,gBAAgB,CAAC,IAAI,CAAC;YACrB,UAAU,EAAE,QAAQ;YACpB,cAAc;SACd,CAAC,CAAA;QAEF,MAAM,CAAC,GAAG,EAAE,CAAA;IACb,CAAC;IAED,OAAO,gBAAgB,CAAA;AACxB,CAAC;AAED,MAAM,sBAAsB,GAA2B;IACtD,0BAA0B,EAAE,UAAU;IACtC,yBAAyB,EAAE,UAAU;IACrC,WAAW,EAAE,UAAU;IACvB,MAAM,EAAE,UAAU;IAClB,SAAS,EAAE,UAAU;IACrB,UAAU,EAAE,UAAU;IACtB,UAAU,EAAE,UAAU;IACtB,UAAU,EAAE,UAAU;IACtB,QAAQ,EAAE,UAAU;IACpB,kBAAkB,EAAE,UAAU;IAC9B,UAAU,EAAE,UAAU;IACtB,SAAS,EAAE,UAAU;IACrB,wBAAwB,EAAE,UAAU;IACpC,uBAAuB,EAAE,UAAU;IACnC,SAAS,EAAE,UAAU;IACrB,QAAQ,EAAE,UAAU;IACpB,YAAY,EAAE,UAAU;IACxB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,UAAU,EAAE,UAAU;IACtB,SAAS,EAAE,UAAU;IACrB,UAAU,EAAE,UAAU;IACtB,WAAW,EAAE,UAAU;IACvB,SAAS,EAAE,UAAU;IACrB,SAAS,EAAE,UAAU;IACrB,SAAS,EAAE,UAAU;IACrB,yBAAyB,EAAE,UAAU;IACrC,gBAAgB,EAAE,UAAU;IAC5B,gCAAgC,EAAE,UAAU;IAC5C,+BAA+B,EAAE,UAAU;IAC3C,iBAAiB,EAAE,UAAU;IAC7B,eAAe,EAAE,UAAU;IAC3B,sBAAsB,EAAE,UAAU;IAClC,uBAAuB,EAAE,UAAU;IACnC,QAAQ,EAAE,UAAU;IACpB,eAAe,EAAE,UAAU;IAC3B,UAAU,EAAE,UAAU;IACtB,OAAO,EAAE,UAAU;IACnB,QAAQ,EAAE,UAAU;IACpB,MAAM,EAAE,UAAU;IAClB,OAAO,EAAE,UAAU;IACnB,OAAO,EAAE,UAAU;IACnB,UAAU,EAAE,UAAU;IACtB,iBAAiB,EAAE,UAAU;IAC7B,iBAAiB,EAAE,UAAU;IAC7B,iBAAiB,EAAE,UAAU;IAC7B,SAAS,EAAE,UAAU;IACrB,WAAW,EAAE,UAAU;IACvB,UAAU,EAAE,UAAU;IACtB,KAAK,EAAE,UAAU;IACjB,SAAS,EAAE,UAAU;IACrB,QAAQ,EAAE,UAAU;IACpB,SAAS,EAAE,UAAU;IACrB,KAAK,EAAE,UAAU;IACjB,QAAQ,EAAE,UAAU;IACpB,UAAU,EAAE,UAAU;IACtB,UAAU,EAAE,UAAU;IACtB,OAAO,EAAE,UAAU;IACnB,UAAU,EAAE,UAAU;IACtB,QAAQ,EAAE,UAAU;IACpB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,UAAU,EAAE,UAAU;IACtB,gBAAgB,EAAE,UAAU;IAC5B,gBAAgB,EAAE,UAAU;IAC5B,OAAO,EAAE,UAAU;IACnB,QAAQ,EAAE,UAAU;IACpB,OAAO,EAAE,UAAU;IACnB,WAAW,EAAE,UAAU;IACvB,WAAW,EAAE,UAAU;IACvB,MAAM,EAAE,UAAU;IAClB,SAAS,EAAE,UAAU;IACrB,YAAY,EAAE,UAAU;IACxB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,UAAU,EAAE,UAAU;IACtB,UAAU,EAAE,UAAU;IACtB,SAAS,EAAE,UAAU;IACrB,QAAQ,EAAE,UAAU;IACpB,cAAc,EAAE,UAAU;IAC1B,QAAQ,EAAE,UAAU;IACpB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,0BAA0B,EAAE,UAAU;IACtC,8BAA8B,EAAE,UAAU;IAC1C,QAAQ,EAAE,UAAU;IACpB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,QAAQ,EAAE,UAAU;IACpB,UAAU,EAAE,UAAU;IACtB,aAAa,EAAE,UAAU;IACzB,QAAQ,EAAE,UAAU;IACpB,QAAQ,EAAE,UAAU;IACpB,KAAK,EAAE,UAAU;IACjB,WAAW,EAAE,UAAU;IACvB,UAAU,EAAE,UAAU;IACtB,YAAY,EAAE,UAAU;IACxB,SAAS,EAAE,UAAU;IACrB,YAAY,EAAE,UAAU;IACxB,SAAS,EAAE,UAAU;IACrB,YAAY,EAAE,UAAU;IACxB,KAAK,EAAE,UAAU;IACjB,eAAe,EAAE,UAAU;IAC3B,YAAY,EAAE,UAAU;IACxB,QAAQ,EAAE,UAAU;IACpB,UAAU,EAAE,UAAU;IACtB,WAAW,EAAE,UAAU;IACvB,SAAS,EAAE,UAAU;IACrB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,yBAAyB,EAAE,UAAU;IACrC,qBAAqB,EAAE,UAAU;IACjC,6BAA6B,EAAE,UAAU;IACzC,4BAA4B,EAAE,UAAU;IACxC,MAAM,EAAE,UAAU;IAClB,oCAAoC,EAAE,UAAU;IAChD,wBAAwB,EAAE,UAAU;IACpC,iBAAiB,EAAE,UAAU;IAC7B,OAAO,EAAE,UAAU;IACnB,cAAc,EAAE,UAAU;IAC1B,QAAQ,EAAE,UAAU;IACpB,mBAAmB,EAAE,UAAU;IAC/B,mBAAmB,EAAE,UAAU;IAC/B,wBAAwB,EAAE,UAAU;IACpC,kBAAkB,EAAE,UAAU;IAC9B,gBAAgB,EAAE,UAAU;IAC5B,gBAAgB,EAAE,UAAU;IAC5B,kBAAkB,EAAE,UAAU;IAC9B,mBAAmB,EAAE,UAAU;IAC/B,MAAM,EAAE,UAAU;IAClB,QAAQ,EAAE,UAAU;IACpB,SAAS,EAAE,UAAU;IACrB,MAAM,EAAE,UAAU;IAClB,YAAY,EAAE,UAAU;IACxB,YAAY,EAAE,UAAU;IACxB,kBAAkB,EAAE,UAAU;IAC9B,QAAQ,EAAE,UAAU;IACpB,YAAY,EAAE,UAAU;IACxB,UAAU,EAAE,UAAU;IACtB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,QAAQ,EAAE,UAAU;IACpB,OAAO,EAAE,UAAU;IACnB,UAAU,EAAE,UAAU;IACtB,SAAS,EAAE,UAAU;IACrB,WAAW,EAAE,UAAU;IACvB,iBAAiB,EAAE,UAAU;IAC7B,SAAS,EAAE,UAAU;IACrB,MAAM,EAAE,UAAU;IAClB,OAAO,EAAE,UAAU;IACnB,UAAU,EAAE,UAAU;IACtB,UAAU,EAAE,UAAU;IACtB,QAAQ,EAAE,UAAU;IACpB,SAAS,EAAE,UAAU;IACrB,QAAQ,EAAE,UAAU;IACpB,WAAW,EAAE,UAAU;IACvB,QAAQ,EAAE,UAAU;IACpB,mBAAmB,EAAE,UAAU;IAC/B,wBAAwB,EAAE,UAAU;IACpC,iBAAiB,EAAE,UAAU;IAC7B,gBAAgB,EAAE,UAAU;IAC5B,oBAAoB,EAAE,UAAU;IAChC,SAAS,EAAE,UAAU;IACrB,kBAAkB,EAAE,UAAU;IAC9B,gBAAgB,EAAE,UAAU;IAC5B,kBAAkB,EAAE,UAAU;IAC9B,WAAW,EAAE,UAAU;IACvB,SAAS,EAAE,UAAU;IACrB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,SAAS,EAAE,UAAU;IACrB,OAAO,EAAE,UAAU;IACnB,yBAAyB,EAAE,UAAU;IACrC,4BAA4B,EAAE,UAAU;IACxC,OAAO,EAAE,UAAU;IACnB,OAAO,EAAE,UAAU;IACnB,sBAAsB,EAAE,UAAU;IAClC,QAAQ,EAAE,UAAU;IACpB,MAAM,EAAE,UAAU;IAClB,UAAU,EAAE,UAAU;IACtB,WAAW,EAAE,UAAU;IACvB,eAAe,EAAE,UAAU;IAC3B,QAAQ,EAAE,UAAU;IACpB,QAAQ,EAAE,UAAU;IACpB,SAAS,EAAE,UAAU;IACrB,iBAAiB,EAAE,UAAU;IAC7B,SAAS,EAAE,UAAU;IACrB,SAAS,EAAE,UAAU;IACrB,KAAK,EAAE,UAAU;IACjB,WAAW,EAAE,UAAU;IACvB,SAAS,EAAE,UAAU;IACrB,MAAM,EAAE,UAAU;IAClB,QAAQ,EAAE,UAAU;IACpB,UAAU,EAAE,UAAU;IACtB,YAAY,EAAE,UAAU;IACxB,OAAO,EAAE,UAAU;IACnB,OAAO,EAAE,UAAU;IACnB,oBAAoB,EAAE,UAAU;IAChC,iBAAiB,EAAE,UAAU;IAC7B,OAAO,EAAE,UAAU;IACnB,OAAO,EAAE,UAAU;IACnB,QAAQ,EAAE,UAAU;IACpB,aAAa,EAAE,UAAU;IACzB,MAAM,EAAE,UAAU;CAClB,CAAA;AAED,MAAM,oBAAoB,GAAmC;IAC5D,0BAA0B,EAAE,SAAS,EAAE,iCAAiC;IACxE,yBAAyB,EAAE,SAAS,EAAE,iCAAiC;IACvE,WAAW,EAAE,IAAI;IACjB,MAAM,EAAE,IAAI;IACZ,SAAS,EAAE,IAAI;IACf,UAAU,EAAE,IAAI;IAChB,UAAU,EAAE,IAAI;IAChB,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,QAAQ,EAAE,KAAK,EAAE,8BAA8B;IAC/C,kBAAkB,EAAE,IAAI,EAAE,yCAAyC;IACnE,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,SAAS,EAAE,IAAI;IACf,wBAAwB,EAAE,SAAS,EAAE,+BAA+B;IACpE,uBAAuB,EAAE,SAAS,EAAE,+BAA+B;IACnE,SAAS,EAAE,IAAI;IACf,QAAQ,EAAE,IAAI;IACd,YAAY,EAAE,IAAI;IAClB,OAAO,EAAE,KAAK,EAAE,8BAA8B;IAC9C,SAAS,EAAE,IAAI;IACf,UAAU,EAAE,KAAK;IACjB,SAAS,EAAE,IAAI;IACf,UAAU,EAAE,KAAK;IACjB,WAAW,EAAE,IAAI;IACjB,SAAS,EAAE,IAAI;IACf,SAAS,EAAE,IAAI;IACf,SAAS,EAAE,KAAK,EAAE,8BAA8B;IAChD,yBAAyB,EAAE,KAAK;IAChC,gBAAgB,EAAE,IAAI,EAAE,mCAAmC;IAC3D,gCAAgC,EAAE,IAAI,EAAE,4CAA4C;IACpF,+BAA+B,EAAE,IAAI,EAAE,4CAA4C;IACnF,iBAAiB,EAAE,KAAK,EAAE,4CAA4C;IACtE,eAAe,EAAE,KAAK,EAAE,8BAA8B;IACtD,sBAAsB,EAAE,IAAI,EAAE,yDAAyD;IACvF,uBAAuB,EAAE,IAAI,EAAE,yDAAyD;IACxF,QAAQ,EAAE,KAAK,EAAE,8BAA8B;IAC/C,eAAe,EAAE,KAAK,EAAE,8BAA8B;IACtD,UAAU,EAAE,IAAI;IAChB,OAAO,EAAE,IAAI;IACb,QAAQ,EAAE,IAAI;IACd,MAAM,EAAE,KAAK,EAAE,uDAAuD;IACtE,OAAO,EAAE,IAAI;IACb,OAAO,EAAE,KAAK;IACd,UAAU,EAAE,IAAI;IAChB,iBAAiB,EAAE,IAAI,EAAE,oDAAoD;IAC7E,iBAAiB,EAAE,KAAK,EAAE,6CAA6C;IACvE,iBAAiB,EAAE,KAAK;IACxB,SAAS,EAAE,IAAI;IACf,WAAW,EAAE,IAAI;IACjB,UAAU,EAAE,IAAI;IAChB,KAAK,EAAE,IAAI;IACX,SAAS,EAAE,IAAI;IACf,QAAQ,EAAE,IAAI;IACd,SAAS,EAAE,IAAI;IACf,KAAK,EAAE,KAAK;IACZ,QAAQ,EAAE,IAAI;IACd,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,UAAU,EAAE,IAAI;IAChB,OAAO,EAAE,IAAI;IACb,UAAU,EAAE,IAAI;IAChB,QAAQ,EAAE,IAAI;IACd,OAAO,EAAE,IAAI;IACb,SAAS,EAAE,IAAI;IACf,UAAU,EAAE,IAAI;IAChB,gBAAgB,EAAE,IAAI;IACtB,gBAAgB,EAAE,IAAI,EAAE,sDAAsD;IAC9E,OAAO,EAAE,IAAI;IACb,QAAQ,EAAE,IAAI;IACd,OAAO,EAAE,IAAI;IACb,WAAW,EAAE,IAAI;IACjB,WAAW,EAAE,IAAI;IACjB,MAAM,EAAE,IAAI;IACZ,SAAS,EAAE,KAAK;IAChB,YAAY,EAAE,IAAI;IAClB,OAAO,EAAE,IAAI;IACb,SAAS,EAAE,IAAI;IACf,UAAU,EAAE,IAAI;IAChB,UAAU,EAAE,IAAI;IAChB,SAAS,EAAE,KAAK,EAAE,8BAA8B;IAChD,QAAQ,EAAE,KAAK,EAAE,8BAA8B;IAC/C,cAAc,EAAE,KAAK,EAAE,8BAA8B;IACrD,QAAQ,EAAE,KAAK;IACf,OAAO,EAAE,KAAK,EAAE,8BAA8B;IAC9C,SAAS,EAAE,IAAI;IACf,0BAA0B,EAAE,IAAI,EAAE,8CAA8C;IAChF,8BAA8B,EAAE,IAAI,EAAE,8CAA8C;IACpF,QAAQ,EAAE,IAAI;IACd,OAAO,EAAE,IAAI;IACb,SAAS,EAAE,IAAI;IACf,QAAQ,EAAE,IAAI;IACd,UAAU,EAAE,KAAK;IACjB,aAAa,EAAE,IAAI;IACnB,QAAQ,EAAE,IAAI;IACd,QAAQ,EAAE,IAAI;IACd,KAAK,EAAE,IAAI;IACX,WAAW,EAAE,KAAK,EAAE,8BAA8B;IAClD,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,YAAY,EAAE,IAAI,EAAE,uDAAuD;IAC3E,SAAS,EAAE,IAAI;IACf,YAAY,EAAE,IAAI;IAClB,SAAS,EAAE,KAAK,EAAE,8BAA8B;IAChD,YAAY,EAAE,KAAK;IACnB,KAAK,EAAE,KAAK;IACZ,eAAe,EAAE,IAAI;IACrB,YAAY,EAAE,IAAI;IAClB,QAAQ,EAAE,KAAK,EAAE,8BAA8B;IAC/C,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,WAAW,EAAE,IAAI;IACjB,SAAS,EAAE,IAAI;IACf,OAAO,EAAE,IAAI;IACb,SAAS,EAAE,IAAI;IACf,yBAAyB,EAAE,KAAK,EAAE,4CAA4C;IAC9E,qBAAqB,EAAE,KAAK,EAAE,8BAA8B;IAC5D,6BAA6B,EAAE,KAAK,EAAE,iDAAiD;IACvF,4BAA4B,EAAE,KAAK,EAAE,iDAAiD;IACtF,MAAM,EAAE,KAAK;IACb,oCAAoC,EAAE,IAAI,EAAE,6DAA6D;IACzG,wBAAwB,EAAE,IAAI,EAAE,6DAA6D;IAC7F,iBAAiB,EAAE,KAAK;IACxB,OAAO,EAAE,KAAK;IACd,cAAc,EAAE,KAAK,EAAE,+CAA+C;IACtE,QAAQ,EAAE,IAAI;IACd,mBAAmB,EAAE,KAAK;IAC1B,mBAAmB,EAAE,IAAI,EAAE,sDAAsD;IACjF,wBAAwB,EAAE,KAAK,EAAE,yDAAyD;IAC1F,kBAAkB,EAAE,KAAK,EAAE,4CAA4C;IACvE,gBAAgB,EAAE,KAAK;IACvB,gBAAgB,EAAE,IAAI,EAAE,gDAAgD;IACxE,kBAAkB,EAAE,IAAI;IACxB,mBAAmB,EAAE,IAAI;IACzB,MAAM,EAAE,KAAK,EAAE,8BAA8B;IAC7C,QAAQ,EAAE,IAAI;IACd,SAAS,EAAE,IAAI;IACf,MAAM,EAAE,IAAI;IACZ,YAAY,EAAE,KAAK;IACnB,YAAY,EAAE,KAAK;IACnB,kBAAkB,EAAE,KAAK,EAAE,mDAAmD;IAC9E,QAAQ,EAAE,IAAI;IACd,YAAY,EAAE,IAAI;IAClB,UAAU,EAAE,IAAI;IAChB,OAAO,EAAE,IAAI;IACb,SAAS,EAAE,IAAI;IACf,QAAQ,EAAE,IAAI;IACd,OAAO,EAAE,IAAI;IACb,UAAU,EAAE,IAAI;IAChB,SAAS,EAAE,KAAK;IAChB,WAAW,EAAE,IAAI,EAAE,8CAA8C;IACjE,iBAAiB,EAAE,IAAI;IACvB,SAAS,EAAE,IAAI;IACf,MAAM,EAAE,KAAK,EAAE,8BAA8B;IAC7C,OAAO,EAAE,IAAI;IACb,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,QAAQ,EAAE,IAAI;IACd,SAAS,EAAE,IAAI;IACf,QAAQ,EAAE,IAAI;IACd,WAAW,EAAE,IAAI;IACjB,QAAQ,EAAE,IAAI;IACd,mBAAmB,EAAE,IAAI,EAAE,sDAAsD;IACjF,wBAAwB,EAAE,KAAK,EAAE,yDAAyD;IAC1F,iBAAiB,EAAE,KAAK,EAAE,2CAA2C;IACrE,gBAAgB,EAAE,IAAI;IACtB,oBAAoB,EAAE,KAAK,EAAE,qDAAqD;IAClF,SAAS,EAAE,IAAI;IACf,kBAAkB,EAAE,IAAI,EAAE,gEAAgE;IAC1F,gBAAgB,EAAE,IAAI,EAAE,6EAA6E;IACrG,kBAAkB,EAAE,IAAI,EAAE,4CAA4C;IACtE,WAAW,EAAE,IAAI;IACjB,SAAS,EAAE,IAAI;IACf,OAAO,EAAE,IAAI;IACb,SAAS,EAAE,IAAI;IACf,SAAS,EAAE,IAAI;IACf,OAAO,EAAE,IAAI;IACb,yBAAyB,EAAE,KAAK,EAAE,8CAA8C;IAChF,4BAA4B,EAAE,KAAK,EAAE,8CAA8C;IACnF,OAAO,EAAE,IAAI;IACb,OAAO,EAAE,IAAI;IACb,sBAAsB,EAAE,KAAK,EAAE,uDAAuD;IACtF,QAAQ,EAAE,IAAI;IACd,MAAM,EAAE,IAAI;IACZ,UAAU,EAAE,IAAI;IAChB,WAAW,EAAE,KAAK;IAClB,eAAe,EAAE,IAAI,EAAE,gEAAgE;IACvF,QAAQ,EAAE,IAAI;IACd,QAAQ,EAAE,IAAI;IACd,SAAS,EAAE,KAAK;IAChB,iBAAiB,EAAE,KAAK,EAAE,kDAAkD;IAC5E,SAAS,EAAE,IAAI;IACf,SAAS,EAAE,IAAI;IACf,KAAK,EAAE,IAAI;IACX,WAAW,EAAE,IAAI;IACjB,SAAS,EAAE,KAAK;IAChB,MAAM,EAAE,IAAI;IACZ,QAAQ,EAAE,IAAI;IACd,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,YAAY,EAAE,IAAI;IAClB,OAAO,EAAE,KAAK;IACd,OAAO,EAAE,IAAI;IACb,oBAAoB,EAAE,IAAI,EAAE,0CAA0C;IACtE,iBAAiB,EAAE,IAAI,EAAE,qEAAqE;IAC9F,OAAO,EAAE,IAAI;IACb,OAAO,EAAE,IAAI;IACb,QAAQ,EAAE,IAAI;IACd,aAAa,EAAE,KAAK,EAAE,8BAA8B;IACpD,MAAM,EAAE,IAAI;CACZ,CAAC"}
|
|
1
|
+
{"version":3,"file":"NLLBTextTranslation.js","sourceRoot":"","sources":["../../src/text-translation/NLLBTextTranslation.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,MAAM,OAAO,CAAA;AAEzB,OAAO,EAAE,SAAS,EAAE,MAAM,wBAAwB,CAAA;AAClD,OAAO,EAAE,MAAM,EAAE,MAAM,wBAAwB,CAAA;AAC/C,OAAO,EAAE,WAAW,EAAE,MAAM,gCAAgC,CAAA;AAE5D,MAAM,CAAC,KAAK,UAAU,aAAa,CAAC,UAAkB,EAAE,cAAsB,EAAE,cAAsB;IACrG,MAAM,MAAM,GAAG,IAAI,MAAM,EAAE,CAAA;IAE3B,2DAA2D;IAE3D,2BAA2B;IAE3B,MAAM,CAAC,KAAK,CAAC,6BAA6B,CAAC,CAAA;IAC3C,MAAM,EAAE,aAAa,EAAE,8BAA8B,EAAE,GAAG,MAAM,MAAM,CAAC,sCAAsC,CAAC,CAAA;IAE9G,MAAM,CAAC,KAAK,CAAC,mBAAmB,CAAC,CAAA;IACjC,MAAM,SAAS,GAAG,MAAM,WAAW,CAAC,mCAAmC,CAAC,CAAA;IAExE,MAAM,CAAC,KAAK,CAAC,qBAAqB,CAAC,CAAA;IACnC,MAAM,SAAS,GAAG,MAAM,aAAa,CAAC,eAAe,CAAC,SAAS,CAAC,CAAA;IAEhE,MAAM,CAAC,KAAK,CAAC,iBAAiB,CAAC,CAAA;IAC/B,MAAM,KAAK,GAAG,MAAM,8BAA8B,CAAC,eAAe,CAAC,SAAS,CAAC,CAAA;IAE7E,MAAM,CAAC,KAAK,CAAC,oBAAoB,CAAC,CAAA;IAElC,MAAM,MAAM,GAAG;QACd,QAAQ,EAAE,UAAU;QACpB,QAAQ,EAAE,UAAU;KACpB,CAAA;IAED,MAAM,aAAa,GAAG,MAAM,SAAS,CAAC,UAAU,EAAE,cAAc,CAAC,CAAA;IAEjE,MAAM,SAAS,GAAG,aAAa,CAAC,SAAS,CAAA;IAEzC,MAAM,CAAC,GAAG,EAAE,CAAA;IAEZ,MAAM,gBAAgB,GAAsB,EAAE,CAAA;IAE9C,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,SAAS,CAAC,MAAM,EAAE,CAAC,EAAE,EAAE,CAAC;QAC3C,MAAM,YAAY,GAAG,SAAS,CAAC,CAAC,CAAC,CAAC,IAAI,CAAA;QAEtC,MAAM,CAAC,gBAAgB,CAAC,sBAAsB,CAAC,GAAG,CAAC,IAAI,SAAS,CAAC,MAAM,EAAE,EAAE,IAAI,YAAY,CAAC,IAAI,EAAE,GAAG,EAAE,KAAK,CAAC,aAAa,CAAC,CAAA;QAE3H,MAAM,CAAC,KAAK,CAAC,mBAAmB,CAAC,CAAA;QACjC,MAAM,MAAM,GAAI,SAAiB,CAAC,yBAAyB,CAAC,YAAY,EAAE;YACzE,OAAO,EAAE,IAAI;YACb,UAAU,EAAE,IAAI;SAChB,EAAE,MAAM,CAAC,CAAA;QAEV,MAAM,CAAC,KAAK,CAAC,oCAAoC,CAAC,CAAA;QAClD,MAAM,mBAAmB,GAAG,MAAM,KAAK,CAAC,QAAQ,CAAC,MAAM,CAAC,SAAS,EAAE,MAAM,CAAC,CAAA;QAE1E,MAAM,CAAC,KAAK,CAAC,gBAAgB,CAAC,CAAA;QAE9B,MAAM,iBAAiB,GAAG,SAAS,CAAC,KAAK,CAAC,qBAAqB,CAAC,mBAAmB,CAAC,CAAC,CAAC,CAAC,CAAA;QAEvF,MAAM,cAAc,GAAG,iBAAiB;aACtC,KAAK,CAAC,CAAC,EAAE,iBAAiB,CAAC,MAAM,GAAG,CAAC,CAAC;aACtC,GAAG,CAAC,KAAK,CAAC,EAAE;YACZ,IAAI,KAAK,CAAC,UAAU,CAAC,GAAG,CAAC,EAAE,CAAC;gBAC3B,OAAO,KAAK,CAAC,UAAU,CAAC,GAAG,EAAE,GAAG,CAAC,CAAA;YAClC,CAAC;YAED,OAAO,KAAK,CAAA;QACb,CAAC,CAAC;aACD,IAAI,CAAC,EAAE,CAAC;aACR,IAAI,EAAE,CAAA;QAER,gBAAgB,CAAC,IAAI,CAAC;YACrB,UAAU,EAAE,YAAY;YACxB,cAAc;SACd,CAAC,CAAA;QAEF,MAAM,CAAC,GAAG,EAAE,CAAA;IACb,CAAC;IAED,OAAO,gBAAgB,CAAA;AACxB,CAAC;AAED,MAAM,sBAAsB,GAA2B;IACtD,0BAA0B,EAAE,UAAU;IACtC,yBAAyB,EAAE,UAAU;IACrC,WAAW,EAAE,UAAU;IACvB,MAAM,EAAE,UAAU;IAClB,SAAS,EAAE,UAAU;IACrB,UAAU,EAAE,UAAU;IACtB,UAAU,EAAE,UAAU;IACtB,UAAU,EAAE,UAAU;IACtB,QAAQ,EAAE,UAAU;IACpB,kBAAkB,EAAE,UAAU;IAC9B,UAAU,EAAE,UAAU;IACtB,SAAS,EAAE,UAAU;IACrB,wBAAwB,EAAE,UAAU;IACpC,uBAAuB,EAAE,UAAU;IACnC,SAAS,EAAE,UAAU;IACrB,QAAQ,EAAE,UAAU;IACpB,YAAY,EAAE,UAAU;IACxB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,UAAU,EAAE,UAAU;IACtB,SAAS,EAAE,UAAU;IACrB,UAAU,EAAE,UAAU;IACtB,WAAW,EAAE,UAAU;IACvB,SAAS,EAAE,UAAU;IACrB,SAAS,EAAE,UAAU;IACrB,SAAS,EAAE,UAAU;IACrB,yBAAyB,EAAE,UAAU;IACrC,gBAAgB,EAAE,UAAU;IAC5B,gCAAgC,EAAE,UAAU;IAC5C,+BAA+B,EAAE,UAAU;IAC3C,iBAAiB,EAAE,UAAU;IAC7B,eAAe,EAAE,UAAU;IAC3B,sBAAsB,EAAE,UAAU;IAClC,uBAAuB,EAAE,UAAU;IACnC,QAAQ,EAAE,UAAU;IACpB,eAAe,EAAE,UAAU;IAC3B,UAAU,EAAE,UAAU;IACtB,OAAO,EAAE,UAAU;IACnB,QAAQ,EAAE,UAAU;IACpB,MAAM,EAAE,UAAU;IAClB,OAAO,EAAE,UAAU;IACnB,OAAO,EAAE,UAAU;IACnB,UAAU,EAAE,UAAU;IACtB,iBAAiB,EAAE,UAAU;IAC7B,iBAAiB,EAAE,UAAU;IAC7B,iBAAiB,EAAE,UAAU;IAC7B,SAAS,EAAE,UAAU;IACrB,WAAW,EAAE,UAAU;IACvB,UAAU,EAAE,UAAU;IACtB,KAAK,EAAE,UAAU;IACjB,SAAS,EAAE,UAAU;IACrB,QAAQ,EAAE,UAAU;IACpB,SAAS,EAAE,UAAU;IACrB,KAAK,EAAE,UAAU;IACjB,QAAQ,EAAE,UAAU;IACpB,UAAU,EAAE,UAAU;IACtB,UAAU,EAAE,UAAU;IACtB,OAAO,EAAE,UAAU;IACnB,UAAU,EAAE,UAAU;IACtB,QAAQ,EAAE,UAAU;IACpB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,UAAU,EAAE,UAAU;IACtB,gBAAgB,EAAE,UAAU;IAC5B,gBAAgB,EAAE,UAAU;IAC5B,OAAO,EAAE,UAAU;IACnB,QAAQ,EAAE,UAAU;IACpB,OAAO,EAAE,UAAU;IACnB,WAAW,EAAE,UAAU;IACvB,WAAW,EAAE,UAAU;IACvB,MAAM,EAAE,UAAU;IAClB,SAAS,EAAE,UAAU;IACrB,YAAY,EAAE,UAAU;IACxB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,UAAU,EAAE,UAAU;IACtB,UAAU,EAAE,UAAU;IACtB,SAAS,EAAE,UAAU;IACrB,QAAQ,EAAE,UAAU;IACpB,cAAc,EAAE,UAAU;IAC1B,QAAQ,EAAE,UAAU;IACpB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,0BAA0B,EAAE,UAAU;IACtC,8BAA8B,EAAE,UAAU;IAC1C,QAAQ,EAAE,UAAU;IACpB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,QAAQ,EAAE,UAAU;IACpB,UAAU,EAAE,UAAU;IACtB,aAAa,EAAE,UAAU;IACzB,QAAQ,EAAE,UAAU;IACpB,QAAQ,EAAE,UAAU;IACpB,KAAK,EAAE,UAAU;IACjB,WAAW,EAAE,UAAU;IACvB,UAAU,EAAE,UAAU;IACtB,YAAY,EAAE,UAAU;IACxB,SAAS,EAAE,UAAU;IACrB,YAAY,EAAE,UAAU;IACxB,SAAS,EAAE,UAAU;IACrB,YAAY,EAAE,UAAU;IACxB,KAAK,EAAE,UAAU;IACjB,eAAe,EAAE,UAAU;IAC3B,YAAY,EAAE,UAAU;IACxB,QAAQ,EAAE,UAAU;IACpB,UAAU,EAAE,UAAU;IACtB,WAAW,EAAE,UAAU;IACvB,SAAS,EAAE,UAAU;IACrB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,yBAAyB,EAAE,UAAU;IACrC,qBAAqB,EAAE,UAAU;IACjC,6BAA6B,EAAE,UAAU;IACzC,4BAA4B,EAAE,UAAU;IACxC,MAAM,EAAE,UAAU;IAClB,oCAAoC,EAAE,UAAU;IAChD,wBAAwB,EAAE,UAAU;IACpC,iBAAiB,EAAE,UAAU;IAC7B,OAAO,EAAE,UAAU;IACnB,cAAc,EAAE,UAAU;IAC1B,QAAQ,EAAE,UAAU;IACpB,mBAAmB,EAAE,UAAU;IAC/B,mBAAmB,EAAE,UAAU;IAC/B,wBAAwB,EAAE,UAAU;IACpC,kBAAkB,EAAE,UAAU;IAC9B,gBAAgB,EAAE,UAAU;IAC5B,gBAAgB,EAAE,UAAU;IAC5B,kBAAkB,EAAE,UAAU;IAC9B,mBAAmB,EAAE,UAAU;IAC/B,MAAM,EAAE,UAAU;IAClB,QAAQ,EAAE,UAAU;IACpB,SAAS,EAAE,UAAU;IACrB,MAAM,EAAE,UAAU;IAClB,YAAY,EAAE,UAAU;IACxB,YAAY,EAAE,UAAU;IACxB,kBAAkB,EAAE,UAAU;IAC9B,QAAQ,EAAE,UAAU;IACpB,YAAY,EAAE,UAAU;IACxB,UAAU,EAAE,UAAU;IACtB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,QAAQ,EAAE,UAAU;IACpB,OAAO,EAAE,UAAU;IACnB,UAAU,EAAE,UAAU;IACtB,SAAS,EAAE,UAAU;IACrB,WAAW,EAAE,UAAU;IACvB,iBAAiB,EAAE,UAAU;IAC7B,SAAS,EAAE,UAAU;IACrB,MAAM,EAAE,UAAU;IAClB,OAAO,EAAE,UAAU;IACnB,UAAU,EAAE,UAAU;IACtB,UAAU,EAAE,UAAU;IACtB,QAAQ,EAAE,UAAU;IACpB,SAAS,EAAE,UAAU;IACrB,QAAQ,EAAE,UAAU;IACpB,WAAW,EAAE,UAAU;IACvB,QAAQ,EAAE,UAAU;IACpB,mBAAmB,EAAE,UAAU;IAC/B,wBAAwB,EAAE,UAAU;IACpC,iBAAiB,EAAE,UAAU;IAC7B,gBAAgB,EAAE,UAAU;IAC5B,oBAAoB,EAAE,UAAU;IAChC,SAAS,EAAE,UAAU;IACrB,kBAAkB,EAAE,UAAU;IAC9B,gBAAgB,EAAE,UAAU;IAC5B,kBAAkB,EAAE,UAAU;IAC9B,WAAW,EAAE,UAAU;IACvB,SAAS,EAAE,UAAU;IACrB,OAAO,EAAE,UAAU;IACnB,SAAS,EAAE,UAAU;IACrB,SAAS,EAAE,UAAU;IACrB,OAAO,EAAE,UAAU;IACnB,yBAAyB,EAAE,UAAU;IACrC,4BAA4B,EAAE,UAAU;IACxC,OAAO,EAAE,UAAU;IACnB,OAAO,EAAE,UAAU;IACnB,sBAAsB,EAAE,UAAU;IAClC,QAAQ,EAAE,UAAU;IACpB,MAAM,EAAE,UAAU;IAClB,UAAU,EAAE,UAAU;IACtB,WAAW,EAAE,UAAU;IACvB,eAAe,EAAE,UAAU;IAC3B,QAAQ,EAAE,UAAU;IACpB,QAAQ,EAAE,UAAU;IACpB,SAAS,EAAE,UAAU;IACrB,iBAAiB,EAAE,UAAU;IAC7B,SAAS,EAAE,UAAU;IACrB,SAAS,EAAE,UAAU;IACrB,KAAK,EAAE,UAAU;IACjB,WAAW,EAAE,UAAU;IACvB,SAAS,EAAE,UAAU;IACrB,MAAM,EAAE,UAAU;IAClB,QAAQ,EAAE,UAAU;IACpB,UAAU,EAAE,UAAU;IACtB,YAAY,EAAE,UAAU;IACxB,OAAO,EAAE,UAAU;IACnB,OAAO,EAAE,UAAU;IACnB,oBAAoB,EAAE,UAAU;IAChC,iBAAiB,EAAE,UAAU;IAC7B,OAAO,EAAE,UAAU;IACnB,OAAO,EAAE,UAAU;IACnB,QAAQ,EAAE,UAAU;IACpB,aAAa,EAAE,UAAU;IACzB,MAAM,EAAE,UAAU;CAClB,CAAA;AAED,MAAM,oBAAoB,GAAmC;IAC5D,0BAA0B,EAAE,SAAS,EAAE,iCAAiC;IACxE,yBAAyB,EAAE,SAAS,EAAE,iCAAiC;IACvE,WAAW,EAAE,IAAI;IACjB,MAAM,EAAE,IAAI;IACZ,SAAS,EAAE,IAAI;IACf,UAAU,EAAE,IAAI;IAChB,UAAU,EAAE,IAAI;IAChB,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,QAAQ,EAAE,KAAK,EAAE,8BAA8B;IAC/C,kBAAkB,EAAE,IAAI,EAAE,yCAAyC;IACnE,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,SAAS,EAAE,IAAI;IACf,wBAAwB,EAAE,SAAS,EAAE,+BAA+B;IACpE,uBAAuB,EAAE,SAAS,EAAE,+BAA+B;IACnE,SAAS,EAAE,IAAI;IACf,QAAQ,EAAE,IAAI;IACd,YAAY,EAAE,IAAI;IAClB,OAAO,EAAE,KAAK,EAAE,8BAA8B;IAC9C,SAAS,EAAE,IAAI;IACf,UAAU,EAAE,KAAK;IACjB,SAAS,EAAE,IAAI;IACf,UAAU,EAAE,KAAK;IACjB,WAAW,EAAE,IAAI;IACjB,SAAS,EAAE,IAAI;IACf,SAAS,EAAE,IAAI;IACf,SAAS,EAAE,KAAK,EAAE,8BAA8B;IAChD,yBAAyB,EAAE,KAAK;IAChC,gBAAgB,EAAE,IAAI,EAAE,mCAAmC;IAC3D,gCAAgC,EAAE,IAAI,EAAE,4CAA4C;IACpF,+BAA+B,EAAE,IAAI,EAAE,4CAA4C;IACnF,iBAAiB,EAAE,KAAK,EAAE,4CAA4C;IACtE,eAAe,EAAE,KAAK,EAAE,8BAA8B;IACtD,sBAAsB,EAAE,IAAI,EAAE,yDAAyD;IACvF,uBAAuB,EAAE,IAAI,EAAE,yDAAyD;IACxF,QAAQ,EAAE,KAAK,EAAE,8BAA8B;IAC/C,eAAe,EAAE,KAAK,EAAE,8BAA8B;IACtD,UAAU,EAAE,IAAI;IAChB,OAAO,EAAE,IAAI;IACb,QAAQ,EAAE,IAAI;IACd,MAAM,EAAE,KAAK,EAAE,uDAAuD;IACtE,OAAO,EAAE,IAAI;IACb,OAAO,EAAE,KAAK;IACd,UAAU,EAAE,IAAI;IAChB,iBAAiB,EAAE,IAAI,EAAE,oDAAoD;IAC7E,iBAAiB,EAAE,KAAK,EAAE,6CAA6C;IACvE,iBAAiB,EAAE,KAAK;IACxB,SAAS,EAAE,IAAI;IACf,WAAW,EAAE,IAAI;IACjB,UAAU,EAAE,IAAI;IAChB,KAAK,EAAE,IAAI;IACX,SAAS,EAAE,IAAI;IACf,QAAQ,EAAE,IAAI;IACd,SAAS,EAAE,IAAI;IACf,KAAK,EAAE,KAAK;IACZ,QAAQ,EAAE,IAAI;IACd,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,UAAU,EAAE,IAAI;IAChB,OAAO,EAAE,IAAI;IACb,UAAU,EAAE,IAAI;IAChB,QAAQ,EAAE,IAAI;IACd,OAAO,EAAE,IAAI;IACb,SAAS,EAAE,IAAI;IACf,UAAU,EAAE,IAAI;IAChB,gBAAgB,EAAE,IAAI;IACtB,gBAAgB,EAAE,IAAI,EAAE,sDAAsD;IAC9E,OAAO,EAAE,IAAI;IACb,QAAQ,EAAE,IAAI;IACd,OAAO,EAAE,IAAI;IACb,WAAW,EAAE,IAAI;IACjB,WAAW,EAAE,IAAI;IACjB,MAAM,EAAE,IAAI;IACZ,SAAS,EAAE,KAAK;IAChB,YAAY,EAAE,IAAI;IAClB,OAAO,EAAE,IAAI;IACb,SAAS,EAAE,IAAI;IACf,UAAU,EAAE,IAAI;IAChB,UAAU,EAAE,IAAI;IAChB,SAAS,EAAE,KAAK,EAAE,8BAA8B;IAChD,QAAQ,EAAE,KAAK,EAAE,8BAA8B;IAC/C,cAAc,EAAE,KAAK,EAAE,8BAA8B;IACrD,QAAQ,EAAE,KAAK;IACf,OAAO,EAAE,KAAK,EAAE,8BAA8B;IAC9C,SAAS,EAAE,IAAI;IACf,0BAA0B,EAAE,IAAI,EAAE,8CAA8C;IAChF,8BAA8B,EAAE,IAAI,EAAE,8CAA8C;IACpF,QAAQ,EAAE,IAAI;IACd,OAAO,EAAE,IAAI;IACb,SAAS,EAAE,IAAI;IACf,QAAQ,EAAE,IAAI;IACd,UAAU,EAAE,KAAK;IACjB,aAAa,EAAE,IAAI;IACnB,QAAQ,EAAE,IAAI;IACd,QAAQ,EAAE,IAAI;IACd,KAAK,EAAE,IAAI;IACX,WAAW,EAAE,KAAK,EAAE,8BAA8B;IAClD,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,YAAY,EAAE,IAAI,EAAE,uDAAuD;IAC3E,SAAS,EAAE,IAAI;IACf,YAAY,EAAE,IAAI;IAClB,SAAS,EAAE,KAAK,EAAE,8BAA8B;IAChD,YAAY,EAAE,KAAK;IACnB,KAAK,EAAE,KAAK;IACZ,eAAe,EAAE,IAAI;IACrB,YAAY,EAAE,IAAI;IAClB,QAAQ,EAAE,KAAK,EAAE,8BAA8B;IAC/C,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,WAAW,EAAE,IAAI;IACjB,SAAS,EAAE,IAAI;IACf,OAAO,EAAE,IAAI;IACb,SAAS,EAAE,IAAI;IACf,yBAAyB,EAAE,KAAK,EAAE,4CAA4C;IAC9E,qBAAqB,EAAE,KAAK,EAAE,8BAA8B;IAC5D,6BAA6B,EAAE,KAAK,EAAE,iDAAiD;IACvF,4BAA4B,EAAE,KAAK,EAAE,iDAAiD;IACtF,MAAM,EAAE,KAAK;IACb,oCAAoC,EAAE,IAAI,EAAE,6DAA6D;IACzG,wBAAwB,EAAE,IAAI,EAAE,6DAA6D;IAC7F,iBAAiB,EAAE,KAAK;IACxB,OAAO,EAAE,KAAK;IACd,cAAc,EAAE,KAAK,EAAE,+CAA+C;IACtE,QAAQ,EAAE,IAAI;IACd,mBAAmB,EAAE,KAAK;IAC1B,mBAAmB,EAAE,IAAI,EAAE,sDAAsD;IACjF,wBAAwB,EAAE,KAAK,EAAE,yDAAyD;IAC1F,kBAAkB,EAAE,KAAK,EAAE,4CAA4C;IACvE,gBAAgB,EAAE,KAAK;IACvB,gBAAgB,EAAE,IAAI,EAAE,gDAAgD;IACxE,kBAAkB,EAAE,IAAI;IACxB,mBAAmB,EAAE,IAAI;IACzB,MAAM,EAAE,KAAK,EAAE,8BAA8B;IAC7C,QAAQ,EAAE,IAAI;IACd,SAAS,EAAE,IAAI;IACf,MAAM,EAAE,IAAI;IACZ,YAAY,EAAE,KAAK;IACnB,YAAY,EAAE,KAAK;IACnB,kBAAkB,EAAE,KAAK,EAAE,mDAAmD;IAC9E,QAAQ,EAAE,IAAI;IACd,YAAY,EAAE,IAAI;IAClB,UAAU,EAAE,IAAI;IAChB,OAAO,EAAE,IAAI;IACb,SAAS,EAAE,IAAI;IACf,QAAQ,EAAE,IAAI;IACd,OAAO,EAAE,IAAI;IACb,UAAU,EAAE,IAAI;IAChB,SAAS,EAAE,KAAK;IAChB,WAAW,EAAE,IAAI,EAAE,8CAA8C;IACjE,iBAAiB,EAAE,IAAI;IACvB,SAAS,EAAE,IAAI;IACf,MAAM,EAAE,KAAK,EAAE,8BAA8B;IAC7C,OAAO,EAAE,IAAI;IACb,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,QAAQ,EAAE,IAAI;IACd,SAAS,EAAE,IAAI;IACf,QAAQ,EAAE,IAAI;IACd,WAAW,EAAE,IAAI;IACjB,QAAQ,EAAE,IAAI;IACd,mBAAmB,EAAE,IAAI,EAAE,sDAAsD;IACjF,wBAAwB,EAAE,KAAK,EAAE,yDAAyD;IAC1F,iBAAiB,EAAE,KAAK,EAAE,2CAA2C;IACrE,gBAAgB,EAAE,IAAI;IACtB,oBAAoB,EAAE,KAAK,EAAE,qDAAqD;IAClF,SAAS,EAAE,IAAI;IACf,kBAAkB,EAAE,IAAI,EAAE,gEAAgE;IAC1F,gBAAgB,EAAE,IAAI,EAAE,6EAA6E;IACrG,kBAAkB,EAAE,IAAI,EAAE,4CAA4C;IACtE,WAAW,EAAE,IAAI;IACjB,SAAS,EAAE,IAAI;IACf,OAAO,EAAE,IAAI;IACb,SAAS,EAAE,IAAI;IACf,SAAS,EAAE,IAAI;IACf,OAAO,EAAE,IAAI;IACb,yBAAyB,EAAE,KAAK,EAAE,8CAA8C;IAChF,4BAA4B,EAAE,KAAK,EAAE,8CAA8C;IACnF,OAAO,EAAE,IAAI;IACb,OAAO,EAAE,IAAI;IACb,sBAAsB,EAAE,KAAK,EAAE,uDAAuD;IACtF,QAAQ,EAAE,IAAI;IACd,MAAM,EAAE,IAAI;IACZ,UAAU,EAAE,IAAI;IAChB,WAAW,EAAE,KAAK;IAClB,eAAe,EAAE,IAAI,EAAE,gEAAgE;IACvF,QAAQ,EAAE,IAAI;IACd,QAAQ,EAAE,IAAI;IACd,SAAS,EAAE,KAAK;IAChB,iBAAiB,EAAE,KAAK,EAAE,kDAAkD;IAC5E,SAAS,EAAE,IAAI;IACf,SAAS,EAAE,IAAI;IACf,KAAK,EAAE,IAAI;IACX,WAAW,EAAE,IAAI;IACjB,SAAS,EAAE,KAAK;IAChB,MAAM,EAAE,IAAI;IACZ,QAAQ,EAAE,IAAI;IACd,UAAU,EAAE,KAAK,EAAE,8BAA8B;IACjD,YAAY,EAAE,IAAI;IAClB,OAAO,EAAE,KAAK;IACd,OAAO,EAAE,IAAI;IACb,oBAAoB,EAAE,IAAI,EAAE,0CAA0C;IACtE,iBAAiB,EAAE,IAAI,EAAE,qEAAqE;IAC9F,OAAO,EAAE,IAAI;IACb,OAAO,EAAE,IAAI;IACb,QAAQ,EAAE,IAAI;IACd,aAAa,EAAE,KAAK,EAAE,8BAA8B;IACpD,MAAM,EAAE,IAAI;CACZ,CAAC"}
|
|
@@ -16,7 +16,7 @@ export declare function formatIntegerWithLeadingZeros(num: number, minDigitCount
|
|
|
16
16
|
export declare function formatListWithQuotedElements(strings: string[], quoteSymbol?: string): string;
|
|
17
17
|
export declare function getUTF32Chars(str: string): {
|
|
18
18
|
utf32chars: string[];
|
|
19
|
-
|
|
19
|
+
utf16To32Mapping: number[];
|
|
20
20
|
};
|
|
21
21
|
export declare function containsInvalidCodepoint(str: string): boolean;
|
|
22
22
|
export declare function splitAndPreserveSeparators(text: string, separatorRegex: RegExp): string[];
|
|
@@ -37,17 +37,17 @@ export function formatListWithQuotedElements(strings, quoteSymbol = `'`) {
|
|
|
37
37
|
}
|
|
38
38
|
export function getUTF32Chars(str) {
|
|
39
39
|
const utf32chars = [];
|
|
40
|
-
const
|
|
40
|
+
const utf16To32Mapping = [];
|
|
41
41
|
let utf32Index = 0;
|
|
42
42
|
for (const utf32char of str) {
|
|
43
43
|
utf32chars.push(utf32char);
|
|
44
44
|
for (let i = 0; i < utf32char.length; i++) {
|
|
45
|
-
|
|
45
|
+
utf16To32Mapping.push(utf32Index);
|
|
46
46
|
}
|
|
47
47
|
utf32Index += 1;
|
|
48
48
|
}
|
|
49
|
-
|
|
50
|
-
return { utf32chars,
|
|
49
|
+
utf16To32Mapping.push(utf32Index);
|
|
50
|
+
return { utf32chars, utf16To32Mapping };
|
|
51
51
|
}
|
|
52
52
|
export function containsInvalidCodepoint(str) {
|
|
53
53
|
for (const char of str) {
|
|
@@ -59,7 +59,7 @@ export function containsInvalidCodepoint(str) {
|
|
|
59
59
|
}
|
|
60
60
|
export function splitAndPreserveSeparators(text, separatorRegex) {
|
|
61
61
|
if (!separatorRegex.flags.includes('g')) {
|
|
62
|
-
throw new Error('
|
|
62
|
+
throw new Error('Separator regular expression must have a global flag');
|
|
63
63
|
}
|
|
64
64
|
// Use the match method to find all matches for the separators
|
|
65
65
|
const matches = text.match(separatorRegex);
|
|
@@ -1 +1 @@
|
|
|
1
|
-
{"version":3,"file":"StringUtilities.js","sourceRoot":"","sources":["../../src/utilities/StringUtilities.ts"],"names":[],"mappings":"AAEA,MAAM,UAAU,aAAa,CAAC,GAAW,EAAE,UAAoB;IAC9D,OAAO,YAAY,CAAC,GAAG,EAAE,UAAU,CAAC,IAAI,CAAC,CAAA;AAC1C,CAAC;AAED,MAAM,UAAU,YAAY,CAAC,GAAW,EAAE,UAAoB;IAC7D,KAAK,MAAM,SAAS,IAAI,UAAU,EAAE,CAAC;QACpC,MAAM,KAAK,GAAG,GAAG,CAAC,OAAO,CAAC,SAAS,CAAC,CAAA;QAEpC,IAAI,KAAK,IAAI,CAAC,EAAE,CAAC;YAChB,OAAO,KAAK,CAAA;QACb,CAAC;IACF,CAAC;IAED,OAAO,CAAC,CAAC,CAAA;AACV,CAAC;AAED,MAAM,UAAU,eAAe,CAAC,GAAW,EAAE,QAAkB;IAC9D,KAAK,MAAM,MAAM,IAAI,QAAQ,EAAE,CAAC;QAC/B,IAAI,GAAG,CAAC,UAAU,CAAC,MAAM,CAAC,EAAE,CAAC;YAC5B,OAAO,IAAI,CAAA;QACZ,CAAC;IACF,CAAC;IAED,OAAO,KAAK,CAAA;AACb,CAAC;AAED,MAAM,UAAU,SAAS,CAAC,OAAkF,EAAE,gBAAgB,GAAG,GAAG;IACnI,OAAO,GAAG,6BAA6B,CAAC,OAAO,CAAC,KAAK,EAAE,CAAC,CAAC,IAAI,6BAA6B,CAAC,OAAO,CAAC,OAAO,EAAE,CAAC,CAAC,IAAI,6BAA6B,CAAC,OAAO,CAAC,OAAO,EAAE,CAAC,CAAC,GAAG,gBAAgB,GAAG,6BAA6B,CAAC,OAAO,CAAC,YAAY,EAAE,CAAC,CAAC,EAAE,CAAA;AAClP,CAAC;AAED,MAAM,UAAU,QAAQ,CAAC,MAAkE,EAAE,gBAAgB,GAAG,GAAG;IAClH,OAAO,GAAG,6BAA6B,CAAC,MAAM,CAAC,OAAO,EAAE,CAAC,CAAC,IAAI,6BAA6B,CAAC,MAAM,CAAC,OAAO,EAAE,CAAC,CAAC,GAAG,gBAAgB,GAAG,6BAA6B,CAAC,MAAM,CAAC,YAAY,EAAE,CAAC,CAAC,EAAE,CAAA;AAC5L,CAAC;AAED,MAAM,UAAU,6BAA6B,CAAC,GAAW,EAAE,aAAqB;IAC/E,GAAG,GAAG,IAAI,CAAC,KAAK,CAAC,GAAG,CAAC,CAAA;IAErB,IAAI,WAAW,GAAG,GAAG,GAAG,EAAE,CAAA;IAE1B,OAAO,WAAW,CAAC,MAAM,GAAG,aAAa,EAAE,CAAC;QAC3C,WAAW,GAAG,IAAI,WAAW,EAAE,CAAA;IAChC,CAAC;IAED,OAAO,WAAW,CAAA;AACnB,CAAC;AAED,MAAM,UAAU,4BAA4B,CAAC,OAAiB,EAAE,WAAW,GAAG,GAAG;IAChF,OAAO,OAAO,CAAC,GAAG,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,WAAW,GAAG,GAAG,GAAG,WAAW,EAAE,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC,CAAA;AAC3E,CAAC;AAED,MAAM,UAAU,aAAa,CAAC,GAAW;IACxC,MAAM,UAAU,GAAa,EAAE,CAAA;IAC/B,MAAM,
|
|
1
|
+
{"version":3,"file":"StringUtilities.js","sourceRoot":"","sources":["../../src/utilities/StringUtilities.ts"],"names":[],"mappings":"AAEA,MAAM,UAAU,aAAa,CAAC,GAAW,EAAE,UAAoB;IAC9D,OAAO,YAAY,CAAC,GAAG,EAAE,UAAU,CAAC,IAAI,CAAC,CAAA;AAC1C,CAAC;AAED,MAAM,UAAU,YAAY,CAAC,GAAW,EAAE,UAAoB;IAC7D,KAAK,MAAM,SAAS,IAAI,UAAU,EAAE,CAAC;QACpC,MAAM,KAAK,GAAG,GAAG,CAAC,OAAO,CAAC,SAAS,CAAC,CAAA;QAEpC,IAAI,KAAK,IAAI,CAAC,EAAE,CAAC;YAChB,OAAO,KAAK,CAAA;QACb,CAAC;IACF,CAAC;IAED,OAAO,CAAC,CAAC,CAAA;AACV,CAAC;AAED,MAAM,UAAU,eAAe,CAAC,GAAW,EAAE,QAAkB;IAC9D,KAAK,MAAM,MAAM,IAAI,QAAQ,EAAE,CAAC;QAC/B,IAAI,GAAG,CAAC,UAAU,CAAC,MAAM,CAAC,EAAE,CAAC;YAC5B,OAAO,IAAI,CAAA;QACZ,CAAC;IACF,CAAC;IAED,OAAO,KAAK,CAAA;AACb,CAAC;AAED,MAAM,UAAU,SAAS,CAAC,OAAkF,EAAE,gBAAgB,GAAG,GAAG;IACnI,OAAO,GAAG,6BAA6B,CAAC,OAAO,CAAC,KAAK,EAAE,CAAC,CAAC,IAAI,6BAA6B,CAAC,OAAO,CAAC,OAAO,EAAE,CAAC,CAAC,IAAI,6BAA6B,CAAC,OAAO,CAAC,OAAO,EAAE,CAAC,CAAC,GAAG,gBAAgB,GAAG,6BAA6B,CAAC,OAAO,CAAC,YAAY,EAAE,CAAC,CAAC,EAAE,CAAA;AAClP,CAAC;AAED,MAAM,UAAU,QAAQ,CAAC,MAAkE,EAAE,gBAAgB,GAAG,GAAG;IAClH,OAAO,GAAG,6BAA6B,CAAC,MAAM,CAAC,OAAO,EAAE,CAAC,CAAC,IAAI,6BAA6B,CAAC,MAAM,CAAC,OAAO,EAAE,CAAC,CAAC,GAAG,gBAAgB,GAAG,6BAA6B,CAAC,MAAM,CAAC,YAAY,EAAE,CAAC,CAAC,EAAE,CAAA;AAC5L,CAAC;AAED,MAAM,UAAU,6BAA6B,CAAC,GAAW,EAAE,aAAqB;IAC/E,GAAG,GAAG,IAAI,CAAC,KAAK,CAAC,GAAG,CAAC,CAAA;IAErB,IAAI,WAAW,GAAG,GAAG,GAAG,EAAE,CAAA;IAE1B,OAAO,WAAW,CAAC,MAAM,GAAG,aAAa,EAAE,CAAC;QAC3C,WAAW,GAAG,IAAI,WAAW,EAAE,CAAA;IAChC,CAAC;IAED,OAAO,WAAW,CAAA;AACnB,CAAC;AAED,MAAM,UAAU,4BAA4B,CAAC,OAAiB,EAAE,WAAW,GAAG,GAAG;IAChF,OAAO,OAAO,CAAC,GAAG,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,WAAW,GAAG,GAAG,GAAG,WAAW,EAAE,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC,CAAA;AAC3E,CAAC;AAED,MAAM,UAAU,aAAa,CAAC,GAAW;IACxC,MAAM,UAAU,GAAa,EAAE,CAAA;IAC/B,MAAM,gBAAgB,GAAa,EAAE,CAAA;IAErC,IAAI,UAAU,GAAG,CAAC,CAAA;IAElB,KAAK,MAAM,SAAS,IAAI,GAAG,EAAE,CAAC;QAC7B,UAAU,CAAC,IAAI,CAAC,SAAS,CAAC,CAAA;QAE1B,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,SAAS,CAAC,MAAM,EAAE,CAAC,EAAE,EAAE,CAAC;YAC3C,gBAAgB,CAAC,IAAI,CAAC,UAAU,CAAC,CAAA;QAClC,CAAC;QAED,UAAU,IAAI,CAAC,CAAA;IAChB,CAAC;IAED,gBAAgB,CAAC,IAAI,CAAC,UAAU,CAAC,CAAA;IAEjC,OAAO,EAAE,UAAU,EAAE,gBAAgB,EAAE,CAAA;AACxC,CAAC;AAED,MAAM,UAAU,wBAAwB,CAAC,GAAW;IACnD,KAAK,MAAM,IAAI,IAAI,GAAG,EAAE,CAAC;QACxB,IAAI,IAAI,CAAC,WAAW,CAAC,CAAC,CAAC,KAAK,KAAK,EAAE,CAAC;YACnC,OAAO,IAAI,CAAA;QACZ,CAAC;IACF,CAAC;IAED,OAAO,KAAK,CAAA;AACb,CAAC;AAED,MAAM,UAAU,0BAA0B,CAAC,IAAY,EAAE,cAAsB;IAC9E,IAAI,CAAC,cAAc,CAAC,KAAK,CAAC,QAAQ,CAAC,GAAG,CAAC,EAAE,CAAC;QACzC,MAAM,IAAI,KAAK,CAAC,sDAAsD,CAAC,CAAA;IACxE,CAAC;IAED,8DAA8D;IAC9D,MAAM,OAAO,GAAG,IAAI,CAAC,KAAK,CAAC,cAAc,CAAC,CAAA;IAE1C,8EAA8E;IAC9E,IAAI,CAAC,OAAO,EAAE,CAAC;QACd,OAAO,CAAC,IAAI,CAAC,CAAA;IACd,CAAC;IAED,8BAA8B;IAC9B,MAAM,MAAM,GAAa,EAAE,CAAA;IAE3B,gCAAgC;IAChC,IAAI,SAAS,GAAG,CAAC,CAAA;IAEjB,8BAA8B;IAC9B,OAAO,CAAC,OAAO,CAAC,KAAK,CAAC,EAAE;QACvB,qCAAqC;QACrC,MAAM,UAAU,GAAG,IAAI,CAAC,OAAO,CAAC,KAAK,EAAE,SAAS,CAAC,CAAA;QAEjD,iFAAiF;QACjF,MAAM,CAAC,IAAI,CAAC,IAAI,CAAC,SAAS,CAAC,SAAS,EAAE,UAAU,CAAC,GAAG,KAAK,CAAC,CAAA;QAE1D,wDAAwD;QACxD,SAAS,GAAG,UAAU,GAAG,KAAK,CAAC,MAAM,CAAA;IACtC,CAAC,CAAC,CAAA;IAEF,iEAAiE;IACjE,CAAC;QACA,MAAM,aAAa,GAAG,IAAI,CAAC,SAAS,CAAC,SAAS,CAAC,CAAA;QAE/C,IAAI,aAAa,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;YAC9B,MAAM,CAAC,IAAI,CAAC,aAAa,CAAC,CAAA;QAC3B,CAAC;IACF,CAAC;IAED,OAAO,MAAM,CAAA;AACd,CAAC;AAED,MAAM,UAAU,uBAAuB,CAAC,MAA2B;IAClE,MAAM,cAAc,GAAG,IAAI,CAAC,KAAK,CAAC,MAAM,CAAC,MAAM,GAAG,CAAC,CAAC,CAAA;IAEpD,MAAM,yBAAyB,GAAa,CAAC,CAAC,CAAC,CAAA;IAE/C,KAAK,IAAI,WAAW,GAAG,CAAC,EAAE,WAAW,IAAI,cAAc,EAAE,WAAW,EAAE,EAAE,CAAC;QACxE,IAAI,UAAU,GAAG,CAAC,CAAA;QAElB,KAAK,IAAI,SAAS,GAAG,WAAW,EAAE,SAAS,GAAG,MAAM,CAAC,MAAM,EAAE,SAAS,EAAE,EAAE,CAAC;YAC1E,MAAM,cAAc,GAAG,SAAS,GAAG,WAAW,CAAA;YAE9C,IAAI,MAAM,CAAC,SAAS,CAAC,KAAK,MAAM,CAAC,cAAc,CAAC,EAAE,CAAC;gBAClD,MAAK;YACN,CAAC;YAED,UAAU,IAAI,CAAC,CAAA;QAChB,CAAC;QAED,MAAM,KAAK,GAAG,UAAU,CAAA;QAExB,yBAAyB,CAAC,IAAI,CAAC,KAAK,CAAC,CAAA;IACtC,CAAC;IAED,IAAI,kBAAkB,GAAG,CAAC,QAAQ,CAAA;IAClC,IAAI,2BAA2B,GAAG,CAAC,QAAQ,CAAA;IAE3C,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,IAAI,yBAAyB,CAAC,MAAM,EAAE,CAAC,EAAE,EAAE,CAAC;QAC5D,MAAM,WAAW,GAAG,yBAAyB,CAAC,CAAC,CAAC,CAAA;QAEhD,IAAI,WAAW,GAAG,kBAAkB,EAAE,CAAC;YACtC,kBAAkB,GAAG,WAAW,CAAA;QACjC,CAAC;QAED,MAAM,UAAU,GAAG,CAAC,WAAW,GAAG,CAAC,CAAC,GAAG,CAAC,CAAA;QAExC,IAAI,UAAU,GAAG,2BAA2B,EAAE,CAAC;YAC9C,2BAA2B,GAAG,UAAU,CAAA;QACzC,CAAC;IACF,CAAC;IAED,OAAO,EAAE,kBAAkB,EAAE,2BAA2B,EAAE,CAAA;AAC3D,CAAC;AAED,MAAM,CAAC,KAAK,UAAU,iBAAiB,CAAC,IAAY;IACnD,MAAM,EAAE,UAAU,EAAE,GAAG,MAAM,MAAM,CAAC,cAAc,CAAC,CAAA;IAEnD,MAAM,IAAI,GAAG,UAAU,CAAC,IAAI,EAAE;QAC7B,QAAQ,EAAE,KAAK;QAEf,SAAS,EAAE;YACV,EAAE,QAAQ,EAAE,GAAG,EAAE,OAAO,EAAE,EAAE,UAAU,EAAE,IAAI,EAAE,EAAE;YAChD,EAAE,QAAQ,EAAE,KAAK,EAAE,MAAM,EAAE,MAAM,EAAE;YACnC,EAAE,QAAQ,EAAE,IAAI,EAAE,OAAO,EAAE,EAAE,SAAS,EAAE,KAAK,EAAE,EAAE;YACjD,EAAE,QAAQ,EAAE,IAAI,EAAE,OAAO,EAAE,EAAE,SAAS,EAAE,KAAK,EAAE,EAAE;YACjD,EAAE,QAAQ,EAAE,IAAI,EAAE,OAAO,EAAE,EAAE,SAAS,EAAE,KAAK,EAAE,EAAE;YACjD,EAAE,QAAQ,EAAE,IAAI,EAAE,OAAO,EAAE,EAAE,SAAS,EAAE,KAAK,EAAE,EAAE;YACjD,EAAE,QAAQ,EAAE,OAAO,EAAE,OAAO,EAAE,EAAE,oBAAoB,EAAE,KAAK,EAAE,EAAE;SAC/D;KACD,CAAC,CAAA;IAEF,OAAO,IAAI,IAAI,EAAE,CAAA;AAClB,CAAC;AAED,MAAM,UAAU,+BAA+B,CAAC,IAAY,EAAE,kBAA0C;IACvG,IAAI,UAAU,GAAG,EAAE,CAAA;IAEnB,KAAK,MAAM,IAAI,IAAI,IAAI,EAAE,CAAC;QACzB,MAAM,YAAY,GAAG,kBAAkB,CAAC,IAAI,CAAC,CAAA;QAE7C,IAAI,YAAY,KAAK,SAAS,EAAE,CAAC;YAChC,UAAU,IAAI,YAAY,CAAA;QAC3B,CAAC;aAAM,CAAC;YACP,UAAU,IAAI,IAAI,CAAA;QACnB,CAAC;IACF,CAAC;IAED,OAAO,UAAU,CAAA;AAClB,CAAC;AAED,MAAM,UAAU,2BAA2B,CAAC,IAAY,EAAE,kBAA0C;IACnG,MAAM,YAAY,GAAG,kBAAkB,CAAC,IAAI,CAAC,CAAA;IAE7C,IAAI,YAAY,KAAK,SAAS,EAAE,CAAC;QAChC,OAAO,YAAY,CAAA;IACpB,CAAC;SAAM,CAAC;QACP,OAAO,IAAI,CAAA;IACZ,CAAC;AACF,CAAC"}
|
|
@@ -2,10 +2,10 @@ import { ParagraphBreakType, WhitespaceProcessing } from '../api/Common.js';
|
|
|
2
2
|
export declare function addTimeOffsetToTimeline(targetTimeline: Timeline, timeOffset: number): Timeline;
|
|
3
3
|
export declare function multiplyTimelineByFactor(targetTimeline: Timeline, factor: number): Timeline;
|
|
4
4
|
export declare function roundTimelineProperties(targetTimeline: Timeline, decimalDigits?: number): Timeline;
|
|
5
|
-
export declare function wordTimelineToSegmentSentenceTimeline(
|
|
5
|
+
export declare function wordTimelineToSegmentSentenceTimeline(wordTimelineWithOffsets: Timeline, transcript: string, language: string, paragraphBreaks?: ParagraphBreakType, whitespace?: WhitespaceProcessing): Promise<{
|
|
6
6
|
segmentTimeline: Timeline;
|
|
7
7
|
}>;
|
|
8
|
-
export declare function
|
|
8
|
+
export declare function addWordTextOffsetsToTimelineInPlace(timeline: Timeline, text: string): void;
|
|
9
9
|
export declare function extractEntries(timeline: Timeline, predicate: (entry: TimelineEntry) => boolean): TimelineEntry[];
|
|
10
10
|
export type TimelineEntryType = 'segment' | 'paragraph' | 'sentence' | 'clause' | 'phrase' | 'word' | 'token' | 'letter' | 'phone' | 'subphone';
|
|
11
11
|
export type TimelineEntry = {
|
|
@@ -22,4 +22,3 @@ export type TimelineEntry = {
|
|
|
22
22
|
timeline?: Timeline;
|
|
23
23
|
};
|
|
24
24
|
export type Timeline = TimelineEntry[];
|
|
25
|
-
export declare function testTimelineFix(): Promise<void>;
|
|
@@ -1,6 +1,7 @@
|
|
|
1
|
-
import {
|
|
1
|
+
import { addMissingPunctuationWordsToWordSequence, segmentWordSequence, WordSequence } from '@echogarden/text-segmentation';
|
|
2
|
+
import { isWord, isWordOrSymbolWord, splitToParagraphs } from '../nlp/Segmentation.js';
|
|
2
3
|
import { deepClone } from './ObjectUtilities.js';
|
|
3
|
-
import { getUTF32Chars
|
|
4
|
+
import { getUTF32Chars } from './StringUtilities.js';
|
|
4
5
|
import { roundToDigits } from './Utilities.js';
|
|
5
6
|
export function addTimeOffsetToTimeline(targetTimeline, timeOffset) {
|
|
6
7
|
if (!targetTimeline) {
|
|
@@ -45,149 +46,114 @@ export function roundTimelineProperties(targetTimeline, decimalDigits = 2) {
|
|
|
45
46
|
}
|
|
46
47
|
return roundedTimeline;
|
|
47
48
|
}
|
|
48
|
-
export async function wordTimelineToSegmentSentenceTimeline(
|
|
49
|
-
|
|
49
|
+
export async function wordTimelineToSegmentSentenceTimeline(wordTimelineWithOffsets, transcript, language, paragraphBreaks = 'double', whitespace = 'collapse') {
|
|
50
|
+
const wordSequence = new WordSequence();
|
|
51
|
+
for (const wordEntry of wordTimelineWithOffsets) {
|
|
52
|
+
const wordStartOffset = wordEntry.startOffsetUtf16;
|
|
53
|
+
const wordEndOffset = wordEntry.endOffsetUtf16;
|
|
54
|
+
const isPunctuation = !isWordOrSymbolWord(wordEntry.text);
|
|
55
|
+
wordSequence.addWord(wordEntry.text, wordStartOffset, isPunctuation);
|
|
56
|
+
}
|
|
57
|
+
const { wordSequenceWithPunctuation, originalWordsReverseMapping } = addMissingPunctuationWordsToWordSequence(wordSequence, transcript);
|
|
58
|
+
const segmentedWordSequence = await segmentWordSequence(wordSequenceWithPunctuation);
|
|
59
|
+
const paragraphs = splitToParagraphs(transcript, paragraphBreaks, whitespace);
|
|
60
|
+
const sentenceIndexesForParagraph = paragraphs.map(_ => []);
|
|
50
61
|
{
|
|
51
|
-
|
|
52
|
-
|
|
53
|
-
|
|
54
|
-
|
|
55
|
-
|
|
56
|
-
|
|
57
|
-
|
|
58
|
-
|
|
59
|
-
|
|
60
|
-
|
|
61
|
-
|
|
62
|
-
|
|
63
|
-
|
|
64
|
-
else {
|
|
65
|
-
throw new Error(`Invalid paragraph break type: '${paragraphBreaks}'`);
|
|
66
|
-
}
|
|
67
|
-
const maskedSegments = paragraphs.map(paragraph => splitToSentences(paragraph, language));
|
|
68
|
-
// Restore the sentence text the original text, using the original transcript,
|
|
69
|
-
// and apply whitespace processing to each sentence.
|
|
70
|
-
let offset = 0;
|
|
71
|
-
for (const segment of maskedSegments) {
|
|
72
|
-
const newSegment = [];
|
|
73
|
-
for (let sentenceIndex = 0; sentenceIndex < segment.length; sentenceIndex++) {
|
|
74
|
-
const sentence = segment[sentenceIndex];
|
|
75
|
-
const sentenceLength = sentence.length;
|
|
76
|
-
const restoredSentence = transcript.substring(offset, offset + sentenceLength);
|
|
77
|
-
const restoredAndProcessedSentence = applyWhitespaceProcessing(restoredSentence, whitespace).trim();
|
|
78
|
-
if (restoredAndProcessedSentence.length > 0) {
|
|
79
|
-
newSegment.push(restoredAndProcessedSentence);
|
|
62
|
+
let sentenceIndex = 0;
|
|
63
|
+
let charOffset = 0;
|
|
64
|
+
for (let paragraphIndex = 0; paragraphIndex < paragraphs.length; paragraphIndex++) {
|
|
65
|
+
const paragraph = paragraphs[paragraphIndex];
|
|
66
|
+
const paragraphStartOffset = charOffset;
|
|
67
|
+
const paragraphEndOffset = paragraphStartOffset + paragraph.length;
|
|
68
|
+
while (sentenceIndex < segmentedWordSequence.sentences.length) {
|
|
69
|
+
const sentenceEntry = segmentedWordSequence.sentences[sentenceIndex];
|
|
70
|
+
const sentenceStartOffset = sentenceEntry.charRange.start;
|
|
71
|
+
const sentenceEndOffset = sentenceEntry.charRange.end;
|
|
72
|
+
if (sentenceStartOffset < paragraphEndOffset) {
|
|
73
|
+
sentenceIndexesForParagraph[paragraphIndex].push(sentenceIndex);
|
|
74
|
+
sentenceIndex++;
|
|
80
75
|
}
|
|
81
|
-
|
|
76
|
+
else {
|
|
77
|
+
break;
|
|
78
|
+
}
|
|
79
|
+
}
|
|
80
|
+
if (sentenceIndex === segmentedWordSequence.sentences.length) {
|
|
81
|
+
break;
|
|
82
82
|
}
|
|
83
|
-
|
|
83
|
+
charOffset += paragraph.length;
|
|
84
84
|
}
|
|
85
|
-
segments = segments.filter(segment => segment.length > 0);
|
|
86
85
|
}
|
|
87
|
-
// Create a new text based on the processed sentences, new segment and sentence timeline,
|
|
88
|
-
// and store mapping between character indexes and the corresponding sentence they belong to.
|
|
89
|
-
let text = '';
|
|
90
|
-
const charIndexToSentenceEntryMapping = [];
|
|
91
86
|
const segmentTimeline = [];
|
|
92
|
-
|
|
93
|
-
|
|
94
|
-
const
|
|
95
|
-
|
|
96
|
-
|
|
97
|
-
|
|
98
|
-
|
|
99
|
-
|
|
100
|
-
|
|
101
|
-
|
|
102
|
-
|
|
87
|
+
let wordIndex = 0;
|
|
88
|
+
for (let paragraphIndex = 0; paragraphIndex < paragraphs.length; paragraphIndex++) {
|
|
89
|
+
const paragraph = paragraphs[paragraphIndex];
|
|
90
|
+
const sentencesIndexes = sentenceIndexesForParagraph[paragraphIndex];
|
|
91
|
+
const sentenceEntries = sentencesIndexes.map(index => segmentedWordSequence.sentences[index]);
|
|
92
|
+
const sentenceTimeline = [];
|
|
93
|
+
for (const sentenceEntry of sentenceEntries) {
|
|
94
|
+
const wordTimeline = [];
|
|
95
|
+
for (const _ of sentenceEntry.words.entries) {
|
|
96
|
+
const originalWordIndex = originalWordsReverseMapping.get(wordIndex);
|
|
97
|
+
if (originalWordIndex !== undefined) {
|
|
98
|
+
const wordTimelineEntry = wordTimelineWithOffsets[originalWordIndex];
|
|
99
|
+
wordTimeline.push(wordTimelineEntry);
|
|
100
|
+
}
|
|
101
|
+
wordIndex += 1;
|
|
102
|
+
}
|
|
103
|
+
const sentenceTimelineEntry = {
|
|
103
104
|
type: 'sentence',
|
|
104
|
-
text:
|
|
105
|
-
startTime:
|
|
106
|
-
endTime: -1,
|
|
107
|
-
timeline:
|
|
105
|
+
text: sentenceEntry.text,
|
|
106
|
+
startTime: wordTimeline[0].startTime,
|
|
107
|
+
endTime: wordTimeline[wordTimeline.length - 1].endTime,
|
|
108
|
+
timeline: wordTimeline,
|
|
108
109
|
};
|
|
109
|
-
|
|
110
|
-
text += char;
|
|
111
|
-
charIndexToSentenceEntryMapping.push(sentenceEntry);
|
|
112
|
-
}
|
|
113
|
-
sentencesInSegment.push(sentenceEntry);
|
|
110
|
+
sentenceTimeline.push(sentenceTimelineEntry);
|
|
114
111
|
}
|
|
115
|
-
|
|
116
|
-
|
|
117
|
-
|
|
118
|
-
|
|
119
|
-
|
|
120
|
-
|
|
121
|
-
|
|
122
|
-
|
|
123
|
-
if (!isWordOrSymbolWord(wordText)) {
|
|
124
|
-
continue;
|
|
125
|
-
}
|
|
126
|
-
const indexOfWordInText = text.indexOf(wordText, wordSearchStartOffset);
|
|
127
|
-
if (indexOfWordInText == -1) {
|
|
128
|
-
throw new Error(`Couldn't find the word '${wordText}' in the text at start position ${wordSearchStartOffset}`);
|
|
129
|
-
}
|
|
130
|
-
const targetSentenceEntry = charIndexToSentenceEntryMapping[indexOfWordInText];
|
|
131
|
-
targetSentenceEntry.timeline.push(deepClone(wordEntry));
|
|
132
|
-
wordSearchStartOffset = indexOfWordInText + wordText.length;
|
|
133
|
-
}
|
|
134
|
-
}
|
|
135
|
-
// Produce a new segment/sentence timeline with rewritten entries,
|
|
136
|
-
// that match the assigned words.
|
|
137
|
-
const newSegmentTimeline = [];
|
|
138
|
-
for (const segmentEntry of segmentTimeline) {
|
|
139
|
-
const oldSentenceTimeline = segmentEntry.timeline;
|
|
140
|
-
const newSentenceTimeline = [];
|
|
141
|
-
for (const sentenceEntry of oldSentenceTimeline) {
|
|
142
|
-
const wordTimeline = sentenceEntry.timeline;
|
|
143
|
-
if (!wordTimeline || wordTimeline.length === 0) {
|
|
144
|
-
continue;
|
|
145
|
-
}
|
|
146
|
-
sentenceEntry.startTime = wordTimeline[0].startTime;
|
|
147
|
-
sentenceEntry.endTime = wordTimeline[wordTimeline.length - 1].endTime;
|
|
148
|
-
newSentenceTimeline.push(sentenceEntry);
|
|
149
|
-
}
|
|
150
|
-
if (newSentenceTimeline.length === 0) {
|
|
151
|
-
continue;
|
|
152
|
-
}
|
|
153
|
-
segmentEntry.text = newSentenceTimeline.map(sentenceEntry => sentenceEntry.text).join(' ');
|
|
154
|
-
segmentEntry.startTime = newSentenceTimeline[0].startTime;
|
|
155
|
-
segmentEntry.endTime = newSentenceTimeline[newSentenceTimeline.length - 1].endTime;
|
|
156
|
-
newSegmentTimeline.push(segmentEntry);
|
|
112
|
+
const segmentTimelineEntry = {
|
|
113
|
+
type: 'segment',
|
|
114
|
+
text: paragraph,
|
|
115
|
+
startTime: sentenceTimeline[0].startTime,
|
|
116
|
+
endTime: sentenceTimeline[sentenceTimeline.length - 1].endTime,
|
|
117
|
+
timeline: sentenceTimeline,
|
|
118
|
+
};
|
|
119
|
+
segmentTimeline.push(segmentTimelineEntry);
|
|
157
120
|
}
|
|
158
|
-
return { segmentTimeline
|
|
121
|
+
return { segmentTimeline };
|
|
159
122
|
}
|
|
160
|
-
export function
|
|
161
|
-
const {
|
|
162
|
-
|
|
163
|
-
|
|
164
|
-
|
|
165
|
-
|
|
166
|
-
|
|
167
|
-
|
|
168
|
-
|
|
169
|
-
|
|
170
|
-
let
|
|
171
|
-
let
|
|
172
|
-
|
|
173
|
-
|
|
123
|
+
export function addWordTextOffsetsToTimelineInPlace(timeline, text) {
|
|
124
|
+
const { utf16To32Mapping } = getUTF32Chars(text);
|
|
125
|
+
let currentOffset = 0;
|
|
126
|
+
function processTimeline(timeline) {
|
|
127
|
+
for (const entry of timeline) {
|
|
128
|
+
if (entry.type === 'word') {
|
|
129
|
+
let word = entry.text;
|
|
130
|
+
word = word.trim().replaceAll(/\s+/g, ' ');
|
|
131
|
+
const wordParts = word.split(' ');
|
|
132
|
+
let startOffset;
|
|
133
|
+
let endOffset;
|
|
134
|
+
for (let i = 0; i < wordParts.length; i++) {
|
|
135
|
+
const wordPart = wordParts[i];
|
|
136
|
+
const wordPartOffset = text.indexOf(wordPart, currentOffset);
|
|
137
|
+
if (wordPartOffset === -1) {
|
|
138
|
+
continue;
|
|
139
|
+
}
|
|
140
|
+
currentOffset = wordPartOffset + wordParts[i].length;
|
|
141
|
+
if (i === 0) {
|
|
142
|
+
startOffset = wordPartOffset;
|
|
143
|
+
}
|
|
144
|
+
endOffset = currentOffset;
|
|
174
145
|
}
|
|
175
|
-
|
|
176
|
-
|
|
177
|
-
|
|
178
|
-
|
|
179
|
-
|
|
146
|
+
entry.startOffsetUtf16 = startOffset;
|
|
147
|
+
entry.endOffsetUtf16 = endOffset;
|
|
148
|
+
entry.startOffsetUtf32 = startOffset !== undefined ? utf16To32Mapping[startOffset] : undefined;
|
|
149
|
+
entry.endOffsetUtf32 = endOffset !== undefined ? utf16To32Mapping[endOffset] : undefined;
|
|
150
|
+
}
|
|
151
|
+
else if (entry.timeline) {
|
|
152
|
+
processTimeline(entry.timeline);
|
|
180
153
|
}
|
|
181
|
-
entry.startOffsetUtf16 = startOffset;
|
|
182
|
-
entry.endOffsetUtf16 = endOffset;
|
|
183
|
-
entry.startOffsetUtf32 = startOffset != undefined ? mapping[startOffset] : undefined;
|
|
184
|
-
entry.endOffsetUtf32 = endOffset != undefined ? mapping[endOffset] : undefined;
|
|
185
|
-
}
|
|
186
|
-
else if (entry.timeline) {
|
|
187
|
-
currentOffset = addWordTextOffsetsToTimeline(entry.timeline, text, currentOffset);
|
|
188
154
|
}
|
|
189
155
|
}
|
|
190
|
-
return
|
|
156
|
+
return processTimeline(timeline);
|
|
191
157
|
}
|
|
192
158
|
function replaceSentenceEndersWithinWordsWithMaskingCharacter(transcript, wordTimeline, maskingCharacter) {
|
|
193
159
|
if (maskingCharacter.length !== 1) {
|
|
@@ -239,21 +205,4 @@ export function extractEntries(timeline, predicate) {
|
|
|
239
205
|
}
|
|
240
206
|
return timelineWordEntries;
|
|
241
207
|
}
|
|
242
|
-
////
|
|
243
|
-
export async function testTimelineFix() {
|
|
244
|
-
let transcript = 'Hello world how are you? Do you want to play chess?';
|
|
245
|
-
const words = (await splitToWords(transcript, 'en')).filter(word => word.trim() !== '');
|
|
246
|
-
let wordTimeline = words.map(wordText => ({
|
|
247
|
-
type: 'word',
|
|
248
|
-
text: wordText,
|
|
249
|
-
startTime: 0,
|
|
250
|
-
endTime: 0,
|
|
251
|
-
}));
|
|
252
|
-
addWordTextOffsetsToTimeline(wordTimeline, transcript);
|
|
253
|
-
wordTimeline[1].text = 'wor.d';
|
|
254
|
-
wordTimeline[8].text = 'wa.t';
|
|
255
|
-
transcript = transcript.replace('world', 'wor.d').replace('want', 'wa.t');
|
|
256
|
-
const result = await wordTimelineToSegmentSentenceTimeline(wordTimeline, transcript, 'en');
|
|
257
|
-
const x = 1;
|
|
258
|
-
}
|
|
259
208
|
//# sourceMappingURL=Timeline.js.map
|
|
@@ -1 +1 @@
|
|
|
1
|
-
{"version":3,"file":"Timeline.js","sourceRoot":"","sources":["../../src/utilities/Timeline.ts"],"names":[],"mappings":"
|
|
1
|
+
{"version":3,"file":"Timeline.js","sourceRoot":"","sources":["../../src/utilities/Timeline.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,wCAAwC,EAAE,mBAAmB,EAAE,YAAY,EAAE,MAAM,+BAA+B,CAAA;AAE3H,OAAO,EAAE,MAAM,EAAE,kBAAkB,EAAE,iBAAiB,EAAgB,MAAM,wBAAwB,CAAA;AACpG,OAAO,EAAE,SAAS,EAAE,MAAM,sBAAsB,CAAA;AAChD,OAAO,EAAE,aAAa,EAAE,MAAM,sBAAsB,CAAA;AACpD,OAAO,EAAE,aAAa,EAAE,MAAM,gBAAgB,CAAA;AAE9C,MAAM,UAAU,uBAAuB,CAAC,cAAwB,EAAE,UAAkB;IACnF,IAAI,CAAC,cAAc,EAAE,CAAC;QACrB,OAAO,cAAc,CAAA;IACtB,CAAC;IAED,MAAM,WAAW,GAAG,SAAS,CAAC,cAAc,CAAC,CAAA;IAE7C,KAAK,MAAM,oBAAoB,IAAI,WAAW,EAAE,CAAC;QAChD,oBAAoB,CAAC,SAAS,GAAG,IAAI,CAAC,GAAG,CAAC,oBAAoB,CAAC,SAAS,GAAG,UAAU,EAAE,CAAC,CAAC,CAAA;QACzF,oBAAoB,CAAC,OAAO,GAAG,IAAI,CAAC,GAAG,CAAC,oBAAoB,CAAC,OAAO,GAAG,UAAU,EAAE,CAAC,CAAC,CAAA;QAErF,IAAI,oBAAoB,CAAC,QAAQ,EAAE,CAAC;YACnC,oBAAoB,CAAC,QAAQ,GAAG,uBAAuB,CAAC,oBAAoB,CAAC,QAAQ,EAAE,UAAU,CAAC,CAAA;QACnG,CAAC;IACF,CAAC;IAED,OAAO,WAAW,CAAA;AACnB,CAAC;AAED,MAAM,UAAU,wBAAwB,CAAC,cAAwB,EAAE,MAAc;IAChF,MAAM,WAAW,GAAG,SAAS,CAAC,cAAc,CAAC,CAAA;IAE7C,KAAK,MAAM,oBAAoB,IAAI,WAAW,EAAE,CAAC;QAChD,oBAAoB,CAAC,SAAS,GAAG,oBAAoB,CAAC,SAAS,GAAG,MAAM,CAAA;QACxE,oBAAoB,CAAC,OAAO,GAAG,oBAAoB,CAAC,OAAO,GAAG,MAAM,CAAA;QAEpE,IAAI,oBAAoB,CAAC,QAAQ,EAAE,CAAC;YACnC,oBAAoB,CAAC,QAAQ,GAAG,wBAAwB,CAAC,oBAAoB,CAAC,QAAQ,EAAE,MAAM,CAAC,CAAA;QAChG,CAAC;IACF,CAAC;IAED,OAAO,WAAW,CAAA;AACnB,CAAC;AAED,MAAM,UAAU,uBAAuB,CAAC,cAAwB,EAAE,aAAa,GAAG,CAAC;IAClF,MAAM,eAAe,GAAG,SAAS,CAAC,cAAc,CAAC,CAAA;IAEjD,KAAK,MAAM,KAAK,IAAI,eAAe,EAAE,CAAC;QACrC,IAAI,KAAK,CAAC,SAAS,EAAE,CAAC;YACrB,KAAK,CAAC,SAAS,GAAG,aAAa,CAAC,KAAK,CAAC,SAAS,EAAE,aAAa,CAAC,CAAA;QAChE,CAAC;QAED,IAAI,KAAK,CAAC,OAAO,EAAE,CAAC;YACnB,KAAK,CAAC,OAAO,GAAG,aAAa,CAAC,KAAK,CAAC,OAAO,EAAE,aAAa,CAAC,CAAA;QAC5D,CAAC;QAED,IAAI,KAAK,CAAC,UAAU,EAAE,CAAC;YACtB,KAAK,CAAC,UAAU,GAAG,aAAa,CAAC,KAAK,CAAC,UAAU,EAAE,aAAa,CAAC,CAAA;QAClE,CAAC;QAED,IAAI,KAAK,CAAC,QAAQ,EAAE,CAAC;YACpB,KAAK,CAAC,QAAQ,GAAG,uBAAuB,CAAC,KAAK,CAAC,QAAQ,CAAC,CAAA;QACzD,CAAC;IACF,CAAC;IAED,OAAO,eAAe,CAAA;AACvB,CAAC;AAED,MAAM,CAAC,KAAK,UAAU,qCAAqC,CAAC,uBAAiC,EAAE,UAAkB,EAAE,QAAgB,EAAE,kBAAsC,QAAQ,EAAE,aAAmC,UAAU;IACjO,MAAM,YAAY,GAAG,IAAI,YAAY,EAAE,CAAA;IAEvC,KAAK,MAAM,SAAS,IAAI,uBAAuB,EAAE,CAAC;QACjD,MAAM,eAAe,GAAG,SAAS,CAAC,gBAAiB,CAAA;QACnD,MAAM,aAAa,GAAG,SAAS,CAAC,cAAe,CAAA;QAE/C,MAAM,aAAa,GAAG,CAAC,kBAAkB,CAAC,SAAS,CAAC,IAAI,CAAC,CAAA;QAEzD,YAAY,CAAC,OAAO,CAAC,SAAS,CAAC,IAAI,EAAE,eAAe,EAAE,aAAa,CAAC,CAAA;IACrE,CAAC;IAED,MAAM,EAAE,2BAA2B,EAAE,2BAA2B,EAAE,GAAG,wCAAwC,CAAC,YAAY,EAAE,UAAU,CAAC,CAAA;IAEvI,MAAM,qBAAqB,GAAG,MAAM,mBAAmB,CAAC,2BAA2B,CAAC,CAAA;IAEpF,MAAM,UAAU,GAAG,iBAAiB,CAAC,UAAU,EAAE,eAAe,EAAE,UAAU,CAAC,CAAA;IAC7E,MAAM,2BAA2B,GAAG,UAAU,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,CAAC,EAAc,CAAC,CAAA;IAEvE,CAAC;QACA,IAAI,aAAa,GAAG,CAAC,CAAA;QACrB,IAAI,UAAU,GAAG,CAAC,CAAA;QAElB,KAAK,IAAI,cAAc,GAAG,CAAC,EAAE,cAAc,GAAG,UAAU,CAAC,MAAM,EAAE,cAAc,EAAE,EAAE,CAAC;YACnF,MAAM,SAAS,GAAG,UAAU,CAAC,cAAc,CAAC,CAAA;YAE5C,MAAM,oBAAoB,GAAG,UAAU,CAAA;YACvC,MAAM,kBAAkB,GAAG,oBAAoB,GAAG,SAAS,CAAC,MAAM,CAAA;YAElE,OAAO,aAAa,GAAG,qBAAqB,CAAC,SAAS,CAAC,MAAM,EAAE,CAAC;gBAC/D,MAAM,aAAa,GAAG,qBAAqB,CAAC,SAAS,CAAC,aAAa,CAAC,CAAA;gBACpE,MAAM,mBAAmB,GAAG,aAAa,CAAC,SAAS,CAAC,KAAK,CAAA;gBACzD,MAAM,iBAAiB,GAAG,aAAa,CAAC,SAAS,CAAC,GAAG,CAAA;gBAErD,IAAI,mBAAmB,GAAG,kBAAkB,EAAE,CAAC;oBAC9C,2BAA2B,CAAC,cAAc,CAAC,CAAC,IAAI,CAAC,aAAa,CAAC,CAAA;oBAC/D,aAAa,EAAE,CAAA;gBAChB,CAAC;qBAAM,CAAC;oBACP,MAAK;gBACN,CAAC;YACF,CAAC;YAED,IAAI,aAAa,KAAK,qBAAqB,CAAC,SAAS,CAAC,MAAM,EAAE,CAAC;gBAC9D,MAAK;YACN,CAAC;YAED,UAAU,IAAI,SAAS,CAAC,MAAM,CAAA;QAC/B,CAAC;IACF,CAAC;IAED,MAAM,eAAe,GAAa,EAAE,CAAA;IACpC,IAAI,SAAS,GAAG,CAAC,CAAA;IAEjB,KAAK,IAAI,cAAc,GAAG,CAAC,EAAE,cAAc,GAAG,UAAU,CAAC,MAAM,EAAE,cAAc,EAAE,EAAE,CAAC;QACnF,MAAM,SAAS,GAAG,UAAU,CAAC,cAAc,CAAC,CAAA;QAC5C,MAAM,gBAAgB,GAAG,2BAA2B,CAAC,cAAc,CAAC,CAAA;QACpE,MAAM,eAAe,GAAG,gBAAgB,CAAC,GAAG,CAAC,KAAK,CAAC,EAAE,CAAC,qBAAqB,CAAC,SAAS,CAAC,KAAK,CAAC,CAAC,CAAA;QAE7F,MAAM,gBAAgB,GAAa,EAAE,CAAA;QAErC,KAAK,MAAM,aAAa,IAAI,eAAe,EAAE,CAAC;YAC7C,MAAM,YAAY,GAAa,EAAE,CAAA;YAEjC,KAAK,MAAM,CAAC,IAAI,aAAa,CAAC,KAAK,CAAC,OAAO,EAAE,CAAC;gBAC7C,MAAM,iBAAiB,GAAG,2BAA2B,CAAC,GAAG,CAAC,SAAS,CAAC,CAAA;gBAEpE,IAAI,iBAAiB,KAAK,SAAS,EAAE,CAAC;oBACrC,MAAM,iBAAiB,GAAG,uBAAuB,CAAC,iBAAiB,CAAC,CAAA;oBAEpE,YAAY,CAAC,IAAI,CAAC,iBAAiB,CAAC,CAAA;gBACrC,CAAC;gBAED,SAAS,IAAI,CAAC,CAAA;YACf,CAAC;YAED,MAAM,qBAAqB,GAAkB;gBAC5C,IAAI,EAAE,UAAU;gBAChB,IAAI,EAAE,aAAa,CAAC,IAAI;gBACxB,SAAS,EAAE,YAAY,CAAC,CAAC,CAAC,CAAC,SAAS;gBACpC,OAAO,EAAE,YAAY,CAAC,YAAY,CAAC,MAAM,GAAG,CAAC,CAAC,CAAC,OAAO;gBAEtD,QAAQ,EAAE,YAAY;aACtB,CAAA;YAED,gBAAgB,CAAC,IAAI,CAAC,qBAAqB,CAAC,CAAA;QAC7C,CAAC;QAED,MAAM,oBAAoB,GAAkB;YAC3C,IAAI,EAAE,SAAS;YACf,IAAI,EAAE,SAAS;YACf,SAAS,EAAE,gBAAgB,CAAC,CAAC,CAAC,CAAC,SAAS;YACxC,OAAO,EAAE,gBAAgB,CAAC,gBAAgB,CAAC,MAAM,GAAG,CAAC,CAAC,CAAC,OAAO;YAE9D,QAAQ,EAAE,gBAAgB;SAC1B,CAAA;QAED,eAAe,CAAC,IAAI,CAAC,oBAAoB,CAAC,CAAA;IAC3C,CAAC;IAED,OAAO,EAAE,eAAe,EAAE,CAAA;AAC3B,CAAC;AAED,MAAM,UAAU,mCAAmC,CAAC,QAAkB,EAAE,IAAY;IACnF,MAAM,EAAE,gBAAgB,EAAE,GAAG,aAAa,CAAC,IAAI,CAAC,CAAA;IAEhD,IAAI,aAAa,GAAG,CAAC,CAAA;IAErB,SAAS,eAAe,CAAC,QAAkB;QAC1C,KAAK,MAAM,KAAK,IAAI,QAAQ,EAAE,CAAC;YAC9B,IAAI,KAAK,CAAC,IAAI,KAAK,MAAM,EAAE,CAAC;gBAC3B,IAAI,IAAI,GAAG,KAAK,CAAC,IAAI,CAAA;gBAErB,IAAI,GAAG,IAAI,CAAC,IAAI,EAAE,CAAC,UAAU,CAAC,MAAM,EAAE,GAAG,CAAC,CAAA;gBAE1C,MAAM,SAAS,GAAG,IAAI,CAAC,KAAK,CAAC,GAAG,CAAC,CAAA;gBAEjC,IAAI,WAA+B,CAAA;gBACnC,IAAI,SAA6B,CAAA;gBAEjC,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,SAAS,CAAC,MAAM,EAAE,CAAC,EAAE,EAAE,CAAC;oBAC3C,MAAM,QAAQ,GAAG,SAAS,CAAC,CAAC,CAAC,CAAA;oBAE7B,MAAM,cAAc,GAAG,IAAI,CAAC,OAAO,CAAC,QAAQ,EAAE,aAAa,CAAC,CAAA;oBAE5D,IAAI,cAAc,KAAK,CAAC,CAAC,EAAE,CAAC;wBAC3B,SAAQ;oBACT,CAAC;oBAED,aAAa,GAAG,cAAc,GAAG,SAAS,CAAC,CAAC,CAAC,CAAC,MAAM,CAAA;oBAEpD,IAAI,CAAC,KAAK,CAAC,EAAE,CAAC;wBACb,WAAW,GAAG,cAAc,CAAA;oBAC7B,CAAC;oBAED,SAAS,GAAG,aAAa,CAAA;gBAC1B,CAAC;gBAED,KAAK,CAAC,gBAAgB,GAAG,WAAW,CAAA;gBACpC,KAAK,CAAC,cAAc,GAAG,SAAS,CAAA;gBAEhC,KAAK,CAAC,gBAAgB,GAAG,WAAW,KAAK,SAAS,CAAC,CAAC,CAAC,gBAAgB,CAAC,WAAW,CAAC,CAAC,CAAC,CAAC,SAAS,CAAA;gBAC9F,KAAK,CAAC,cAAc,GAAG,SAAS,KAAK,SAAS,CAAC,CAAC,CAAC,gBAAgB,CAAC,SAAS,CAAC,CAAC,CAAC,CAAC,SAAS,CAAA;YACzF,CAAC;iBAAM,IAAI,KAAK,CAAC,QAAQ,EAAE,CAAC;gBAC3B,eAAe,CAAC,KAAK,CAAC,QAAQ,CAAC,CAAA;YAChC,CAAC;QACF,CAAC;IACF,CAAC;IAED,OAAO,eAAe,CAAC,QAAQ,CAAC,CAAA;AACjC,CAAC;AAED,SAAS,oDAAoD,CAAC,UAAkB,EAAE,YAAsB,EAAE,gBAAwB;IACjI,IAAI,gBAAgB,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;QACnC,MAAM,IAAI,KAAK,CAAC,uCAAuC,CAAC,CAAA;IACzD,CAAC;IAED,IAAI,kBAAkB,GAAG,UAAU,CAAA;IAEnC,MAAM,cAAc,GAAG,CAAC,GAAG,EAAE,GAAG,EAAE,GAAG,EAAE,GAAG,EAAE,GAAG,EAAE,GAAG,EAAE,GAAG,CAAC,CAAA;IAE1D,KAAK,MAAM,SAAS,IAAI,YAAY,EAAE,CAAC;QACtC,MAAM,QAAQ,GAAG,SAAS,CAAC,IAAI,CAAA;QAE/B,IAAI,CAAC,MAAM,CAAC,QAAQ,CAAC,EAAE,CAAC;YACvB,SAAQ;QACT,CAAC;QAED,IAAI,WAAW,GAAG,EAAE,CAAA;QACpB,IAAI,SAAS,GAAG,CAAC,CAAA;QAEjB,KAAK,MAAM,IAAI,IAAI,QAAQ,EAAE,CAAC;YAC7B,MAAM,WAAW,GAAG,SAAS,KAAK,CAAC,CAAA;YACnC,MAAM,UAAU,GAAG,SAAS,GAAG,IAAI,CAAC,MAAM,KAAK,QAAQ,CAAC,MAAM,CAAA;YAC9D,MAAM,iBAAiB,GAAG,WAAW,IAAI,UAAU,CAAA;YAEnD,IAAI,CAAC,UAAU,IAAI,cAAc,CAAC,QAAQ,CAAC,IAAI,CAAC,EAAE,CAAC;gBAClD,KAAK,IAAI,CAAC,GAAG,CAAC,EAAE,CAAC,GAAG,IAAI,CAAC,MAAM,EAAE,CAAC,EAAE,EAAE,CAAC;oBACtC,WAAW,IAAI,gBAAgB,CAAA;gBAChC,CAAC;YACF,CAAC;iBAAM,CAAC;gBACP,WAAW,IAAI,IAAI,CAAA;YACpB,CAAC;YAED,SAAS,IAAI,IAAI,CAAC,MAAM,CAAA;QACzB,CAAC;QAED,IAAI,WAAW,KAAK,QAAQ,EAAE,CAAC;YAC9B,MAAM,eAAe,GAAG,SAAS,CAAC,gBAAiB,CAAA;YACnD,MAAM,aAAa,GAAG,SAAS,CAAC,cAAe,CAAA;YAE/C,kBAAkB;gBACjB,kBAAkB,CAAC,SAAS,CAAC,CAAC,EAAE,eAAe,CAAC;oBAChD,WAAW;oBACX,kBAAkB,CAAC,SAAS,CAAC,aAAa,CAAC,CAAA;QAC7C,CAAC;IACF,CAAC;IAED,OAAO,kBAAkB,CAAA;AAC1B,CAAC;AAED,MAAM,UAAU,cAAc,CAAC,QAAkB,EAAE,SAA4C;IAC9F,MAAM,mBAAmB,GAAoB,EAAE,CAAA;IAE/C,KAAK,MAAM,KAAK,IAAI,QAAQ,EAAE,CAAC;QAC9B,IAAI,SAAS,CAAC,KAAK,CAAC,EAAE,CAAC;YACtB,mBAAmB,CAAC,IAAI,CAAC,KAAK,CAAC,CAAA;QAChC,CAAC;aAAM,IAAI,KAAK,CAAC,QAAQ,EAAE,CAAC;YAC3B,mBAAmB,CAAC,IAAI,CAAC,GAAG,cAAc,CAAC,KAAK,CAAC,QAAQ,EAAE,SAAS,CAAC,CAAC,CAAA;QACvE,CAAC;IACF,CAAC;IAED,OAAO,mBAAmB,CAAA;AAC3B,CAAC"}
|
|
@@ -1,4 +1,4 @@
|
|
|
1
|
-
import { splitToParagraphs,
|
|
1
|
+
import { splitToParagraphs, wordCharacterRegExp } from '../nlp/Segmentation.js';
|
|
2
2
|
import { Logger } from './Logger.js';
|
|
3
3
|
export async function parseWikipediaArticle(articleName, language) {
|
|
4
4
|
const logger = new Logger();
|
|
@@ -12,13 +12,13 @@ export async function parseWikipediaArticle(articleName, language) {
|
|
|
12
12
|
const sectionsText = [];
|
|
13
13
|
for (const section of sections) {
|
|
14
14
|
const sectionTitle = section.title();
|
|
15
|
-
if (
|
|
15
|
+
if (wordCharacterRegExp.test(sectionTitle)) {
|
|
16
16
|
sectionsText.push(sectionTitle);
|
|
17
17
|
}
|
|
18
18
|
const sectionParagraphs = splitToParagraphs(section.text(), 'single', 'preserve');
|
|
19
19
|
for (const paragraph of sectionParagraphs) {
|
|
20
20
|
const paragraphText = paragraph;
|
|
21
|
-
if (
|
|
21
|
+
if (wordCharacterRegExp.test(paragraphText)) {
|
|
22
22
|
sectionsText.push(paragraphText);
|
|
23
23
|
}
|
|
24
24
|
}
|
|
@@ -1 +1 @@
|
|
|
1
|
-
{"version":3,"file":"WikipediaReader.js","sourceRoot":"","sources":["../../src/utilities/WikipediaReader.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,iBAAiB,EAAE,
|
|
1
|
+
{"version":3,"file":"WikipediaReader.js","sourceRoot":"","sources":["../../src/utilities/WikipediaReader.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,iBAAiB,EAAE,mBAAmB,EAAE,MAAM,wBAAwB,CAAA;AAC/E,OAAO,EAAE,MAAM,EAAE,MAAM,aAAa,CAAA;AAEpC,MAAM,CAAC,KAAK,UAAU,qBAAqB,CAAC,WAAmB,EAAE,QAAgB;IAChF,MAAM,MAAM,GAAG,IAAI,MAAM,EAAE,CAAA;IAE3B,MAAM,MAAM,CAAC,UAAU,CAAC,4BAA4B,CAAC,CAAA;IAErD,MAAM,EAAE,OAAO,EAAE,GAAG,EAAE,GAAG,MAAM,MAAM,CAAC,eAAe,CAAC,CAAA;IAEtD,MAAM,QAAQ,GAAG,MAAM,GAAG,CAAC,KAAK,CAAC,WAAW,EAAE,QAAQ,CAAC,CAAA;IAEvD,IAAI,CAAC,QAAQ,EAAE,CAAC;QACf,MAAM,IAAI,KAAK,CAAC,kCAAkC,CAAC,CAAA;IACpD,CAAC;IAED,MAAM,QAAQ,GAAG,QAAQ,CAAC,QAAQ,EAAE,CAAA;IACpC,MAAM,YAAY,GAAa,EAAE,CAAA;IAEjC,KAAK,MAAM,OAAO,IAAI,QAAQ,EAAE,CAAC;QAChC,MAAM,YAAY,GAAG,OAAO,CAAC,KAAK,EAAE,CAAA;QAEpC,IAAI,mBAAmB,CAAC,IAAI,CAAC,YAAY,CAAC,EAAE,CAAC;YAC5C,YAAY,CAAC,IAAI,CAAC,YAAY,CAAC,CAAA;QAChC,CAAC;QAED,MAAM,iBAAiB,GAAG,iBAAiB,CAAC,OAAO,CAAC,IAAI,EAAE,EAAE,QAAQ,EAAE,UAAU,CAAC,CAAA;QAEjF,KAAK,MAAM,SAAS,IAAI,iBAAiB,EAAE,CAAC;YAC3C,MAAM,aAAa,GAAG,SAAS,CAAA;YAE/B,IAAI,mBAAmB,CAAC,IAAI,CAAC,aAAa,CAAC,EAAE,CAAC;gBAC7C,YAAY,CAAC,IAAI,CAAC,aAAa,CAAC,CAAA;YACjC,CAAC;QACF,CAAC;IACF,CAAC;IAED,MAAM,CAAC,GAAG,EAAE,CAAA;IAEZ,OAAO,YAAY,CAAA;AACpB,CAAC"}
|
|
@@ -1,5 +1,5 @@
|
|
|
1
1
|
import * as AudioBufferConversion from '../audio/AudioBufferConversion.js';
|
|
2
|
-
import {
|
|
2
|
+
import { wrapEmscriptenModuleHeap } from 'wasm-heap-manager';
|
|
3
3
|
export async function detectVoiceActivity(rawAudio, frameDuration = 10, mode = 0) {
|
|
4
4
|
if (rawAudio.sampleRate != 16000) {
|
|
5
5
|
throw new Error('Audio sample rate must be 16KHz');
|
|
@@ -9,7 +9,7 @@ export async function detectVoiceActivity(rawAudio, frameDuration = 10, mode = 0
|
|
|
9
9
|
}
|
|
10
10
|
export async function fvad(samples, sampleRate, frameDuration, mode) {
|
|
11
11
|
const m = await getFvadInstance();
|
|
12
|
-
const
|
|
12
|
+
const wasmHeap = wrapEmscriptenModuleHeap(m);
|
|
13
13
|
const fvad_new = m._fvad_new;
|
|
14
14
|
const fvad_free = m._fvad_free;
|
|
15
15
|
const fvad_reset = m._fvad_reset;
|
|
@@ -26,7 +26,7 @@ export async function fvad(samples, sampleRate, frameDuration, mode) {
|
|
|
26
26
|
throw new Error(`fvad_set_mode failed for mode ${mode}`);
|
|
27
27
|
}
|
|
28
28
|
const frameSampleCount = Math.floor(sampleRate * (frameDuration / 1000));
|
|
29
|
-
const frameSamplesRef =
|
|
29
|
+
const frameSamplesRef = wasmHeap.allocInt16Array(frameSampleCount);
|
|
30
30
|
const result = [];
|
|
31
31
|
for (let sampleOffset = 0; sampleOffset < samples.length; sampleOffset += frameSampleCount) {
|
|
32
32
|
const frame = samples.subarray(sampleOffset, sampleOffset + frameSampleCount);
|
|
@@ -39,7 +39,7 @@ export async function fvad(samples, sampleRate, frameDuration, mode) {
|
|
|
39
39
|
result.push(fvadResult);
|
|
40
40
|
}
|
|
41
41
|
fvad_free(instancePtr);
|
|
42
|
-
|
|
42
|
+
wasmHeap.freeAll();
|
|
43
43
|
return result;
|
|
44
44
|
}
|
|
45
45
|
let fvadInstance;
|
|
@@ -1 +1 @@
|
|
|
1
|
-
{"version":3,"file":"WebRtcVAD.js","sourceRoot":"","sources":["../../src/voice-activity-detection/WebRtcVAD.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,qBAAqB,MAAM,mCAAmC,CAAA;
|
|
1
|
+
{"version":3,"file":"WebRtcVAD.js","sourceRoot":"","sources":["../../src/voice-activity-detection/WebRtcVAD.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,qBAAqB,MAAM,mCAAmC,CAAA;AAG1E,OAAO,EAAE,wBAAwB,EAAE,MAAM,mBAAmB,CAAA;AAE5D,MAAM,CAAC,KAAK,UAAU,mBAAmB,CAAC,QAAkB,EAAE,gBAA8B,EAAE,EAAE,OAAsB,CAAC;IACtH,IAAI,QAAQ,CAAC,UAAU,IAAI,KAAK,EAAE,CAAC;QAClC,MAAM,IAAI,KAAK,CAAC,iCAAiC,CAAC,CAAA;IACnD,CAAC;IAED,MAAM,oBAAoB,GAAc,MAAM,IAAI,CAAC,qBAAqB,CAAC,iBAAiB,CAAC,QAAQ,CAAC,aAAa,CAAC,CAAC,CAAC,CAAC,EAAE,QAAQ,CAAC,UAAU,EAAE,aAAa,EAAE,IAAI,CAAC,CAAA;IAEhK,OAAO,oBAAoB,CAAA;AAC5B,CAAC;AAED,MAAM,CAAC,KAAK,UAAU,IAAI,CAAC,OAAmB,EAAE,UAAkB,EAAE,aAA2B,EAAE,IAAmB;IACnH,MAAM,CAAC,GAAG,MAAM,eAAe,EAAE,CAAA;IAEjC,MAAM,QAAQ,GAAG,wBAAwB,CAAC,CAAC,CAAC,CAAA;IAE5C,MAAM,QAAQ,GAAG,CAAC,CAAC,SAAS,CAAA;IAC5B,MAAM,SAAS,GAAG,CAAC,CAAC,UAAU,CAAA;IAC9B,MAAM,UAAU,GAAG,CAAC,CAAC,WAAW,CAAA;IAChC,MAAM,aAAa,GAAG,CAAC,CAAC,cAAc,CAAA;IACtC,MAAM,oBAAoB,GAAG,CAAC,CAAC,qBAAqB,CAAA;IACpD,MAAM,YAAY,GAAG,CAAC,CAAC,aAAa,CAAA;IAEpC,MAAM,WAAW,GAAG,QAAQ,EAAE,CAAA;IAE9B,MAAM,eAAe,GAAG,oBAAoB,CAAC,WAAW,EAAE,UAAU,CAAC,CAAA;IAErE,IAAI,eAAe,IAAI,CAAC,EAAE,CAAC;QAC1B,MAAM,IAAI,KAAK,CAAC,yCAAyC,UAAU,EAAE,CAAC,CAAA;IACvE,CAAC;IAED,MAAM,SAAS,GAAG,aAAa,CAAC,WAAW,EAAE,IAAI,CAAC,CAAA;IAElD,IAAI,SAAS,IAAI,CAAC,EAAE,CAAC;QACpB,MAAM,IAAI,KAAK,CAAC,iCAAiC,IAAI,EAAE,CAAC,CAAA;IACzD,CAAC;IAED,MAAM,gBAAgB,GAAG,IAAI,CAAC,KAAK,CAAC,UAAU,GAAG,CAAC,aAAa,GAAG,IAAI,CAAC,CAAC,CAAA;IACxE,MAAM,eAAe,GAAG,QAAQ,CAAC,eAAe,CAAC,gBAAgB,CAAC,CAAA;IAElE,MAAM,MAAM,GAAG,EAAE,CAAA;IAEjB,KAAK,IAAI,YAAY,GAAG,CAAC,EAAE,YAAY,GAAG,OAAO,CAAC,MAAM,EAAE,YAAY,IAAI,gBAAgB,EAAE,CAAC;QAC5F,MAAM,KAAK,GAAG,OAAO,CAAC,QAAQ,CAAC,YAAY,EAAE,YAAY,GAAG,gBAAgB,CAAC,CAAA;QAE7E,eAAe,CAAC,KAAK,EAAE,CAAA;QACvB,eAAe,CAAC,IAAI,CAAC,GAAG,CAAC,KAAK,CAAC,CAAA;QAE/B,MAAM,UAAU,GAAG,YAAY,CAAC,WAAW,EAAE,eAAe,CAAC,OAAO,EAAE,gBAAgB,CAAC,CAAA;QAEvF,IAAI,UAAU,IAAI,CAAC,CAAC,EAAE,CAAC;YACtB,MAAM,IAAI,KAAK,CAAC,qBAAqB,CAAC,CAAA;QACvC,CAAC;QAED,MAAM,CAAC,IAAI,CAAC,UAAU,CAAC,CAAA;IACxB,CAAC;IAED,SAAS,CAAC,WAAW,CAAC,CAAA;IACtB,QAAQ,CAAC,OAAO,EAAE,CAAA;IAElB,OAAO,MAAM,CAAA;AACd,CAAC;AAED,IAAI,YAAiB,CAAA;AACrB,KAAK,UAAU,eAAe;IAC7B,IAAI,CAAC,YAAY,EAAE,CAAC;QACnB,MAAM,EAAE,OAAO,EAAE,eAAe,EAAE,GAAG,MAAM,MAAM,CAAC,uBAAuB,CAAC,CAAA;QAE1E,YAAY,GAAG,MAAM,eAAe,EAAE,CAAA;IACvC,CAAC;IAED,OAAO,YAAY,CAAA;AACpB,CAAC"}
|
package/docs/Tasklist.md
CHANGED
|
@@ -7,7 +7,6 @@
|
|
|
7
7
|
* IPA -> Kirshenbaum translation is still not completely similar to what is output by eSpeak. Also, in rare situations, it outputs characters that are not accepted by eSpeak and eSpeak errors. Investigate when that happens and how to improve on this
|
|
8
8
|
|
|
9
9
|
### Subtitles
|
|
10
|
-
* Phrase splitting may split on number separators like the `,` in `100,000`. The new segmentation library would resolve that
|
|
11
10
|
|
|
12
11
|
### Browser extension
|
|
13
12
|
* Investigate why WebSpeech events sometimes completely stop working in the middle of an utterance for no apparent reason. Sometimes this is permanent, until the extension is restarted. Is this a browser issue?
|
|
@@ -78,7 +77,6 @@
|
|
|
78
77
|
|
|
79
78
|
### API
|
|
80
79
|
* Validate timelines to ensure timestamps are always increasing: no negative timestamps or timestamps over the duration of the audio. No sentences without words, etc. and correct if needed
|
|
81
|
-
* See whether it's possible to detect and include / remove Emoji characters in timelines
|
|
82
80
|
* Add support for phrases in timelines
|
|
83
81
|
* Accept voice list caching options in `SynthesisOptions`
|
|
84
82
|
|
|
@@ -93,7 +91,6 @@
|
|
|
93
91
|
|
|
94
92
|
### Subtitles
|
|
95
93
|
* Split long words if needed
|
|
96
|
-
* Clauses shouldn't be split in the middle of numbers, like the `,` in `123,456`
|
|
97
94
|
* Decide how many punctuation characters to allow before breaking to a new line (currently it's infinite)
|
|
98
95
|
* If a subtitle is too short and at the end of the audio, try to extend it back if possible (for example, if the previous subtitle is already extended, take back from it)
|
|
99
96
|
* Add more clause separators, for even more special cases
|
|
@@ -104,7 +101,6 @@
|
|
|
104
101
|
* Option to disable alignment (only for some engines). Alternative: use a low granularity DTW setting that is very fast to compute
|
|
105
102
|
* Find places to add commas (",") to improve speech fluency. VITS voices don't normally add speech breaks if there is no punctuation
|
|
106
103
|
* An isolated dash " - " can be converted to a " , " to ensure there's a break in the speech
|
|
107
|
-
* Ensure abbreviations like "Ph.d" or similar names are segmented and read correctly (does `cldr` treat it as a word? Maybe eSpeak doesn't recognize it as a word). "C#" and ".NET" as well
|
|
108
104
|
* Find a way to manually reset voice list cache
|
|
109
105
|
* When synthesized text isn't pre-split to sentences, apply sentence splits by using the existing method to convert the output of word timelines to sentence/segment timelines
|
|
110
106
|
* Some `sapi` voices and `msspeech` languages output phones that are converted to Microsoft alphabet, not IPA symbols. Try to see if these can be translated to IPA
|
|
@@ -120,7 +116,7 @@
|
|
|
120
116
|
### Synthesis / preprocessing
|
|
121
117
|
* Full date normalization (e.g. `21 August 2023`, `21 Aug 2023`, `August 21, 2023`)
|
|
122
118
|
* Add support for capitalized-only rules, and possibly also all uppercase / all lowercase rules
|
|
123
|
-
* Add support for multiple words in `precededBy` and `
|
|
119
|
+
* Add support for multiple consecutive words in `precededBy` and `followedBy` conditions
|
|
124
120
|
* Support substituting to graphemes in lexicons, not only phonemes
|
|
125
121
|
* Cache lexicons to avoid parsing the JSON each time it is loaded (this may not be needed for if the file is relatively small)
|
|
126
122
|
* Is it possible to pre-phonemize common words like "the" or is it a bad idea / not necessary?
|
|
@@ -159,7 +155,6 @@
|
|
|
159
155
|
|
|
160
156
|
### Source separation / MDX-NET
|
|
161
157
|
* Option to customize overlap
|
|
162
|
-
* Add more models
|
|
163
158
|
|
|
164
159
|
### Server
|
|
165
160
|
* Option to allow or disallow local file paths as arguments to API methods (as a security safeguard)
|