pyests 0.1.0__tar.gz → 0.2.0__tar.gz

{pyests-0.1.0 → pyests-0.2.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.5
 Name: pyests
-Version: 0.1.0
+Version: 0.2.0
 Summary: Spanish Texts Statistics
 Project-URL: Homepage, https://github.com/SergeyShk/esTS
 Project-URL: Repository, https://github.com/SergeyShk/esTS
@@ -34,8 +34,16 @@ Requires-Dist: simplemma>=1.0
 Requires-Dist: spacy>=3.7
 Description-Content-Type: text/markdown
 
+<p align="center">
+  <img src="https://raw.githubusercontent.com/SergeyShk/esTS/master/docs/img/ests.png" alt="esTS" width="340">
+</p>
+
 <h1 align="center">esTS</h1>
 
+<p align="center">
+  <i>¿Cómo esTáS, texto?</i>
+</p>
+
 <p align="center">
   <b>Spanish Texts Statistics</b> - a library for statistics extraction from texts in Spanish
 </p>
@@ -56,17 +64,21 @@ Description-Content-Type: text/markdown
 
 ---
 
-**esTS** computes for Spanish texts what usually requires assembling several separate tools: basic statistics, readability and lexical diversity - by published formulas with the coefficients and the scales of their authors, deterministically and without a neural network inside.
+**esTS** computes for Spanish texts what usually requires assembling several separate tools: basic statistics, readability, lexical diversity, morphology, syntax and cohesion - by published formulas with the coefficients and the scales of their authors, and by the parts of speech and the features of Universal Dependencies.
 
-The library works both with raw strings and with `Doc` objects of [spaCy](https://github.com/explosion/spaCy), and needs no trained model: sentences, words and character N-grams are extracted by rules, syllables and stress follow from the orthography.
+The library works both with raw strings and with `Doc` objects of [spaCy](https://github.com/explosion/spaCy): sentences, words and character N-grams are extracted by rules, syllables and stress follow from the orthography, and only the morphological, the syntactic and the cohesion statistics need a trained model.
 
 * **[Object extraction](https://sergeyshk.github.io/esTS/extractors/sentences/)** - configurable sentence, word and character N-gram tokenizers that know the inverted marks, the dialogue dash and the abbreviations of Spanish
 * **[Syllables and stress](https://sergeyshk.github.io/esTS/syllables/)** - rule-based syllabification and the stressed syllable derived from the spelling, with no dictionary
 * **[Basic statistics](https://sergeyshk.github.io/esTS/stats/basic_stats/)** - counts of sentences, words, letters, syllables and punctuation marks by type, with distributions and normalized shares
 * **[Readability metrics](https://sergeyshk.github.io/esTS/stats/readability_stats/)** - Fernández Huerta, Szigriszt-Pazos with the INFLESZ scale, Gutiérrez de Polini, Crawford, Legibilidad µ, SOL, LIX and RIX, with a consensus grade, the school stages of Spain and reading time
 * **[Lexical diversity metrics](https://sergeyshk.github.io/esTS/stats/diversity_stats/)** - TTR and its variations, MATTR, MSTTR, MTLD, HD-D, Simpson's and Yule's indices, entropy, Zipf's and Heaps' laws
+* **[Morphological statistics](https://sergeyshk.github.io/esTS/stats/morph_stats/)** - parts of speech and fifteen grammatical features of Universal Dependencies, with the markers of Spanish: the moods, the non-finite forms, `ser` against `estar`, the adverbs in `-mente`
+* **[spaCy components](https://sergeyshk.github.io/esTS/components/)** - every statistics class as a component of a pipeline, the statistics attached to the `Doc` in one pass
+* **[Cohesion statistics](https://sergeyshk.github.io/esTS/stats/cohesion_stats/)** - the overlap of nouns, arguments and content words between sentences, givenness and temporal cohesion in the manner of Coh-Metrix, with the density of 255 Spanish discourse markers
+* **[Syntactic statistics](https://sergeyshk.github.io/esTS/stats/syntax_stats/)** - the dependency tree by distances, depth, clauses and coordination, with the constructions of the administrative style: the passive with `ser` and with `se`, the participial and the gerund clauses, the chains of `de`, the split predicates
 
-Morphology, syntax and cohesion on Universal Dependencies come in 0.2, corpus measures and stylometry in 0.3, style, phonostatistics, metre and rhyme in 0.4.
+Corpus measures and stylometry come in 0.3, style, phonostatistics, metre and rhyme in 0.4.
 
 ## Installation
 
@@ -82,7 +94,7 @@ Or with [uv](https://docs.astral.sh/uv/):
 uv add pyests
 ```
 
-The distribution on PyPI is `pyests`, the package it installs is `ests`. No spaCy model is needed for the statistics of 0.1; one is needed only to parse a text yourself and pass the `Doc` instead of a string:
+The distribution on PyPI is `pyests`, the package it installs is `ests`. The basic statistics, the readability and the lexical diversity metrics need no spaCy model; the morphological, the syntactic and the cohesion statistics do, and so does parsing a text yourself to pass the `Doc` instead of a string:
 
 ```bash
 python -m spacy download es_core_news_sm
@@ -325,6 +337,144 @@ More in the [documentation](https://sergeyshk.github.io/esTS/stats/diversity_sta
 
 </details>
 
+<details>
+<summary><b>Morphological statistics</b></summary>
+
+<br>
+
+The library annotates a text with the parts of speech and the grammatical features of Universal Dependencies, as the Spanish models of spaCy give them, and counts them:
+
+*   the part of speech and fifteen features: case, definiteness, degree, gender, mood, numeral type, number, person, polarity, politeness, possessive, pronoun type, reflexive, tense and verb form
+*   the distribution of the words by the values of any feature, and the parse of the text word by word
+*   the markers of Spanish: the moods among the finite forms, the non-finite forms, `ser` against `estar`, the adverbs in `-mente`
+
+```python
+>>> from ests import MorphStats
+
+>>> ms = MorphStats("Si tuviera tiempo, leería el libro que me recomendaste ayer")
+
+>>> ms.get_stats("mood", "tense", filter_none=True)
+{'mood': {'Sub': 1, 'Cnd': 1, 'Ind': 1}, 'tense': {'Imp': 1, 'Pres': 1}}
+
+>>> ms.tags[1]
+'Mood=Sub|Number=Sing|Person=3|Tense=Imp|VerbForm=Fin'
+
+>>> ms.explain_text("pos", "mood", filter_none=True)[1]
+('tuviera', {'pos': 'VERB', 'mood': 'Sub'})
+
+>>> MorphStats("Ella es alta pero hoy está cansada y habla lentamente").get_markers()["p_ser"]
+0.5
+```
+
+The statistics need a spaCy model: a text is parsed with `es_core_news_sm`, and any other pipeline can be passed in `nlp`.
+
+More in the [documentation](https://sergeyshk.github.io/esTS/stats/morph_stats/).
+
+</details>
+
+<details>
+<summary><b>Syntactic statistics</b></summary>
+
+<br>
+
+The library measures the dependency tree of Universal Dependencies and the constructions that the Spanish guides to clear language warn about:
+
+*   the complexity of the tree: dependency distances, depth, leaves and subtrees, valency of the finite verbs, coordination chains, clauses and subordinate clauses, modifiers per noun
+*   the constructions: the passive with `ser` and with `se`, the participial and the gerund clauses, the chains of `de`, the split predicates, the impersonal `se`, the words of negation, the ratio of nouns to verbs
+
+```python
+>>> from ests import SyntaxStats
+
+>>> text = ("La revisión de las cuentas fue realizada por el comité. "
+...         "Se llevó a cabo la reforma sin que nadie hiciera mención de los problemas.")
+>>> ss = SyntaxStats(text)
+
+>>> ss.n_sents, ss.n_words
+(2, 24)
+
+>>> ss.p_passive, ss.noun_verb_ratio
+(0.6666666666666666, 2.3333333333333335)
+
+>>> ss.split_predicates
+('llevó cabo', 'hiciera mención')
+
+>>> round(ss.mean_dependency_distance, 2)
+2.05
+```
+
+The statistics need a parse: a text is parsed with `es_core_news_sm`, and any other pipeline can be passed in `nlp`.
+
+More in the [documentation](https://sergeyshk.github.io/esTS/stats/syntax_stats/).
+
+</details>
+
+<details>
+<summary><b>Cohesion statistics</b></summary>
+
+<br>
+
+The library measures referential cohesion in the manner of Coh-Metrix and of its Spanish adaptation Coh-Metrix-Esp:
+
+*   the overlap of nouns, of arguments and of content words between adjacent sentences and between all pairs of sentences, binary and proportional
+*   givenness: pronouns, demonstratives and the content words whose lemma was already used
+*   temporal cohesion: the repetition of the tense and of the mood of the verbs of adjacent sentences
+*   the density of 255 Spanish discourse markers by class - causal, adversative, concessive, temporal, additive, conditional, reformulative - and by kind
+
+```python
+>>> from ests import CohesionStats
+
+>>> text = ("El informe fue aprobado por la comisión. Sin embargo, el informe no resuelve el problema. "
+...         "Por lo tanto, la comisión aplazó la decisión.")
+>>> cs = CohesionStats(text)
+
+>>> cs.n_sents, cs.n_words
+(3, 23)
+
+>>> cs.noun_overlap_adjacent, round(cs.p_given, 3)
+(0.5, 0.167)
+
+>>> cs.c_connectors
+{'por lo tanto': 1, 'sin embargo': 1}
+
+>>> round(cs.connectors, 2), round(cs.connectors_causal, 2)
+(86.96, 43.48)
+```
+
+The statistics need the annotation: a text is parsed with `es_core_news_sm`, and any other pipeline can be passed in `nlp`.
+
+More in the [documentation](https://sergeyshk.github.io/esTS/stats/cohesion_stats/).
+
+</details>
+
+<details>
+<summary><b>spaCy components</b></summary>
+
+<br>
+
+Every statistics class is also a component of a pipeline, so a text is annotated and measured in one pass and the statistics travel with the `Doc`:
+
+```python
+>>> import ests
+>>> import spacy
+
+>>> nlp = spacy.load("es_core_news_sm")
+>>> for factory in ("basic", "morph", "syntax"):
+...     _ = nlp.add_pipe(f"ests_{factory}", name=factory, last=True)
+
+>>> nlp.pipe_names[-3:]
+['basic', 'morph', 'syntax']
+
+>>> doc = nlp("El gato duerme en la ventana. Los niños juegan en el parque.")
+>>> doc._.basic.n_words, doc._.morph.pos[:2], doc._.syntax.tree_depth
+(12, ('DET', 'NOUN'), 2.0)
+```
+
+The factories are `ests_basic`, `ests_readability`, `ests_diversity`, `ests_morph`, `ests_syntax` and `ests_cohesion`; the name of the pipe is free and is what the extension is called.
+
+More in the [documentation](https://sergeyshk.github.io/esTS/components/).
+
+</details>
+
 ## Development
 
 The project uses [uv](https://docs.astral.sh/uv/) for dependency management and [ruff](https://docs.astral.sh/ruff/) for linting and formatting.
@@ -362,11 +512,15 @@ Bug reports, ideas and pull requests are welcome - [issues](https://github.com/S
 *   **docs** - project documentation
 *   **ests**:
     *   basic_stats.py - basic text statistics
+    *   cohesion_stats.py - cohesion statistics
+    *   components.py - components of a spaCy pipeline
     *   constants.py - constants of the Spanish language and of the metrics
     *   diversity_stats.py - lexical diversity metrics
     *   exceptions.py - library exceptions
     *   extractors.py - tools for object extraction from a text
+    *   morph_stats.py - morphological statistics
     *   readability_stats.py - readability metrics
+    *   syntax_stats.py - syntactic statistics
     *   syllables.py - syllabification and stress
     *   utils.py - helper tools
 *   **tests** - tests mirroring the package structure

{pyests-0.1.0 → pyests-0.2.0}/README.es.md

@@ -1,5 +1,13 @@
+<p align="center">
+  <img src="https://raw.githubusercontent.com/SergeyShk/esTS/master/docs/img/ests.png" alt="esTS" width="340">
+</p>
+
 <h1 align="center">esTS</h1>
 
+<p align="center">
+  <i>¿Cómo esTáS, texto?</i>
+</p>
+
 <p align="center">
   <b>Spanish Texts Statistics</b> - biblioteca para extraer estadísticas de textos en español
 </p>
@@ -20,17 +28,21 @@
 
 ---
 
-**esTS** calcula para textos en español lo que normalmente exige juntar varias herramientas sueltas: estadísticas básicas, legibilidad y diversidad léxica, con fórmulas publicadas y con los coeficientes y las escalas de sus autores, de forma determinista y sin ninguna red neuronal dentro.
+**esTS** calcula para textos en español lo que normalmente exige juntar varias herramientas sueltas: estadísticas básicas, legibilidad, diversidad léxica, morfología, sintaxis y cohesión, con fórmulas publicadas y con los coeficientes y las escalas de sus autores, y con las categorías y los rasgos de Universal Dependencies.
 
-La biblioteca trabaja tanto con cadenas como con objetos `Doc` de [spaCy](https://github.com/explosion/spaCy) y no necesita ningún modelo entrenado: las oraciones, las palabras y los N-gramas de caracteres se extraen por reglas, y las sílabas y el acento se deducen de la ortografía.
+La biblioteca trabaja tanto con cadenas como con objetos `Doc` de [spaCy](https://github.com/explosion/spaCy): las oraciones, las palabras y los N-gramas de caracteres se extraen por reglas, las sílabas y el acento se deducen de la ortografía, y solo las estadísticas morfológicas, las sintácticas y las de cohesión necesitan un modelo entrenado.
 
 * **[Extracción de objetos](https://sergeyshk.github.io/esTS/es/extractors/sentences/)** - tokenizadores configurables de oraciones, palabras y N-gramas de caracteres que conocen los signos de apertura, la raya de diálogo y las abreviaturas del español
 * **[Sílabas y acento](https://sergeyshk.github.io/esTS/es/syllables/)** - silabificación por reglas y sílaba tónica deducida de la escritura, sin diccionario
 * **[Estadísticas básicas](https://sergeyshk.github.io/esTS/es/stats/basic_stats/)** - recuentos de oraciones, palabras, letras, sílabas y signos de puntuación por tipo, con distribuciones y proporciones normalizadas
 * **[Métricas de legibilidad](https://sergeyshk.github.io/esTS/es/stats/readability_stats/)** - Fernández Huerta, Szigriszt-Pazos con la escala INFLESZ, Gutiérrez de Polini, Crawford, Legibilidad µ, SOL, LIX y RIX, con grado de consenso, etapas escolares de España y tiempo de lectura
 * **[Métricas de diversidad léxica](https://sergeyshk.github.io/esTS/es/stats/diversity_stats/)** - TTR y sus variantes, MATTR, MSTTR, MTLD, HD-D, índices de Simpson y de Yule, entropía, leyes de Zipf y de Heaps
+* **[Estadísticas morfológicas](https://sergeyshk.github.io/esTS/es/stats/morph_stats/)** - categorías gramaticales y quince rasgos morfológicos de Universal Dependencies, con los marcadores del español: los modos, las formas no personales, `ser` frente a `estar`, los adverbios en `-mente`
+* **[Componentes de spaCy](https://sergeyshk.github.io/esTS/es/components/)** - cada clase de estadísticas como componente de un pipeline, con las estadísticas puestas en el `Doc` en una sola pasada
+* **[Estadísticas de cohesión](https://sergeyshk.github.io/esTS/es/stats/cohesion_stats/)** - la repetición de sustantivos, argumentos y palabras con contenido entre oraciones, la información dada y la cohesión temporal a la manera de Coh-Metrix, con la densidad de 255 marcadores del discurso españoles
+* **[Estadísticas sintácticas](https://sergeyshk.github.io/esTS/es/stats/syntax_stats/)** - el árbol de dependencias por distancias, profundidad, cláusulas y coordinación, con las construcciones del estilo administrativo: la pasiva con `ser` y con `se`, las cláusulas de participio y de gerundio, las cadenas de `de`, los predicados escindidos
 
-La morfología, la sintaxis y la cohesión sobre Universal Dependencies llegan en la 0.2, las medidas de corpus y la estilometría en la 0.3, el estilo, la fonoestadística, la métrica y la rima en la 0.4.
+Las medidas de corpus y la estilometría llegan en la 0.3, el estilo, la fonoestadística, la métrica y la rima en la 0.4.
 
 ## Instalación
 
@@ -46,7 +58,7 @@ O con [uv](https://docs.astral.sh/uv/):
 uv add pyests
 ```
 
-El distribuible en PyPI se llama `pyests` y el paquete que instala es `ests`. Las estadísticas de la 0.1 no necesitan ningún modelo de spaCy; solo hace falta para analizar un texto por su cuenta y pasar el `Doc` en lugar de una cadena:
+El distribuible en PyPI se llama `pyests` y el paquete que instala es `ests`. Las estadísticas básicas, la legibilidad y la diversidad léxica no necesitan ningún modelo de spaCy; las estadísticas morfológicas, las sintácticas y las de cohesión sí, igual que analizar un texto por su cuenta para pasar el `Doc` en lugar de una cadena:
 
 ```bash
 python -m spacy download es_core_news_sm
@@ -289,6 +301,144 @@ Más en la [documentación](https://sergeyshk.github.io/esTS/es/stats/diversity_
 
 </details>
 
+<details>
+<summary><b>Estadísticas morfológicas</b></summary>
+
+<br>
+
+La biblioteca anota el texto con las categorías gramaticales y los rasgos morfológicos de Universal Dependencies, tal como los dan los modelos españoles de spaCy, y los cuenta:
+
+*   la categoría gramatical y quince rasgos: caso, definitud, grado, género, modo, tipo de numeral, número, persona, polaridad, cortesía, posesivo, tipo de pronombre, reflexivo, tiempo verbal y forma verbal
+*   la distribución de las palabras por los valores de cualquier rasgo y el análisis del texto palabra por palabra
+*   los marcadores del español: los modos entre las formas personales, las formas no personales, `ser` frente a `estar`, los adverbios en `-mente`
+
+```python
+>>> from ests import MorphStats
+
+>>> ms = MorphStats("Si tuviera tiempo, leería el libro que me recomendaste ayer")
+
+>>> ms.get_stats("mood", "tense", filter_none=True)
+{'mood': {'Sub': 1, 'Cnd': 1, 'Ind': 1}, 'tense': {'Imp': 1, 'Pres': 1}}
+
+>>> ms.tags[1]
+'Mood=Sub|Number=Sing|Person=3|Tense=Imp|VerbForm=Fin'
+
+>>> ms.explain_text("pos", "mood", filter_none=True)[1]
+('tuviera', {'pos': 'VERB', 'mood': 'Sub'})
+
+>>> MorphStats("Ella es alta pero hoy está cansada y habla lentamente").get_markers()["p_ser"]
+0.5
+```
+
+Las estadísticas necesitan un modelo de spaCy: el texto se analiza con `es_core_news_sm`, y en `nlp` puede indicarse cualquier otro pipeline.
+
+Más en la [documentación](https://sergeyshk.github.io/esTS/es/stats/morph_stats/).
+
+</details>
+
+<details>
+<summary><b>Estadísticas sintácticas</b></summary>
+
+<br>
+
+La biblioteca mide el árbol de dependencias de Universal Dependencies y las construcciones que advierten las guías españolas de lenguaje claro:
+
+*   la complejidad del árbol: distancias de dependencia, profundidad, hojas y subárboles, valencia de los verbos personales, cadenas de coordinación, cláusulas y subordinadas, modificadores por sustantivo
+*   las construcciones: la pasiva con `ser` y con `se`, las cláusulas de participio y de gerundio, las cadenas de `de`, los predicados escindidos, el `se` impersonal, las palabras de negación, la razón entre sustantivos y verbos
+
+```python
+>>> from ests import SyntaxStats
+
+>>> text = ("La revisión de las cuentas fue realizada por el comité. "
+...         "Se llevó a cabo la reforma sin que nadie hiciera mención de los problemas.")
+>>> ss = SyntaxStats(text)
+
+>>> ss.n_sents, ss.n_words
+(2, 24)
+
+>>> ss.p_passive, ss.noun_verb_ratio
+(0.6666666666666666, 2.3333333333333335)
+
+>>> ss.split_predicates
+('llevó cabo', 'hiciera mención')
+
+>>> round(ss.mean_dependency_distance, 2)
+2.05
+```
+
+Las estadísticas necesitan el análisis sintáctico: el texto se analiza con `es_core_news_sm`, y en `nlp` puede indicarse cualquier otro pipeline.
+
+Más en la [documentación](https://sergeyshk.github.io/esTS/es/stats/syntax_stats/).
+
+</details>
+
+<details>
+<summary><b>Estadísticas de cohesión</b></summary>
+
+<br>
+
+La biblioteca mide la cohesión referencial a la manera de Coh-Metrix y de su adaptación española Coh-Metrix-Esp:
+
+*   la repetición de sustantivos, de argumentos y de palabras con contenido entre oraciones contiguas y entre todos los pares de oraciones, binaria y proporcional
+*   la información dada: pronombres, demostrativos y palabras con contenido cuyo lema ya se había usado
+*   la cohesión temporal: la repetición del tiempo y del modo de los verbos de oraciones contiguas
+*   la densidad de 255 marcadores del discurso españoles por clase - causales, adversativos, concesivos, temporales, aditivos, condicionales, reformulativos - y por tipo
+
+```python
+>>> from ests import CohesionStats
+
+>>> text = ("El informe fue aprobado por la comisión. Sin embargo, el informe no resuelve el problema. "
+...         "Por lo tanto, la comisión aplazó la decisión.")
+>>> cs = CohesionStats(text)
+
+>>> cs.n_sents, cs.n_words
+(3, 23)
+
+>>> cs.noun_overlap_adjacent, round(cs.p_given, 3)
+(0.5, 0.167)
+
+>>> cs.c_connectors
+{'por lo tanto': 1, 'sin embargo': 1}
+
+>>> round(cs.connectors, 2), round(cs.connectors_causal, 2)
+(86.96, 43.48)
+```
+
+Las estadísticas necesitan la anotación: el texto se analiza con `es_core_news_sm`, y en `nlp` puede indicarse cualquier otro pipeline.
+
+Más en la [documentación](https://sergeyshk.github.io/esTS/es/stats/cohesion_stats/).
+
+</details>
+
+<details>
+<summary><b>Componentes de spaCy</b></summary>
+
+<br>
+
+Cada clase de estadísticas es también un componente de un pipeline, de modo que el texto se anota y se mide en una sola pasada y las estadísticas viajan con el `Doc`:
+
+```python
+>>> import ests
+>>> import spacy
+
+>>> nlp = spacy.load("es_core_news_sm")
+>>> for factory in ("basic", "morph", "syntax"):
+...     _ = nlp.add_pipe(f"ests_{factory}", name=factory, last=True)
+
+>>> nlp.pipe_names[-3:]
+['basic', 'morph', 'syntax']
+
+>>> doc = nlp("El gato duerme en la ventana. Los niños juegan en el parque.")
+>>> doc._.basic.n_words, doc._.morph.pos[:2], doc._.syntax.tree_depth
+(12, ('DET', 'NOUN'), 2.0)
+```
+
+Las fábricas son `ests_basic`, `ests_readability`, `ests_diversity`, `ests_morph`, `ests_syntax` y `ests_cohesion`; el nombre del paso del pipeline es libre y es como se llama la extensión.
+
+Más en la [documentación](https://sergeyshk.github.io/esTS/es/components/).
+
+</details>
+
 ## Desarrollo
 
 El proyecto usa [uv](https://docs.astral.sh/uv/) para gestionar las dependencias y [ruff](https://docs.astral.sh/ruff/) para el análisis y el formato del código.
@@ -326,11 +476,15 @@ Los informes de errores, las ideas y los pull requests son bienvenidos: las [iss
 *   **docs** - documentación del proyecto
 *   **ests**:
     *   basic_stats.py - estadísticas básicas del texto
+    *   cohesion_stats.py - estadísticas de cohesión
+    *   components.py - componentes de un pipeline de spaCy
     *   constants.py - constantes de la lengua española y de las métricas
     *   diversity_stats.py - métricas de diversidad léxica
     *   exceptions.py - excepciones de la biblioteca
     *   extractors.py - herramientas de extracción de objetos del texto
+    *   morph_stats.py - estadísticas morfológicas
     *   readability_stats.py - métricas de legibilidad
+    *   syntax_stats.py - estadísticas sintácticas
     *   syllables.py - silabificación y acento
     *   utils.py - herramientas auxiliares
 *   **tests** - pruebas que reproducen la estructura del paquete

{pyests-0.1.0 → pyests-0.2.0}/README.md

@@ -1,5 +1,13 @@
+<p align="center">
+  <img src="https://raw.githubusercontent.com/SergeyShk/esTS/master/docs/img/ests.png" alt="esTS" width="340">
+</p>
+
 <h1 align="center">esTS</h1>
 
+<p align="center">
+  <i>¿Cómo esTáS, texto?</i>
+</p>
+
 <p align="center">
   <b>Spanish Texts Statistics</b> - a library for statistics extraction from texts in Spanish
 </p>
@@ -20,17 +28,21 @@
 
 ---
 
-**esTS** computes for Spanish texts what usually requires assembling several separate tools: basic statistics, readability and lexical diversity - by published formulas with the coefficients and the scales of their authors, deterministically and without a neural network inside.
+**esTS** computes for Spanish texts what usually requires assembling several separate tools: basic statistics, readability, lexical diversity, morphology, syntax and cohesion - by published formulas with the coefficients and the scales of their authors, and by the parts of speech and the features of Universal Dependencies.
 
-The library works both with raw strings and with `Doc` objects of [spaCy](https://github.com/explosion/spaCy), and needs no trained model: sentences, words and character N-grams are extracted by rules, syllables and stress follow from the orthography.
+The library works both with raw strings and with `Doc` objects of [spaCy](https://github.com/explosion/spaCy): sentences, words and character N-grams are extracted by rules, syllables and stress follow from the orthography, and only the morphological, the syntactic and the cohesion statistics need a trained model.
 
 * **[Object extraction](https://sergeyshk.github.io/esTS/extractors/sentences/)** - configurable sentence, word and character N-gram tokenizers that know the inverted marks, the dialogue dash and the abbreviations of Spanish
 * **[Syllables and stress](https://sergeyshk.github.io/esTS/syllables/)** - rule-based syllabification and the stressed syllable derived from the spelling, with no dictionary
 * **[Basic statistics](https://sergeyshk.github.io/esTS/stats/basic_stats/)** - counts of sentences, words, letters, syllables and punctuation marks by type, with distributions and normalized shares
 * **[Readability metrics](https://sergeyshk.github.io/esTS/stats/readability_stats/)** - Fernández Huerta, Szigriszt-Pazos with the INFLESZ scale, Gutiérrez de Polini, Crawford, Legibilidad µ, SOL, LIX and RIX, with a consensus grade, the school stages of Spain and reading time
 * **[Lexical diversity metrics](https://sergeyshk.github.io/esTS/stats/diversity_stats/)** - TTR and its variations, MATTR, MSTTR, MTLD, HD-D, Simpson's and Yule's indices, entropy, Zipf's and Heaps' laws
+* **[Morphological statistics](https://sergeyshk.github.io/esTS/stats/morph_stats/)** - parts of speech and fifteen grammatical features of Universal Dependencies, with the markers of Spanish: the moods, the non-finite forms, `ser` against `estar`, the adverbs in `-mente`
+* **[spaCy components](https://sergeyshk.github.io/esTS/components/)** - every statistics class as a component of a pipeline, the statistics attached to the `Doc` in one pass
+* **[Cohesion statistics](https://sergeyshk.github.io/esTS/stats/cohesion_stats/)** - the overlap of nouns, arguments and content words between sentences, givenness and temporal cohesion in the manner of Coh-Metrix, with the density of 255 Spanish discourse markers
+* **[Syntactic statistics](https://sergeyshk.github.io/esTS/stats/syntax_stats/)** - the dependency tree by distances, depth, clauses and coordination, with the constructions of the administrative style: the passive with `ser` and with `se`, the participial and the gerund clauses, the chains of `de`, the split predicates
 
-Morphology, syntax and cohesion on Universal Dependencies come in 0.2, corpus measures and stylometry in 0.3, style, phonostatistics, metre and rhyme in 0.4.
+Corpus measures and stylometry come in 0.3, style, phonostatistics, metre and rhyme in 0.4.
 
 ## Installation
 
@@ -46,7 +58,7 @@ Or with [uv](https://docs.astral.sh/uv/):
 uv add pyests
 ```
 
-The distribution on PyPI is `pyests`, the package it installs is `ests`. No spaCy model is needed for the statistics of 0.1; one is needed only to parse a text yourself and pass the `Doc` instead of a string:
+The distribution on PyPI is `pyests`, the package it installs is `ests`. The basic statistics, the readability and the lexical diversity metrics need no spaCy model; the morphological, the syntactic and the cohesion statistics do, and so does parsing a text yourself to pass the `Doc` instead of a string:
 
 ```bash
 python -m spacy download es_core_news_sm
@@ -289,6 +301,144 @@ More in the [documentation](https://sergeyshk.github.io/esTS/stats/diversity_sta
 
 </details>
 
+<details>
+<summary><b>Morphological statistics</b></summary>
+
+<br>
+
+The library annotates a text with the parts of speech and the grammatical features of Universal Dependencies, as the Spanish models of spaCy give them, and counts them:
+
+*   the part of speech and fifteen features: case, definiteness, degree, gender, mood, numeral type, number, person, polarity, politeness, possessive, pronoun type, reflexive, tense and verb form
+*   the distribution of the words by the values of any feature, and the parse of the text word by word
+*   the markers of Spanish: the moods among the finite forms, the non-finite forms, `ser` against `estar`, the adverbs in `-mente`
+
+```python
+>>> from ests import MorphStats
+
+>>> ms = MorphStats("Si tuviera tiempo, leería el libro que me recomendaste ayer")
+
+>>> ms.get_stats("mood", "tense", filter_none=True)
+{'mood': {'Sub': 1, 'Cnd': 1, 'Ind': 1}, 'tense': {'Imp': 1, 'Pres': 1}}
+
+>>> ms.tags[1]
+'Mood=Sub|Number=Sing|Person=3|Tense=Imp|VerbForm=Fin'
+
+>>> ms.explain_text("pos", "mood", filter_none=True)[1]
+('tuviera', {'pos': 'VERB', 'mood': 'Sub'})
+
+>>> MorphStats("Ella es alta pero hoy está cansada y habla lentamente").get_markers()["p_ser"]
+0.5
+```
+
+The statistics need a spaCy model: a text is parsed with `es_core_news_sm`, and any other pipeline can be passed in `nlp`.
+
+More in the [documentation](https://sergeyshk.github.io/esTS/stats/morph_stats/).
+
+</details>
+
+<details>
+<summary><b>Syntactic statistics</b></summary>
+
+<br>
+
+The library measures the dependency tree of Universal Dependencies and the constructions that the Spanish guides to clear language warn about:
+
+*   the complexity of the tree: dependency distances, depth, leaves and subtrees, valency of the finite verbs, coordination chains, clauses and subordinate clauses, modifiers per noun
+*   the constructions: the passive with `ser` and with `se`, the participial and the gerund clauses, the chains of `de`, the split predicates, the impersonal `se`, the words of negation, the ratio of nouns to verbs
+
+```python
+>>> from ests import SyntaxStats
+
+>>> text = ("La revisión de las cuentas fue realizada por el comité. "
+...         "Se llevó a cabo la reforma sin que nadie hiciera mención de los problemas.")
+>>> ss = SyntaxStats(text)
+
+>>> ss.n_sents, ss.n_words
+(2, 24)
+
+>>> ss.p_passive, ss.noun_verb_ratio
+(0.6666666666666666, 2.3333333333333335)
+
+>>> ss.split_predicates
+('llevó cabo', 'hiciera mención')
+
+>>> round(ss.mean_dependency_distance, 2)
+2.05
+```
+
+The statistics need a parse: a text is parsed with `es_core_news_sm`, and any other pipeline can be passed in `nlp`.
+
+More in the [documentation](https://sergeyshk.github.io/esTS/stats/syntax_stats/).
+
+</details>
+
+<details>
+<summary><b>Cohesion statistics</b></summary>
+
+<br>
+
+The library measures referential cohesion in the manner of Coh-Metrix and of its Spanish adaptation Coh-Metrix-Esp:
+
+*   the overlap of nouns, of arguments and of content words between adjacent sentences and between all pairs of sentences, binary and proportional
+*   givenness: pronouns, demonstratives and the content words whose lemma was already used
+*   temporal cohesion: the repetition of the tense and of the mood of the verbs of adjacent sentences
+*   the density of 255 Spanish discourse markers by class - causal, adversative, concessive, temporal, additive, conditional, reformulative - and by kind
+
+```python
+>>> from ests import CohesionStats
+
+>>> text = ("El informe fue aprobado por la comisión. Sin embargo, el informe no resuelve el problema. "
+...         "Por lo tanto, la comisión aplazó la decisión.")
+>>> cs = CohesionStats(text)
+
+>>> cs.n_sents, cs.n_words
+(3, 23)
+
+>>> cs.noun_overlap_adjacent, round(cs.p_given, 3)
+(0.5, 0.167)
+
+>>> cs.c_connectors
+{'por lo tanto': 1, 'sin embargo': 1}
+
+>>> round(cs.connectors, 2), round(cs.connectors_causal, 2)
+(86.96, 43.48)
+```
+
+The statistics need the annotation: a text is parsed with `es_core_news_sm`, and any other pipeline can be passed in `nlp`.
+
+More in the [documentation](https://sergeyshk.github.io/esTS/stats/cohesion_stats/).
+
+</details>
+
+<details>
+<summary><b>spaCy components</b></summary>
+
+<br>
+
+Every statistics class is also a component of a pipeline, so a text is annotated and measured in one pass and the statistics travel with the `Doc`:
+
+```python
+>>> import ests
+>>> import spacy
+
+>>> nlp = spacy.load("es_core_news_sm")
+>>> for factory in ("basic", "morph", "syntax"):
+...     _ = nlp.add_pipe(f"ests_{factory}", name=factory, last=True)
+
+>>> nlp.pipe_names[-3:]
+['basic', 'morph', 'syntax']
+
+>>> doc = nlp("El gato duerme en la ventana. Los niños juegan en el parque.")
+>>> doc._.basic.n_words, doc._.morph.pos[:2], doc._.syntax.tree_depth
+(12, ('DET', 'NOUN'), 2.0)
+```
+
+The factories are `ests_basic`, `ests_readability`, `ests_diversity`, `ests_morph`, `ests_syntax` and `ests_cohesion`; the name of the pipe is free and is what the extension is called.
+
+More in the [documentation](https://sergeyshk.github.io/esTS/components/).
+
+</details>
+
 ## Development
 
 The project uses [uv](https://docs.astral.sh/uv/) for dependency management and [ruff](https://docs.astral.sh/ruff/) for linting and formatting.
@@ -326,11 +476,15 @@ Bug reports, ideas and pull requests are welcome - [issues](https://github.com/S
 *   **docs** - project documentation
 *   **ests**:
     *   basic_stats.py - basic text statistics
+    *   cohesion_stats.py - cohesion statistics
+    *   components.py - components of a spaCy pipeline
     *   constants.py - constants of the Spanish language and of the metrics
     *   diversity_stats.py - lexical diversity metrics
     *   exceptions.py - library exceptions
     *   extractors.py - tools for object extraction from a text
+    *   morph_stats.py - morphological statistics
     *   readability_stats.py - readability metrics
+    *   syntax_stats.py - syntactic statistics
     *   syllables.py - syllabification and stress
     *   utils.py - helper tools
 *   **tests** - tests mirroring the package structure