rumdl 0.0.167__tar.gz → 0.0.169__tar.gz

{rumdl-0.0.167 → rumdl-0.0.169}/.pre-commit-config.yaml

@@ -44,6 +44,14 @@ repos:
         pass_filenames: false
         stages: [pre-commit]
 
+      - id: cargo-lock-check
+        name: check Cargo.lock is up-to-date
+        entry: cargo check --locked
+        language: system
+        files: ^(Cargo\.(toml|lock)|.*\.rs)$
+        pass_filenames: false
+        stages: [pre-commit]
+
   # General file quality checks
   - repo: https://github.com/pre-commit/pre-commit-hooks
     rev: v4.6.0
@@ -60,12 +68,12 @@ repos:
       - id: mixed-line-ending
         args: [--fix=lf]
 
-  # Markdown linting using rumdl itself (local binary)
+  # Markdown linting using rumdl itself (cargo run)
   - repo: local
     hooks:
       - id: rumdl
         name: rumdl check
-        entry: ./target/release/rumdl check
+        entry: cargo run --quiet -- check
         language: system
         files: \.md$
         exclude: ^(test_tmp|benchmark/test-data|docs/temp|CHANGELOG\.md)
@@ -101,3 +109,12 @@ repos:
         pass_filenames: false
         stages: [pre-push]
         verbose: true
+
+      - id: cargo-lock-check-push
+        name: verify Cargo.lock is committed and up-to-date
+        entry: cargo check --locked
+        language: system
+        files: ^(Cargo\.(toml|lock)|.*\.rs)$
+        pass_filenames: false
+        stages: [pre-push]
+        verbose: true

{rumdl-0.0.167 → rumdl-0.0.169}/CHANGELOG.md

@@ -7,6 +7,213 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## [Unreleased]
 
+## [0.0.169] - 2025-10-30
+
+### Performance
+
+**MASSIVE PERFORMANCE IMPROVEMENTS**: This release delivers 7-53x faster linting through systematic elimination of O(n²) bottlenecks and algorithmic optimizations. rumdl is now 16-29x faster than markdownlint-cli2 on real-world repositories.
+
+- **Fix catastrophic O(n²) bottleneck in FilteredLinesIter** ⭐ THE GAME CHANGER
+  - Eliminated `content.lines().collect()` from inside Iterator::next() method
+  - Single-file optimization delivered 7,600x speedup for affected rules
+  - MD011: 6.00s → 0.785ms (7,644x faster)
+  - MD012: 5.95s → 1.643ms (3,621x faster)
+  - Impact: Stress test (10k lines): 9,987ms → 187ms (53x faster)
+  - Impact: Rust Book (478 files): 2,646ms → 269ms (9.8x faster)
+  - Impact: PyO3 (76 files): 2,004ms → 262ms (7.6x faster)
+
+- **Pre-compute LintContext data structures to eliminate redundant work**
+  - LineIndex: Eliminated 46× content cloning across all rules
+  - Jinja template ranges: Pre-computed once instead of O(n×m) scanning
+  - Table blocks: Computed once instead of 4× independent scans per document
+  - HTML comment ranges: Pre-computed with 50-70x speedup
+  - Code block line mapping: Optimized with binary search instead of linear scan
+  - Autodoc blocks (MkDocs): Pre-computed to avoid O(n²) scaling
+
+- **Optimize link and image parsing with binary search**
+  - Replaced linear search with binary search for code span checks
+  - Faster link/image parsing across all reference-based rules
+
+- **Replace regex with byte-level parsing for better performance**
+  - List detection: Manual byte scanning instead of regex
+  - Blockquote prefix: Byte-level parsing instead of regex
+  - Line info parsing: Eliminated redundant blockquote prefix parsing
+
+- **Streaming parser architecture**
+  - Replaced AST parsing with pulldown-cmark streaming for lower memory overhead
+  - Better scalability for very large documents
+
+- **MD046 optimization**
+  - Pre-compute list/tab contexts
+  - Use ctx.code_blocks instead of independent detection
+
+### Benchmarks
+
+**vs Previous Version (v0.0.168):**
+- Rust Book (478 files): 2,646ms → 269ms (9.8x faster)
+- Stress Test (10,514 lines): 9,987ms → 187ms (53.4x faster)
+- PyO3 (76 files): 2,004ms → 262ms (7.6x faster)
+
+**vs markdownlint-cli2 (industry standard):**
+- Rust Book: 10.3s vs 0.35s (29.4x faster)
+- PyO3: 4.4s vs 0.26s (16.9x faster)
+
+**Current Performance:**
+- 0.7ms per file (Rust Book)
+- 6.3x parallelization efficiency
+- Zero O(n²) algorithmic bottlenecks remaining
+
+### Added
+
+- **MDX and Quarto flavor support**
+  - New flavors: `MarkdownFlavor::MDX` and `MarkdownFlavor::Quarto`
+  - JSX component handling: Skip linting inside JSX elements
+  - ESM import/export support: Ignore JavaScript import/export statements
+  - Quarto code chunk support: Recognize `{r}`, `{python}` chunk delimiters
+  - Essential for modern React-based documentation and data science workflows
+
+### Fixed
+
+- **MD011: Intelligent URL vs text detection in reversed links**
+  - Smarter classification of link components as URL or text
+  - Reduces false positives in edge cases like `(Generic<T>)[link]`
+  - Correctly handles `(http://url)[text]` vs `(text)[#anchor]`
+  - Improved heuristics for ambiguous single-word patterns
+
+- **MD013: Preserve HTML blocks in list items during reflow**
+  - HTML blocks inside list items are now preserved during auto-fix
+  - Prevents broken indentation and tag structure
+  - Better handling of complex nested content
+
+### Changed
+
+- Architecture improvements for pre-computation pattern
+  - LintContext now owns shared data structures
+  - Rules consume pre-computed data instead of duplicating work
+  - Consistent binary search APIs for range lookups
+  - Foundation for future optimizations
+
+## [0.0.168] - 2025-10-28
+
+### Added
+
+- **CLI: Support for Quarto (.qmd) and RMarkdown (.rmd/.Rmd) files**
+  - Added support for `.qmd` (Quarto), `.rmd` and `.Rmd` (RMarkdown) file extensions
+  - Enables markdown linting for data science and scientific documentation workflows
+  - Particularly useful for Jupyter-based publishing and reproducible research documents
+
+- **LSP: will_save_wait_until for proper auto-fix on save**
+  - Implemented LSP `textDocument/willSaveWaitUntil` capability
+  - Provides proper auto-fix on save support in compatible editors
+  - More reliable than `textDocument/didSave` approach
+  - Ensures fixes are applied before file is actually saved to disk
+
+- **MD033: LSP Quick Fix to remove HTML tags while keeping content**
+  - New code action removes HTML opening and closing tags while preserving inner content
+  - Helps convert inline HTML to plain text when needed
+  - Available through editor Quick Fix menu (Ctrl+. or Cmd+.)
+
+### Fixed
+
+- **MD013: Skip auto-fix for list items containing HTML tags**
+  - Prevents broken auto-fix when HTML tags are present in list items
+  - HTML structure (indentation, tag hierarchy) is now preserved
+  - Errors are still reported but no destructive fix is applied
+  - Pragmatic solution until full HTML-aware reflow is implemented
+  - Fixes issues where tags like `</details>` were split or indentation was lost
+
+- **MD013: Fix incorrect sentence splitting after abbreviations in sentence-per-line mode**
+  - No longer incorrectly splits sentences after common abbreviations (e.g., etc., i.e., Dr., Mr.)
+  - Improved sentence detection algorithm for better accuracy
+  - Prevents unwanted line breaks in the middle of sentences
+
+- **MD013: Prevent autolinks from being parsed as HTML tags**
+  - Autolinks like `<https://example.com>` are no longer treated as HTML
+  - Fixes false positives in HTML detection that could skip auto-fix unnecessarily
+  - Properly distinguishes between markdown autolinks and actual HTML tags
+
+- **MD013: Prevent content duplication in sentence-per-line reflow**
+  - Fixed bug where content could be duplicated during paragraph reflow
+  - Ensures each sentence appears exactly once in reflowed output
+  - Improves reliability of auto-fix in sentence-per-line mode
+
+- **MD013: Improve sentence-per-line error messages and highlighting**
+  - Better error messages that clearly indicate sentence-per-line violations
+  - More accurate highlighting of problematic text
+  - Helps users understand what needs to be fixed
+
+- **MD013: Skip template directives at paragraph start in sentence-per-line mode**
+  - Template directives (like `{{ variable }}`) at start of paragraphs no longer cause issues
+  - Prevents false positives in templated markdown files
+  - Improves compatibility with static site generators and template engines
+
+- **MD013: Treat template directives as paragraph boundaries**
+  - Template directives now properly separate paragraphs during reflow
+  - Prevents template syntax from being joined with regular content
+  - Better handling of mixed template and markdown content
+
+- **MD013: Join single-sentence paragraphs in sentence-per-line mode**
+  - Single-sentence paragraphs that span multiple lines are now properly joined
+  - Fixes issues where short paragraphs were incorrectly flagged
+  - Improves consistency of sentence-per-line formatting
+
+- **MD013: Handle multiple spaces and multi-line paragraphs in sentence-per-line mode**
+  - Better handling of paragraphs with inconsistent spacing
+  - Multi-line paragraphs are now correctly reflowed
+  - Fixes edge cases in whitespace handling
+
+- **MD052: Preserve backtick-wrapped patterns with dots in MkDocs mode**
+  - Backtick-wrapped references like `` `[foo.bar]` `` now preserve dots in slugs
+  - Matches MkDocs behavior of treating code-wrapped text literally
+  - Prevents false positives for code examples in documentation
+
+- **MD052: Support Pandoc citations and inline footnotes in RMarkdown/Quarto**
+  - Recognizes Pandoc citation syntax: `[@citation]`, `@citation`, `[-@citation]`
+  - Recognizes inline footnote syntax: `^[footnote text]`
+  - No longer treats these as reference-style links
+  - Essential for academic and scientific writing in RMarkdown and Quarto
+
+- **MD033: Only report opening HTML tags, not closing tags**
+  - MD033 violations now only report the opening tag of an HTML element
+  - Reduces noise in linting output (one violation per element vs two)
+  - Closing tags like `</div>` are no longer separately reported
+  - Makes HTML-related warnings clearer and less redundant
+
+- **MD018: Skip CSS selectors and JS code inside HTML blocks**
+  - CSS selectors like `#slide-1` inside `<style>` tags no longer trigger MD018
+  - JavaScript code inside `<script>` tags is properly ignored
+  - Prevents false positives for Quarto and RMarkdown files with embedded HTML/CSS/JS
+  - Particularly important for interactive documents and custom styling
+
+- **MD012: Enforce exactly 1 newline at EOF and clean LSP logging**
+  - Files now must end with exactly one newline character (not zero, not two)
+  - Aligns with POSIX standard and common editor behavior
+  - Improved LSP logging with less noise
+
+- **CI: Use cargo run instead of release binary in rumdl pre-commit hook**
+  - Pre-commit hooks now use `cargo run` for more reliable execution
+  - Prevents issues with stale release binaries during development
+  - Better integration with cargo workflow
+
+- **Schema: Allow root-level rule sections like [MD013] in config validation**
+  - Configuration schema now correctly allows `[MD013]` style sections
+  - Fixes false validation errors for valid TOML config
+  - Better compatibility with common configuration patterns
+
+### Changed
+
+- **Refactor: Detect HTML blocks before parsing headings**
+  - Reordered LintContext initialization to detect HTML blocks first
+  - Headings are no longer detected inside HTML blocks (like `<style>` or `<script>`)
+  - Architectural improvement that prevents multiple false positives
+  - Benefits MD018 and other heading-related rules
+  - More correct parsing aligned with markdown specifications
+
+- **Refactor: Use filtered_lines() for front-matter handling in MD011 and MD012**
+  - Improved front-matter handling using consistent filtered_lines API
+  - Better code reuse and maintainability
+  - More reliable front-matter detection across rules
+
 ## [0.0.167] - 2025-10-24
 
 ### Added

{rumdl-0.0.167 → rumdl-0.0.169}/Cargo.lock

@@ -1983,7 +1983,7 @@ dependencies = [
 
 [[package]]
 name = "rumdl"
-version = "0.0.167"
+version = "0.0.169"
 dependencies = [
  "anyhow",
  "assert_cmd",

{rumdl-0.0.167 → rumdl-0.0.169}/Cargo.toml

@@ -1,6 +1,6 @@
 [package]
 name = "rumdl"
-version = "0.0.167"
+version = "0.0.169"
 edition = "2024"
 rust-version = "1.89.0"
 description = "A fast Markdown linter written in Rust (Ru(st) MarkDown Linter)"
@@ -22,26 +22,6 @@ crate-type = ["rlib"]
 name = "rumdl"
 path = "src/main.rs"
 
-[[bench]]
-name = "rule_performance"
-harness = false
-
-[[bench]]
-name = "fix_performance"
-harness = false
-
-[[bench]]
-name = "range_performance"
-harness = false
-
-[[bench]]
-name = "simple_fix_bench"
-harness = false
-
-[[bench]]
-name = "range_utils_benchmark"
-harness = false
-
 [profile.release]
 lto = true           # Enable Link-Time Optimization
 strip = true         # Strip symbols from binary

{rumdl-0.0.167 → rumdl-0.0.169}/Makefile

@@ -115,6 +115,9 @@ fmt:
 	cargo fix --allow-dirty --allow-staged
 
 lint:
+	CARGO_INCREMENTAL=1 cargo clippy --workspace --lib --bins --tests -- -D warnings -D clippy::uninlined_format_args
+
+lint-all:
 	CARGO_INCREMENTAL=1 cargo clippy --all-targets --all-features -- -D warnings -D clippy::uninlined_format_args
 
 lint-fast:

{rumdl-0.0.167 → rumdl-0.0.169}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: rumdl
-Version: 0.0.167
+Version: 0.0.169
 Classifier: Development Status :: 4 - Beta
 Classifier: Environment :: Console
 Classifier: Intended Audience :: Developers

{rumdl-0.0.167 → rumdl-0.0.169}/docs/md013.md

@@ -212,7 +212,11 @@ When `line-length` is set to `0`, no line length warnings will be reported for a
 - Sentence-per-line workflows where line length is not a concern
 - Documentation where long lines (e.g., URLs, technical terms) are unavoidable and acceptable
 
-**Note**: With `line-length: 0`, reflow still works (using a very large effective line length), so you can still use `sentence-per-line` mode for automatic formatting without any line length warnings.
+**Note**: With `line-length: 0` and `reflow-mode: "sentence-per-line"`, rumdl will:
+
+- Split multiple sentences that share a line into separate lines
+- Join single sentences that span multiple lines into one line (since there's no length constraint)
+- Provide consistent "one sentence = one line" formatting throughout your document
 
 ### Example with automatic reflow
 

rumdl-0.0.169/examples/profile_quadratic.rs

@@ -0,0 +1,75 @@
+fn main() {
+    unsafe {
+        std::env::set_var("RUMDL_PROFILE_QUADRATIC", "1");
+    }
+
+    let sep = "=".repeat(80);
+    println!("{}", sep);
+    println!("PROFILING EACH OPERATION AT DIFFERENT SCALES");
+    println!("{}", sep);
+
+    let sizes = vec![
+        (1_000, "1K lines"),
+        (5_000, "5K lines"),
+        (10_000, "10K lines"),
+        (25_000, "25K lines"),
+        (50_000, "50K lines"),
+    ];
+
+    for (target_lines, label) in sizes {
+        let content = create_content(target_lines);
+        let actual_lines = content.lines().count();
+
+        let dash_line = "-".repeat(80);
+        println!("\n{}", dash_line);
+        println!("{} ({} KB, {} lines)", label, content.len() / 1024, actual_lines);
+        println!("{}", dash_line);
+
+        // Run once to see timings
+        let _ = rumdl_lib::lint_context::LintContext::new(&content, rumdl_lib::config::MarkdownFlavor::Standard);
+        println!();
+    }
+}
+
+fn create_content(target_lines: usize) -> String {
+    let patterns = vec![
+        "# Main Heading\n\n",
+        "## Section Heading\n\n",
+        "### Subsection\n\n",
+        "This is a paragraph with `inline code`, **bold text**, and [a link](https://example.com). It contains multiple sentences to make it realistic. Some more text here with *emphasis* and `more code`.\n\n",
+        "- List item 1 with `code` and [link](https://example.com)\n",
+        "- List item 2 with **bold** and *emphasis*\n",
+        "  - Nested item with `more code`\n",
+        "  - Another nested item\n",
+        "- List item 3\n\n",
+        "1. First numbered item with `code`\n",
+        "2. Second item with [reference link][ref1]\n",
+        "3. Third item with **bold text**\n\n",
+        "> Blockquote with `code` and [a link](https://example.com)\n",
+        "> Second line of blockquote with **bold**\n",
+        "> > Nested blockquote with *emphasis*\n\n",
+        "```rust\nfn example() {\n    println!(\"Hello, world!\");\n    let x = 42;\n}\n```\n\n",
+        "```python\ndef example():\n    print('Hello, world!')\n    x = 42\n```\n\n",
+        "| Header 1 | Header 2 with `code` | Header 3 |\n",
+        "|----------|---------------------|----------|\n",
+        "| Cell 1 with `code` | Cell 2 | Cell 3 with [link](https://example.com) |\n",
+        "| Cell 4 | Cell 5 with **bold** | Cell 6 |\n\n",
+        "<!-- This is a comment -->\n\n",
+        "[ref1]: https://example1.com\n",
+        "[ref2]: https://example2.com \"Title\"\n\n",
+        "\n",
+    ];
+
+    let mut content = String::new();
+    let mut line_count = 0;
+    let mut pattern_idx = 0;
+
+    while line_count < target_lines {
+        let pattern = patterns[pattern_idx % patterns.len()];
+        content.push_str(pattern);
+        line_count += pattern.lines().count();
+        pattern_idx += 1;
+    }
+
+    content
+}

{rumdl-0.0.167 → rumdl-0.0.169}/rumdl.schema.json

@@ -1,107 +1,73 @@
 {
   "$schema": "http://json-schema.org/draft-07/schema#",
-  "title": "Config",
-  "description": "rumdl configuration for linting Markdown files. Rules can be configured individually using [MD###] sections with rule-specific options.",
-  "type": "object",
-  "properties": {
-    "global": {
-      "description": "Global configuration options",
-      "default": {
-        "disable": [],
-        "enable": [],
-        "exclude": [],
-        "fixable": [],
-        "flavor": "standard",
-        "force_exclude": false,
-        "include": [],
-        "line_length": 80,
-        "respect_gitignore": true,
-        "unfixable": []
-      },
-      "allOf": [
-        {
-          "$ref": "#/definitions/GlobalConfig"
-        }
-      ]
-    },
-    "per-file-ignores": {
-      "description": "Per-file rule ignores: maps file patterns to lists of rules to ignore Example: { \"README.md\": [\"MD033\"], \"docs/**/*.md\": [\"MD013\"] }",
-      "default": {},
-      "type": "object",
-      "additionalProperties": {
-        "type": "array",
-        "items": {
-          "type": "string"
-        }
-      }
-    }
+  "additionalProperties": {
+    "$ref": "#/definitions/RuleConfig"
   },
   "definitions": {
     "GlobalConfig": {
       "description": "Global configuration options",
-      "type": "object",
       "properties": {
         "disable": {
-          "description": "Disabled rules",
           "default": [],
-          "type": "array",
+          "description": "Disabled rules",
           "items": {
             "type": "string"
-          }
+          },
+          "type": "array"
         },
         "enable": {
-          "description": "Enabled rules",
           "default": [],
-          "type": "array",
+          "description": "Enabled rules",
           "items": {
             "type": "string"
-          }
+          },
+          "type": "array"
         },
         "exclude": {
-          "description": "Files to exclude",
           "default": [],
-          "type": "array",
+          "description": "Files to exclude",
           "items": {
             "type": "string"
-          }
+          },
+          "type": "array"
         },
         "fixable": {
-          "description": "Rules that are allowed to be fixed when --fix is used If specified, only these rules will be fixed",
           "default": [],
-          "type": "array",
+          "description": "Rules that are allowed to be fixed when --fix is used If specified, only these rules will be fixed",
           "items": {
             "type": "string"
-          }
+          },
+          "type": "array"
         },
         "flavor": {
-          "description": "Markdown flavor/dialect to use (mkdocs, gfm, commonmark, etc.) When set, adjusts parsing and validation rules for that specific Markdown variant",
-          "default": "standard",
           "allOf": [
             {
               "$ref": "#/definitions/MarkdownFlavor"
             }
-          ]
+          ],
+          "default": "standard",
+          "description": "Markdown flavor/dialect to use (mkdocs, gfm, commonmark, etc.) When set, adjusts parsing and validation rules for that specific Markdown variant"
         },
         "force_exclude": {
-          "description": "[DEPRECATED] Whether to enforce exclude patterns for explicitly passed paths. This option is deprecated as of v0.0.156 and has no effect. Exclude patterns are now always respected, even for explicitly provided files. This prevents duplication between rumdl config and tool configs like pre-commit.",
           "default": false,
           "deprecated": true,
+          "description": "[DEPRECATED] Whether to enforce exclude patterns for explicitly passed paths. This option is deprecated as of v0.0.156 and has no effect. Exclude patterns are now always respected, even for explicitly provided files. This prevents duplication between rumdl config and tool configs like pre-commit.",
           "type": "boolean"
         },
         "include": {
-          "description": "Files to include",
           "default": [],
-          "type": "array",
+          "description": "Files to include",
           "items": {
             "type": "string"
-          }
+          },
+          "type": "array"
         },
         "line_length": {
-          "description": "Global line length setting (used by MD013 and other rules if not overridden)",
           "default": 80,
-          "type": "integer",
+          "description": "Global line length setting (used by MD013 and other rules if not overridden)",
           "format": "uint64",
-          "minimum": 0.0
+          "minimum": 0.0,
+          "type": "integer"
         },
         "output_format": {
           "description": "Output format for linting results (e.g., \"text\", \"json\", \"pylint\", etc.)",
@@ -111,43 +77,80 @@
           ]
         },
         "respect_gitignore": {
-          "description": "Respect .gitignore files when scanning directories",
           "default": true,
+          "description": "Respect .gitignore files when scanning directories",
           "type": "boolean"
         },
         "unfixable": {
-          "description": "Rules that should never be fixed, even when --fix is used Takes precedence over fixable",
           "default": [],
-          "type": "array",
+          "description": "Rules that should never be fixed, even when --fix is used Takes precedence over fixable",
           "items": {
             "type": "string"
-          }
+          },
+          "type": "array"
         }
-      }
+      },
+      "type": "object"
     },
     "MarkdownFlavor": {
       "description": "Markdown flavor/dialect enumeration",
       "oneOf": [
         {
           "description": "Standard Markdown without flavor-specific adjustments",
-          "type": "string",
           "enum": [
             "standard"
-          ]
+          ],
+          "type": "string"
         },
         {
           "description": "MkDocs flavor with auto-reference support",
-          "type": "string",
           "enum": [
             "mkdocs"
-          ]
+          ],
+          "type": "string"
         }
       ]
     },
     "RuleConfig": {
+      "additionalProperties": true,
       "description": "Represents a rule-specific configuration",
-      "type": "object",
-      "additionalProperties": true
+      "type": "object"
+    }
+  },
+  "description": "rumdl configuration for linting Markdown files. Rules can be configured individually using [MD###] sections with rule-specific options.",
+  "properties": {
+    "global": {
+      "allOf": [
+        {
+          "$ref": "#/definitions/GlobalConfig"
+        }
+      ],
+      "default": {
+        "disable": [],
+        "enable": [],
+        "exclude": [],
+        "fixable": [],
+        "flavor": "standard",
+        "force_exclude": false,
+        "include": [],
+        "line_length": 80,
+        "respect_gitignore": true,
+        "unfixable": []
+      },
+      "description": "Global configuration options"
+    },
+    "per-file-ignores": {
+      "additionalProperties": {
+        "items": {
+          "type": "string"
+        },
+        "type": "array"
+      },
+      "default": {},
+      "description": "Per-file rule ignores: maps file patterns to lists of rules to ignore Example: { \"README.md\": [\"MD033\"], \"docs/**/*.md\": [\"MD013\"] }",
+      "type": "object"
     }
-  }
+  },
+  "title": "Config",
+  "type": "object"
 }