dslop 1.5.1 → 1.5.2

package/CHANGELOG.md

@@ -1,5 +1,17 @@
 # Changelog
 
+## v1.5.2
+
+[compare changes](https://github.com/turf-sports/dslop/compare/v1.5.1...v1.5.2)
+
+### 📖 Documentation
+
+- Update README with AST-based detection details ([2bdb4f4](https://github.com/turf-sports/dslop/commit/2bdb4f4))
+
+### ❤️ Contributors
+
+- Siddharth Sharma <sharmasiddharthcs@gmail.com>
+
 ## v1.5.1
 
 [compare changes](https://github.com/turf-sports/dslop/compare/v1.5.0...v1.5.1)

package/README.md

@@ -36,26 +36,42 @@ dslop --all --cross-package  # cross-package dupes (monorepos)
 
 ## How it works
 
-**Block extraction:** Sliding window over source files. Extracts overlapping blocks at sizes 4, 6, 9, 13... lines. For blocks <10 lines, step=1 (every line). Larger blocks use step=blockSize/2.
+dslop uses two detection methods in parallel:
 
-**Normalization:** Before hashing, code is normalized:
+### 1. AST-based detection (functions/classes)
+
+Parses TypeScript/JavaScript with Babel to extract functions and classes. Normalizes the AST by replacing all identifiers with generic placeholders (`$0`, `$1`, etc.), preserving only the code structure.
+
+**This catches:**
+- Functions with identical logic but different variable names
+- Renamed copies of existing functions
+- Structurally identical classes
+
+Example: `calculateSum(numbers)` and `computeTotal(items)` with the same loop structure will match.
+
+### 2. Text-based detection (code blocks)
+
+Sliding window over source files extracts overlapping blocks at sizes 4, 6, 9, 13... lines. Before hashing, code is normalized:
 - String literals → `"<STRING>"`
 - Numbers → `<NUMBER>`
 - Whitespace collapsed
 - Comments preserved (intentional - comments often indicate copy-paste)
 
-**Matching:** Normalized blocks are hashed. Exact hash matches = exact duplicates. For similar (non-exact) matches, uses character-level similarity on a sample of blocks per hash bucket.
+Exact hash matches = exact duplicates. For similar (non-exact) matches, uses character-level similarity.
+
+### Changed-line filtering (default mode)
+
+Parses `git diff` output to get exact line ranges of your changes. Only reports duplicates where your changed lines match code elsewhere in the codebase.
 
-**Declaration detection** (`--all` mode): Regex-based extraction of types, interfaces, functions, classes. Compares by name similarity (Levenshtein + word overlap) and content similarity.
+### Declaration detection (`--all` mode)
 
-**Changed-line filtering** (default mode): Parses `git diff` output to get exact line ranges. Only reports duplicates where your changed lines match code elsewhere.
+Regex-based extraction of types, interfaces, enums. Compares by name similarity (Levenshtein + word overlap) and content similarity.
 
 ## Limitations
 
-- **Text-based, not AST:** Doesn't understand code structure. A reformatted function won't match the original. Two semantically identical functions with different variable names won't match.
-- **TypeScript/JavaScript focused:** Default extensions are ts/tsx/js/jsx. Works on any text but tuned for JS-like syntax.
+- **TypeScript/JavaScript only for AST:** AST parsing uses Babel with TS/JSX plugins. Other languages fall back to text-based only.
 - **No cross-language:** Won't detect a Python function duplicated in TypeScript.
-- **Comments affect matching:** Intentional tradeoff. Copy-pasted code often includes comments.
+- **Comments affect text matching:** Intentional tradeoff. Copy-pasted code often includes comments.
 - **Declaration detection is regex:** Can miss edge cases like multi-line generics or decorators.
 - **Minimum 4 lines:** Shorter duplicates ignored to reduce noise. Use `-m 2` for stricter.
 - **Memory:** Loads all blocks in memory. Very large codebases (>1M lines) may be slow.

package/dist/index.cjs

@@ -51724,7 +51724,7 @@ async function scanDirectory(targetPath, options, enableAST = true) {
 }
 
 // index.ts
-var VERSION = process.env.npm_package_version || "1.5.1";
+var VERSION = process.env.npm_package_version || "1.5.2";
 function parseDiffOutput(diff, cwd) {
   const changes = /* @__PURE__ */ new Map();
   let currentFile = null;

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "dslop",
-  "version": "1.5.1",
+  "version": "1.5.2",
   "description": "Detect Similar/Duplicate Lines Of Programming - Find code duplication in your codebase",
   "type": "module",
   "main": "./dist/index.cjs",