dslop 1.0.6 → 1.1.0

package/CHANGELOG.md

@@ -1,32 +1,19 @@
 # Changelog
 
-All notable changes to this project will be documented in this file.
+## v1.1.0
 
-## v1.0.6
-
-[compare changes](https://github.com/turf-sports/dslop/compare/v1.0.5...v1.0.6)
+[compare changes](https://github.com/turf-sports/dslop/compare/v1.0.7...v1.1.0)
 
-### 🏡 Chore
+### 🚀 Enhancements
 
-- Add changelogen for automated changelogs ([7cb82db](https://github.com/turf-sports/dslop/commit/7cb82db))
+- Add --staged flag to check uncommitted changes ([48d66b1](https://github.com/turf-sports/dslop/commit/48d66b1))
 
 ### ❤️ Contributors
 
 - Siddharth Sharma <sharmasiddharthcs@gmail.com>
 
-## v1.0.5
-
-### 🚀 Features
+## v1.0.7
 
-- Initial public release
-- Detect duplicate and similar code blocks across your codebase
-- Smart normalization (strings, numbers, colors) for structural comparison
-- Monorepo mode with `--cross-package` flag
-- JSON output support
-- Configurable similarity threshold and minimum block size
-
-### 📦 Publishing
-
-- Available via `npx dslop`
-- Auto-versioning with changelogs
+## v1.0.6
 
+- Initial release

package/README.md

@@ -1,138 +1,37 @@
 # dslop
 
-**D**etect **S**imilar/**L**ines **O**f **P**rogramming - A fast duplicate code detector.
-
-## Quick Start
-
-Run instantly with npx (no install required):
+Find duplicate code in your codebase.
 
 ```bash
 npx dslop .
 ```
 
-## Installation
+## Install
 
 ```bash
-# Install globally
-npm install -g dslop
-
-# Or with other package managers
-pnpm add -g dslop
-bun add -g dslop
-yarn global add dslop
+npm i -g dslop
 ```
 
 ## Usage
 
 ```bash
-# Scan current directory
-dslop .
-
-# Scan specific directory with options
-dslop ./src -m 6 -s 80
-
-# Only show duplicates across packages (great for monorepos)
-dslop . --cross-package
-
-# Output as JSON
-dslop . --json
-```
-
-Or run without installing:
-
-```bash
-npx dslop .
-bunx dslop .
-pnpm dlx dslop .
+dslop .                      # scan current directory
+dslop --staged               # check uncommitted changes for dupes
+dslop ./src -m 6 -s 80       # 6 line min, 80% similarity  
+dslop . --cross-package      # only cross-package dupes (monorepos)
+dslop . --json               # json output
 ```
 
 ## Options
 
-| Option | Short | Default | Description |
-|--------|-------|---------|-------------|
-| `--min-lines` | `-m` | 4 | Minimum block size in lines |
-| `--similarity` | `-s` | 70 | Minimum similarity threshold (0-100) |
-| `--extensions` | `-e` | ts,tsx,js,jsx | File extensions to scan |
-| `--ignore` | `-i` | node_modules,dist,... | Patterns to ignore |
-| `--no-normalize` | | | Disable string/number normalization |
-| `--json` | | | Output as JSON |
-| `--help` | `-h` | | Show help |
-| `--version` | `-v` | | Show version |
-
-## How It Works
-
-1. **Scanning**: Recursively scans files matching the specified extensions
-2. **Block Extraction**: Extracts code blocks using a sliding window approach at multiple granularities
-3. **Normalization**: Replaces string literals, numbers, and colors with placeholders for structural comparison
-4. **Hash Grouping**: Groups exact duplicates by hash for fast matching
-5. **Similarity Matching**: Uses Jaccard similarity on line sets for near-duplicates
-6. **Filtering**: Removes overlapping blocks and deduplicates groups
-
-## Monorepo Mode
-
-Use `--cross-package` to find duplicates that span across different packages/apps - perfect for identifying code that should be moved to a shared library:
-
-```bash
-dslop . --cross-package
-```
-
-This filters results to only show duplicates where occurrences are in different `apps/`, `packages/`, or `libs/` directories.
-
-## Example Output
-
-```
-Scanning ./src...
-  Extensions: ts, tsx, js, jsx
-  Min block size: 4 lines
-  Similarity threshold: 70%
-  Normalization: enabled
-
-Scanned 81 files (15,672 lines) in 129ms
-Extracted 13,920 code blocks
-
-Found 500 duplicate groups in 51ms
-
-────────────────────────────────────────────────────────────────────────────────
-DUPLICATE CODE DETECTED
-────────────────────────────────────────────────────────────────────────────────
-
-Group 1 │ EXACT │ 28 lines × 2 occurrences = 56 lines of duplication
-
-  ├─ QuarterlyWinnerMessagePreview.tsx:197-224
-  ├─ CoachEnteredMessagePreview.tsx:113-140
-
-  Code preview:
-  │ <View style={{
-  │   backgroundColor: "white",
-  │   ...
-
-SUMMARY
-────────────────────────────────────────────────────────────────────────────────
-  Total duplicate groups:    500
-  Exact matches:             450
-  Similar matches:           50
-  Files affected:            65
-  Total duplicate lines:     12,340
-  Average similarity:        95%
-```
-
-## Development
-
-```bash
-# Clone and install
-git clone https://github.com/turf-sports/dslop.git
-cd dslop
-bun install
-
-# Run in dev mode
-bun run dev
-
-# Build for npm
-bun run build
-
-# Create standalone binary
-bun run build:binary
-```
+| Flag | Default | Description |
+|------|---------|-------------|
+| `-m, --min-lines` | 4 | min lines per block |
+| `-s, --similarity` | 70 | similarity threshold (0-100) |
+| `-e, --extensions` | ts,tsx,js,jsx | file extensions |
+| `--staged` | | only show dupes involving uncommitted changes |
+| `--cross-package` | | only show dupes across packages |
+| `--json` | | json output |
 
 ## License
 

package/dist/index.js

@@ -2,6 +2,8 @@
 
 // index.ts
 import { parseArgs } from "util";
+import { execSync } from "child_process";
+import path4 from "path";
 
 // src/constants.ts
 var DEFAULT_MIN_LINES = 4;
@@ -6559,7 +6561,27 @@ async function scanDirectory(targetPath, options) {
 }
 
 // index.ts
-var VERSION = process.env.npm_package_version || "1.0.6";
+var VERSION = process.env.npm_package_version || "1.1.0";
+function getChangedFiles(targetPath) {
+  const absolutePath = path4.resolve(targetPath);
+  try {
+    const staged = execSync("git diff --cached --name-only", { cwd: absolutePath, encoding: "utf-8" });
+    const unstaged = execSync("git diff --name-only", { cwd: absolutePath, encoding: "utf-8" });
+    const untracked = execSync("git ls-files --others --exclude-standard", { cwd: absolutePath, encoding: "utf-8" });
+    const files = new Set;
+    for (const file of [...staged.split(`
+`), ...unstaged.split(`
+`), ...untracked.split(`
+`)]) {
+      if (file.trim()) {
+        files.add(path4.resolve(absolutePath, file.trim()));
+      }
+    }
+    return files;
+  } catch {
+    return new Set;
+  }
+}
 function showHelp() {
   console.log(`
 dslop - Detect Similar/Duplicate Lines Of Programming
@@ -6575,6 +6597,7 @@ Options:
   -s, --similarity <n>  Minimum similarity threshold 0-100 (default: ${Math.round(DEFAULT_SIMILARITY * 100)})
   -e, --extensions <s>  File extensions to scan (default: ${DEFAULT_EXTENSIONS.join(",")})
   -i, --ignore <s>      Patterns to ignore (default: ${DEFAULT_IGNORE_PATTERNS.slice(0, 4).join(",")},...)
+  --staged              Only show duplicates involving uncommitted changes
   --no-normalize        Disable string/number normalization
   --cross-package       Only show duplicates across different packages/apps (monorepo mode)
   --json                Output as JSON
@@ -6583,8 +6606,8 @@ Options:
 
 Examples:
   dslop .                          Scan current directory
+  dslop --staged                   Check uncommitted changes for duplicates
   dslop ./src -m 6 -s 80           Scan src with 6 line min, 80% similarity
-  dslop . -e ts,tsx --json         Scan TypeScript files, output JSON
   dslop . --cross-package          Only duplicates across packages (great for monorepos)
 `);
 }
@@ -6601,6 +6624,7 @@ async function main() {
       ignore: { type: "string", short: "i", default: DEFAULT_IGNORE_PATTERNS.join(",") },
       normalize: { type: "boolean", default: true },
       "no-normalize": { type: "boolean", default: false },
+      staged: { type: "boolean", default: false },
       "cross-package": { type: "boolean", default: false },
       json: { type: "boolean", default: false },
       help: { type: "boolean", short: "h", default: false },
@@ -6622,6 +6646,7 @@ async function main() {
   const extensions = values.extensions.split(",").map((e) => e.trim());
   const ignorePatterns = values.ignore.split(",").map((p) => p.trim());
   const normalize2 = !values["no-normalize"];
+  const staged = values.staged;
   const crossPackage = values["cross-package"];
   const jsonOutput = values.json;
   if (minLines < 2) {
@@ -6638,14 +6663,23 @@ async function main() {
     minLines,
     normalize: normalize2
   };
+  const changedFiles = staged ? getChangedFiles(targetPath) : null;
+  if (staged && changedFiles?.size === 0) {
+    console.log(`
+No uncommitted changes found.`);
+    process.exit(0);
+  }
   console.log(`
 Scanning ${targetPath}...`);
   console.log(`  Extensions: ${extensions.join(", ")}`);
   console.log(`  Min block size: ${minLines} lines`);
   console.log(`  Similarity threshold: ${Math.round(similarity * 100)}%`);
   console.log(`  Normalization: ${normalize2 ? "enabled" : "disabled"}`);
+  if (staged) {
+    console.log(`  Staged mode: checking ${changedFiles.size} changed files against codebase`);
+  }
   if (crossPackage) {
-    console.log(`  Cross-package mode: enabled (only showing duplicates across different packages/apps)`);
+    console.log(`  Cross-package mode: enabled`);
   }
   console.log();
   try {
@@ -6662,6 +6696,9 @@ Scanning ${targetPath}...`);
     const detectStart = performance.now();
     let duplicates = findDuplicates(blocks, similarity, targetPath);
     const detectTime = performance.now() - detectStart;
+    if (staged && changedFiles) {
+      duplicates = duplicates.filter((group) => group.matches.some((m) => changedFiles.has(m.filePath)));
+    }
     if (crossPackage) {
       duplicates = duplicates.filter((group) => {
         const packages = new Set(group.matches.map((m) => {
@@ -6674,7 +6711,13 @@ Scanning ${targetPath}...`);
     console.log(`Found ${duplicates.length} duplicate groups in ${Math.round(detectTime)}ms
 `);
     if (duplicates.length === 0) {
-      console.log(crossPackage ? "No cross-package duplicates found!" : "No duplicates found!");
+      if (staged) {
+        console.log("No duplicates in your changes. You're good!");
+      } else if (crossPackage) {
+        console.log("No cross-package duplicates found!");
+      } else {
+        console.log("No duplicates found!");
+      }
       process.exit(0);
     }
     if (jsonOutput) {

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "dslop",
-  "version": "1.0.6",
+  "version": "1.1.0",
   "description": "Detect Similar/Duplicate Lines Of Programming - Find code duplication in your codebase",
   "type": "module",
   "main": "./dist/index.js",