sftp-push-sync 2.5.0 → 3.0.1

package/CHANGELOG.md

@@ -1,15 +1,23 @@
 # Changelog
 
-## [2.4.0] - 2026-03-04
+## [3.0.1] - 2026-03-05
+
+- stability improvements especialy during large and longtime uploads, error handling, log with datetime.
+
+## [3.0.0] - 2026-03-04
+
+- Switched from JSON-file based hash cache to NDJSON-based Cache-implementation.
+- Disk-based, only active entries in RAM
+- Scales to 100,000+ files without memory issues
+- Auto-persist (no explicit saving required)
+- Auto-migration - Existing JSON cache is automatically migrated
+
+## [2.5.0] - 2026-03-04
 
 - Parallel remote walker walkers.mjs: scans 8 directories simultaneously
 - Batch analysis with concurrency compare.mjs: 8 file comparisons in parallel
 - Parallel hash calculation: local + remote hash simultaneously
-- Keep-alive: SftpPushSyncApp.mjs prevents server disconnection
-
-## [2.3.0] - 2026-03-04
-
-- Keep-Alive enabled - a Keep-Alive packet is sent every 10 seconds.
+- Keep-alive: SftpPushSyncApp.mjs prevents server disconnection. A Keep-Alive packet is sent every 10 seconds.
 
 ## [2.1.0] - 2025-11-19
 

package/README.md

@@ -19,13 +19,18 @@ Features:
 - adds, updates, deletes files
 - text diff detection
 - Binary files (images, video, audio, PDF, etc.): SHA-256 hash comparison
-- Hashes are cached in .sync-cache.*.json
+- Hashes are cached in `.sync-cache.*.ndjson`
 - Parallel uploads/deletions via worker pool
 - include/exclude patterns
 - Sidecar uploads / downloads - Bypassing the sync process
 
 The file `sftp-push-sync.mjs` is pure JavaScript (ESM), not TypeScript. Node.js can execute it directly as long as "type": "module" is specified in package.json or the file has the extension .mjs.
 
+## Breaking changes in 3.0.0
+
+- New Cache Mechanism: NDJSON instead of JSON.
+- The cache can now handle any number of files.
+
 ## Breaking changes in 2.0.0
 
 - The flags `--upload-list` / `--download-list` have been replaced by
@@ -99,6 +104,7 @@ Create a `sync.config.json` in the root folder of your project:
     "analyzeChunk": 1
   },
   "logLevel": "normal",
+  "logTimestamps": false,
   "logFile": ".sftp-push-sync.{target}.log"
 }
 ```
@@ -199,6 +205,7 @@ sftp-push-sync prod --sidecar-download --skip-sync
 Logging can also be configured.
 
 - `logLevel` - normal, verbose, laconic.
+- `logTimestamps` - true/false. When enabled, each log line is prefixed with a timestamp `[YYYY-MM-DD HH:mm:ss.SSS]`.
 - `logFile` - an optional logFile.
 - `scanChunk` - After how many elements should a log output be generated during scanning?
 - `analyzeChunk` - After how many elements should a log output be generated during analysis?
@@ -253,12 +260,12 @@ However, it should also manage directories:
 
 ## Which files are created?
 
-- The cache files: `.sync-cache.*.json`
+- The cache files: `.sync-cache.*.ndjson`. The old ones can be deleted: `.sync-cache.*.json`
 - The log file: `.sftp-push-sync.{target}.log` (Optional, overwritten with each run)
 
 You can safely delete the local cache at any time. The first analysis will then take longer, because remote hashes will be streamed again. After that, everything will run fast.
 
-Note 1: The first run always takes a while, especially with lots of media – so be patient! Once the cache is full, it will be faster. 
+Note 1: The first run always takes a while, especially with lots of media – so be patient! Once the cache is full, it will be faster.
 Note 2: Reliability and accuracy are more important to me than speed.
 
 ## Example Output
@@ -270,4 +277,4 @@ Note 2: Reliability and accuracy are more important to me than speed.
 - <https://www.npmjs.com/package/sftp-push-sync>
 - <https://github.com/cnichte/sftp-push-sync>
 - <https://www.npmjs.com/package/hugo-toolbox>
-- <https://carsten-nichte.de>
+- <https://carsten-nichte.de>

package/bin/sftp-push-sync.mjs

@@ -80,6 +80,7 @@ let DRY_RUN = false;
 let RUN_UPLOAD_LIST = false;
 let RUN_DOWNLOAD_LIST = false;
 let SKIP_SYNC = false;
+let SIZE_ONLY = false;
 let cliLogLevel = null;
 let configPath = undefined;
 
@@ -92,6 +93,9 @@ for (let i = 0; i < rest.length; i += 1) {
     case "--dry-run":
       DRY_RUN = true;
       break;
+    case "--size-only":
+      SIZE_ONLY = true;
+      break;
     case "--sidecar-upload":
       RUN_UPLOAD_LIST = true;
       break;
@@ -196,4 +200,4 @@ main().catch((err) => {
     console.error(err);
   }
   process.exit(1);
-});
+});

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "sftp-push-sync",
-  "version": "2.5.0",
+  "version": "3.0.1",
   "description": "SFTP sync tool for Hugo projects (local to remote, with hash cache)",
   "type": "module",
   "bin": {