strobengine 0.6.0__tar.gz → 0.7.0__tar.gz

{strobengine-0.6.0 → strobengine-0.7.0}/CHANGELOG.md

@@ -4,6 +4,89 @@ All notable changes to `strobengine` will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [0.7.0] - 2026-09-21
+
+### Bug Fixes
+
+- *(orchestration)* Run aggregator concurrently to prevent bounded channel deadlock
+- *(grpc)* Return explicit ProtoError on invalid hex and base64 payloads
+- *(worker)* Add timeout guards for context creation and session teardown
+- *(cli)* Forward export options from subcommands to _run_load_test
+- *(metrics)* Handle missing PID gracefully in resource monitor sampler
+- *(sse)* Replace fragile unwrap in persistent stream with safe let-else
+- *(cli)* Surface FFI and export errors with friendly messages
+- *(reporter)* Use try/finally for atomic write cleanup in save_report
+
+### Documentation
+
+- *(reporter)* Add cross-language schema references and contract tests
+- *(reports)* Update filename pattern and persistence ownership
+- Document resource monitoring, system_metrics schema, and CLI option
+- Mark connection pool metrics complete and add to JSON schema docs
+
+### Features
+
+- *(ffi)* Expose build_report_artifact_dict for Python artifact parity
+- *(protocols)* Return Result from detect_protocol to eliminate silent fallbacks
+- *(metrics)* Add ResourceMonitor with sampler worker and ResourceSample
+- *(cli)* Wire resource monitor through config and CLI options
+- *(metrics)* Add SystemMetrics struct with aggregated resource stats
+- *(report)* Include system_metrics in TestSummary JSON and ReportArtifact
+- *(reporting)* Format system metrics for terminal and Jinja context
+- *(html)* Add dual-axis Chart.js client resource footprint section
+- *(metrics)* Add DNS resolution and connection reuse tracking
+- *(protocols)* Instrument DNS resolution and socket reuse across engines
+- *(report)* Add connection pool metrics to ReportArtifact and JSON export
+
+### Miscellaneous Tasks
+
+- *(report)* Remove dead writer.rs module and tests
+
+### Refactoring
+
+- *(metrics)* Extract SummaryInput struct for calculate_summary
+- *(cli)* Extract _run_load_test helper and fix E2E test failures
+- *(metrics)* Centralize histogram bucket order via PyO3 constant
+- *(metrics)* Group connection fields into ConnectionMetrics struct
+- *(metrics)* Extract finalize_metrics logic to helper module
+- *(metrics)* Introduce AggregatedMetrics struct
+- *(report)* Align ReportArtifact serde with Python artifact schema
+- *(reporter)* Delegate build_artifact_dict to Rust for schema parity
+- *(reporter)* Make save_report atomic with latest.json pointer
+- *(engine)* Consolidate artifact persistence into StrobEngine.run()
+- *(cli)* Remove duplicate save_report from _output_results
+- *(lib)* Remove artifact write from Rust run_load_test
+- *(protocols)* Replace Box<dyn Any> with typed WorkerSession trait
+- *(config)* Introduce TestConfigBuilder and remove dead option structs
+- *(lib)* Make run_load_profiles accept TestConfig for capability parity
+- *(engine)* Build TestConfig for all execution profiles in Python
+- *(metrics)* Replace unbounded Vec<u128> with HDR Histograms
+- *(lib)* Extract shared build_engine helper from run_load_test/profiles
+
+### Testing
+
+- *(e2e)* Update persistence tests for Python artifact writer
+- *(reporting)* Add schema edge-case and parity tests
+- *(metrics)* Add unit and integration tests for connection pool and DNS metrics
+- *(reporter)* Cover save_report temp-file cleanup
+## [0.6.1] - 2026-09-13
+
+### Bug Fixes
+
+- *(lib)* Remove unnecessary clippy::too_many_arguments suppression
+
+### Features
+
+- *(reporter)* Use dynamic terminal width for histogram bar rendering
+
+### Miscellaneous Tasks
+
+- *(release)* Bump version to 0.6.1
+
+### Refactoring
+
+- *(schema)* Derive LatencyPercentiles from TestSummary via From impl
+- *(engine)* Clone TestSummary before enrichment to prevent in-place mutation
 ## [0.6.0] - 2026-09-09
 
 ### Bug Fixes
@@ -32,6 +115,10 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 - *(metrics)* Add latency jitter, p99.99, and histogram bucketing
 - *(reporter)* Expose extended latency stats in terminal and artifact output
 
+### Miscellaneous Tasks
+
+- *(release)* Bump version to 0.6.0
+
 ### Refactoring
 
 - *(lib)* Extract spawn_worker helper from execute_test

{strobengine-0.6.0 → strobengine-0.7.0}/Cargo.lock

@@ -2,6 +2,12 @@
 # It is not intended for manual editing.
 version = 4
 
+[[package]]
+name = "adler2"
+version = "2.0.1"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "320119579fcad9c21884f5c4861d16174d0e06250625266f50fe6898340abefa"
+
 [[package]]
 name = "aho-corasick"
 version = "1.1.4"
@@ -139,6 +145,12 @@ version = "3.20.3"
 source = "registry+https://github.com/rust-lang/crates.io-index"
 checksum = "72f5acc6cb2ba439de613abc23857ec3d78374d8ed5ac84e9d11336e87da8649"
 
+[[package]]
+name = "byteorder"
+version = "1.5.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "1fd0f2584146f6f2ef48085050886acf353beff7305ebd1ae69500e27c67f64b"
+
 [[package]]
 name = "bytes"
 version = "1.12.1"
@@ -245,6 +257,30 @@ dependencies = [
  "libc",
 ]
 
+[[package]]
+name = "crc32fast"
+version = "1.5.2"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "01a7799fd6b852db0e61728dde9a204c423b44d689dbd432522543614b490e78"
+dependencies = [
+ "cfg-if",
+]
+
+[[package]]
+name = "crossbeam-channel"
+version = "0.5.17"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "98b0cc327b5bc766e7fda9c9260cc0fa81b43a8e240440422dff70788e3f9ef1"
+dependencies = [
+ "crossbeam-utils",
+]
+
+[[package]]
+name = "crossbeam-utils"
+version = "0.8.23"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "a31eee39dddec8330830986fcd7625edb5a24ec90ea038215273bbc3adb08ac6"
+
 [[package]]
 name = "crypto-common"
 version = "0.1.7"
@@ -328,6 +364,17 @@ version = "0.1.9"
 source = "registry+https://github.com/rust-lang/crates.io-index"
 checksum = "5baebc0774151f905a1a2cc41989300b1e6fbb29aff0ceffa1064fdd3088d582"
 
+[[package]]
+name = "flate2"
+version = "1.1.10"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "6e634e2e0ebac1ee034020da1ca582e17ffe4e0f5e985823721e168928136dcb"
+dependencies = [
+ "crc32fast",
+ "miniz_oxide",
+ "zlib-rs",
+]
+
 [[package]]
 name = "fnv"
 version = "1.0.7"
@@ -539,6 +586,20 @@ version = "0.17.1"
 source = "registry+https://github.com/rust-lang/crates.io-index"
 checksum = "ed5909b6e89a2db4456e54cd5f673791d7eca6732202bbf2a9cc504fe2f9b84a"
 
+[[package]]
+name = "hdrhistogram"
+version = "7.6.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "f49d1053f4708f0af3cf9fc5bffc7e68a914a3c45becb231c80068c9c3f78bea"
+dependencies = [
+ "base64",
+ "byteorder",
+ "crossbeam-channel",
+ "flate2",
+ "nom",
+ "num-traits",
+]
+
 [[package]]
 name = "heck"
 version = "0.5.0"
@@ -1049,6 +1110,16 @@ version = "0.3.17"
 source = "registry+https://github.com/rust-lang/crates.io-index"
 checksum = "6877bb514081ee2a7ff5ef9de3281f14a4dd4bceac4c09388074a6b5df8a139a"
 
+[[package]]
+name = "miniz_oxide"
+version = "0.9.1"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "b63fbc4a50860e98e7b2aa7804ded1db5cbc3aff9193adaff57a6931bf7c4b4c"
+dependencies = [
+ "adler2",
+ "simd-adler32",
+]
+
 [[package]]
 name = "mio"
 version = "1.2.2"
@@ -1060,6 +1131,24 @@ dependencies = [
  "windows-sys 0.61.2",
 ]
 
+[[package]]
+name = "nom"
+version = "8.0.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "df9761775871bdef83bee530e60050f7e54b1105350d6884eb0fb4f46c2f9405"
+dependencies = [
+ "memchr",
+]
+
+[[package]]
+name = "ntapi"
+version = "0.4.3"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "c3b335231dfd352ffb0f8017f3b6027a4917f7df785ea2143d8af2adc66980ae"
+dependencies = [
+ "winapi",
+]
+
 [[package]]
 name = "nu-ansi-term"
 version = "0.50.3"
@@ -1078,6 +1167,15 @@ dependencies = [
  "autocfg",
 ]
 
+[[package]]
+name = "objc2-core-foundation"
+version = "0.3.2"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "2a180dd8642fa45cdb7dd721cd4c11b1cadd4929ce112ebd8b9f5803cc79d536"
+dependencies = [
+ "bitflags",
+]
+
 [[package]]
 name = "once_cell"
 version = "1.21.4"
@@ -1739,6 +1837,12 @@ dependencies = [
  "libc",
 ]
 
+[[package]]
+name = "simd-adler32"
+version = "0.3.10"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "3a219298ac11a56ea9a6d2120044824d6f01aeb034955e7af7bc16858527deea"
+
 [[package]]
 name = "simd_cesu8"
 version = "1.2.0"
@@ -1785,7 +1889,7 @@ checksum = "6ce2be8dc25455e1f91df71bfa12ad37d7af1092ae736f3a6cd0e37bc7810596"
 
 [[package]]
 name = "strobengine"
-version = "0.6.0"
+version = "0.7.0"
 dependencies = [
  "async-trait",
  "base64",
@@ -1794,6 +1898,7 @@ dependencies = [
  "futures-util",
  "h3",
  "h3-quinn",
+ "hdrhistogram",
  "hex",
  "http",
  "indicatif",
@@ -1807,6 +1912,7 @@ dependencies = [
  "reqwest",
  "serde",
  "serde_json",
+ "sysinfo",
  "tokio",
  "tokio-stream",
  "tokio-tungstenite",
@@ -1867,6 +1973,19 @@ dependencies = [
  "syn 2.0.119",
 ]
 
+[[package]]
+name = "sysinfo"
+version = "0.34.2"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "a4b93974b3d3aeaa036504b8eefd4c039dced109171c1ae973f1dc63b2c7e4b2"
+dependencies = [
+ "libc",
+ "memchr",
+ "ntapi",
+ "objc2-core-foundation",
+ "windows",
+]
+
 [[package]]
 name = "target-lexicon"
 version = "0.13.5"
@@ -2420,6 +2539,22 @@ dependencies = [
  "rustls-pki-types",
 ]
 
+[[package]]
+name = "winapi"
+version = "0.3.9"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "5c839a674fcd7a98952e593242ea400abe93992746761e38641405d28b00f419"
+dependencies = [
+ "winapi-i686-pc-windows-gnu",
+ "winapi-x86_64-pc-windows-gnu",
+]
+
+[[package]]
+name = "winapi-i686-pc-windows-gnu"
+version = "0.4.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "ac3b87c63620426dd9b991e5ce0329eff545bccbbb34f3be09ff6fb6ab51b7b6"
+
 [[package]]
 name = "winapi-util"
 version = "0.1.11"
@@ -2429,12 +2564,71 @@ dependencies = [
  "windows-sys 0.61.2",
 ]
 
+[[package]]
+name = "winapi-x86_64-pc-windows-gnu"
+version = "0.4.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "712e227841d057c1ee1cd2fb22fa7e5a5461ae8e48fa2ca79ec42cfc1931183f"
+
+[[package]]
+name = "windows"
+version = "0.57.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "12342cb4d8e3b046f3d80effd474a7a02447231330ef77d71daa6fbc40681143"
+dependencies = [
+ "windows-core",
+ "windows-targets",
+]
+
+[[package]]
+name = "windows-core"
+version = "0.57.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "d2ed2439a290666cd67ecce2b0ffaad89c2a56b976b736e6ece670297897832d"
+dependencies = [
+ "windows-implement",
+ "windows-interface",
+ "windows-result",
+ "windows-targets",
+]
+
+[[package]]
+name = "windows-implement"
+version = "0.57.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "9107ddc059d5b6fbfbffdfa7a7fe3e22a226def0b2608f72e9d552763d3e1ad7"
+dependencies = [
+ "proc-macro2",
+ "quote",
+ "syn 2.0.119",
+]
+
+[[package]]
+name = "windows-interface"
+version = "0.57.0"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "29bee4b38ea3cde66011baa44dba677c432a78593e202392d1e9070cf2a7fca7"
+dependencies = [
+ "proc-macro2",
+ "quote",
+ "syn 2.0.119",
+]
+
 [[package]]
 name = "windows-link"
 version = "0.2.1"
 source = "registry+https://github.com/rust-lang/crates.io-index"
 checksum = "f0805222e57f7521d6a62e36fa9163bc891acd422f971defe97d64e70d0a4fe5"
 
+[[package]]
+name = "windows-result"
+version = "0.1.2"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "5e383302e8ec8515204254685643de10811af0ed97ea37210dc26fb0032647f8"
+dependencies = [
+ "windows-targets",
+]
+
 [[package]]
 name = "windows-sys"
 version = "0.52.0"
@@ -2632,6 +2826,12 @@ dependencies = [
  "syn 2.0.119",
 ]
 
+[[package]]
+name = "zlib-rs"
+version = "0.6.8"
+source = "registry+https://github.com/rust-lang/crates.io-index"
+checksum = "b268e58e7c693d7c271f93ffc4ba3b380412554231c85bf61ca7af91042a4112"
+
 [[package]]
 name = "zmij"
 version = "1.0.23"

{strobengine-0.6.0 → strobengine-0.7.0}/Cargo.toml

@@ -1,6 +1,6 @@
 [package]
 name = "strobengine"
-version = "0.6.0"
+version = "0.7.0"
 edition = "2024"
 readme = "README.md"
 
@@ -44,3 +44,5 @@ quinn = { version = "0.11", default-features = false, features = ["runtime-tokio
 h3 = "0.0.8"
 h3-quinn = "0.0.10"
 webpki-roots = "0.26"
+hdrhistogram = "7"
+sysinfo = "0.34"

{strobengine-0.6.0 → strobengine-0.7.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: strobengine
-Version: 0.6.0
+Version: 0.7.0
 Requires-Dist: rich>=13.0.0
 Requires-Dist: typer>=0.27.0
 Requires-Dist: jinja2>=3.1

{strobengine-0.6.0 → strobengine-0.7.0}/docs/cli.md

@@ -45,6 +45,7 @@ By default, this spawns **10 concurrent workers** for **10 seconds** with a **10
 | `--quic-max-idle-timeout` | none | QUIC max idle timeout in ms |
 | `--sse/--no-sse` | off | Enable SSE streaming mode |
 | `--sse-max-events` | none | Maximum events to receive per connection |
+| `--sys-sample-interval` | `1000` | Resource monitor sample interval in ms (0 to disable) |
 
 ## Stress Subcommand Options
 
@@ -79,6 +80,7 @@ By default, this spawns **10 concurrent workers** for **10 seconds** with a **10
 | `--quic-max-idle-timeout` | none | QUIC max idle timeout in ms |
 | `--sse/--no-sse` | off | Enable SSE streaming mode |
 | `--sse-max-events` | none | Maximum events to receive per connection |
+| `--sys-sample-interval` | `1000` | Resource monitor sample interval in ms (0 to disable) |
 
 ## Spike Subcommand Options
 
@@ -114,6 +116,7 @@ By default, this spawns **10 concurrent workers** for **10 seconds** with a **10
 | `--quic-max-idle-timeout` | none | QUIC max idle timeout in ms |
 | `--sse/--no-sse` | off | Enable SSE streaming mode |
 | `--sse-max-events` | none | Maximum events to receive per connection |
+| `--sys-sample-interval` | `1000` | Resource monitor sample interval in ms (0 to disable) |
 
 ## Global Options
 

{strobengine-0.6.0 → strobengine-0.7.0}/docs/reports.md

@@ -12,12 +12,12 @@ to disk by default.
 | Property | Value |
 |----------|-------|
 | Default directory | `./.strobengine/reports/` |
-| Filename pattern | `report_YYYYMMDD_HHMMSS_<host>.json` |
+| Filename pattern | `{timestamp}_{slug}.json` (e.g., `2026-08-28T10_00_00+00_00_localhost_8080.json`) |
 | Atomic writes | Yes — tmp file + rename prevents corruption |
 | `latest.json` pointer | Yes — tracks most recent report |
 
-Reports are written by both the Rust engine (`run_load_test`) and
-the Python reporter (`save_report`).
+Reports are written by the Python reporter (`save_report`) inside
+`StrobEngine.run()` with atomic writes and `latest.json` pointer management.
 
 ## Configuration Flags
 
@@ -47,6 +47,8 @@ These flags appear on all three subcommands (`load`, `stress`, `spike`):
 | `quic` | `zero_rtt_accepted_count`, `retransmissions`, `avg_handshake_ms` *(HTTP/3 only)* |
 | `sse` | `total_events_received`, `avg_ttfb_ms` *(SSE only)* |
 | `chaos_faults` | `injected_total`, `by_type` *(chaos-enabled runs only)* |
+| `system_metrics` | `summary` (peak/avg CPU, memory MB, threads), `samples` (time series) *(when `--sys-sample-interval > 0`)* |
+| `connection_pool` | `socket_creation_rate`, `socket_reuse_rate`, `dns_lookup_ms` *(when requests > 0)* |
 
 All latency values are stored in **microseconds**.
 
@@ -74,6 +76,24 @@ All latency values are stored in **microseconds**.
       "LatencySpike": 4,
       "CorruptedPayload": 3
     }
+  },
+  "system_metrics": {
+    "summary": {
+      "peak_cpu_percent": 45.2,
+      "avg_cpu_percent": 18.1,
+      "peak_memory_mb": 64.5,
+      "avg_memory_mb": 52.3,
+      "peak_threads": 32
+    },
+    "samples": [
+      { "elapsed_sec": 1.0, "cpu_percent": 12.4, "memory_mb": 42.1, "threads": 16 },
+      { "elapsed_sec": 2.0, "cpu_percent": 24.8, "memory_mb": 51.0, "threads": 28 }
+    ]
+  },
+  "connection_pool": {
+    "socket_creation_rate": 0.25,
+    "socket_reuse_rate": 0.75,
+    "dns_lookup_ms": 1.5
   }
 }
 ```
@@ -99,6 +119,7 @@ strobengine load http://localhost:8080/api -c 10 -d 30 --html report.html
 - **Dark theme** — slate/navy color palette
 - **Bar chart**: Latency percentiles (P50, P90, P95, P99) in milliseconds
 - **Doughnut chart**: Status code distribution (2xx, 4xx, 5xx, Other)
+- **Line chart**: Client resource footprint (CPU % + Memory RSS, dual-axis) when `--sys-sample-interval > 0`
 - **Metadata grid**: Target URL, method, concurrency, duration, RPS, error rate
 
 ### Python API

{strobengine-0.6.0 → strobengine-0.7.0}/docs/roadmap.md

@@ -33,7 +33,7 @@ This document outlines the planned trajectory and upcoming feature epics for **s
 
 - [x] Interactive CLI progress indicators (live RPS, active virtual users, latency feed). `[v0.2.0]`
 - [ ] ~~Real-time telemetry dashboard / TUI integration.~~ *(Postponed: Python scripting is primary runner; CLI is for quick drafts only)*
-- [ ] ~~Improved streaming metrics collection to minimize memory overhead during long runs.~~ *(Deferred until $O(1)$ memory metrics are required for multi-hour runs)*
+- [ ] ~~Improved streaming metrics collection to minimize memory overhead during long runs.~~ *(Completed: replaced unbounded Vec<u128> with hdrhistogram::Histogram<u64> for O(1) memory)*
 
 ---
 
@@ -100,14 +100,14 @@ This document outlines the planned trajectory and upcoming feature epics for **s
   - [x] Add p99.99 percentile
   - [x] Add latency histogram buckets for distribution visualization
 
-- [ ] **Client System Resource Monitoring** `[v0.7.0]`
-  - [ ] Track engine CPU %, memory (RSS), thread count during test
-  - [ ] Sample at configurable interval (e.g., every 1s)
-  - [ ] Include in JSON report artifact and HTML visualization
+- [x] **Client System Resource Monitoring** `[v0.7.0]`
+  - [x] Track engine CPU %, memory (RSS), thread count during test
+  - [x] Sample at configurable interval via `--sys-sample-interval` (default 1000ms, 0 to disable)
+  - [x] Include in JSON report artifact (`system_metrics` field) and HTML visualization (dual-axis Chart.js line chart)
 
-- [ ] **Connection Pool Metrics** `[v0.7.0]`
-  - [ ] Track socket creation rate vs reuse rate
-  - [ ] Report DNS resolution duration (if instrumentable)
+- [x] **Connection Pool Metrics** `[v0.7.0]`
+  - [x] Track socket creation rate vs reuse rate
+  - [x] Report DNS resolution duration (if instrumentable)
 
 - [ ] **Protocol-Specific Deep Metrics** `[v0.8.0]`
   - [ ] WebSocket: unsolicited pings/pongs, backpressure depth

{strobengine-0.6.0 → strobengine-0.7.0}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "strobengine"
-version = "0.6.0"
+version = "0.7.0"
 description = "A load testing framework with a Python UI and a bare-metal Rust engine core."
 readme = "README.md"
 license = "Apache-2.0"

{strobengine-0.6.0 → strobengine-0.7.0}/src/chaos.rs

@@ -23,7 +23,9 @@ impl ChaosFault {
 
 #[derive(Debug, Clone, Default, serde::Serialize, serde::Deserialize)]
 pub struct ChaosMetrics {
+    #[serde(rename = "injected_total")]
     pub total_injected: u64,
+    #[serde(rename = "by_type")]
     pub faults_by_type: HashMap<String, u64>,
 }