strobengine 0.5.2__tar.gz → 0.6.0__tar.gz

{strobengine-0.5.2 → strobengine-0.6.0}/CHANGELOG.md

@@ -4,6 +4,50 @@ All notable changes to `strobengine` will be documented in this file.
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [0.6.0] - 2026-09-09
+
+### Bug Fixes
+
+- *(pyi)* Add QuicMetrics, SseMetrics stubs and missing TestSummary properties
+- *(metrics)* Use serde_json for to_json and add protocol fields to schema
+- *(reporter)* Include protocol sections in JSON report artifact
+- *(reporter)* Use correct chaos_faults structure in JSON artifact
+
+### Documentation
+
+- *(cli)* Document known CLI option duplication across subcommands
+- Update documentation for QuicMetrics and SseMetrics
+- Update roadmap and report schema for chaos fault tracking
+- Update roadmap and report schema for extended latency statistics
+
+### Features
+
+- *(metrics)* Add QuicMetrics, SseMetrics, and connection latency to TestSummary
+- *(aggregator)* Aggregate connection latency, QUIC, and SSE metrics in execute_test
+- *(chaos)* Add ChaosMetrics struct and ChaosFault name helper
+- *(metrics)* Add chaos fields to RequestMetric and TestSummary
+- *(protocols)* Set chaos_fault on RequestMetric in all engines
+- *(aggregator)* Collect chaos metrics in existing Tokio loop
+- *(reports)* Include chaos metrics in JSON report artifact
+- *(metrics)* Add latency jitter, p99.99, and histogram bucketing
+- *(reporter)* Expose extended latency stats in terminal and artifact output
+
+### Refactoring
+
+- *(lib)* Extract spawn_worker helper from execute_test
+- *(config)* Add protocol sub-structs and for_protocol_detection
+- *(lib)* Use for_protocol_detection in run_load_profiles
+- *(cli)* Extract ExportOptions dataclass and deduplicate _output_results
+- *(cli)* Replace 27-param _build_request_options with **kwargs
+- *(reporting)* Extract inline HTML template to separate file
+- *(engine)* Replace nested ternary with dictionary WsMode mapping
+
+### Testing
+
+- *(report)* Update TestSummary test fixture for new metric fields
+- *(e2e)* Add test for SSE metrics JSON export
+- *(e2e)* Add chaos fault tracking verification tests
+- *(e2e)* Add latency stats JSON and terminal output E2E tests
 ## [0.5.2] - 2026-09-02
 
 ### Bug Fixes
@@ -13,6 +57,10 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 - *(reporter)* Replace hardcoded version string with dynamic resolution
 - *(reporting)* Validate baseline artifact structure in compute_comparison
 
+### Miscellaneous Tasks
+
+- *(release)* Bump version to 0.5.2
+
 ### Refactoring
 
 - *(lib)* Remove unnecessary clones on config.body, config.form, config.headers

{strobengine-0.5.2 → strobengine-0.6.0}/Cargo.lock

@@ -1785,7 +1785,7 @@ checksum = "6ce2be8dc25455e1f91df71bfa12ad37d7af1092ae736f3a6cd0e37bc7810596"
 
 [[package]]
 name = "strobengine"
-version = "0.5.2"
+version = "0.6.0"
 dependencies = [
  "async-trait",
  "base64",

{strobengine-0.5.2 → strobengine-0.6.0}/Cargo.toml

@@ -1,6 +1,6 @@
 [package]
 name = "strobengine"
-version = "0.5.2"
+version = "0.6.0"
 edition = "2024"
 readme = "README.md"
 

{strobengine-0.5.2 → strobengine-0.6.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: strobengine
-Version: 0.5.2
+Version: 0.6.0
 Requires-Dist: rich>=13.0.0
 Requires-Dist: typer>=0.27.0
 Requires-Dist: jinja2>=3.1

{strobengine-0.5.2 → strobengine-0.6.0}/docs/http3.md

@@ -123,7 +123,15 @@ The `--http3` flag enables HTTP/3 mode explicitly.
 ## Metrics
 
 HTTP/3 load tests produce the same `TestSummary` metrics as HTTP, plus
-QUIC-specific fields:
+aggregated QUIC metrics in `TestSummary.quic`:
+
+| Field | Description |
+|-------|-------------|
+| `zero_rtt_accepted_count` | Number of successful 0-RTT connections |
+| `retransmissions` | Total QUIC packet retransmissions |
+| `avg_handshake_ms` | Average QUIC handshake duration in milliseconds |
+
+Per-iteration fields available in `RequestMetric`:
 
 | Metric | Description |
 |--------|-------------|
@@ -138,6 +146,7 @@ QUIC-specific fields:
 | `max_latency_ms` | Maximum latency |
 | `total_bytes_received` | Total bytes received |
 | `status_codes` | Status code distribution (200=success, 0=network error) |
+| `avg_connection_latency_us` | Average connection establishment latency in microseconds |
 | `quic_handshake_us` | QUIC handshake duration (persistent sessions) |
 | `quic_0rtt_used` | Whether 0-RTT was accepted (persistent sessions) |
 | `quic_retransmits` | Packet retransmission count since last iteration |

{strobengine-0.5.2 → strobengine-0.6.0}/docs/reports.md

@@ -40,8 +40,13 @@ These flags appear on all three subcommands (`load`, `stress`, `spike`):
 | `cli_options` | `method`, `concurrency`, `timeout_secs`, `chaos`, `chaos_rate`, `body`, `headers` |
 | `system_info` | `hostname`, `platform`, `version` |
 | `summary` | `total_requests`, `successful_requests`, `failed_requests`, `rps`, `bytes_transferred` |
-| `latency_percentiles` | `p50_us`, `p90_us`, `p95_us`, `p99_us`, `min_us`, `max_us`, `mean_us` |
+| `latency_percentiles` | `p50_us`, `p90_us`, `p95_us`, `p99_us`, `p99_99_us`, `min_us`, `max_us`, `mean_us`, `std_dev_us` |
+| `latency_histogram` | Bucket distribution (e.g., `"<1ms": 1240`, `"1-5ms": 750`, ...) |
 | `error_breakdown` | Status code string → count (e.g., `"200": 950, "500": 50`) |
+| `avg_connection_latency_us` | Average connection establishment latency in microseconds |
+| `quic` | `zero_rtt_accepted_count`, `retransmissions`, `avg_handshake_ms` *(HTTP/3 only)* |
+| `sse` | `total_events_received`, `avg_ttfb_ms` *(SSE only)* |
+| `chaos_faults` | `injected_total`, `by_type` *(chaos-enabled runs only)* |
 
 All latency values are stored in **microseconds**.
 
@@ -58,7 +63,18 @@ All latency values are stored in **microseconds**.
   },
   "summary": { "total_requests": 1500, "successful_requests": 1485, "failed_requests": 15, "rps": 50.0, "bytes_transferred": 524288 },
   "latency_percentiles": { "p50_us": 1200.0, "p90_us": 3500.0, "p95_us": 5200.0, "p99_us": 9800.0, "min_us": 200.0, "max_us": 15000.0, "mean_us": 2800.0 },
-  "error_breakdown": { "200": 1485, "500": 15 }
+  "error_breakdown": { "200": 1485, "500": 15 },
+  "avg_connection_latency_us": 850.0,
+  "quic": null,
+  "sse": null,
+  "chaos_faults": {
+    "injected_total": 12,
+    "by_type": {
+      "ConnectionDrop": 5,
+      "LatencySpike": 4,
+      "CorruptedPayload": 3
+    }
+  }
 }
 ```
 

{strobengine-0.5.2 → strobengine-0.6.0}/docs/roadmap.md

@@ -87,18 +87,18 @@ This document outlines the planned trajectory and upcoming feature epics for **s
 ### Epic: Advanced Metrics & Observability
 *Target Focus: Deep Performance Insights & System Monitoring*
 
-- [ ] **Aggregate Existing Protocol Metrics** `[v0.6.0]`
-  - [ ] Forward `connection_latency_us`, `quic_*`, `sse_*` fields through aggregator to `TestSummary`
-  - [ ] Add protocol-specific sections to JSON report artifact
-
-- [ ] **Chaos Fault Tracking** `[v0.6.0]`
-  - [ ] Count injected faults by type (ConnectionDrop, LatencySpike, etc.)
-  - [ ] Include fault breakdown in JSON report artifact
-
-- [ ] **Extended Latency Statistics** `[v0.6.0]`
-  - [ ] Compute latency jitter (standard deviation)
-  - [ ] Add p99.99 percentile
-  - [ ] Add latency histogram buckets for distribution visualization
+- [x] **Aggregate Existing Protocol Metrics** `[v0.6.0]`
+  - [x] Forward `connection_latency_us`, `quic_*`, `sse_*` fields through aggregator to `TestSummary`
+  - [x] Add protocol-specific sections to JSON report artifact
+
+- [x] **Chaos Fault Tracking** `[v0.6.0]`
+  - [x] Count injected faults by type (ConnectionDrop, LatencySpike, etc.)
+  - [x] Include fault breakdown in JSON report artifact
+
+- [x] **Extended Latency Statistics** `[v0.6.0]`
+  - [x] Compute latency jitter (standard deviation)
+  - [x] Add p99.99 percentile
+  - [x] Add latency histogram buckets for distribution visualization
 
 - [ ] **Client System Resource Monitoring** `[v0.7.0]`
   - [ ] Track engine CPU %, memory (RSS), thread count during test

{strobengine-0.5.2 → strobengine-0.6.0}/docs/sse.md

@@ -141,7 +141,14 @@ connection.
 ## Metrics
 
 SSE load tests produce the same `TestSummary` metrics as HTTP, plus
-SSE-specific fields:
+aggregated SSE metrics in `TestSummary.sse`:
+
+| Field | Description |
+|-------|-------------|
+| `total_events_received` | Total SSE events received across all iterations |
+| `avg_ttfb_ms` | Average time to first event in milliseconds |
+
+Per-iteration fields available in `RequestMetric`:
 
 | Metric | Description |
 |--------|-------------|

{strobengine-0.5.2 → strobengine-0.6.0}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "strobengine"
-version = "0.5.2"
+version = "0.6.0"
 description = "A load testing framework with a Python UI and a bare-metal Rust engine core."
 readme = "README.md"
 license = "Apache-2.0"
@@ -31,6 +31,7 @@ features = ["pyo3/extension-module"]
 module-name = "strobengine._strobengine"
 python-packages = ["strobengine"]
 python-source = "src"
+include = ["src/strobengine/reporting/assets/*"]
 
 [tool.uv]
 cache-keys = [{ file = "pyproject.toml" }, { file = "src/**/*.rs" }, { file = "Cargo.toml" }, { file = "Cargo.lock" }]

{strobengine-0.5.2 → strobengine-0.6.0}/src/chaos.rs

@@ -1,3 +1,5 @@
+use std::collections::HashMap;
+
 pub const DEFAULT_CHAOS_RATE: f32 = 0.1;
 
 #[derive(Debug, Clone, Copy)]
@@ -8,6 +10,37 @@ pub enum ChaosFault {
     ConnectionDrop,
 }
 
+impl ChaosFault {
+    pub fn name(&self) -> &'static str {
+        match self {
+            ChaosFault::LatencySpike { .. } => "LatencySpike",
+            ChaosFault::CorruptedPayload => "CorruptedPayload",
+            ChaosFault::MetadataCorruption => "MetadataCorruption",
+            ChaosFault::ConnectionDrop => "ConnectionDrop",
+        }
+    }
+}
+
+#[derive(Debug, Clone, Default, serde::Serialize, serde::Deserialize)]
+pub struct ChaosMetrics {
+    pub total_injected: u64,
+    pub faults_by_type: HashMap<String, u64>,
+}
+
+impl ChaosMetrics {
+    pub fn new() -> Self {
+        Self::default()
+    }
+
+    pub fn record_fault(&mut self, fault: &ChaosFault) {
+        self.total_injected += 1;
+        *self
+            .faults_by_type
+            .entry(fault.name().to_string())
+            .or_insert(0) += 1;
+    }
+}
+
 #[derive(Debug, Clone, Copy, Default)]
 pub struct ChaosEngine {
     pub enabled: bool,

{strobengine-0.5.2 → strobengine-0.6.0}/src/config.rs

@@ -3,6 +3,57 @@ use std::time::Duration;
 use crate::chaos::DEFAULT_CHAOS_RATE;
 use pyo3::prelude::*;
 
+/// WebSocket protocol options (internal, not exposed to Python).
+#[derive(Debug, Clone, Default)]
+#[allow(dead_code)]
+pub(crate) struct WsOptions {
+    pub mode: WsMode,
+    pub payload: Option<String>,
+    pub persistent: bool,
+    pub keepalive_secs: Option<u64>,
+    pub max_messages: Option<u64>,
+    pub role: Option<String>,
+    pub publish_interval_ms: Option<u64>,
+    pub subscribers: Option<usize>,
+}
+
+/// gRPC protocol options (internal, not exposed to Python).
+#[derive(Debug, Clone, Default)]
+#[allow(dead_code)]
+pub(crate) struct GrpcOptions {
+    pub service: Option<String>,
+    pub method: Option<String>,
+    pub payload: Option<String>,
+    pub deadline_ms: Option<u64>,
+    pub proto_path: Option<String>,
+    pub use_reflection: bool,
+}
+
+/// HTTP/3 + QUIC options (internal, not exposed to Python).
+#[derive(Debug, Clone, Default)]
+#[allow(dead_code)]
+pub(crate) struct Http3Options {
+    pub enabled: bool,
+    pub zero_rtt: bool,
+    pub max_idle_timeout_ms: Option<u64>,
+}
+
+/// SSE streaming options (internal, not exposed to Python).
+#[derive(Debug, Clone, Default)]
+#[allow(dead_code)]
+pub(crate) struct SseOptions {
+    pub enabled: bool,
+    pub max_events: Option<u64>,
+}
+
+/// Report output options (internal, not exposed to Python).
+#[derive(Debug, Clone, Default)]
+#[allow(dead_code)]
+pub(crate) struct OutputOptions {
+    pub output_dir: Option<String>,
+    pub no_save: bool,
+}
+
 #[derive(Debug, Clone, Copy, PartialEq, Eq, Default)]
 #[pyclass(from_py_object)]
 pub enum WsMode {
@@ -208,6 +259,52 @@ impl TestConfig {
     }
 }
 
+impl TestConfig {
+    /// Minimal config for protocol detection (used by `run_load_profiles`).
+    /// Replaces the 32-line positional call with a concise factory.
+    pub fn for_protocol_detection(
+        url: String,
+        concurrency: usize,
+        duration_secs: u64,
+        timeout_secs: u64,
+    ) -> Self {
+        Self::new(
+            url,
+            concurrency,
+            duration_secs,
+            timeout_secs,
+            false,
+            DEFAULT_CHAOS_RATE,
+            false,
+            "GET",
+            None,
+            None,
+            None,
+            WsMode::Handshake,
+            None,
+            None,
+            None,
+            None,
+            None,
+            None,
+            false,
+            false,
+            None,
+            None,
+            None,
+            None,
+            None,
+            false,
+            false,
+            None,
+            false,
+            None,
+            None,
+            false,
+        )
+    }
+}
+
 #[derive(Debug, Clone)]
 #[pyclass(from_py_object)]
 pub enum LoadProfile {