slik-report 1.0.5 → 1.0.6
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +143 -16
- package/dist/index.js +607 -199
- package/package.json +5 -3
package/README.md
CHANGED
|
@@ -1,6 +1,136 @@
|
|
|
1
|
+
# ✨ Slik Report — Advanced HTML Reporting for Playwright
|
|
2
|
+
|
|
3
|
+
Slik Report is a **modern, compact, and insight-driven HTML report** for Playwright test runs.
|
|
4
|
+
It goes beyond pass/fail and focuses on **test stability, flakiness, trends, and execution confidence** — all in a single, readable report.
|
|
5
|
+
|
|
6
|
+
🔗 NPM: https://www.npmjs.com/package/slik-report
|
|
7
|
+
|
|
8
|
+
---
|
|
9
|
+
|
|
10
|
+
## 🚀 Why Slik Report?
|
|
11
|
+
|
|
12
|
+
Most Playwright reports answer only one question:
|
|
13
|
+
> Did tests pass or fail?
|
|
14
|
+
|
|
15
|
+
Slik Report answers better questions:
|
|
16
|
+
- How **stable** is my system?
|
|
17
|
+
- Are failures **flaky or reproducible**?
|
|
18
|
+
- Is quality improving over time?
|
|
19
|
+
- Where is execution time actually going?
|
|
20
|
+
|
|
21
|
+
And it does this without breaking UI at lower zoom levels or cluttering the screen.
|
|
22
|
+
|
|
23
|
+
---
|
|
24
|
+
|
|
25
|
+
## 🧠 What Makes Slik Report Different?
|
|
26
|
+
|
|
27
|
+
### 📊 Confidence-Driven Overview
|
|
28
|
+
The Overview page provides **system-level confidence metrics**, not just counts:
|
|
29
|
+
|
|
30
|
+
- Total / Passed / Failed / Skipped
|
|
31
|
+
- Pass Rate
|
|
32
|
+
- Stability Score (0–100)
|
|
33
|
+
- Flaky Test Percentage
|
|
34
|
+
- Retry Dependency
|
|
35
|
+
- Failure Reproducibility
|
|
36
|
+
- Risk Level (STABLE / UNSTABLE / HIGH RISK)
|
|
37
|
+
|
|
38
|
+
This turns raw test data into **decision-ready insights**.
|
|
39
|
+
|
|
40
|
+
---
|
|
41
|
+
|
|
42
|
+
### 🧭 Rich Navigation Structure
|
|
43
|
+
|
|
44
|
+
The report includes clearly separated views:
|
|
45
|
+
|
|
46
|
+
- **Overview** – KPIs, confidence & metadata
|
|
47
|
+
- **Categories** – Failure grouping (when applicable)
|
|
48
|
+
- **Suites** – Expandable suites → tests → logs
|
|
49
|
+
- **Execution View** – Visual execution flow
|
|
50
|
+
- **Graphs** – Trends, duration distribution, pass rate history
|
|
51
|
+
- **Timeline** – Sequential execution timeline
|
|
52
|
+
- **Historical Runs** – Quality trend across runs
|
|
53
|
+
- **Tags** – Tag-based analysis (auto-enabled)
|
|
54
|
+
- **External HTML** – Embed Playwright’s native report
|
|
55
|
+
|
|
56
|
+
All sections are available from a fixed sidebar for fast navigation.
|
|
57
|
+
|
|
58
|
+
---
|
|
59
|
+
|
|
60
|
+
### 📈 Graphs & Trends Built-In
|
|
61
|
+
|
|
62
|
+
Slik Report includes visual analytics out of the box:
|
|
63
|
+
|
|
64
|
+
- Pass / Fail / Skip distribution
|
|
65
|
+
- Test duration histogram
|
|
66
|
+
- Pass-rate trend across runs
|
|
67
|
+
- Historical regression detection
|
|
68
|
+
- Execution timeline chart
|
|
69
|
+
|
|
70
|
+
No external tools required.
|
|
71
|
+
|
|
72
|
+
---
|
|
73
|
+
|
|
74
|
+
### 🧪 Flaky Test Detection
|
|
75
|
+
|
|
76
|
+
Tests are automatically marked **flaky** when history indicates instability.
|
|
77
|
+
|
|
78
|
+
You get:
|
|
79
|
+
- Flaky percentage
|
|
80
|
+
- Historical status tracking
|
|
81
|
+
- Retry dependency metrics
|
|
82
|
+
- Visual flaky indicators
|
|
83
|
+
|
|
84
|
+
This helps teams fix **root causes**, not just rerun failures.
|
|
85
|
+
|
|
86
|
+
---
|
|
87
|
+
|
|
88
|
+
### 🧾 Deep Test Logs (API-Friendly)
|
|
89
|
+
|
|
90
|
+
Each test can expose:
|
|
91
|
+
- Request / response logs
|
|
92
|
+
- Headers and payloads
|
|
93
|
+
- Execution duration
|
|
94
|
+
- Status history
|
|
95
|
+
- Retry behavior
|
|
96
|
+
|
|
97
|
+
Ideal for **API automation** and backend workflows.
|
|
98
|
+
|
|
99
|
+
---
|
|
100
|
+
|
|
101
|
+
### 🌓 Dark Mode & Compact UI
|
|
102
|
+
|
|
103
|
+
- Light and dark themes
|
|
104
|
+
- Layout remains readable at **80–90% zoom**
|
|
105
|
+
- Designed for laptops, CI artifacts, and shared screens
|
|
106
|
+
|
|
107
|
+
---
|
|
108
|
+
|
|
109
|
+
### 📥 Built-In Downloads
|
|
110
|
+
|
|
111
|
+
One-click export:
|
|
112
|
+
- HTML
|
|
113
|
+
- CSV
|
|
114
|
+
- JSON
|
|
115
|
+
|
|
116
|
+
Perfect for audits, sharing, or offline analysis.
|
|
117
|
+
|
|
1
118
|
# slik-report
|
|
2
119
|
|
|
3
|
-
A powerful Playwright reporter for
|
|
120
|
+
A powerful and interactive Playwright reporter designed for deep test analysis, flakiness tracking, and historical trend visualization.
|
|
121
|
+
|
|
122
|
+
## Features
|
|
123
|
+
|
|
124
|
+
- 📊 **Advanced KPI Tracking**: Monitor Pass Rate Consistency (Standard Deviation), Flaky Test Percentage, and Failure Reproducibility.
|
|
125
|
+
- 💯 **Stability Scoring**: A dedicated algorithm calculates an overall stability score (0-100) and risk level for your test suite.
|
|
126
|
+
- 🏷️ **Tag Analysis**: Automated breakdown of metrics by test `@tags`, providing pass rates and duration insights for categorized tests.
|
|
127
|
+
- 🕒 **Historical Trends**: Visualize test performance over time to identify regressions and flakiness patterns across last 20+ runs.
|
|
128
|
+
- 🔍 **Failure Categorization**: Auto-groups failed tests into **Bugs** (Assertion failures) and **Script Issues** (Timeouts/Logic errors).
|
|
129
|
+
- 📈 **Execution Flow**: A hierarchical graph (powered by Cytoscape) that visualizes the flow from Suites to Files to individual Test cases.
|
|
130
|
+
- 🌓 **Interactive Dashboard**: Modern UI with Dark Mode, Global Search (across suites, tests, and logs), and smooth animations.
|
|
131
|
+
- 💾 **Multi-Format Export**: One-click downloads for your summary data in **HTML**, **CSV**, or **JSON** formats.
|
|
132
|
+
- 🔗 **External Report Linking**: Seamlessly jump to Playwright's detailed HTML portal for traces, videos, and network logs.
|
|
133
|
+
|
|
4
134
|
|
|
5
135
|
## Installation
|
|
6
136
|
|
|
@@ -10,11 +140,7 @@ npm install slik-report --save-dev
|
|
|
10
140
|
|
|
11
141
|
## How to Use
|
|
12
142
|
|
|
13
|
-
|
|
14
|
-
|
|
15
|
-
### Configuration Example
|
|
16
|
-
|
|
17
|
-
Add `slik-report` to the `reporter` array in your `playwright.config.ts`:
|
|
143
|
+
Configure `slik-report` in your `playwright.config.ts`:
|
|
18
144
|
|
|
19
145
|
```typescript
|
|
20
146
|
// playwright.config.ts
|
|
@@ -23,23 +149,24 @@ import { defineConfig } from '@playwright/test';
|
|
|
23
149
|
export default defineConfig({
|
|
24
150
|
reporter: [
|
|
25
151
|
['json', { outputFile: 'playwright-report/report.json' }],
|
|
26
|
-
// Use the Slik Report reporter and pass options
|
|
27
152
|
['slik-report', {
|
|
28
|
-
input: 'playwright-report/report.json', //
|
|
29
|
-
output: 'slik-report.html', // Output
|
|
30
|
-
history: './slik_history', //
|
|
153
|
+
input: 'playwright-report/report.json', // Source JSON from Playwright
|
|
154
|
+
output: 'slik-report.html', // Output path for Slik report
|
|
155
|
+
history: './slik_history', // History storage directory
|
|
156
|
+
externalHtml: './playwright-report/index.html' // Optional: Link to Playwright HTML report
|
|
31
157
|
}]
|
|
32
158
|
],
|
|
33
159
|
});
|
|
34
160
|
```
|
|
35
161
|
|
|
36
|
-
|
|
162
|
+
## Configuration Options
|
|
37
163
|
|
|
38
|
-
| Option
|
|
39
|
-
|
|
|
40
|
-
| `input`
|
|
41
|
-
| `output`
|
|
42
|
-
| `history` | string | Directory path
|
|
164
|
+
| Option | Type | Description | Default |
|
|
165
|
+
| :--- | :--- | :--- | :--- |
|
|
166
|
+
| `input` | `string` | Path to the JSON report file generated by the Playwright 'json' reporter. | `playwright-report/report.json` |
|
|
167
|
+
| `output` | `string` | Destination path where the Slik HTML dashboard will be generated. | `summary-report.html` |
|
|
168
|
+
| `history` | `string` | Directory path where historical run data (JSON) will be stored. | `./reports/reports_history` |
|
|
169
|
+
| `externalHtml`| `string` | Path to Playwright's standard HTML report for linking traces and logs. | `./playwright-report/reports/index.html` |
|
|
43
170
|
|
|
44
171
|
## License
|
|
45
172
|
|