@pickled-dev/cli 0.2.0 → 0.3.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +48 -26
- package/dist/index.js +168 -137
- package/package.json +1 -1
package/README.md
CHANGED
|
@@ -2,7 +2,7 @@
|
|
|
2
2
|
|
|
3
3
|
> Stay fresh in AI 🥒
|
|
4
4
|
|
|
5
|
-
|
|
5
|
+
Test how well AI responds to questions about your developer tool. Define scenarios, run checks, and see your freshness score.
|
|
6
6
|
|
|
7
7
|
## Installation
|
|
8
8
|
|
|
@@ -24,21 +24,21 @@ Creates a `pickled.yml` file:
|
|
|
24
24
|
tool:
|
|
25
25
|
name: "your-tool"
|
|
26
26
|
description: "What your tool does"
|
|
27
|
-
keywords:
|
|
28
|
-
- keyword1
|
|
29
|
-
- keyword2
|
|
30
27
|
|
|
31
28
|
scenarios:
|
|
32
|
-
- name: "
|
|
33
|
-
prompt: "
|
|
29
|
+
- name: "Installation"
|
|
30
|
+
prompt: "How do I install this tool?"
|
|
34
31
|
|
|
35
|
-
- name: "
|
|
36
|
-
prompt: "
|
|
32
|
+
- name: "Getting started"
|
|
33
|
+
prompt: "How do I set up this tool for my project?"
|
|
34
|
+
|
|
35
|
+
- name: "Basic usage"
|
|
36
|
+
prompt: "Show me a basic example of using this tool"
|
|
37
37
|
```
|
|
38
38
|
|
|
39
39
|
### 2. Edit your config
|
|
40
40
|
|
|
41
|
-
Update `pickled.yml` with your actual tool info and scenarios
|
|
41
|
+
Update `pickled.yml` with your actual tool info and scenarios developers might ask about.
|
|
42
42
|
|
|
43
43
|
### 3. Run check
|
|
44
44
|
|
|
@@ -54,52 +54,74 @@ Create a starter `pickled.yml` config file.
|
|
|
54
54
|
|
|
55
55
|
### `pickled check [path]`
|
|
56
56
|
|
|
57
|
-
Run
|
|
57
|
+
Run freshness checks and report results.
|
|
58
58
|
|
|
59
59
|
| Option | Description |
|
|
60
60
|
| --------------------- | ---------------------- |
|
|
61
61
|
| `--json` | Output as JSON |
|
|
62
62
|
| `-o, --output <file>` | Save report to file |
|
|
63
63
|
| `-v, --verbose` | Show detailed progress |
|
|
64
|
+
| `-t, --threshold <n>` | Min score % to pass |
|
|
64
65
|
|
|
65
66
|
## Example Output
|
|
66
67
|
|
|
67
68
|
```
|
|
68
|
-
🥒
|
|
69
|
+
🥒 Freshness Check
|
|
69
70
|
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
|
|
70
71
|
|
|
71
72
|
Tool: zod
|
|
72
|
-
Path: /path/to/zod
|
|
73
73
|
|
|
74
|
-
✓ "
|
|
75
|
-
✓ "
|
|
76
|
-
|
|
74
|
+
[default] ✓ "Installation" - Well preserved (92%)
|
|
75
|
+
[default] ✓ "Basic parsing" - Fresh (85%)
|
|
76
|
+
[default] ⚠ "Error handling" - Going stale (65%)
|
|
77
|
+
Missing: safeParse details
|
|
77
78
|
|
|
78
79
|
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
|
|
79
|
-
Freshness:
|
|
80
|
+
Freshness Score: 81% 🥒🥒🥒🥒░
|
|
80
81
|
|
|
81
|
-
🥒
|
|
82
|
+
🥒 Looking fresh! Your docs are doing well.
|
|
82
83
|
```
|
|
83
84
|
|
|
85
|
+
## Freshness Scores
|
|
86
|
+
|
|
87
|
+
| Score | Status | Meaning |
|
|
88
|
+
|-------|--------|---------|
|
|
89
|
+
| 90%+ | Well preserved | AI nails it |
|
|
90
|
+
| 70-89% | Fresh | Good, minor gaps |
|
|
91
|
+
| 50-69% | Going stale | Needs attention |
|
|
92
|
+
| <50% | Gone sour | Major documentation gaps |
|
|
93
|
+
|
|
84
94
|
## Config Reference
|
|
85
95
|
|
|
86
96
|
```yaml
|
|
87
97
|
tool:
|
|
88
|
-
name: "tool-name"
|
|
89
|
-
description: "
|
|
90
|
-
keywords: # Required: relevant keywords
|
|
91
|
-
- keyword1
|
|
92
|
-
- keyword2
|
|
98
|
+
name: "tool-name" # Required: your tool's name
|
|
99
|
+
description: "desc" # Required: what it does
|
|
93
100
|
|
|
94
|
-
scenarios:
|
|
101
|
+
scenarios: # Required: scenarios to check
|
|
95
102
|
- name: "Scenario name" # Display name
|
|
96
103
|
prompt: "The question" # What to ask AI
|
|
104
|
+
target: target-name # Optional: specific target
|
|
97
105
|
|
|
98
|
-
|
|
99
|
-
|
|
100
|
-
|
|
106
|
+
targets: # Optional: named targets
|
|
107
|
+
claude-sonnet:
|
|
108
|
+
category: cli
|
|
109
|
+
provider: claude-code
|
|
110
|
+
model: claude-sonnet-4-20250514
|
|
111
|
+
|
|
112
|
+
threshold: 80 # Optional: min score % to pass
|
|
101
113
|
```
|
|
102
114
|
|
|
115
|
+
## CI/CD Integration
|
|
116
|
+
|
|
117
|
+
```yaml
|
|
118
|
+
# GitHub Actions
|
|
119
|
+
- name: Check AI freshness
|
|
120
|
+
run: pickled check --threshold 80
|
|
121
|
+
```
|
|
122
|
+
|
|
123
|
+
Fail the build if AI can't answer questions about your tool correctly.
|
|
124
|
+
|
|
103
125
|
## Local Development
|
|
104
126
|
|
|
105
127
|
```bash
|