skilldrop-cli 0.16.15 → 0.16.17
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/package.json +1 -1
- package/packs/ai-engineering/pack.json +1 -1
- package/packs/ai-engineering/skills/ai-usage-policy/SKILL.md +60 -41
- package/packs/ai-engineering/skills/ai-usage-policy/evals/evals.json +28 -0
- package/packs/ai-engineering/skills/ai-usage-policy/evals/files/6/board-meeting-extract.md +13 -0
- package/packs/ai-engineering/skills/ai-usage-policy/evals/files/6/ops-notes.md +42 -0
- package/packs/ai-engineering/skills/ai-usage-policy/evals/files/6/vendor-sheet-murmurly.txt +10 -0
- package/packs/ai-engineering/skills/ai-usage-policy/manifest.json +3 -3
- package/packs/solution-architect/skills/design-doc/evals/evals.json +28 -0
- package/packs/solution-architect/skills/design-doc/evals/files/6/figures.csv +11 -0
- package/packs/solution-architect/skills/design-doc/evals/files/6/premeet-notes.md +25 -0
- package/packs/solution-architect/skills/design-doc/evals/files/6/requirements.md +8 -0
- package/packs/solution-architect/skills/design-doc/manifest.json +1 -1
- package/packs/sre-oncall/pack.json +1 -1
- package/packs/sre-oncall/skills/postmortem-generator/SKILL.md +76 -51
- package/packs/sre-oncall/skills/postmortem-generator/evals/evals.json +27 -0
- package/packs/sre-oncall/skills/postmortem-generator/evals/files/6/alerts.csv +4 -0
- package/packs/sre-oncall/skills/postmortem-generator/evals/files/6/incident-channel.txt +27 -0
- package/packs/sre-oncall/skills/postmortem-generator/evals/files/6/timeline.md +21 -0
- package/packs/sre-oncall/skills/postmortem-generator/manifest.json +3 -3
- package/packs/sre-oncall/skills/postmortem-generator/templates/postmortem.md +28 -42
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "skilldrop-cli",
|
|
3
|
-
"version": "0.16.
|
|
3
|
+
"version": "0.16.17",
|
|
4
4
|
"description": "Portable AI-agent skills, measured against the agent without them. ADRs, PRDs, runbooks, decks and reviews, installable into Claude Code, Cursor, Kiro, and any IDE that takes custom instructions. One command per skill or per role-based pack.",
|
|
5
5
|
"author": {
|
|
6
6
|
"name": "Sanjay Ananthanarayan",
|
|
@@ -43,7 +43,7 @@
|
|
|
43
43
|
{
|
|
44
44
|
"skill": "ai-usage-policy",
|
|
45
45
|
"you_do": "Give the population, the tools and any data rules already in force.",
|
|
46
|
-
"you_get": "
|
|
46
|
+
"you_get": "A policy at the length your audience needs: what's allowed first, every restriction paired with what to do instead or who decides, what to do if data has already gone in, and no claim about a tool, owner or law that you didn't give it."
|
|
47
47
|
},
|
|
48
48
|
{
|
|
49
49
|
"skill": "ai-adoption-rollout",
|
|
@@ -1,59 +1,75 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: ai-usage-policy
|
|
3
|
-
description: Draft an organisation's AI
|
|
3
|
+
description: Draft an organisation's AI use policy or staff guidance from what it has told you about its people, tools, data and worries — every "don't" paired with what to do instead (or who decides, when no approved way exists yet), what to do if data has already gone into a tool, and no claim about a tool, licence, owner, regulation or commitment the input didn't give. Written in the length, labels and voice the audience needs. Use when a team needs rules for what people may put into AI tools, or asks for an AI acceptable-use or governance policy. Do NOT use to write a repo's agent-tooling policy (that's agents-md-generator) or to analyse one agent's capability surface (that's agent-threat-model).
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# ai-usage-policy
|
|
7
7
|
|
|
8
|
-
|
|
8
|
+
**The rule: every "don't" comes with what to do instead.** A policy that only forbids doesn't
|
|
9
|
+
stop the work; it moves it to a personal account where nobody can see it. So each prohibition
|
|
10
|
+
names the approved way to do the same task today: ✅ *"Don't paste client reports into a chat
|
|
11
|
+
tool to summarise them. Use the summariser in the document system, which keeps them inside."*
|
|
12
|
+
When no approved way exists yet, the policy says so and says who decides: ✅ *"There's no
|
|
13
|
+
approved tool for transcribing interviews yet. Ask the operations lead before using one."*
|
|
9
14
|
|
|
10
|
-
|
|
15
|
+
The policy also says **what to do if it has already happened**: data pasted into the wrong
|
|
16
|
+
tool, a draft sent unchecked. Who to tell, how fast, and that telling is what's expected.
|
|
11
17
|
|
|
12
|
-
|
|
13
|
-
|
|
14
|
-
|
|
15
|
-
|
|
16
|
-
|
|
17
|
-
|
|
18
|
-
|
|
19
|
-
- **Write for someone who has never heard of this skill.** No skill names, no paths or scripts from this folder, no internal terms, and nothing about how the run was set up. A next step is one plain sentence at the end that describes the work.
|
|
20
|
-
- **For this skill:** A usable policy says what to do when the rule has already been broken (data already pasted into a tool) and how it is enforced; include both. Check that the data classes and the approved-tools list agree with each other. Make no claim about where a tool sends data unless the user told you.
|
|
18
|
+
A second rule sits beside it: **claim nothing you weren't given.** No statement about where a
|
|
19
|
+
tool sends data, whether it trains on inputs, how many seats exist, who owns the policy, how
|
|
20
|
+
fast exceptions are handled, or which law applies, unless the input says so. A vendor's own
|
|
21
|
+
data-sheet is the vendor's claim: report it as "the vendor says", never as fact, and never
|
|
22
|
+
let it be the reason sensitive data is allowed. Check the tools against what you were told
|
|
23
|
+
(seat counts against headcount, a contract that has lapsed, terms not yet signed) and say
|
|
24
|
+
where they don't line up.
|
|
21
25
|
|
|
22
|
-
|
|
26
|
+
## How to respond
|
|
23
27
|
|
|
24
|
-
|
|
28
|
+
1. **Write for the people who'll read it, at the size asked for.** "A short note for our
|
|
29
|
+
twelve staff", "one page to attach for a client", "the full policy for the board": that
|
|
30
|
+
sets the length, voice and structure. Use the organisation's own words for its data and
|
|
31
|
+
roles; if it already classifies data, use those names, not a new scheme.
|
|
25
32
|
|
|
26
|
-
|
|
27
|
-
|
|
28
|
-
|
|
29
|
-
| **Internal** | internal docs, non-personal telemetry, private repo code | approved tools with data-retention off / enterprise terms |
|
|
30
|
-
| **Restricted** | personal data, credentials, customer content under contract, regulated records | never pasted; only via a named reviewed integration, if at all |
|
|
33
|
+
2. **Say what's allowed, plainly, first.** The common, low-risk uses (drafting, rewording,
|
|
34
|
+
brainstorming on non-sensitive material) are named as fine, so the restrictions read as
|
|
35
|
+
targeted rather than blanket.
|
|
31
36
|
|
|
32
|
-
|
|
37
|
+
3. **The restrictions, each with its alternative.** State them as behaviours tied to the
|
|
38
|
+
organisation's real data: what not to put in which tool, and what to do instead. Review
|
|
39
|
+
before use only where the consequence warrants it: something reaching a customer, money,
|
|
40
|
+
a legal position, a decision about a person.
|
|
33
41
|
|
|
34
|
-
|
|
42
|
+
4. **The tools, as far as you know them.** The tools the input names, and what each is
|
|
43
|
+
cleared for, as far as the input says. For anything else, the route to ask, with the role
|
|
44
|
+
who decides if the input names one, or "to be agreed" if it doesn't.
|
|
35
45
|
|
|
36
|
-
|
|
46
|
+
5. **If something has already gone wrong.** One short section: who to tell, and that
|
|
47
|
+
reporting quickly is what's expected.
|
|
37
48
|
|
|
38
|
-
|
|
49
|
+
6. **Keep notes to the requester out of the policy.** The policy is a document someone will
|
|
50
|
+
circulate. Questions for the person who asked (who owns this, which tool contract to
|
|
51
|
+
check, whether a law applies) go in a short list after it, never as bracketed tags inside.
|
|
39
52
|
|
|
40
|
-
|
|
53
|
+
7. **Deliver from what you have.** With anything about the organisation to go on, write the
|
|
54
|
+
policy and state any assumption in one line. Ask first only when you don't know who it is
|
|
55
|
+
for or what kind of data they handle.
|
|
41
56
|
|
|
42
57
|
## Quality bar
|
|
43
58
|
|
|
44
|
-
- **Every
|
|
45
|
-
|
|
46
|
-
- **
|
|
47
|
-
- **
|
|
48
|
-
|
|
49
|
-
- **
|
|
50
|
-
- **
|
|
59
|
+
- **Every prohibition names an alternative,** or says no approved way exists yet and who
|
|
60
|
+
decides.
|
|
61
|
+
- **There is a line on what to do if it has already happened.**
|
|
62
|
+
- **Nothing unsupplied:** no data-handling claim, seat count, owner, turnaround, commitment or
|
|
63
|
+
regulation the input didn't give; vendor claims are attributed to the vendor.
|
|
64
|
+
- **The tool list is checked against the input** and mismatches are named.
|
|
65
|
+
- **The length, voice and labels fit the audience asked for.**
|
|
66
|
+
- **No notes, tags or questions to the requester inside the policy.**
|
|
51
67
|
|
|
52
68
|
## When to use this skill
|
|
53
69
|
|
|
54
70
|
- ✅ "What are people allowed to put into these tools?" — the question every rollout hits in week one.
|
|
55
|
-
- ✅ Standing up
|
|
56
|
-
- ✅ Replacing an informal "be sensible" norm with something
|
|
71
|
+
- ✅ Standing up guidance before or alongside an AI rollout.
|
|
72
|
+
- ✅ Replacing an informal "be sensible" norm with something people can follow.
|
|
57
73
|
|
|
58
74
|
## When NOT to use this skill
|
|
59
75
|
|
|
@@ -65,11 +81,14 @@ A policy that prohibits without offering a permitted path doesn't reduce risk; i
|
|
|
65
81
|
|
|
66
82
|
## Anti-patterns to avoid
|
|
67
83
|
|
|
68
|
-
- ❌ **Prohibition without an alternative.**
|
|
69
|
-
- ❌ **
|
|
70
|
-
- ❌ **
|
|
71
|
-
|
|
72
|
-
- ❌ **
|
|
73
|
-
|
|
74
|
-
|
|
75
|
-
|
|
84
|
+
- ❌ **Prohibition without an alternative.** It moves the work out of sight.
|
|
85
|
+
- ❌ **Repeating the vendor.** "The tool never stores your data" because a sales sheet said so.
|
|
86
|
+
- ❌ **Invented machinery.** An owner, a five-day exception turnaround, a quarterly review, a
|
|
87
|
+
tier scheme the organisation never asked for.
|
|
88
|
+
- ❌ **The full framework on a short note.** Tier tables and review matrices for a twelve-person
|
|
89
|
+
team that asked for half a page.
|
|
90
|
+
- ❌ **Bracketed notes in the policy.** `[confirm with counsel]` in a document about to be
|
|
91
|
+
attached for a client.
|
|
92
|
+
- ❌ **Naming laws the user didn't name.** Say what to check, in the note after the policy.
|
|
93
|
+
- ❌ **Requiring review of everything.** A gate on low-risk drafting trains people to ignore the
|
|
94
|
+
gates that matter.
|
|
@@ -74,6 +74,34 @@
|
|
|
74
74
|
"It does not state as fact that a specific law applies or that the studio owns the copyright in AI-generated material; any such point is marked as something to check",
|
|
75
75
|
"The policy itself fits on about one page (roughly 500 words or fewer)"
|
|
76
76
|
]
|
|
77
|
+
},
|
|
78
|
+
{
|
|
79
|
+
"id": 6,
|
|
80
|
+
"held_out": "2026-10-17",
|
|
81
|
+
"prompt": "I'm the operations director at Harrowmere Veterinary Group (11 clinics, about 230 staff). The board wants a staff policy on using AI tools at its next meeting. Everything I know is in three files: `ops-notes.md`, `vendor-sheet-murmurly.txt` and `board-meeting-extract.md`. Draft the policy for all staff: reception, vets, nurses, marketing and our two developers. Plain English, no more than two pages (about 900 words), and skip any intro about how AI is changing the world. Separately, give me a short list of the questions I need the Managing Director or the board to settle; keep those out of the staff policy itself.",
|
|
82
|
+
"assertions": [
|
|
83
|
+
"It says Murmurly transcription may be used only in the pilot at Northgate and Fernhill clinics (with the client told and able to object) and that other clinics must not start using it yet; it does not describe Murmurly as approved across the group",
|
|
84
|
+
"It does not repeat Murmurly's data-handling claims (zero retention, never used for training, compliant with every law, certified secure) as established fact; any it mentions are attributed to the vendor or marked unverified pending the unsigned contract",
|
|
85
|
+
"Every use the policy rules out comes with an alternative staff can use (such as the Dosewell formulary for doses, or a Tallowby Business seat) or a statement that there is no approved way yet and that the Managing Director decides; no prohibition is left without one",
|
|
86
|
+
"It tells staff what to do if client, payment or staff details have already been put into an AI tool, including reporting it to the Practice Compliance Lead under the existing data incident procedure, and it does not treat the receptionist's incident as already resolved",
|
|
87
|
+
"It does not say every member of staff has or can get a Tallowby Business account; it reflects that there are 40 seats and that who gets them is undecided",
|
|
88
|
+
"It does not invent a policy owner, review date or cycle, training programme, tool, licence count, or regulation not in the files; the claim about the veterinary regulator's rules on AI in clinical records is marked as unchecked, not stated as a rule",
|
|
89
|
+
"The staff policy is about 900 words or fewer, and the questions for the Managing Director or board are given separately from it rather than inside it"
|
|
90
|
+
]
|
|
91
|
+
},
|
|
92
|
+
{
|
|
93
|
+
"id": 7,
|
|
94
|
+
"held_out": "2026-10-17",
|
|
95
|
+
"prompt": "hi, we run Millbrook Lane Bakery, 3 shops and about 18 staff. a few of the team have started using Wordnook (the free chat app) on their phones to write our instagram posts, and one shift lead used it to sort out the staff rota. I'm the owner and I'm a bit worried about people putting customer stuff in there, like the custom cake orders which have names, phone numbers and allergy notes on them. can you write me something short I can pin up in the back room? half a page max, no jargon please",
|
|
96
|
+
"assertions": [
|
|
97
|
+
"It delivers the notice in this reply rather than asking questions first; any gaps are noted briefly without holding up the notice",
|
|
98
|
+
"The notice is about half a page (roughly 250 words or fewer) and written in plain everyday words, without terms like 'data controller', 'LLM' or 'personal data processing'",
|
|
99
|
+
"It says customer names, phone numbers and allergy or order details from cake orders must not be typed into Wordnook, and says what to do instead (for example, write the post without them, or ask the owner)",
|
|
100
|
+
"It covers staff information such as the rota (names, hours) as well as customer information",
|
|
101
|
+
"Every 'don't' on the notice is paired with what to do instead or with 'ask the owner'",
|
|
102
|
+
"It says what to do if someone has already typed customer or staff details into Wordnook, at least telling the owner",
|
|
103
|
+
"It does not invent a paid plan, app settings, a law, a named person other than the owner, training, a review date, or other tools, and does not state as fact what Wordnook does or does not do with what is typed into it"
|
|
104
|
+
]
|
|
77
105
|
}
|
|
78
106
|
]
|
|
79
107
|
}
|
|
@@ -0,0 +1,13 @@
|
|
|
1
|
+
# Board meeting, 2 October: extract, item 6 (AI tools)
|
|
2
|
+
|
|
3
|
+
- Murmurly: agreed as a PILOT only, at Northgate and Fernhill clinics, until the contract
|
|
4
|
+
and data processing terms are signed and the pilot is reviewed. Other clinics are not to
|
|
5
|
+
start using it. Pilot vets must tell the client a consult is being transcribed and stop
|
|
6
|
+
if the client objects.
|
|
7
|
+
- Glimmerpress: no client pet photos until the marketing team has a way to get the
|
|
8
|
+
owner's permission. No decision yet on how that will work.
|
|
9
|
+
- Policy ownership: two names were put forward (Head of Clinical Services, IT Manager).
|
|
10
|
+
Not agreed. The Managing Director will decide who owns the policy, and until then any
|
|
11
|
+
"can I use AI for this?" question not covered by the policy goes to the Managing Director.
|
|
12
|
+
- Codewren: decision on buying deferred until the trial ends.
|
|
13
|
+
- Ops director to draft a staff policy for the next meeting.
|
|
@@ -0,0 +1,42 @@
|
|
|
1
|
+
# AI tools: where we are (ops director's notes, October)
|
|
2
|
+
|
|
3
|
+
Harrowmere Veterinary Group: 11 clinics, about 230 staff. Reception and client care, vets,
|
|
4
|
+
vet nurses, a small marketing team (3), and two in-house developers who look after the
|
|
5
|
+
booking site and the practice-management integrations.
|
|
6
|
+
|
|
7
|
+
## What people are using
|
|
8
|
+
|
|
9
|
+
- **Tallowby Chat** (general chat assistant). We bought 40 seats on the Tallowby Business
|
|
10
|
+
plan in the spring, mostly for clinic managers and marketing. Nobody has decided who gets
|
|
11
|
+
the other seats or whether we buy more. Plenty of staff are using the free Tallowby app on
|
|
12
|
+
their own phones and personal accounts instead, including reception.
|
|
13
|
+
- **Murmurly** (consult transcription). Vets love it. See the board extract for what was
|
|
14
|
+
actually agreed. The vendor sheet is in `vendor-sheet-murmurly.txt`. Contract and data
|
|
15
|
+
processing terms are with our solicitor and have NOT been signed yet.
|
|
16
|
+
- **Codewren** (coding assistant). The two developers are on a free 60-day trial that ends
|
|
17
|
+
next month. No decision on buying it. They have mentioned pasting chunks of the booking
|
|
18
|
+
site code and, once, a config file to debug a payment issue.
|
|
19
|
+
- **Glimmerpress** (image generator). Marketing uses it for social posts. Worry: someone
|
|
20
|
+
suggested uploading photos clients send us of their pets to "make them look festive" for
|
|
21
|
+
the Christmas campaign. We have never asked clients whether we can use those photos.
|
|
22
|
+
|
|
23
|
+
## What's already gone wrong
|
|
24
|
+
|
|
25
|
+
- Two weeks ago a receptionist pasted a whole client complaint into her personal Tallowby
|
|
26
|
+
account to help write a reply. It had the client's full name, phone number, home address,
|
|
27
|
+
the pet's treatment history and the last four digits of their card. She told her manager
|
|
28
|
+
afterwards. Nothing else has been done about it yet.
|
|
29
|
+
- A locum vet asked Tallowby for a dosage for a cat and used it. It turned out fine, but
|
|
30
|
+
that should have come from the Dosewell formulary, which every clinic already subscribes to.
|
|
31
|
+
|
|
32
|
+
## Things that already exist
|
|
33
|
+
|
|
34
|
+
- Data incidents go to the Practice Compliance Lead under the existing data incident
|
|
35
|
+
procedure. Staff mostly don't know that.
|
|
36
|
+
- Client photos and records live in the practice-management system.
|
|
37
|
+
|
|
38
|
+
## Things I don't know
|
|
39
|
+
|
|
40
|
+
- Someone at the board said the veterinary regulator "has rules about AI in clinical
|
|
41
|
+
records". Nobody has checked whether that's true.
|
|
42
|
+
- Who owns this policy going forward. See board extract.
|
|
@@ -0,0 +1,10 @@
|
|
|
1
|
+
MURMURLY FOR VETERINARY PRACTICES - WHY TEAMS TRUST US
|
|
2
|
+
|
|
3
|
+
* Zero data retention: recordings are deleted the moment your note is ready.
|
|
4
|
+
* Your data is NEVER used to train our models.
|
|
5
|
+
* Fully compliant with every data protection law in every market we serve.
|
|
6
|
+
* Bank-grade encryption, end to end.
|
|
7
|
+
* Certified secure by independent auditors.
|
|
8
|
+
* Clinical-grade accuracy: 99.4% of notes need no correction.
|
|
9
|
+
|
|
10
|
+
Start your free practice-wide rollout today.
|
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "ai-usage-policy",
|
|
3
|
-
"version": "0.
|
|
4
|
-
"description": "Draft an organisation's AI
|
|
3
|
+
"version": "0.2.0",
|
|
4
|
+
"description": "Draft an organisation's AI use policy or staff guidance from what it has told you about its people, tools, data and worries — every \"don't\" paired with what to do instead (or who decides, when no approved way exists yet), what to do if data has already gone into a tool, and no claim about a tool, licence, owner, regulation or commitment the input didn't give. Written in the length, labels and voice the audience needs. Use when a team needs rules for what people may put into AI tools, or asks for an AI acceptable-use or governance policy. Do NOT use to write a repo's agent-tooling policy (that's agents-md-generator) or to analyse one agent's capability surface (that's agent-threat-model).",
|
|
5
5
|
"entrypoint": "SKILL.md",
|
|
6
6
|
"deps": {
|
|
7
7
|
"npm": [],
|
|
@@ -28,6 +28,6 @@
|
|
|
28
28
|
],
|
|
29
29
|
"model": {
|
|
30
30
|
"tier": "standard",
|
|
31
|
-
"rationale": "Drafts a policy
|
|
31
|
+
"rationale": "Drafts a policy that pairs every restriction with an alternative and claims nothing unsupplied. Bounded generation; escalate via ambiguous-input where a regulatory regime is named or contested."
|
|
32
32
|
}
|
|
33
33
|
}
|
|
@@ -70,6 +70,34 @@
|
|
|
70
70
|
"The rollout includes a step that observes or logs would-be limiting before requests are actually blocked, or a stated way to switch enforcement off quickly",
|
|
71
71
|
"It is about one page: roughly 700 words or fewer"
|
|
72
72
|
]
|
|
73
|
+
},
|
|
74
|
+
{
|
|
75
|
+
"id": 6,
|
|
76
|
+
"held_out": "2026-10-17",
|
|
77
|
+
"prompt": "Can you write the nurse rostering proposal for the Digital Programme Board on 23 October? Notes from the pre-meet are in premeet-notes.md, the requirements we agreed are in requirements.md, and the quotes and other numbers are in figures.csv. It goes into the board pack, so two pages at most, call it 1,000 words, and the board needs a recommendation it can vote on. Save it as rostering-proposal.md.",
|
|
78
|
+
"assertions": [
|
|
79
|
+
"Within its first few paragraphs it says what is proposed and which option it recommends (a recommendation that depends on a stated condition counts), framed as a decision for this board to take; it does not say the board already approved Corvane in March",
|
|
80
|
+
"ShiftLattice is not recommended as it stands, because its Canadian hosting fails the UK data requirement (IG-07), and the document says so even though ward managers prefer it; making it conditional on UK hosting becoming available is fine",
|
|
81
|
+
"The recommended option's weaknesses are stated as well as its strengths (for example Corvane's payroll interface being only in beta, or the in-house route being uncosted and needing a developer for most of a year)",
|
|
82
|
+
"The two agency spend figures (£4.2m from the finance ledger and £3.1m from the nursing workforce report) are not merged or silently reduced to one: it reports the discrepancy, or uses one with the other noted, and says it needs reconciling",
|
|
83
|
+
"The ward-manager time saved is stated as not measured, with a way to measure it (for example timing rota work on some wards); no hours-per-week or money saving is presented as fact, and Priya's 'a day a week' is not used as a measured figure",
|
|
84
|
+
"It does not invent facts the inputs do not give: no named owners for actions, no go-live or milestone dates, no author name, and no cost for the in-house option or other figures absent from figures.csv",
|
|
85
|
+
"It respects the board pack limit: roughly 1,100 words or fewer"
|
|
86
|
+
]
|
|
87
|
+
},
|
|
88
|
+
{
|
|
89
|
+
"id": 7,
|
|
90
|
+
"held_out": "2026-10-17",
|
|
91
|
+
"prompt": "hey can you write me a one-pager to get our two partners to sign off on this. we're a small vet practice, Linthorpe Vets, 3 vets and 6 support staff. reception spends most mornings ringing clients to confirm the next day's appointments and we still get no-shows, nobody's counted how many. we want to switch to text reminders. our practice software VetLedger has a texting add-on for £45 a month, or Jo found a standalone texting service that's cheaper per message but we'd have to export the appointment list to it every day. some of the older clients only have landlines on file. a page max please",
|
|
92
|
+
"assertions": [
|
|
93
|
+
"It delivers the one-pager rather than stopping to ask questions; any open questions appear inside the document, not instead of it",
|
|
94
|
+
"Near the top it says what is proposed and which of the two options it recommends, or the specific fact that would decide between them",
|
|
95
|
+
"The trade-off between the options is stated honestly: the add-on costs a fixed £45 a month, while the standalone service needs a daily manual export that can be forgotten or go out of date",
|
|
96
|
+
"It says clients with only a landline on file will not get texts and need another route (such as a phone call), so morning calls do not disappear entirely",
|
|
97
|
+
"The no-show rate is recorded as not yet counted, with a way to find out (for example counting no-shows for a few weeks before and after the switch); no no-show rate or time saving is presented as fact",
|
|
98
|
+
"It does not invent facts the user did not give: no per-message price for the standalone service, no message volumes, no money saved, no named owners beyond Jo's stated role, no go-live dates and no author name",
|
|
99
|
+
"It fits on one page: roughly 550 words or fewer"
|
|
100
|
+
]
|
|
73
101
|
}
|
|
74
102
|
]
|
|
75
103
|
}
|
|
@@ -0,0 +1,11 @@
|
|
|
1
|
+
item,value,source
|
|
2
|
+
Wards in scope,14,Nursing directorate
|
|
3
|
+
Nursing staff on rotas (registered nurses and healthcare assistants),620,Nursing directorate
|
|
4
|
+
Corvane rostering module - implementation,£185000,Corvane quote September 2026
|
|
5
|
+
Corvane rostering module - annual licence,£62000,Corvane quote September 2026
|
|
6
|
+
ShiftLattice - implementation,£20000,ShiftLattice quote September 2026
|
|
7
|
+
ShiftLattice - annual subscription,£48000,ShiftLattice quote September 2026
|
|
8
|
+
In-house extension of Access rota tool,not costed,Digital
|
|
9
|
+
Agency nursing spend 2025/26,£4.2m,Finance ledger (Tomasz Lee)
|
|
10
|
+
Agency nursing spend 2025/26,£3.1m,Nursing workforce report (Helen Marsh)
|
|
11
|
+
Rota publication lead time today,4 weeks,Nursing directorate
|
|
@@ -0,0 +1,25 @@
|
|
|
1
|
+
# Nurse rostering - pre-meet for Digital Programme Board
|
|
2
|
+
|
|
3
|
+
Wrenfield District Hospital, 2 October 2026
|
|
4
|
+
|
|
5
|
+
Present: Helen Marsh (Deputy Chief Nurse), Tomasz Lee (Finance Business Partner), Ade Okafor (Head of Digital), Priya Raman (Ward Manager, Elm Ward), Gary Fenn (Information Governance Lead)
|
|
6
|
+
|
|
7
|
+
**Where we are**
|
|
8
|
+
- Helen: every ward still builds its rota in its own spreadsheet and keeps the live version on the office whiteboard. Gaps get spotted a few days out, which is when we end up ringing agencies.
|
|
9
|
+
- Helen: the board will want to know how many hours this gives back to ward managers. "Put a number on it." Nobody has ever timed how long rota work takes. Priya: "feels like a day a week, for me anyway."
|
|
10
|
+
|
|
11
|
+
**Money**
|
|
12
|
+
- Tomasz: agency nursing spend for 2025/26 was £4.2m, from the finance ledger.
|
|
13
|
+
- Helen: her figure from the nursing workforce report is £3.1m for the same year.
|
|
14
|
+
- Not resolved which is right or why they differ.
|
|
15
|
+
|
|
16
|
+
**Options**
|
|
17
|
+
- ShiftLattice: Priya and two other ward managers sat through the demo and loved it - self-rostering on the phone, very easy to use. Priya: "it's the obvious choice."
|
|
18
|
+
- Gary: ShiftLattice told us their data is hosted in Canada and they have no date for UK hosting. Policy IG-07 says staff personal data stays in the UK. Gary can't sign it off as it stands.
|
|
19
|
+
- Corvane rostering module: Corvane already runs our patient record system. Ade has the quote. Their interface to Pellbridge (our payroll) is in beta; two other hospitals are piloting it.
|
|
20
|
+
- In-house: Ade says we could extend the old Access rota tool, but it would need a developer for most of a year. Not costed.
|
|
21
|
+
|
|
22
|
+
**Other**
|
|
23
|
+
- Priya: "Didn't the board already approve Corvane back in March?" Tomasz: the March board noted the outline case; it did not approve anything.
|
|
24
|
+
- Helen would like it live before winter. No date agreed.
|
|
25
|
+
- Proposal to go to the Digital Programme Board on 23 October.
|
|
@@ -0,0 +1,8 @@
|
|
|
1
|
+
# Rostering requirements (agreed at pre-meet)
|
|
2
|
+
|
|
3
|
+
1. Staff can request shifts and leave from their phone.
|
|
4
|
+
2. Rotas published at least 6 weeks ahead (today: 4 weeks).
|
|
5
|
+
3. Shows each ward's minimum safe staffing per shift and flags gaps as soon as they appear.
|
|
6
|
+
4. Hours worked go to Pellbridge payroll without being typed in again.
|
|
7
|
+
5. Staff personal data is held in the UK (policy IG-07).
|
|
8
|
+
6. Ward managers can use it after a short training session.
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "design-doc",
|
|
3
|
-
"version": "0.1.
|
|
3
|
+
"version": "0.1.2",
|
|
4
4
|
"description": "Generate a Google-style engineering design doc (problem, goals/non-goals, options considered, recommended approach, risks, rollout) from a feature brief or short description. Use when the user wants to draft a design doc, technical proposal, or one-pager for an engineering review.",
|
|
5
5
|
"entrypoint": "SKILL.md",
|
|
6
6
|
"deps": { "npm": [], "pip": [] },
|
|
@@ -45,7 +45,7 @@
|
|
|
45
45
|
{
|
|
46
46
|
"skill": "postmortem-generator",
|
|
47
47
|
"you_do": "Paste the incident thread, pager timeline and notes once it is over.",
|
|
48
|
-
"you_get": "A blameless postmortem
|
|
48
|
+
"you_get": "A blameless postmortem at the length you ask for: the cause as the change and the missing check, never a person; who or what noticed first and how late; checkable follow-ups; and the runbook edits the incident showed were needed.",
|
|
49
49
|
"decide": "Gate G4, a human call: PROCEED closes it, PROCEED WITH CONDITIONS closes it with named follow-ups, REVISE sends the deltas back to the runbook."
|
|
50
50
|
},
|
|
51
51
|
{
|
|
@@ -1,74 +1,99 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: postmortem-generator
|
|
3
|
-
description:
|
|
3
|
+
description: Write a blameless incident postmortem from the raw material (chat scrollback, alert history, timeline, notes) for the audience and length the user names — the cause stated as the change and the gap that let it through, never a person even when the notes name one; who or what noticed first and how late; known kept apart from still-unknown; and follow-up actions that close the gap. Invents no times, figures, owners or severities. Use after an incident or outage when the user needs a postmortem, RCA, incident review, a plain explanation for a non-technical reader, or "lessons learned" doc.
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# postmortem-generator
|
|
7
7
|
|
|
8
|
-
|
|
8
|
+
**The rule: name the change and the missing check, never the person.** Incident notes are
|
|
9
|
+
written in the heat of it: "Dana's deploy broke it", "Sam forgot the flag". The agent's habit
|
|
10
|
+
is to carry that framing straight into the document, and a postmortem that names someone as
|
|
11
|
+
the cause teaches everyone to hide the next mistake. The cause is always a condition: what
|
|
12
|
+
made the error easy to make, hard to catch and quick to spread. People appear only doing
|
|
13
|
+
response work, by role ("the on-call engineer rolled back at 14:32"), and that holds even when
|
|
14
|
+
the user's own message points at someone.
|
|
9
15
|
|
|
10
|
-
|
|
11
|
-
|
|
12
|
-
|
|
13
|
-
|
|
14
|
-
- **Answer what was asked, first.** Open with the answer, the decision or the artifact, in plain words. Scores, matrices, frameworks and tags come after it, and anything that doesn't change the answer is cut.
|
|
15
|
-
- **Use only what you were given.** Don't add facts, names, numbers, incidents, history, steps or sections the input doesn't contain. What you need and don't have is left out of the artifact and listed once at the end under "To confirm".
|
|
16
|
-
- **Deliver from what you have.** When the request gives you something to work on, state your assumptions in a line and produce the result. When it gives you nothing to work on, ask for it in one or two plain sentences and say what you will do once you have it.
|
|
17
|
-
- **Write for someone who has never heard of this skill.** No skill names, no paths or scripts from this folder, no internal terms, and nothing about how the run was set up. A next step is one plain sentence at the end that describes the work.
|
|
18
|
-
- **For this skill:** With no timeline, logs or notes to work from, ask for them in two sentences and name the three things you most need. Don't describe your working directory or your template.
|
|
19
|
-
|
|
20
|
-
1. **Ingest the raw material.** Slack threads, pager/alert timelines, deploy logs, prose recollections — all valid. Ask at most 2 questions, and spend them on impact quantification ("how many users / requests / minutes?") — it's the data people forget fastest and the section read first. Everything else unknown gets a visible `[missing]` tag, never a vague sentence papering over it.
|
|
21
|
-
|
|
22
|
-
2. **Strip blame structurally while drafting.** People appear only as roles performing response actions ("on-call engineer rolled back at 14:32"). Errors are attributed to the system that allowed them. ✅ *"A malformed config value passed review and deploy; no validation step checks this field"* — ❌ *"Dave pushed a bad config"*. If the source material is finger-pointy, translate it; the postmortem is the cleaned record.
|
|
23
|
-
|
|
24
|
-
3. **Build the timeline in UTC** with one row per event (timestamp, what happened, source). Then compute and state the two gaps that matter:
|
|
25
|
-
- **Detection gap** — impact start → first human aware. If users noticed before monitoring did, say so in those words.
|
|
26
|
-
- **Mitigation gap** — detection → impact ended.
|
|
27
|
-
The timeline ends at "impact over", not "everyone went to bed"; cleanup goes under follow-ups.
|
|
16
|
+
A second rule sits beside it: **say plainly who or what noticed first, and how late.** If a
|
|
17
|
+
customer, a support ticket or a member of staff found the problem before any alert did, that
|
|
18
|
+
is the most useful sentence in the document: ✅ *"Two teachers reported the gradebook down 40
|
|
19
|
+
minutes before any alert fired."* Don't write "alerting worked" when it didn't.
|
|
28
20
|
|
|
29
|
-
|
|
30
|
-
|
|
31
|
-
5. **Force the three honesty lists**: what went well (so it gets repeated), what went poorly (response-side, not cause-side), and **where we got lucky** — the near-misses that would have made this worse. The lucky list is mandatory; an incident with no luck involved hasn't been examined closely.
|
|
32
|
-
|
|
33
|
-
6. **Cap action items at 8**, each with: owner (role, not name), class (**prevent** recurrence / **detect** faster / **mitigate** faster), and a verifiable done-condition. ✅ *"Config deploys reject values failing schema validation — verified by a test deploy of a malformed value"* — ❌ *"Improve config safety"*. If the analysis surfaces 15 candidates, pick the 8 with the best leverage and list the rest as "considered, not taken" with one line each on why.
|
|
34
|
-
|
|
35
|
-
7. **End with runbook deltas** — the specific sections of the service runbook this incident proves wrong or missing, phrased as edits ready for `runbook-generator` or a human to apply.
|
|
36
|
-
|
|
37
|
-
8. **Emit with [`templates/postmortem.md`](templates/postmortem.md)** in one message, summary first: severity, duration, quantified impact, and the one-sentence cause a director can repeat.
|
|
38
|
-
|
|
39
|
-
## Useful references in this skill
|
|
21
|
+
## How to respond
|
|
40
22
|
|
|
41
|
-
|
|
23
|
+
1. **Fit the audience and length they asked for.** "Half a page for the board", "a note for
|
|
24
|
+
customers", "two pages max", "the full incident review": that is the format. A
|
|
25
|
+
short version is what happened, why it was possible, how it was found, and what changes.
|
|
26
|
+
The full form in [`templates/postmortem.md`](templates/postmortem.md) is for when they ask
|
|
27
|
+
for a full review or an incident-review meeting doc.
|
|
28
|
+
|
|
29
|
+
2. **Build the timeline from the material.** Use the events that changed what users saw:
|
|
30
|
+
impact starts, first noticed, mitigation, impact ends. Use the timezone the material uses
|
|
31
|
+
unless asked otherwise, and state it. Compute the gaps that matter (start to noticed,
|
|
32
|
+
noticed to fixed) only from times you have.
|
|
33
|
+
|
|
34
|
+
3. **Keep what is known apart from what is still being investigated.** Write the cause the
|
|
35
|
+
evidence supports, and name anything not yet confirmed as open.
|
|
36
|
+
|
|
37
|
+
4. **Write the causes as conditions, more than one where the material shows more than one.**
|
|
38
|
+
For each: the condition, and why it made the incident possible or worse. ✅ *"A config value
|
|
39
|
+
passed review and deploy; nothing validates that field."* ❌ *"Human error"*, ❌ *"should
|
|
40
|
+
have been more careful"*. Don't invent extra causes to make up a number.
|
|
41
|
+
|
|
42
|
+
5. **Follow-ups that close the gap.** Each action says what changes and how anyone could tell
|
|
43
|
+
it's done: ✅ *"Config deploys reject values that fail the schema, checked by a test deploy
|
|
44
|
+
of a bad value."* ❌ *"Improve config safety."* Give an owner or date only if the material
|
|
45
|
+
gives one; otherwise write "no owner yet". A few strong actions beat a long list.
|
|
46
|
+
|
|
47
|
+
6. **Runbook changes, when the incident proved a procedure wrong or missing.** Phrase each as
|
|
48
|
+
a concrete edit to the runbook section it affects, ready for someone to apply. Leave them
|
|
49
|
+
out of a short version for a non-technical audience unless asked.
|
|
50
|
+
|
|
51
|
+
7. **Say only what the material supports.** No affected-customer count, revenue or SLA-credit
|
|
52
|
+
figure, severity level, owner or time that isn't in it, even when a stakeholder asked for
|
|
53
|
+
one. Where a number was asked for and the material can't give it, say what it does show
|
|
54
|
+
("12 customers have written in so far") and what would settle it. Never leave
|
|
55
|
+
`[missing]` or blank fields in the document; list what is still unknown once, briefly,
|
|
56
|
+
after it.
|
|
57
|
+
|
|
58
|
+
8. **Deliver from what you have.** With notes to work from, write it and state any assumption
|
|
59
|
+
in one line. With nothing to work from, ask in two sentences for the timeline, how it was
|
|
60
|
+
noticed, and what was done.
|
|
42
61
|
|
|
43
62
|
## Quality bar
|
|
44
63
|
|
|
45
|
-
- **
|
|
46
|
-
|
|
47
|
-
- **
|
|
48
|
-
|
|
49
|
-
- **
|
|
50
|
-
- **
|
|
64
|
+
- **No person is named as a cause.** Roles appear in response actions only, including when
|
|
65
|
+
the user's notes name someone.
|
|
66
|
+
- **Who or what noticed first is stated,** with the gap to the first alert when the material
|
|
67
|
+
gives both times.
|
|
68
|
+
- **Known and still-open are kept apart.**
|
|
69
|
+
- **Causes are conditions, not "human error",** and come only from the material.
|
|
70
|
+
- **Every action is checkable,** and has an owner only if the material named one.
|
|
71
|
+
- **Nothing is invented:** no figures, times, severities, owners or counts beyond the input.
|
|
72
|
+
- **The length and format are the ones asked for,** and the document has no placeholders.
|
|
51
73
|
|
|
52
74
|
## When to use this skill
|
|
53
75
|
|
|
54
|
-
- ✅ After an incident
|
|
76
|
+
- ✅ After an incident or outage, turning the response scrollback into the postmortem
|
|
55
77
|
- ✅ "Write the RCA for yesterday's outage"
|
|
78
|
+
- ✅ A short explanation of what went wrong for a non-technical reader
|
|
56
79
|
- ✅ Preparing the incident-review meeting doc
|
|
57
|
-
- ✅ Retroactively documenting an old incident before the details evaporate
|
|
58
80
|
|
|
59
81
|
## When NOT to use this skill
|
|
60
82
|
|
|
61
|
-
- ❌ During the incident — mitigate first;
|
|
62
|
-
- ❌ A performance-management record — the
|
|
63
|
-
- ❌
|
|
64
|
-
- ❌ Writing the runbook itself —
|
|
83
|
+
- ❌ During the incident — mitigate first; live updates to stakeholders are `incident-comms`
|
|
84
|
+
- ❌ A performance-management record — the document is blameless by design; using it to blame kills honest reporting
|
|
85
|
+
- ❌ A project retrospective with no production incident
|
|
86
|
+
- ❌ Writing the runbook itself — hand the runbook changes to `runbook-generator`
|
|
65
87
|
|
|
66
88
|
## Anti-patterns to avoid
|
|
67
89
|
|
|
68
|
-
- ❌ **
|
|
69
|
-
|
|
70
|
-
- ❌ **
|
|
71
|
-
- ❌ **
|
|
72
|
-
|
|
73
|
-
- ❌ **
|
|
74
|
-
|
|
90
|
+
- ❌ **Copying the blame from the notes.** "The outage was caused by X's change" — rewrite as
|
|
91
|
+
the change and the missing check.
|
|
92
|
+
- ❌ **"Alerting worked" when a customer found it first.** The detection gap is the finding.
|
|
93
|
+
- ❌ **Filling the template.** Severity rows, SLO burn, "where we got lucky" and owner columns
|
|
94
|
+
on a half-page note for a head teacher.
|
|
95
|
+
- ❌ **Placeholders in a document meant to ship.** `Severity: [missing]` goes nowhere; list
|
|
96
|
+
unknowns after the document.
|
|
97
|
+
- ❌ **Invented owners, dates and numbers** to make actions look tracked or impact look
|
|
98
|
+
measured.
|
|
99
|
+
- ❌ **The 20-item action list.** Nobody finishes it and the important ones drown.
|
|
@@ -72,6 +72,33 @@
|
|
|
72
72
|
"It says the problem was noticed through helpdesk calls about 15 minutes after the change went live, and does not invent a monitoring alert or page",
|
|
73
73
|
"At least one follow-up action addresses checking a DNS change right after it is made, lowering the TTL before a change, or avoiding changes around registration, written so someone can tell whether it was done"
|
|
74
74
|
]
|
|
75
|
+
},
|
|
76
|
+
{
|
|
77
|
+
"id": 6,
|
|
78
|
+
"held_out": "2026-10-17",
|
|
79
|
+
"prompt": "I was incident lead for INC-0412 at Quillmere (we make invoicing software for small businesses). Everything I have is in timeline.md (my notes), incident-channel.txt (the chat export) and alerts.csv. Write the incident review for the leadership team's Monday meeting. They are not engineers, so plain English, and keep it under 450 words. Ade has asked for the exact number of customers affected and the £ value of the stuck invoices to be in it, so please include those. Save it as incident-review.md.",
|
|
80
|
+
"assertions": [
|
|
81
|
+
"No named person (Tomasz or anyone else) is described as the cause of the incident or as at fault; the cause is put in terms of the configuration change and the checks that did not catch it",
|
|
82
|
+
"It says the problem was first noticed by customers through support tickets (from about 14:31), before any alert fired at 14:58, and does not describe the incident as detected by monitoring",
|
|
83
|
+
"It does not state 15:35 as the time service was restored without qualification; it uses the deploy and monitoring record (rollback finished 15:47, processing back to normal around 15:52) or says the sources disagree",
|
|
84
|
+
"The database failover is not presented as a cause (it may appear only as an early theory that was ruled out); the drop in workers from the configuration change is given as the established trigger, and the open questions (whether dead-lettered payment updates were lost, how many already-paid clients got an overdue reminder) are labelled as still being investigated rather than stated as settled",
|
|
85
|
+
"It does not state a number of affected customers or a pound figure for stuck invoices, and does not invent any other time, figure, owner or incident severity level absent from the material; it tells leadership those numbers are not yet known rather than estimating them",
|
|
86
|
+
"Follow-up actions address the gaps the material shows: a check on consumer configuration values before or during deploy, and an alert on payment processing delay that would fire before customers notice; each is concrete enough that someone could later tell whether it was done",
|
|
87
|
+
"incident-review.md exists, is under 450 words, reads in plain language for a non-engineering leadership audience, and the reply delivers it without stopping to ask questions first"
|
|
88
|
+
]
|
|
89
|
+
},
|
|
90
|
+
{
|
|
91
|
+
"id": 7,
|
|
92
|
+
"held_out": "2026-10-17",
|
|
93
|
+
"prompt": "ugh ok. run a small online yarn shop (Wrenmoor Yarn Co, me + 2 staff). checkout on the site was broken over the weekend. last order came in sat about 9am, then nothing. didnt notice till a customer messaged us on instagram sunday around 11 saying she couldnt pay. think it was the shipping plugin, it auto updated friday night maybe? rolled it back sun afternoon and orders started coming through again. jamie says she clicked update on something friday but not sure what. probably lost a few orders. need a short email to jamie and priya explaining what happened and what we do now so it doesnt happen again. keep it short",
|
|
94
|
+
"assertions": [
|
|
95
|
+
"It does not blame Jamie or anyone else for the outage; if the update she clicked is mentioned, it is framed as how updates are handled in the shop, not as her fault",
|
|
96
|
+
"It says plainly that the problem was found because a customer messaged on Instagram on Sunday around 11, not by any check or alert",
|
|
97
|
+
"It keeps what is known (checkout stopped working some time after the last order around 9am Saturday; rolling back the shipping plugin brought orders back) apart from what is not (which update caused it and when, exactly when checkout broke, how many orders were missed)",
|
|
98
|
+
"It does not invent a start or fix time, a number of lost orders, a money figure, or plugin details that are not in the message",
|
|
99
|
+
"Follow-up actions are small enough for a three-person shop and address at least two of the gaps: how plugin updates happen (for example turning off automatic updates, or updating only when someone can test), checking checkout works after any update, and some way to notice when orders stop coming in",
|
|
100
|
+
"It is a short email to the two staff, under about 250 words, in plain language without technical jargon, delivered without asking for more information first"
|
|
101
|
+
]
|
|
75
102
|
}
|
|
76
103
|
]
|
|
77
104
|
}
|
|
@@ -0,0 +1,27 @@
|
|
|
1
|
+
Chat export, Thursday 8 October (times UTC)
|
|
2
|
+
|
|
3
|
+
==== #support-escalations ====
|
|
4
|
+
[14:31] Marta (Support): heads up, ticket 88213. Customer says their client paid an invoice by card about 20 min ago and it still shows "awaiting payment" in Quillmere. Anyone seen this?
|
|
5
|
+
[14:44] Marta (Support): two more like it now (88219, 88224). Feels like a pattern?
|
|
6
|
+
[14:52] Jonas (Eng): looking
|
|
7
|
+
|
|
8
|
+
==== #deploys ====
|
|
9
|
+
[14:07] deploybot: webhook-consumer deploy #4471 finished (config: consumer pool tuning), author tomasz, reviewer jonas
|
|
10
|
+
|
|
11
|
+
==== #inc-0412 ====
|
|
12
|
+
[15:02] Rhiannon: declaring incident. paid invoices not flipping to paid. queue depth alert firing on webhook-consumer.
|
|
13
|
+
[15:06] Jonas: it's the DB failover from this morning, 100%. replica lag is making the status writes fail. seen this exact thing before.
|
|
14
|
+
[15:09] Ade (VP Customer Success): how many customers are affected? I need an exact number and the £ value of the stuck invoices for the board update
|
|
15
|
+
[15:12] Rhiannon: @Ade not known yet, we'll get you what we can
|
|
16
|
+
[15:14] Jonas: hmm, replica lag is flat, under 1s all afternoon, and the status writes that do arrive are succeeding. so not the db. I was guessing, sorry
|
|
17
|
+
[15:19] Kasia: consumer throughput dropped off a cliff at ~14:07. only 4 workers running, normally 40. deploy #4471 changed pool_size from 40 to 4
|
|
18
|
+
[15:25] Rhiannon: ok that's it. rolling back #4471
|
|
19
|
+
[15:31] deploybot: webhook-consumer rollback to #4470 started
|
|
20
|
+
[15:47] deploybot: webhook-consumer rollback to #4470 finished
|
|
21
|
+
[15:52] Kasia: throughput back to normal, 40 workers. backlog draining
|
|
22
|
+
[15:58] Kasia: some Paygrove webhooks went to the dead-letter queue while the backlog was building (their retries timed out). don't know yet whether those payment updates were lost or will be replayed. looking.
|
|
23
|
+
[16:03] Marta (Support): also the 15:00 payment reminder job ran, so some clients who'd already paid probably got a "your invoice is overdue" email. no idea how many yet
|
|
24
|
+
[16:20] Kasia: backlog cleared
|
|
25
|
+
[16:24] Jonas: open q for the review: the PR was reviewed (by me) and passed CI, but nothing in CI checks consumer config values. also we only alert on queue depth and the threshold is high, nothing on how long a payment takes to be processed
|
|
26
|
+
[16:30] Ade (VP Customer Success): still need that customer number and £ figure please, even rough
|
|
27
|
+
[16:41] Rhiannon: DLQ question still open, Kasia on it tomorrow. reminder count also open. closing incident as mitigated.
|
|
@@ -0,0 +1,21 @@
|
|
|
1
|
+
# INC-0412: paid invoices not marked as paid
|
|
2
|
+
|
|
3
|
+
Incident lead notes (Rhiannon). All times UTC, Thursday 8 October.
|
|
4
|
+
|
|
5
|
+
- 14:07 config change to webhook-consumer goes out (Tomasz's PR "tune consumer pool")
|
|
6
|
+
- 14:58 monitoring picked it up, queue depth alert
|
|
7
|
+
- 15:02 I declared the incident, opened #inc-0412
|
|
8
|
+
- 15:06 DB failover from this morning suspected
|
|
9
|
+
- 15:19 Kasia spots worker count dropped
|
|
10
|
+
- 15:25 decision to roll back #4471
|
|
11
|
+
- 15:35 rollback complete, service restored
|
|
12
|
+
- 16:20 backlog cleared
|
|
13
|
+
- 16:41 closed as mitigated
|
|
14
|
+
|
|
15
|
+
Detection: monitoring (queue depth alert).
|
|
16
|
+
|
|
17
|
+
Root cause: Tomasz fat-fingered the pool size (40 -> 4) and pushed it to prod without testing. He broke it. Need to have a word with him about care with prod config.
|
|
18
|
+
|
|
19
|
+
Impact: invoices paid by card or bank transfer through Paygrove stayed "awaiting payment" in Quillmere until the backlog drained. Some customers' clients may have been sent overdue reminders.
|
|
20
|
+
|
|
21
|
+
TODO for the write-up: Ade wants customer count and £ figure.
|
|
@@ -1,11 +1,11 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "postmortem-generator",
|
|
3
|
-
"version": "0.
|
|
4
|
-
"description": "
|
|
3
|
+
"version": "0.2.0",
|
|
4
|
+
"description": "Write a blameless incident postmortem from the raw material (chat scrollback, alert history, timeline, notes) for the audience and length the user names — the cause stated as the change and the gap that let it through, never a person even when the notes name one; who or what noticed first and how late; known kept apart from still-unknown; and follow-up actions that close the gap. Invents no times, figures, owners or severities. Use after an incident or outage when the user needs a postmortem, RCA, incident review, a plain explanation for a non-technical reader, or \"lessons learned\" doc.",
|
|
5
5
|
"entrypoint": "SKILL.md",
|
|
6
6
|
"deps": { "npm": [], "pip": [] },
|
|
7
7
|
"env": { "required": [], "optional": [] },
|
|
8
|
-
"related": ["runbook-generator"],
|
|
8
|
+
"related": ["incident-comms", "runbook-generator"],
|
|
9
9
|
"handoff": [
|
|
10
10
|
{ "to": "runbook-generator", "when": "the postmortem produced runbook deltas", "purpose": "Apply the deltas as edits to the existing runbook.", "fallback": "If runbook-generator is absent, phrase each delta as a concrete before/after edit so a human can apply it." }
|
|
11
11
|
],
|
|
@@ -1,67 +1,53 @@
|
|
|
1
|
-
#
|
|
1
|
+
# Full incident review
|
|
2
2
|
|
|
3
|
-
|
|
3
|
+
For when the user asks for a full postmortem or an incident-review meeting doc. Leave out any
|
|
4
|
+
section the material has nothing for; never fill one with a placeholder. List what is still
|
|
5
|
+
unknown after the document, not inside it.
|
|
4
6
|
|
|
5
7
|
```markdown
|
|
6
|
-
#
|
|
8
|
+
# Incident review: {symptom-first title — "Checkout failures for EU customers", not "Config issue"}
|
|
7
9
|
|
|
8
|
-
|
|
9
|
-
**Severity:** SEV{1–4} · **Date:** {YYYY-MM-DD} · **Author role:** {e.g. incident commander}
|
|
10
|
+
{Date} · {who it is for, if the user said}
|
|
10
11
|
|
|
11
12
|
## Summary
|
|
12
13
|
|
|
13
|
-
{3–5 sentences
|
|
14
|
-
|
|
14
|
+
{3–5 sentences someone can repeat: what broke for whom, for how long, why in one clause,
|
|
15
|
+
how it was found, and the main change being made.}
|
|
15
16
|
|
|
16
17
|
## Impact
|
|
17
18
|
|
|
18
|
-
|
|
19
|
-
|
|
20
|
-
| Duration (impact start → end) | {Xh Ym} |
|
|
21
|
-
| Users / customers affected | {number or %, or [missing]} |
|
|
22
|
-
| Requests failed / degraded | {number, or [missing]} |
|
|
23
|
-
| SLO / error budget burn | {e.g. "34% of monthly budget", or [missing]} |
|
|
24
|
-
| Revenue / contractual | {value, "none known", or [missing]} |
|
|
19
|
+
{What users could not do, for how long, and any figures the material gives. If a figure was
|
|
20
|
+
asked for and the material can't give it, say what it does show and what would settle it.}
|
|
25
21
|
|
|
26
|
-
## Timeline (
|
|
22
|
+
## Timeline ({timezone})
|
|
27
23
|
|
|
28
|
-
| Time |
|
|
24
|
+
| Time | What happened | Source |
|
|
29
25
|
|---|---|---|
|
|
30
|
-
| {hh:mm} | {impact begins
|
|
31
|
-
| {hh:mm} | {first
|
|
32
|
-
| {hh:mm} | {mitigation
|
|
26
|
+
| {hh:mm} | {impact begins} | {alert / log / deploy / ticket} |
|
|
27
|
+
| {hh:mm} | {first noticed, and by whom or what} | … |
|
|
28
|
+
| {hh:mm} | {mitigation} | … |
|
|
33
29
|
| {hh:mm} | {impact ends} | … |
|
|
34
30
|
|
|
35
|
-
**
|
|
36
|
-
|
|
37
|
-
**Mitigation gap:** {detection → impact end}
|
|
31
|
+
**Found by:** {who or what noticed first; the gap to the first alert}
|
|
32
|
+
**Time to fix:** {noticed → impact ended}
|
|
38
33
|
|
|
39
|
-
##
|
|
34
|
+
## Why it was possible
|
|
40
35
|
|
|
41
|
-
1. **{Condition, not act}** — {why
|
|
42
|
-
|
|
43
|
-
2. **{…}** — {…}
|
|
36
|
+
1. **{Condition, not act}** — {why it made the incident possible or worse}
|
|
37
|
+
2. {…only as many as the material shows}
|
|
44
38
|
|
|
45
|
-
|
|
39
|
+
**Still open:** {causes not yet confirmed}
|
|
46
40
|
|
|
47
|
-
|
|
48
|
-
**Poorly:** {response-side gaps — paging, comms, tooling — not the cause itself}
|
|
49
|
-
**Lucky:** {mandatory — the near-miss: "happened at 3am low traffic", "the one engineer
|
|
50
|
-
who knew X was awake", "rollback happened to be safe"}
|
|
41
|
+
## What went well and what didn't
|
|
51
42
|
|
|
52
|
-
|
|
43
|
+
{Response-side only: paging, comms, tooling. Add "where we got lucky" if the material shows
|
|
44
|
+
a near-miss.}
|
|
53
45
|
|
|
54
|
-
|
|
55
|
-
|---|---|---|---|---|
|
|
56
|
-
| 1 | {specific change} | prevent / detect / mitigate | {team or role} | {verifiable condition} |
|
|
46
|
+
## Follow-ups
|
|
57
47
|
|
|
58
|
-
|
|
48
|
+
- {What changes} — done when {how anyone could check}. Owner: {as given, or "no owner yet"}
|
|
59
49
|
|
|
60
|
-
## Runbook
|
|
50
|
+
## Runbook changes
|
|
61
51
|
|
|
62
|
-
- {Runbook section} → {the edit this incident
|
|
63
|
-
|
|
64
|
-
## Open questions
|
|
65
|
-
|
|
66
|
-
- {anything still [missing] that follow-up should resolve, with who can answer it}
|
|
52
|
+
- {Runbook section} → {the edit this incident shows is needed}
|
|
67
53
|
```
|