qatools-cli 1.1.2 → 1.1.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/package.json +1 -1
- package/qatools.js +18 -0
package/package.json
CHANGED
package/qatools.js
CHANGED
|
@@ -1863,6 +1863,12 @@ Every claim, verdict, analysis, and recommendation MUST cite specific evidence:
|
|
|
1863
1863
|
|
|
1864
1864
|
## If you're unsure
|
|
1865
1865
|
Say "I'm unsure" — that's better than guessing. Suggest what evidence would resolve the uncertainty.
|
|
1866
|
+
|
|
1867
|
+
## Specialized skills
|
|
1868
|
+
|
|
1869
|
+
There is a specific skill for **algorithmic and numerical** bugs: \`qa-numerical-verification.md\`. Read it when you're fixing a formula or any code where the bug is "wrong number" rather than "wrong structure".
|
|
1870
|
+
|
|
1871
|
+
If you encounter a different recurring bug class that needs its own verification pattern (UI regressions, race conditions, data integrity, etc.), create a NEW specific skill (\`qa-<class>-verification.md\`) rather than expanding this file or building a monolithic "fix-checklist". The pattern is: principle here, specific category in its own skill, CLI enforces evidence regardless of category. Don't build a generic checklist for hypothetical categories — let real biting cases drive the need.
|
|
1866
1872
|
`,
|
|
1867
1873
|
"qa-numerical-verification.md": `---
|
|
1868
1874
|
description: How to verify algorithmic and numerical bug fixes. Read this when fixing a formula, calculation, or any code where the bug is "wrong number" rather than "wrong structure".
|
|
@@ -1874,6 +1880,18 @@ Most evidence-first examples deal with structural bugs (NullReferenceException,
|
|
|
1874
1880
|
|
|
1875
1881
|
This skill is for those bugs. The verification pattern is non-negotiable.
|
|
1876
1882
|
|
|
1883
|
+
## Before you start — entry-point checklist
|
|
1884
|
+
|
|
1885
|
+
Stop here and answer these BEFORE writing any verification code:
|
|
1886
|
+
|
|
1887
|
+
- [ ] Which input or test case actually triggers the bug? (Not "the system" — name a specific input.)
|
|
1888
|
+
- [ ] Does that input have non-zero, non-default values for the field the bug touches? (If everything is 0 or NULL, multiplying by anything gives the same result — the input cannot discriminate buggy from fixed code.)
|
|
1889
|
+
- [ ] If your input is non-discriminating: change it, or pick a different input. Never proceed with "the data doesn't show it".
|
|
1890
|
+
- [ ] Where will you write the expected and actual values? Answer: in the --evidence flag when you set status. If the values are large, also save them to a file you reference in evidence ("see /tmp/verify-2026-04-08.txt").
|
|
1891
|
+
- [ ] Can you compute the expected value by hand from the formula in under 60 seconds? If not, the formula is too complex for this verification — break it into pieces and verify each.
|
|
1892
|
+
|
|
1893
|
+
If any answer is "I don't know", stop and ask. Don't guess.
|
|
1894
|
+
|
|
1877
1895
|
## The pattern
|
|
1878
1896
|
|
|
1879
1897
|
1. **Trivialize the input.** Pick values that make the formula readable. Set multipliers to 1, set inputs to round numbers (10, 100), set toggles to known states.
|