dsh-math-modeling-agent 0.4.1 → 0.5.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +247 -187
- package/package.json +34 -34
- package/skills/math-modeling-agent/SKILL.md +70 -69
- package/skills/math-modeling-agent/references/claims-evidence.md +53 -41
- package/skills/math-modeling-agent/references/interaction-protocol.md +165 -163
- package/skills/math-modeling-agent/references/report-contract.md +130 -122
- package/skills/math-modeling-agent/references/run-directory.md +65 -62
- package/skills/math-modeling-agent/references/verification-recipes.md +43 -0
- package/skills/math-modeling-agent/schemas/attempt.schema.json +89 -70
- package/skills/math-modeling-agent/schemas/evidence.schema.json +110 -0
- package/skills/math-modeling-agent/schemas/failure.schema.json +30 -0
- package/skills/math-modeling-agent/schemas/ledger.schema.json +88 -68
- package/skills/math-modeling-agent/schemas/run.schema.json +126 -102
- package/skills/math-modeling-agent/schemas/verification.schema.json +60 -0
- package/skills/math-modeling-agent/scripts/correction-lineage.mjs +78 -0
- package/skills/math-modeling-agent/scripts/evidence-store.mjs +349 -0
- package/skills/math-modeling-agent/scripts/failure-insights.mjs +79 -0
- package/skills/math-modeling-agent/scripts/input-snapshot.mjs +98 -0
- package/skills/math-modeling-agent/scripts/ledger-mutation.mjs +82 -0
- package/skills/math-modeling-agent/scripts/migration-v3.mjs +31 -0
- package/skills/math-modeling-agent/scripts/output-integrity.mjs +82 -0
- package/skills/math-modeling-agent/scripts/paper-evidence.mjs +45 -0
- package/skills/math-modeling-agent/scripts/report-contract.mjs +112 -0
- package/skills/math-modeling-agent/scripts/run-state.mjs +829 -707
- package/skills/math-modeling-agent/scripts/verification-recipes.mjs +52 -0
- package/skills/math-modeling-agent/scripts/verification-runner.mjs +8 -0
- package/skills/math-modeling-audit/SKILL.md +41 -41
- package/skills/math-modeling-audit/references/mcm-icm-final-judge.md +335 -331
- package/skills/math-modeling-audit/scripts/mcm-score.mjs +293 -218
- package/skills/math-modeling-audit/scripts/paper-final-review.mjs +40 -0
- package/skills/math-modeling-audit/scripts/project-initial-review.mjs +41 -0
|
@@ -1,331 +1,335 @@
|
|
|
1
|
-
# MCM/ICM Final Judging Panel
|
|
2
|
-
|
|
3
|
-
This is a simulated 100-point final-panel framework, not a COMAP official quantitative scorecard. Review as if the paper is competing for Outstanding Winner or Finalist. Do not coach, reward effort, or supply missing evidence.
|
|
4
|
-
|
|
5
|
-
##
|
|
6
|
-
|
|
7
|
-
-
|
|
8
|
-
|
|
9
|
-
-
|
|
10
|
-
|
|
11
|
-
-
|
|
12
|
-
-
|
|
13
|
-
|
|
14
|
-
|
|
15
|
-
|
|
16
|
-
|
|
17
|
-
|
|
18
|
-
1
|
|
19
|
-
|
|
20
|
-
|
|
21
|
-
|
|
22
|
-
|
|
23
|
-
|
|
24
|
-
|
|
25
|
-
|
|
26
|
-
|
|
27
|
-
|
|
28
|
-
|
|
29
|
-
|
|
30
|
-
|
|
31
|
-
|
|
32
|
-
|
|
33
|
-
|
|
34
|
-
|
|
35
|
-
|
|
36
|
-
|
|
37
|
-
|
|
38
|
-
-
|
|
39
|
-
|
|
40
|
-
-
|
|
41
|
-
-
|
|
42
|
-
-
|
|
43
|
-
-
|
|
44
|
-
-
|
|
45
|
-
|
|
46
|
-
|
|
47
|
-
|
|
48
|
-
|
|
49
|
-
|
|
50
|
-
|
|
51
|
-
|
|
52
|
-
|
|
53
|
-
|
|
54
|
-
#### 1.
|
|
55
|
-
|
|
56
|
-
Check
|
|
57
|
-
|
|
58
|
-
#### 1.
|
|
59
|
-
|
|
60
|
-
Check
|
|
61
|
-
|
|
62
|
-
|
|
63
|
-
|
|
64
|
-
|
|
65
|
-
|
|
66
|
-
|
|
67
|
-
|
|
68
|
-
#### 2.
|
|
69
|
-
|
|
70
|
-
|
|
71
|
-
|
|
72
|
-
#### 2.
|
|
73
|
-
|
|
74
|
-
Check
|
|
75
|
-
|
|
76
|
-
#### 2.
|
|
77
|
-
|
|
78
|
-
|
|
79
|
-
|
|
80
|
-
#### 2.
|
|
81
|
-
|
|
82
|
-
|
|
83
|
-
|
|
84
|
-
|
|
85
|
-
|
|
86
|
-
|
|
87
|
-
|
|
88
|
-
|
|
89
|
-
|
|
90
|
-
#### 3.
|
|
91
|
-
|
|
92
|
-
|
|
93
|
-
|
|
94
|
-
#### 3.
|
|
95
|
-
|
|
96
|
-
|
|
97
|
-
|
|
98
|
-
#### 3.
|
|
99
|
-
|
|
100
|
-
Check
|
|
101
|
-
|
|
102
|
-
#### 3.
|
|
103
|
-
|
|
104
|
-
Check
|
|
105
|
-
|
|
106
|
-
#### 3.
|
|
107
|
-
|
|
108
|
-
Check
|
|
109
|
-
|
|
110
|
-
|
|
111
|
-
|
|
112
|
-
|
|
113
|
-
|
|
114
|
-
|
|
115
|
-
|
|
116
|
-
#### 4.
|
|
117
|
-
|
|
118
|
-
|
|
119
|
-
|
|
120
|
-
#### 4.
|
|
121
|
-
|
|
122
|
-
Check
|
|
123
|
-
|
|
124
|
-
#### 4.
|
|
125
|
-
|
|
126
|
-
Check
|
|
127
|
-
|
|
128
|
-
#### 4.
|
|
129
|
-
|
|
130
|
-
Check
|
|
131
|
-
|
|
132
|
-
|
|
133
|
-
|
|
134
|
-
|
|
135
|
-
|
|
136
|
-
|
|
137
|
-
|
|
138
|
-
#### 5.
|
|
139
|
-
|
|
140
|
-
|
|
141
|
-
|
|
142
|
-
#### 5.
|
|
143
|
-
|
|
144
|
-
|
|
145
|
-
|
|
146
|
-
#### 5.
|
|
147
|
-
|
|
148
|
-
|
|
149
|
-
|
|
150
|
-
#### 5.
|
|
151
|
-
|
|
152
|
-
|
|
153
|
-
|
|
154
|
-
#### 5.
|
|
155
|
-
|
|
156
|
-
|
|
157
|
-
|
|
158
|
-
#### 5.
|
|
159
|
-
|
|
160
|
-
|
|
161
|
-
|
|
162
|
-
|
|
163
|
-
|
|
164
|
-
|
|
165
|
-
|
|
166
|
-
|
|
167
|
-
|
|
168
|
-
#### 6.
|
|
169
|
-
|
|
170
|
-
|
|
171
|
-
|
|
172
|
-
#### 6.
|
|
173
|
-
|
|
174
|
-
|
|
175
|
-
|
|
176
|
-
#### 6.
|
|
177
|
-
|
|
178
|
-
|
|
179
|
-
|
|
180
|
-
|
|
181
|
-
|
|
182
|
-
|
|
183
|
-
|
|
184
|
-
|
|
185
|
-
|
|
186
|
-
#### 7.
|
|
187
|
-
|
|
188
|
-
Check
|
|
189
|
-
|
|
190
|
-
#### 7.
|
|
191
|
-
|
|
192
|
-
Check
|
|
193
|
-
|
|
194
|
-
#### 7.
|
|
195
|
-
|
|
196
|
-
Check
|
|
197
|
-
|
|
198
|
-
#### 7.
|
|
199
|
-
|
|
200
|
-
Check
|
|
201
|
-
|
|
202
|
-
#### 7.
|
|
203
|
-
|
|
204
|
-
Check
|
|
205
|
-
|
|
206
|
-
|
|
207
|
-
|
|
208
|
-
|
|
209
|
-
|
|
210
|
-
|
|
211
|
-
|
|
212
|
-
|
|
213
|
-
|
|
214
|
-
-
|
|
215
|
-
-
|
|
216
|
-
-
|
|
217
|
-
|
|
218
|
-
|
|
219
|
-
|
|
220
|
-
|
|
221
|
-
|
|
222
|
-
|
|
223
|
-
|
|
224
|
-
|
|
225
|
-
|
|
226
|
-
|
|
227
|
-
|
|
228
|
-
|
|
229
|
-
|
|
230
|
-
|
|
231
|
-
|
|
232
|
-
|
|
233
|
-
|
|
234
|
-
|
|
235
|
-
|
|
236
|
-
|
|
237
|
-
|
|
238
|
-
|
|
239
|
-
|
|
240
|
-
|
|
241
|
-
|
|
242
|
-
|
|
243
|
-
|
|
244
|
-
|
|
245
|
-
|
|
246
|
-
-
|
|
247
|
-
-
|
|
248
|
-
|
|
249
|
-
|
|
250
|
-
|
|
251
|
-
|
|
252
|
-
|
|
253
|
-
|
|
254
|
-
|
|
255
|
-
|
|
256
|
-
|
|
257
|
-
-
|
|
258
|
-
-
|
|
259
|
-
|
|
260
|
-
|
|
261
|
-
|
|
262
|
-
|
|
263
|
-
|
|
264
|
-
|
|
265
|
-
|
|
266
|
-
|
|
267
|
-
|
|
268
|
-
|
|
269
|
-
|
|
270
|
-
###
|
|
271
|
-
|
|
272
|
-
|
|
273
|
-
|
|
274
|
-
###
|
|
275
|
-
|
|
276
|
-
|
|
277
|
-
|
|
278
|
-
###
|
|
279
|
-
|
|
280
|
-
|
|
281
|
-
|
|
282
|
-
|
|
283
|
-
|
|
284
|
-
|
|
285
|
-
|
|
286
|
-
|
|
287
|
-
|
|
288
|
-
|
|
289
|
-
|
|
290
|
-
|
|
291
|
-
|
|
292
|
-
|
|
293
|
-
|
|
294
|
-
|
|
295
|
-
|
|
296
|
-
###
|
|
297
|
-
|
|
298
|
-
|
|
299
|
-
|
|
300
|
-
###
|
|
301
|
-
|
|
302
|
-
|
|
303
|
-
|
|
304
|
-
|
|
305
|
-
|
|
306
|
-
|
|
307
|
-
|
|
308
|
-
|
|
309
|
-
|
|
310
|
-
|
|
311
|
-
###
|
|
312
|
-
|
|
313
|
-
|
|
314
|
-
|
|
315
|
-
###
|
|
316
|
-
|
|
317
|
-
|
|
318
|
-
|
|
319
|
-
###
|
|
320
|
-
|
|
321
|
-
|
|
322
|
-
|
|
323
|
-
###
|
|
324
|
-
|
|
325
|
-
|
|
326
|
-
|
|
327
|
-
###
|
|
328
|
-
|
|
329
|
-
|
|
330
|
-
|
|
331
|
-
|
|
1
|
+
# MCM/ICM Final Judging Panel
|
|
2
|
+
|
|
3
|
+
This is a simulated 100-point final-panel framework, not a COMAP official quantitative scorecard. Review as if the paper is competing for Outstanding Winner or Finalist. Do not coach, reward effort, or supply missing evidence. CUMCM use is a paper-quality proxy, not official CUMCM/COMAP scoring.
|
|
4
|
+
|
|
5
|
+
## v0.5 review modes
|
|
6
|
+
|
|
7
|
+
PROJECT_INITIAL_REVIEW evaluates the current run and paper-evidence readiness before a complete manuscript exists. PAPER_FINAL_REVIEW evaluates a user-provided frozen manuscript plus a frozen evidence graph. Both modes use the same rubric intent and fourteen-section output. Every score row, cap and ceiling must cite evidenceRefs that resolve to artifact paths and hashes; prose evidence alone is invalid. Findings may open a correction lineage, but a score never mutates the parent run or silently upgrades a claim.
|
|
8
|
+
|
|
9
|
+
## Non-negotiable principles
|
|
10
|
+
|
|
11
|
+
- Do not assume the model is correct.
|
|
12
|
+
- Complexity, machine learning, optimization, neural networks, Monte Carlo, AHP, TOPSIS, entropy weights, or named algorithms earn no automatic innovation credit.
|
|
13
|
+
- Reject formulas without mechanism, results without traceable computation, figures without conclusions, and formalistic sensitivity analysis that misses critical parameters.
|
|
14
|
+
- Distinguish plausible from validated and a number from a credible modeling result.
|
|
15
|
+
- Cite page, section, equation, table, figure, or exact value whenever possible.
|
|
16
|
+
- If evidence is absent, write “论文未提供证据”.
|
|
17
|
+
|
|
18
|
+
## Stage 1: veto and award caps
|
|
19
|
+
|
|
20
|
+
Classify each item as 通过, 警告, 严重问题, or 一票否决风险:
|
|
21
|
+
|
|
22
|
+
1. every subproblem is answered;
|
|
23
|
+
2. no omission, off-target answer, or proxy substituted for the requested metric;
|
|
24
|
+
3. no critical mathematical formula error;
|
|
25
|
+
4. no dimensional, unit, or order-of-magnitude error;
|
|
26
|
+
5. no key result violates constraints;
|
|
27
|
+
6. summary, body, tables, and figures agree numerically;
|
|
28
|
+
7. conclusions follow from model and computation;
|
|
29
|
+
8. critical parameters have a source or defensible estimate;
|
|
30
|
+
9. critical model and algorithm are reproducible;
|
|
31
|
+
10. no data/future leakage or train-test mixing;
|
|
32
|
+
11. sources, data, and references are traceable and non-fabricated;
|
|
33
|
+
12. external methods, algorithms, images, and data are cited;
|
|
34
|
+
13. applicable annual COMAP page, anonymity, submission, citation, and AI/disclosure rules are satisfied;
|
|
35
|
+
14. core prediction/optimization/decision results are validated;
|
|
36
|
+
15. model structure fits the real mechanism or the mismatch is discussed.
|
|
37
|
+
|
|
38
|
+
Apply evidence-linked caps:
|
|
39
|
+
|
|
40
|
+
- missing core subtask: Outstanding and Finalist normally unavailable;
|
|
41
|
+
- conclusion-changing main-model math error: cap 69;
|
|
42
|
+
- completely unvalidated core prediction/optimization/decision model: cap 84;
|
|
43
|
+
- unsupported highly sensitive core parameter: cap 79;
|
|
44
|
+
- irreproducible critical result: cap 79;
|
|
45
|
+
- clear leakage or answer-information training: cap 69;
|
|
46
|
+
- main conclusion conflicts with calculation/figure: cap 74;
|
|
47
|
+
- almost no quantitative result: cap 59;
|
|
48
|
+
- suspected fabricated data/reference, plagiarism, or serious rule violation: stop ordinary scoring and report Disqualification Risk.
|
|
49
|
+
|
|
50
|
+
## Stage 2: 100-point scoring
|
|
51
|
+
|
|
52
|
+
### 1. Problem understanding, decomposition, and summary — 10
|
|
53
|
+
|
|
54
|
+
#### 1.1 Summary Sheet — 4
|
|
55
|
+
|
|
56
|
+
Check whether a 60-second reader learns the problem, models, method per subproblem, core quantitative results, recommendation, validation, and numbers consistent with the body. “Good performance” without numbers is weak evidence.
|
|
57
|
+
|
|
58
|
+
#### 1.2 Understanding and decomposition — 3
|
|
59
|
+
|
|
60
|
+
Check every explicit task, hidden constraint, practical objective, stakeholder, subproblem relation, and whether the paper solved an easier substitute problem.
|
|
61
|
+
|
|
62
|
+
#### 1.3 Assumptions, definitions, boundaries — 3
|
|
63
|
+
|
|
64
|
+
Check completeness, necessity, realism, simplification rationale, applicability, distinction among fact/assumption/setting, and support from data, literature, or sensitivity.
|
|
65
|
+
|
|
66
|
+
### 2. Data, evidence, and parameters — 12
|
|
67
|
+
|
|
68
|
+
#### 2.1 Source credibility — 3
|
|
69
|
+
|
|
70
|
+
For every key dataset record name, source, time, sample size, unit, and consuming model. Check temporal/spatial match, conflicts, update frequency, and traceability.
|
|
71
|
+
|
|
72
|
+
#### 2.2 Cleaning and preprocessing — 2
|
|
73
|
+
|
|
74
|
+
Check missing values, outliers, scaling, interpolation, smoothing, trend creation, method explanation, and before-after comparison.
|
|
75
|
+
|
|
76
|
+
#### 2.3 Representativeness, bias, leakage — 2
|
|
77
|
+
|
|
78
|
+
Check selection, survivor, temporal, spatial, and entity bias; train/validation/test separation; future and target leakage.
|
|
79
|
+
|
|
80
|
+
#### 2.4 Parameter determination and calibration — 3
|
|
81
|
+
|
|
82
|
+
Every key parameter must come from data estimation, literature, theory, calibration, inverse optimization, justified expert input, or an explicitly tested scenario. Unsupported values such as “let alpha=0.5” are penalized.
|
|
83
|
+
|
|
84
|
+
#### 2.5 Data-parameter-model consistency — 2
|
|
85
|
+
|
|
86
|
+
Check unit, temporal, and spatial consistency; physical meaning; whether data supports variables; and whether variables were invented only to fit a method.
|
|
87
|
+
|
|
88
|
+
### 3. Model formulation — 22
|
|
89
|
+
|
|
90
|
+
#### 3.1 Mechanism-to-mathematics mapping — 5
|
|
91
|
+
|
|
92
|
+
Check whether variables, equations, probability structure, objective, and constraints correspond to the real mechanism rather than mathematical assembly.
|
|
93
|
+
|
|
94
|
+
#### 3.2 Valuable innovation — 4
|
|
95
|
+
|
|
96
|
+
Credit mechanism design, justified coupling, structural adaptation, meaningful new indicators, evidence-based correction, or a genuinely useful solver. Do not credit stacking, deep learning by name, jargon, or unnecessary parameters. Ask whether a simpler model gives essentially the same answer.
|
|
97
|
+
|
|
98
|
+
#### 3.3 Variables, objective, constraints, equations — 4
|
|
99
|
+
|
|
100
|
+
Check every symbol, objective fidelity, complete real constraints, mathematical correctness, units, initial conditions, and boundary conditions.
|
|
101
|
+
|
|
102
|
+
#### 3.4 Assumption and internal consistency — 3
|
|
103
|
+
|
|
104
|
+
Check contradictions among assumptions/equations, changing parameter meanings, reused symbols, and circular logic.
|
|
105
|
+
|
|
106
|
+
#### 3.5 Complexity and explainability — 3
|
|
107
|
+
|
|
108
|
+
Check necessary complexity, overfitting, removable modules, interpretability, and fit to a four-day contest.
|
|
109
|
+
|
|
110
|
+
#### 3.6 Multi-subproblem unity — 3
|
|
111
|
+
|
|
112
|
+
Check whether earlier results genuinely support later tasks and whether the paper forms problem → core model → extension → verification → decision rather than a model collage.
|
|
113
|
+
|
|
114
|
+
### 4. Mathematical solution, algorithm, reproducibility — 16
|
|
115
|
+
|
|
116
|
+
#### 4.1 Derivation correctness — 4
|
|
117
|
+
|
|
118
|
+
Audit probability, calculus, differential/difference equations, matrices, statistics, normalization, weights, and recurrences. State whether an error changes the conclusion.
|
|
119
|
+
|
|
120
|
+
#### 4.2 Algorithms and numerical methods — 4
|
|
121
|
+
|
|
122
|
+
Check method suitability, initial values, stop/convergence conditions, numerical stability, hyperparameters, seeds, and local-versus-global claims.
|
|
123
|
+
|
|
124
|
+
#### 4.3 Reproducibility — 3
|
|
125
|
+
|
|
126
|
+
Check inputs, parameters, steps, outputs, code/pseudocode, and figure-to-computation traceability.
|
|
127
|
+
|
|
128
|
+
#### 4.4 Complexity, convergence, optimality — 3
|
|
129
|
+
|
|
130
|
+
Check time/space complexity, convergence, grid convergence, optimality proof/gap, baselines for heuristics, and multi-start tests.
|
|
131
|
+
|
|
132
|
+
#### 4.5 Sanity checks — 2
|
|
133
|
+
|
|
134
|
+
Check extremes, magnitude, bounds, units, sums/probabilities, resource capacities, nonnegative time, and common-sense violations.
|
|
135
|
+
|
|
136
|
+
### 5. Results, validation, robustness, credibility — 24
|
|
137
|
+
|
|
138
|
+
#### 5.1 Task completion — 4
|
|
139
|
+
|
|
140
|
+
Build requirement → model → output → conclusion mapping. A method without the requested number, ranking, strategy, prediction, or decision is incomplete.
|
|
141
|
+
|
|
142
|
+
#### 5.2 Numerical correctness and internal consistency — 4
|
|
143
|
+
|
|
144
|
+
Audit the three to ten most important results: value, unit, page, model, input, computation path, reproducibility, plausibility, validation, and PASS/WARNING/FAIL. Compare summary, body, tables, figures, and repeated values.
|
|
145
|
+
|
|
146
|
+
#### 5.3 Baseline and controls — 3
|
|
147
|
+
|
|
148
|
+
Check naive, traditional, historical, official, current, random, or literature baselines. A standalone 91% result has no comparative meaning.
|
|
149
|
+
|
|
150
|
+
#### 5.4 Sensitivity — 4
|
|
151
|
+
|
|
152
|
+
Identify truly critical parameters first. Check realistic perturbation, quantitative output change, thresholds, rank reversal, and failure. Ask how far a parameter moves before the conclusion changes.
|
|
153
|
+
|
|
154
|
+
#### 5.5 Robustness and uncertainty — 4
|
|
155
|
+
|
|
156
|
+
Check parameter, data, measurement, random, structural, and scenario uncertainty; Monte Carlo, bootstrap, confidence/prediction intervals, worst case, or robust optimization. Distinguish exact-looking numbers from credible intervals.
|
|
157
|
+
|
|
158
|
+
#### 5.6 Independent/external validation — 3
|
|
159
|
+
|
|
160
|
+
Prefer holdout, time extrapolation, backtest, real case, independent source, literature result, known theorem, or simulation-to-reality comparison. Training-data self-validation is weak.
|
|
161
|
+
|
|
162
|
+
#### 5.7 Failure scenarios and counterexamples — 2
|
|
163
|
+
|
|
164
|
+
Check extreme parameters, missing data, network failure, demand shock, environmental/policy change, and black swans. Outstanding papers know when they fail.
|
|
165
|
+
|
|
166
|
+
### 6. Conclusions, practical meaning, generalization — 8
|
|
167
|
+
|
|
168
|
+
#### 6.1 Model-grounded conclusions — 3
|
|
169
|
+
|
|
170
|
+
Trace data → model → result → conclusion. Penalize correlation written as causation, unlimited extrapolation, or precise policy advice without computation.
|
|
171
|
+
|
|
172
|
+
#### 6.2 Actionable recommendations — 2
|
|
173
|
+
|
|
174
|
+
Identify actor, action, timing, cost, risk, resources, and implementation constraints.
|
|
175
|
+
|
|
176
|
+
#### 6.3 Concrete limitations — 2
|
|
177
|
+
|
|
178
|
+
Name the most dangerous assumption, missing data, sensitive parameter, failure condition, and bias direction—not “more work is needed”.
|
|
179
|
+
|
|
180
|
+
#### 6.4 Transferability — 1
|
|
181
|
+
|
|
182
|
+
Assess extension across region, time, scale, network, and policy scenario.
|
|
183
|
+
|
|
184
|
+
### 7. Writing, figures, professional presentation — 8
|
|
185
|
+
|
|
186
|
+
#### 7.1 Structure — 2
|
|
187
|
+
|
|
188
|
+
Check logical service of sections, repetition, result-before-model reasoning, jumps, and clear section purpose.
|
|
189
|
+
|
|
190
|
+
#### 7.2 Figures — 2
|
|
191
|
+
|
|
192
|
+
Check necessity, axes, units, legend, self-contained caption, resolution, font, color, independent readability, and whether the figure supports a conclusion.
|
|
193
|
+
|
|
194
|
+
#### 7.3 Language — 1
|
|
195
|
+
|
|
196
|
+
Check concise, professional, accurate language without empty AI-style prose.
|
|
197
|
+
|
|
198
|
+
#### 7.4 Notation and formulas — 1
|
|
199
|
+
|
|
200
|
+
Check prior definition, consistency, numbering, units, and absence of decorative equations.
|
|
201
|
+
|
|
202
|
+
#### 7.5 Citations — 1
|
|
203
|
+
|
|
204
|
+
Check data, image, algorithm, and literature references and correspondence between text and bibliography.
|
|
205
|
+
|
|
206
|
+
#### 7.6 Page efficiency — 1
|
|
207
|
+
|
|
208
|
+
Check wasted space, unnecessary contents pages, code in body, hidden key reasoning, and information density under the page limit.
|
|
209
|
+
|
|
210
|
+
## Stage 3: model-by-model autopsy
|
|
211
|
+
|
|
212
|
+
For every M1, M2, ... report:
|
|
213
|
+
|
|
214
|
+
- problem solved, inputs, outputs, core equations, parameters, assumptions;
|
|
215
|
+
- why chosen and mechanism fit;
|
|
216
|
+
- mathematical correctness and parameter interpretability;
|
|
217
|
+
- solver and result;
|
|
218
|
+
- validation, sensitivity, robustness;
|
|
219
|
+
- strengths, most serious defect, simpler alternative, marginal value;
|
|
220
|
+
- score /10 and retain/simplify/restructure/untrustworthy.
|
|
221
|
+
|
|
222
|
+
Conclude unified system or model collage.
|
|
223
|
+
|
|
224
|
+
## Stage 4: key-result audit
|
|
225
|
+
|
|
226
|
+
Use:
|
|
227
|
+
|
|
228
|
+
| ID | Result | Source | Unit | Model | Reproducible | Magnitude | Validated | Importance | Verdict |
|
|
229
|
+
|---|---|---|---|---|---|---|---|---|---|
|
|
230
|
+
|
|
231
|
+
Then answer:
|
|
232
|
+
|
|
233
|
+
1. most credible result;
|
|
234
|
+
2. most fragile result;
|
|
235
|
+
3. result most dependent on manual parameters;
|
|
236
|
+
4. result most exposed to data failure;
|
|
237
|
+
5. result whose failure collapses the paper;
|
|
238
|
+
6. precision illusion;
|
|
239
|
+
7. all constraints satisfied;
|
|
240
|
+
8. better solution possibly missed;
|
|
241
|
+
9. stability under ±5%, ±10%, ±20% input perturbations;
|
|
242
|
+
10. reason to trust for real decisions.
|
|
243
|
+
|
|
244
|
+
## Stage 5: type-specific module
|
|
245
|
+
|
|
246
|
+
- MCM A: ODE/PDE/difference equations, initial/boundary conditions, dimensions, discretization, grid convergence, stability, parameter estimation, physical meaning.
|
|
247
|
+
- MCM B: graph/combinatorial structure, dynamic/integer programming, correctness, complexity, optimality, scalability.
|
|
248
|
+
- MCM C: quality, leakage, splits, feature engineering, variable selection, multicollinearity, overfitting, baselines, metrics, calibration, uncertainty, interpretation.
|
|
249
|
+
- ICM D: network construction, node/edge meaning, weights, metrics, objective, constraints, optimization, scale, perturbation stability.
|
|
250
|
+
- ICM E: boundary, time scale, lifecycle, environmental-economic-social tradeoff, weights, scenarios, uncertainty, long-run and unintended consequences.
|
|
251
|
+
- ICM F: correlation/causality, behavior, stakeholders, fairness, cost, incentives, execution, scenarios, unintended and heterogeneous effects.
|
|
252
|
+
|
|
253
|
+
## Stage 6: award judgment
|
|
254
|
+
|
|
255
|
+
Reference bands:
|
|
256
|
+
|
|
257
|
+
- 93–100 Outstanding Candidate;
|
|
258
|
+
- 87–92 Finalist;
|
|
259
|
+
- 78–86 Meritorious;
|
|
260
|
+
- 68–77 Honorable Mention;
|
|
261
|
+
- 55–67 Successful Participant;
|
|
262
|
+
- below 55 Unsuccessful Risk.
|
|
263
|
+
|
|
264
|
+
Outstanding additionally requires complete tasks, no major math/logic error, credible core validation, meaningful sensitivity/robustness, sourced key parameters, strong Summary Sheet, non-template modeling, closed model-result-conclusion loop, reproducibility, and one memorable contribution. High score without gates is Finalist or below.
|
|
265
|
+
|
|
266
|
+
## Required final output
|
|
267
|
+
|
|
268
|
+
Use exactly these top-level sections and fields.
|
|
269
|
+
|
|
270
|
+
### 一、60 秒终审印象
|
|
271
|
+
|
|
272
|
+
Paper objective; core methods; core results; strongest point; most serious first-impression problem; continue reading: 是/勉强/否.
|
|
273
|
+
|
|
274
|
+
### 二、一票否决与奖项封顶检查
|
|
275
|
+
|
|
276
|
+
For each risk: risk; evidence; severity; cap triggered; cap level.
|
|
277
|
+
|
|
278
|
+
### 三、总体评价与最终得分
|
|
279
|
+
|
|
280
|
+
Composite score /100; raw score; capped score; predicted award; Outstanding probability; Finalist-or-higher probability; core advantages; fatal weaknesses.
|
|
281
|
+
|
|
282
|
+
### 四、100 分分项评分
|
|
283
|
+
|
|
284
|
+
| 一级指标 | 二级指标 | 得分 | 满分 | 评委意见 |
|
|
285
|
+
|---|---|---:|---:|---|
|
|
286
|
+
|
|
287
|
+
Every row needs evidence.
|
|
288
|
+
|
|
289
|
+
### 五、题目要求覆盖矩阵
|
|
290
|
+
|
|
291
|
+
| 题目要求 | 是否完成 | 使用模型 | 最终结果 | 验证情况 | 判定 |
|
|
292
|
+
|---|---|---|---|---|---|
|
|
293
|
+
|
|
294
|
+
Find omissions and proxy answers.
|
|
295
|
+
|
|
296
|
+
### 六、模型逐个尸检
|
|
297
|
+
|
|
298
|
+
Review M1, M2, M3 separately using the autopsy template.
|
|
299
|
+
|
|
300
|
+
### 七、建模结果专项审计
|
|
301
|
+
|
|
302
|
+
Provide R1, R2, ... table and judge correctness, credibility, robustness, reproducibility, and practical meaning.
|
|
303
|
+
|
|
304
|
+
### 八、数据与参数审计
|
|
305
|
+
|
|
306
|
+
| 参数 | 数值 | 来源 | 是否有依据 | 敏感性 | 风险 |
|
|
307
|
+
|---|---:|---|---|---|---|
|
|
308
|
+
|
|
309
|
+
Name Achilles’ heel parameters.
|
|
310
|
+
|
|
311
|
+
### 九、灵敏度、稳健性与验证专项评价
|
|
312
|
+
|
|
313
|
+
State what authors did, omitted, whether existing analysis is effective or formalistic, and validation needed for Finalist/Outstanding.
|
|
314
|
+
|
|
315
|
+
### 十、数学与计算正确性抽查
|
|
316
|
+
|
|
317
|
+
Check at least three formulas, three numbers, one algorithm, one figure, and one final conclusion when available; recompute when possible.
|
|
318
|
+
|
|
319
|
+
### 十一、图表与写作评审
|
|
320
|
+
|
|
321
|
+
Name best/worst/delete/add figures, hardest and most wasteful sections, and whether Summary Sheet is final-round quality.
|
|
322
|
+
|
|
323
|
+
### 十二、Outstanding Winner 差距分析
|
|
324
|
+
|
|
325
|
+
Explain why another paper wins; missing decisive evidence; current award level; three blockers to Finalist; three blockers to Outstanding; genuine innovation; removable model.
|
|
326
|
+
|
|
327
|
+
### 十三、修改优先级
|
|
328
|
+
|
|
329
|
+
P0 no high award without fix; P1 Meritorious vs Finalist; P2 Finalist vs Outstanding; P3 polish. Every item states problem, severity, fix, expected gain, and low/medium/high cost.
|
|
330
|
+
|
|
331
|
+
### 十四、评委最终裁决
|
|
332
|
+
|
|
333
|
+
One-sentence summary; most likely award; recommend Final Round yes/no; Head Judge defense yes/no; reason; final verdict.
|
|
334
|
+
|
|
335
|
+
Do not inflate for encouragement. Use “技术复杂度高于证据强度” or “presentation quality exceeds modeling quality” when supported. The final question is how credible the conclusions are and why they belong among the best papers.
|