math-skill 2.1.0 → 3.0.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.en-US.md +159 -200
- package/README.md +159 -200
- package/agents/math-critic.en.md +2 -2
- package/agents/math-critic.md +8 -8
- package/commands/ask.md +3 -10
- package/design-patterns/attention/equivariant-attention.en.md +72 -0
- package/design-patterns/attention/equivariant-attention.md +72 -0
- package/design-patterns/attention/geometry-aware-attention.en.md +73 -0
- package/design-patterns/attention/geometry-aware-attention.md +72 -0
- package/design-patterns/attention/information-bottleneck-attention.en.md +72 -0
- package/design-patterns/attention/information-bottleneck-attention.md +72 -0
- package/design-patterns/attention/projection-attention.en.md +68 -0
- package/design-patterns/attention/projection-attention.md +68 -0
- package/design-patterns/attention/spectral-attention.en.md +71 -0
- package/design-patterns/attention/spectral-attention.md +71 -0
- package/design-patterns/compression/leverage-score-selection.en.md +71 -0
- package/design-patterns/compression/leverage-score-selection.md +71 -0
- package/design-patterns/compression/low-rank-kv-cache.en.md +60 -0
- package/design-patterns/compression/low-rank-kv-cache.md +60 -0
- package/design-patterns/compression/spectral-token-pruning.en.md +61 -0
- package/design-patterns/compression/spectral-token-pruning.md +61 -0
- package/design-patterns/compression/topology-preserving-compression.en.md +64 -0
- package/design-patterns/compression/topology-preserving-compression.md +64 -0
- package/design-patterns/loss/constraint-penalty.en.md +67 -0
- package/design-patterns/loss/constraint-penalty.md +78 -0
- package/design-patterns/loss/contrastive-loss.en.md +59 -0
- package/design-patterns/loss/contrastive-loss.md +68 -0
- package/design-patterns/loss/information-bottleneck-loss.en.md +69 -0
- package/design-patterns/loss/information-bottleneck-loss.md +74 -0
- package/design-patterns/loss/orthogonality-loss.en.md +56 -0
- package/design-patterns/loss/orthogonality-loss.md +60 -0
- package/design-patterns/loss/variational-loss.en.md +61 -0
- package/design-patterns/loss/variational-loss.md +71 -0
- package/design-patterns/representation/equivariant-split.en.md +87 -0
- package/design-patterns/representation/equivariant-split.md +89 -0
- package/design-patterns/representation/manifold-representation.en.md +85 -0
- package/design-patterns/representation/manifold-representation.md +87 -0
- package/design-patterns/representation/shared-private-decomposition.en.md +84 -0
- package/design-patterns/representation/shared-private-decomposition.md +86 -0
- package/design-patterns/representation/subspace-alignment.en.md +90 -0
- package/design-patterns/representation/subspace-alignment.md +92 -0
- package/design-patterns/routing/graph-routing.en.md +79 -0
- package/design-patterns/routing/graph-routing.md +81 -0
- package/design-patterns/routing/moe-routing.en.md +85 -0
- package/design-patterns/routing/moe-routing.md +87 -0
- package/design-patterns/routing/optimal-transport-routing.en.md +68 -0
- package/design-patterns/routing/optimal-transport-routing.md +72 -0
- package/design-patterns/routing/spectral-clustering-routing.en.md +88 -0
- package/design-patterns/routing/spectral-clustering-routing.md +90 -0
- package/knowledge-base/differential-geometry/connection.en.md +51 -0
- package/knowledge-base/differential-geometry/connection.md +51 -0
- package/knowledge-base/differential-geometry/curvature.en.md +49 -0
- package/knowledge-base/differential-geometry/curvature.md +49 -0
- package/knowledge-base/differential-geometry/geodesic.en.md +51 -0
- package/knowledge-base/differential-geometry/geodesic.md +51 -0
- package/knowledge-base/differential-geometry/manifold.en.md +47 -0
- package/knowledge-base/differential-geometry/manifold.md +47 -0
- package/knowledge-base/differential-geometry/metric-tensor.en.md +50 -0
- package/knowledge-base/differential-geometry/metric-tensor.md +50 -0
- package/knowledge-base/differential-geometry/tangent-space.en.md +48 -0
- package/knowledge-base/differential-geometry/tangent-space.md +48 -0
- package/knowledge-base/information-geometry/fisher-metric.en.md +56 -0
- package/knowledge-base/information-geometry/fisher-metric.md +56 -0
- package/knowledge-base/information-geometry/natural-gradient.en.md +54 -0
- package/knowledge-base/information-geometry/natural-gradient.md +54 -0
- package/knowledge-base/lie-theory/equivariance.en.md +54 -0
- package/knowledge-base/lie-theory/equivariance.md +54 -0
- package/knowledge-base/lie-theory/group-action.en.md +51 -0
- package/knowledge-base/lie-theory/group-action.md +51 -0
- package/knowledge-base/lie-theory/lie-algebra.en.md +51 -0
- package/knowledge-base/lie-theory/lie-algebra.md +51 -0
- package/knowledge-base/lie-theory/lie-group.en.md +51 -0
- package/knowledge-base/lie-theory/lie-group.md +51 -0
- package/knowledge-base/lie-theory/representation.en.md +52 -0
- package/knowledge-base/lie-theory/representation.md +52 -0
- package/knowledge-base/matrix-analysis/low-rank-approximation.en.md +49 -0
- package/knowledge-base/matrix-analysis/low-rank-approximation.md +49 -0
- package/knowledge-base/matrix-analysis/matrix-perturbation.en.md +49 -0
- package/knowledge-base/matrix-analysis/matrix-perturbation.md +49 -0
- package/knowledge-base/matrix-analysis/positive-semidefinite.en.md +50 -0
- package/knowledge-base/matrix-analysis/positive-semidefinite.md +50 -0
- package/knowledge-base/matrix-analysis/projection.en.md +47 -0
- package/knowledge-base/matrix-analysis/projection.md +47 -0
- package/knowledge-base/matrix-analysis/spectral-decomposition.en.md +48 -0
- package/knowledge-base/matrix-analysis/spectral-decomposition.md +48 -0
- package/knowledge-base/optimization/constrained-optimization.en.md +53 -0
- package/knowledge-base/optimization/constrained-optimization.md +53 -0
- package/knowledge-base/optimization/convex-optimization.en.md +50 -0
- package/knowledge-base/optimization/convex-optimization.md +50 -0
- package/knowledge-base/optimization/lagrangian-duality.en.md +50 -0
- package/knowledge-base/optimization/lagrangian-duality.md +50 -0
- package/knowledge-base/optimization/proximal-method.en.md +52 -0
- package/knowledge-base/optimization/proximal-method.md +52 -0
- package/knowledge-base/optimization/riemannian-optimization.en.md +51 -0
- package/knowledge-base/optimization/riemannian-optimization.md +51 -0
- package/knowledge-base/overview.en.md +29 -218
- package/knowledge-base/overview.md +29 -220
- package/knowledge-base/probability/concentration-inequality.en.md +45 -0
- package/knowledge-base/probability/concentration-inequality.md +45 -0
- package/knowledge-base/probability/entropy.en.md +47 -0
- package/knowledge-base/probability/entropy.md +47 -0
- package/knowledge-base/probability/fisher-information.en.md +48 -0
- package/knowledge-base/probability/fisher-information.md +48 -0
- package/knowledge-base/probability/information-bottleneck.en.md +49 -0
- package/knowledge-base/probability/information-bottleneck.md +49 -0
- package/knowledge-base/probability/kl-divergence.en.md +51 -0
- package/knowledge-base/probability/kl-divergence.md +51 -0
- package/knowledge-base/topology/euler-characteristic.en.md +54 -0
- package/knowledge-base/topology/euler-characteristic.md +54 -0
- package/knowledge-base/topology/fundamental-group.en.md +52 -0
- package/knowledge-base/topology/fundamental-group.md +52 -0
- package/knowledge-base/topology/persistent-homology.en.md +54 -0
- package/knowledge-base/topology/persistent-homology.md +54 -0
- package/lenses/algorithmic.en.md +49 -0
- package/lenses/algorithmic.md +49 -0
- package/lenses/axiomatization.en.md +48 -0
- package/lenses/axiomatization.md +48 -0
- package/lenses/categorical.en.md +48 -0
- package/lenses/categorical.md +48 -0
- package/lenses/causal.en.md +49 -0
- package/lenses/causal.md +49 -0
- package/lenses/duality.en.md +47 -0
- package/lenses/duality.md +47 -0
- package/lenses/game.en.md +50 -0
- package/lenses/game.md +50 -0
- package/lenses/geometric.en.md +53 -0
- package/lenses/geometric.md +53 -0
- package/lenses/local-to-global.en.md +52 -0
- package/lenses/local-to-global.md +52 -0
- package/lenses/perturbation.en.md +51 -0
- package/lenses/perturbation.md +51 -0
- package/lenses/probabilistic.en.md +48 -0
- package/lenses/probabilistic.md +48 -0
- package/lenses/projection.en.md +50 -0
- package/lenses/projection.md +50 -0
- package/lenses/spectral.en.md +52 -0
- package/lenses/spectral.md +52 -0
- package/lenses/symmetry.en.md +49 -0
- package/lenses/symmetry.md +49 -0
- package/lenses/topological.en.md +48 -0
- package/lenses/topological.md +48 -0
- package/lenses/variational.en.md +48 -0
- package/lenses/variational.md +48 -0
- package/package.json +9 -3
- package/references/books/abstract-algebra.md +5 -5
- package/references/books/algebraic-geometry-rising-sea.md +5 -5
- package/references/books/differential-geometry.md +3 -3
- package/references/books/matrix-analysis.md +4 -4
- package/references/books/micro-lie-theory.md +3 -3
- package/references/books/optimization-ml.md +1 -1
- package/references/books/smooth-manifolds.md +3 -3
- package/references/gpu-friendly-math.en.md +8 -8
- package/references/gpu-friendly-math.md +2 -2
- package/references/inspiration.en.md +1 -1
- package/references/inspiration.md +2 -2
- package/skills/math-research-activator/SKILL.en.md +161 -106
- package/skills/math-research-activator/SKILL.md +162 -110
- package/skills/math-research-activator/original-texts.en.md +9 -9
- package/skills/math-research-activator/original-texts.md +11 -11
- package/commands/abstraction.md +0 -11
- package/commands/algorithmic-thinking.md +0 -11
- package/commands/axiomatization.md +0 -11
- package/commands/causal-inference.md +0 -11
- package/commands/discrete-combinatorial.md +0 -11
- package/commands/game-theory.md +0 -11
- package/commands/induction-analogy.md +0 -11
- package/commands/information-theory.md +0 -11
- package/commands/logic-deduction.md +0 -11
- package/commands/modeling.md +0 -11
- package/commands/optimization.md +0 -11
- package/commands/probability-statistics.md +0 -11
- package/commands/symmetry-invariance.md +0 -11
- package/commands/topological-thinking.md +0 -11
- package/commands/transformation.md +0 -11
- package/skills/abstraction/SKILL.en.md +0 -117
- package/skills/abstraction/SKILL.md +0 -121
- package/skills/abstraction/original-texts.en.md +0 -163
- package/skills/abstraction/original-texts.md +0 -175
- package/skills/algorithmic-thinking/SKILL.en.md +0 -132
- package/skills/algorithmic-thinking/SKILL.md +0 -138
- package/skills/algorithmic-thinking/original-texts.en.md +0 -253
- package/skills/algorithmic-thinking/original-texts.md +0 -256
- package/skills/axiomatization/SKILL.en.md +0 -144
- package/skills/axiomatization/SKILL.md +0 -151
- package/skills/axiomatization/original-texts.en.md +0 -154
- package/skills/axiomatization/original-texts.md +0 -160
- package/skills/causal-inference/SKILL.en.md +0 -147
- package/skills/causal-inference/SKILL.md +0 -151
- package/skills/causal-inference/original-texts.en.md +0 -136
- package/skills/causal-inference/original-texts.md +0 -167
- package/skills/discrete-combinatorial/SKILL.en.md +0 -124
- package/skills/discrete-combinatorial/SKILL.md +0 -131
- package/skills/discrete-combinatorial/original-texts.en.md +0 -184
- package/skills/discrete-combinatorial/original-texts.md +0 -185
- package/skills/game-theory/SKILL.en.md +0 -117
- package/skills/game-theory/SKILL.md +0 -123
- package/skills/game-theory/original-texts.en.md +0 -131
- package/skills/game-theory/original-texts.md +0 -131
- package/skills/induction-analogy/SKILL.en.md +0 -145
- package/skills/induction-analogy/SKILL.md +0 -152
- package/skills/induction-analogy/original-texts.en.md +0 -140
- package/skills/induction-analogy/original-texts.md +0 -154
- package/skills/information-theory/SKILL.en.md +0 -134
- package/skills/information-theory/SKILL.md +0 -140
- package/skills/information-theory/original-texts.en.md +0 -127
- package/skills/information-theory/original-texts.md +0 -127
- package/skills/logic-deduction/SKILL.en.md +0 -130
- package/skills/logic-deduction/SKILL.md +0 -135
- package/skills/logic-deduction/original-texts.en.md +0 -160
- package/skills/logic-deduction/original-texts.md +0 -173
- package/skills/modeling/SKILL.en.md +0 -135
- package/skills/modeling/SKILL.md +0 -139
- package/skills/modeling/original-texts.en.md +0 -162
- package/skills/modeling/original-texts.md +0 -165
- package/skills/optimization/SKILL.en.md +0 -129
- package/skills/optimization/SKILL.md +0 -135
- package/skills/optimization/original-texts.en.md +0 -167
- package/skills/optimization/original-texts.md +0 -168
- package/skills/probability-statistics/SKILL.en.md +0 -146
- package/skills/probability-statistics/SKILL.md +0 -151
- package/skills/probability-statistics/original-texts.en.md +0 -191
- package/skills/probability-statistics/original-texts.md +0 -193
- package/skills/symmetry-invariance/SKILL.en.md +0 -135
- package/skills/symmetry-invariance/SKILL.md +0 -139
- package/skills/symmetry-invariance/original-texts.en.md +0 -206
- package/skills/symmetry-invariance/original-texts.md +0 -221
- package/skills/topological-thinking/SKILL.en.md +0 -124
- package/skills/topological-thinking/SKILL.md +0 -128
- package/skills/topological-thinking/original-texts.en.md +0 -134
- package/skills/topological-thinking/original-texts.md +0 -164
- package/skills/transformation/SKILL.en.md +0 -120
- package/skills/transformation/SKILL.md +0 -124
- package/skills/transformation/original-texts.en.md +0 -204
- package/skills/transformation/original-texts.md +0 -216
|
@@ -1,228 +1,39 @@
|
|
|
1
|
-
#
|
|
1
|
+
# Knowledge Base Navigation
|
|
2
2
|
|
|
3
|
-
|
|
3
|
+
> This file is the v3 knowledge base index, helping you find specific knowledge cards from problem types.
|
|
4
4
|
|
|
5
|
-
|
|
5
|
+
## Knowledge Base Structure
|
|
6
6
|
|
|
7
|
-
|
|
7
|
+
The knowledge base is organized by mathematical domain, with 7 domains and 31 knowledge cards. Each card contains: minimal definition, core formulas, applicable problems, AI design translation, engineering feasibility, risks and failure conditions.
|
|
8
8
|
|
|
9
|
-
|
|
10
|
-
|
|
11
|
-
-
|
|
9
|
+
| Domain | Directory | Cards | Typical Applications |
|
|
10
|
+
|--------|-----------|-------|---------------------|
|
|
11
|
+
| Matrix Analysis | `matrix-analysis/` | projection, spectral-decomposition, low-rank-approximation, positive-semidefinite, matrix-perturbation | LoRA, spectral normalization, condition number monitoring |
|
|
12
|
+
| Optimization | `optimization/` | lagrangian-duality, convex-optimization, constrained-optimization, riemannian-optimization, proximal-method | GAN minimax, weight constraints, Muon optimizer |
|
|
13
|
+
| Differential Geometry | `differential-geometry/` | manifold, tangent-space, metric-tensor, geodesic, curvature, connection | Natural gradient, manifold optimization, K-FAC |
|
|
14
|
+
| Lie Theory | `lie-theory/` | group-action, lie-group, lie-algebra, representation, equivariance | Equivariant networks, SO(3) parameterization, spherical harmonics |
|
|
15
|
+
| Topology | `topology/` | persistent-homology, euler-characteristic, fundamental-group | Topological regularization, latent space monitoring |
|
|
16
|
+
| Probability & Information | `probability/` | concentration-inequality, entropy, kl-divergence, information-bottleneck, fisher-information | VAE, knowledge distillation, generalization bounds |
|
|
17
|
+
| Information Geometry | `information-geometry/` | natural-gradient, fisher-metric | Natural gradient descent, Fisher-Rao metric |
|
|
12
18
|
|
|
13
|
-
|
|
19
|
+
## From Problem to Knowledge Card
|
|
14
20
|
|
|
15
|
-
|
|
21
|
+
| Problem Type | Recommended Cards |
|
|
22
|
+
|-------------|-------------------|
|
|
23
|
+
| Need dimensionality reduction/compression | low-rank-approximation, projection |
|
|
24
|
+
| Need constrained optimization | constrained-optimization, lagrangian-duality |
|
|
25
|
+
| Need equivariance/symmetry | group-action, equivariance, representation |
|
|
26
|
+
| Need stable training | matrix-perturbation, positive-semidefinite, fisher-information |
|
|
27
|
+
| Need manifold parameterization | manifold, riemannian-optimization, tangent-space |
|
|
28
|
+
| Need information compression | information-bottleneck, entropy, kl-divergence |
|
|
29
|
+
| Need topological regularization | persistent-homology, euler-characteristic |
|
|
16
30
|
|
|
17
|
-
|
|
31
|
+
## Relationship to Thinking Lenses
|
|
18
32
|
|
|
19
|
-
|
|
33
|
+
Thinking lenses (`../../lenses/`) handle "what perspective to use"; the knowledge base provides "concrete mathematical tools." Typical chain:
|
|
20
34
|
|
|
21
|
-
|
|
35
|
+
```
|
|
36
|
+
Lens diagnosis → Knowledge card provides tools → Design pattern translates to AI module
|
|
37
|
+
```
|
|
22
38
|
|
|
23
|
-
|
|
24
|
-
|-------|---------|--------------|
|
|
25
|
-
| Elementary Algebra | Equations, inequalities, polynomial operations | Variables, identities, operation laws |
|
|
26
|
-
| Advanced Algebra (Linear Algebra) | Vector spaces, linear transformations, matrices | Linear spaces, bases, dimension, eigenvalues |
|
|
27
|
-
| Abstract Algebra | Groups, rings, fields | Algebraic structures, homomorphisms, isomorphisms |
|
|
28
|
-
| Category Theory | Abstract theory of objects and morphisms | Functors, natural transformations, universal properties |
|
|
29
|
-
|
|
30
|
-
### Geometry
|
|
31
|
-
|
|
32
|
-
The study of space, shape, structure, and their relationships.
|
|
33
|
-
|
|
34
|
-
| Level | Content | Core Concepts |
|
|
35
|
-
|-------|---------|--------------|
|
|
36
|
-
| Euclidean Geometry | Plane and solid geometry | Points, lines, planes, angles, distances |
|
|
37
|
-
| Analytic Geometry | Studying geometry via algebraic methods | Coordinate systems, equations, curves |
|
|
38
|
-
| Non-Euclidean Geometry | Geometries with modified parallel postulates | Hyperbolic geometry, elliptic geometry |
|
|
39
|
-
| Differential Geometry | Studying geometry via calculus | Curvature, geodesics, manifolds |
|
|
40
|
-
| Fractal Geometry | Self-similar geometric structures | Fractal dimension, iterated function systems |
|
|
41
|
-
|
|
42
|
-
### Analysis
|
|
43
|
-
|
|
44
|
-
The study of functions, limits, continuity, differentiation, and integration.
|
|
45
|
-
|
|
46
|
-
| Level | Content | Core Concepts |
|
|
47
|
-
|-------|---------|--------------|
|
|
48
|
-
| Calculus | Limits, derivatives, integrals | Continuity, differentiability, integrability |
|
|
49
|
-
| Mathematical Analysis | Rigorous limit theory | $\varepsilon$-$\delta$ language, uniform convergence |
|
|
50
|
-
| Real Analysis | Measure theory, Lebesgue integration | Measure spaces, $L^p$ spaces |
|
|
51
|
-
| Complex Analysis | Theory of complex functions | Analytic functions, residues, conformal mappings |
|
|
52
|
-
| Functional Analysis | Analysis on infinite-dimensional spaces | Banach spaces, Hilbert spaces, operators |
|
|
53
|
-
| Differential Equations | ODEs and PDEs | Existence, uniqueness, stability, numerical methods |
|
|
54
|
-
|
|
55
|
-
## 2. Major Branches
|
|
56
|
-
|
|
57
|
-
### 1. Number Theory
|
|
58
|
-
|
|
59
|
-
The study of integer properties, such as prime distribution, congruences, and Diophantine equations.
|
|
60
|
-
|
|
61
|
-
- **Elementary Number Theory**: Divisibility, congruences, primes
|
|
62
|
-
- **Analytic Number Theory**: Using analytical methods for number-theoretic problems (e.g., the Prime Number Theorem)
|
|
63
|
-
- **Algebraic Number Theory**: Using algebraic methods for number-theoretic problems (e.g., algebraic number fields)
|
|
64
|
-
- **Geometric Number Theory**: Using geometric methods for number-theoretic problems
|
|
65
|
-
|
|
66
|
-
### 2. Probability & Statistics
|
|
67
|
-
|
|
68
|
-
The study of random phenomena and data analysis, widely applied in finance, biology, and social sciences. Corresponding thinking weapons: **Probability & Statistics**, **Information Theory**, **Causal Inference**.
|
|
69
|
-
|
|
70
|
-
- **Probability Theory**: Random variables, distributions, limit theorems → See **Probability & Statistics** (Kolmogorov axioms)
|
|
71
|
-
- **Mathematical Statistics**: Parameter estimation, hypothesis testing, regression analysis → See **Probability & Statistics** (regression modeling, experimental design)
|
|
72
|
-
- **Stochastic Processes**: Markov chains, Brownian motion, martingale theory
|
|
73
|
-
- **Bayesian Statistics**: Priors, posteriors, MCMC → See **Information Theory** (maximum entropy principle)
|
|
74
|
-
|
|
75
|
-
### 3. Topology
|
|
76
|
-
|
|
77
|
-
The study of invariant properties of spaces under continuous deformation. Corresponding thinking weapon: **Topological Thinking**.
|
|
78
|
-
|
|
79
|
-
- **Point-Set Topology**: Open sets, closed sets, connectedness, compactness → See **Symmetry & Invariance** (invariant perspective)
|
|
80
|
-
- **Algebraic Topology**: Homotopy, homology, cohomology → See **Topological Thinking** (fundamental group, Betti numbers)
|
|
81
|
-
- **Differential Topology**: Manifolds, tangent spaces, differential forms
|
|
82
|
-
|
|
83
|
-
### 4. Discrete Mathematics
|
|
84
|
-
|
|
85
|
-
Set theory, graph theory, mathematical logic, etc. — the mathematical foundation of computer science. Corresponding thinking weapons: **Algorithmic & Computational Thinking**, **Discrete & Combinatorial Thinking**.
|
|
86
|
-
|
|
87
|
-
- **Set Theory**: Sets, relations, functions, cardinality, ordinals
|
|
88
|
-
- **Graph Theory**: Graphs, paths, connectivity, coloring, network flows
|
|
89
|
-
- **Mathematical Logic**: Propositional logic, predicate logic, computability → See **Axiomatic Thinking**, **Logical Deduction**
|
|
90
|
-
- **Combinatorics**: Counting, permutations and combinations, generating functions → See **Discrete & Combinatorial Thinking**
|
|
91
|
-
- **Algorithms & Complexity**: Sorting, searching, P/NP, decidability → See **Algorithmic & Computational Thinking**
|
|
92
|
-
|
|
93
|
-
### 5. Applied Mathematics Branches
|
|
94
|
-
|
|
95
|
-
Applying mathematical methods to real-world problems. Corresponding thinking weapons: **Optimization**, **Information Theory**, **Game Theory**, **Algorithmic & Computational Thinking**, **Causal Inference**.
|
|
96
|
-
|
|
97
|
-
- **Operations Research**: Linear programming, integer programming, dynamic programming, queueing theory → See **Optimization** (LP/IP/DP taxonomy), **Algorithmic & Computational Thinking** (solution algorithms)
|
|
98
|
-
- **Control Theory**: System control, optimal control, robust control → See **Optimization** (optimal control as variational optimization)
|
|
99
|
-
- **Information Theory**: Entropy, channel capacity, data compression, coding theory → See **Information Theory** (Shannon entropy, coding theorems)
|
|
100
|
-
- **Game Theory**: Strategic interaction, equilibrium analysis, mechanism design → See **Game Theory** (Nash equilibrium, minimax)
|
|
101
|
-
- **Causal Inference**: Causal graph models, intervention analysis, counterfactual reasoning → See **Causal Inference** (DAGs, do-calculus)
|
|
102
|
-
- **Financial Mathematics**: Option pricing, risk management, stochastic calculus → See **Modeling** (Black-Scholes), **Probability & Statistics**
|
|
103
|
-
- **Computational Mathematics**: Numerical analysis, finite elements, Monte Carlo methods → See **Algorithmic & Computational Thinking** (numerical algorithms)
|
|
104
|
-
- **Mathematical Foundations of Machine Learning**: Optimization, statistical learning theory, kernel methods → See **Optimization**, **Probability & Statistics**, **Information Theory** (MDL/AIC)
|
|
105
|
-
|
|
106
|
-
## 3. Hierarchical Structure of the Knowledge System
|
|
107
|
-
|
|
108
|
-
From a learning-path perspective, mathematical knowledge can be organized into levels:
|
|
109
|
-
|
|
110
|
-
### Foundation Level
|
|
111
|
-
|
|
112
|
-
Number sense, logic and classification, arithmetic, and basic geometry.
|
|
113
|
-
|
|
114
|
-
- Concepts and operations of numbers
|
|
115
|
-
- Basic logical reasoning
|
|
116
|
-
- Arithmetic operations (addition, subtraction, multiplication, division)
|
|
117
|
-
- Basic geometric shapes and properties
|
|
118
|
-
|
|
119
|
-
### Algebra Level
|
|
120
|
-
|
|
121
|
-
Variables, equations, functions, geometric proofs.
|
|
122
|
-
|
|
123
|
-
- Algebraic expressions and equations
|
|
124
|
-
- Function concepts and basic function families
|
|
125
|
-
- Plane geometry proofs
|
|
126
|
-
- Vectors and coordinates
|
|
127
|
-
|
|
128
|
-
### Synthesis Level
|
|
129
|
-
|
|
130
|
-
Functions and derivatives, calculus, sequences, solid geometry, advanced probability and statistics.
|
|
131
|
-
|
|
132
|
-
- Limits and continuity
|
|
133
|
-
- Differentiation and integration
|
|
134
|
-
- Sequences and series
|
|
135
|
-
- Solid geometry
|
|
136
|
-
- Probability distributions and statistical inference
|
|
137
|
-
|
|
138
|
-
### Frontier Level
|
|
139
|
-
|
|
140
|
-
Mathematical analysis, advanced algebra, analytic/differential geometry, number theory, topology, etc.
|
|
141
|
-
|
|
142
|
-
- Rigorous analytical theory ($\varepsilon$-$\delta$)
|
|
143
|
-
- Abstract algebraic structures (groups, rings, fields)
|
|
144
|
-
- Manifolds and differential geometry
|
|
145
|
-
- Algebraic/analytic number theory
|
|
146
|
-
- Point-set/algebraic topology
|
|
147
|
-
- Functional analysis and operator theory
|
|
148
|
-
|
|
149
|
-
## 4. Levels of Mathematical Thinking Methods
|
|
150
|
-
|
|
151
|
-
| Level | Thinking Method | Description |
|
|
152
|
-
|-------|----------------|-------------|
|
|
153
|
-
| Foundation | Logical deduction, inductive analogy | The basis of all mathematical thinking |
|
|
154
|
-
| Method | Axiomatization, abstraction, modeling | Methods for constructing mathematical theories |
|
|
155
|
-
| Tool | Optimization, transformation, probability & statistics | Tools for solving concrete problems |
|
|
156
|
-
| Extension | Algorithms & computation, information theory, game theory, causal inference | Tools applied to computation, information, interaction, and causation |
|
|
157
|
-
| Philosophy | Symmetry & invariance, topological thinking, discrete & combinatorial thinking | Philosophical perspectives for understanding structure and essence |
|
|
158
|
-
|
|
159
|
-
## 5. Connections Between Mathematics and Other Disciplines
|
|
160
|
-
|
|
161
|
-
| Discipline | Mathematical Tools Used | Typical Applications |
|
|
162
|
-
|-----------|------------------------|---------------------|
|
|
163
|
-
| Physics | Calculus, linear algebra, group theory | Mechanics, quantum mechanics, relativity |
|
|
164
|
-
| Computer Science | Discrete mathematics, graph theory, probability | Algorithm analysis, cryptography, AI |
|
|
165
|
-
| Economics | Optimization, game theory, differential equations | Market equilibrium, pricing models |
|
|
166
|
-
| Biology | Differential equations, statistics, graph theory | Population dynamics, systems biology |
|
|
167
|
-
| Engineering | Differential equations, Fourier analysis, numerical methods | Control systems, signal processing |
|
|
168
|
-
| Social Sciences | Statistics, game theory, network analysis | Social networks, decision analysis |
|
|
169
|
-
|
|
170
|
-
## 6. Mapping Thinking Weapons to Mathematical Branches
|
|
171
|
-
|
|
172
|
-
The 16 thinking weapons in this project (15 specialized weapons + 1 math-research-activator auto-trigger entry point) do not exist in isolation; they form a complementary toolkit with mathematical branches. Below is a simplified mapping to help you find suitable mathematical methods directly from problem types. v2 also includes `references/books/*.md` × 7 volumes covering algebraic geometry / differential geometry / Lie theory / abstract algebra / matrix analysis / optimization / manifolds and other modern mathematical structures, activated on demand into algorithm design (see README "Three-Layer Progressive Disclosure").
|
|
173
|
-
|
|
174
|
-
| Thinking Weapon | Corresponding Mathematical Branch | Typical Methods / Concepts |
|
|
175
|
-
|----------------|----------------------------------|---------------------------|
|
|
176
|
-
| 🧭 Math Research Activator | Meta-cognition, problem classification, modern math mapping | Diagnosis → Mapping → Routing → GPU Filtering, dual acceptance gates |
|
|
177
|
-
| 📐 Axiomatic Thinking | Mathematical logic, set theory | Axiomatic systems, formal languages, consistency, independence |
|
|
178
|
-
| 🧩 Abstraction | Algebra, category theory, topology | Abstract structures, isomorphisms, universal properties |
|
|
179
|
-
| 🧠 Logical Deduction | Mathematical logic, proof theory | Propositional logic, predicate logic, inference rules |
|
|
180
|
-
| 🌉 Modeling | Applied mathematics, statistics | Equation-based modeling, dimensional analysis, validation |
|
|
181
|
-
| ⚖️ Optimization | Optimization theory, operations research | Convex optimization, KKT conditions, dynamic programming |
|
|
182
|
-
| 🎲 Probability & Statistics | Probability theory, mathematical statistics | Random variables, hypothesis testing, regression analysis |
|
|
183
|
-
| 🔄 Transformation | Analysis, generating functions | Fourier, Laplace, algebraic transformations |
|
|
184
|
-
| ⚛️ Symmetry & Invariance | Group theory, geometry | Group actions, invariants, quotient spaces |
|
|
185
|
-
| 📈 Induction & Analogy | Elementary mathematics, number theory | Inductive proofs, analogical reasoning, pattern recognition |
|
|
186
|
-
| 🖥️ Algorithmic & Computational Thinking | Computation theory, discrete mathematics | Complexity, computability, algorithm paradigms |
|
|
187
|
-
| 📡 Information Theory | Information theory, statistical learning | Entropy, mutual information, coding limits |
|
|
188
|
-
| 🎯 Game Theory | Mathematical economics, mechanism design | Nash equilibrium, incentive compatibility, optimal strategy |
|
|
189
|
-
| 🔗 Causal Inference | Causal inference, statistics | DAGs, do-calculus, intervention analysis |
|
|
190
|
-
| 🌀 Topological Thinking | Topology, algebraic topology | Homotopy, homology, topological invariants |
|
|
191
|
-
| 🧮 Discrete & Combinatorial Thinking | Combinatorics, graph theory | Pigeonhole principle, generating functions, enumeration |
|
|
192
|
-
|
|
193
|
-
## 7. How to Choose a Thinking Weapon
|
|
194
|
-
|
|
195
|
-
When facing a problem, the most important first step is not "analyze hard," but "choose the right tool." Here is a selection guide:
|
|
196
|
-
|
|
197
|
-
### Quick Selection Guide
|
|
198
|
-
|
|
199
|
-
| Core Problem Characteristic | Most Likely Suitable Thinking Weapon |
|
|
200
|
-
|----------------------------|-------------------------------------|
|
|
201
|
-
| Multi-party interaction; my optimum depends on others | 🎯 Game Theory |
|
|
202
|
-
| Uncertainty / randomness | 🎲 Probability & Statistics |
|
|
203
|
-
| Optimal choice under constraints | ⚖️ Optimization |
|
|
204
|
-
| Difficult to handle from current perspective | 🔄 Transformation |
|
|
205
|
-
| Need to extract essential structure | 🧩 Abstraction |
|
|
206
|
-
| Need rigorous reasoning and verification | 🧠 Logical Deduction |
|
|
207
|
-
| Need to discover patterns from experience | 📈 Induction & Analogy |
|
|
208
|
-
| Need to build a predictive model | 🌉 Modeling |
|
|
209
|
-
| Invariance amid change | ⚛️ Symmetry & Invariance |
|
|
210
|
-
| Need executable steps | 🖥️ Algorithmic & Computational Thinking |
|
|
211
|
-
| Counting / structure over finite objects | 🧮 Discrete & Combinatorial Thinking |
|
|
212
|
-
|
|
213
|
-
### Using the Activator
|
|
214
|
-
|
|
215
|
-
If you are unsure which tool to use, simply invoke the math-research-activator via the `/ask` command. It will diagnose the problem, map to modern mathematical structures, recommend the 1–3 most suitable thinking weapons, and perform GPU feasibility filtering. When algorithm / kernel / model code appears in the workspace, the activator will also intervene automatically.
|
|
216
|
-
|
|
217
|
-
### Path
|
|
218
|
-
|
|
219
|
-
v2 has removed the "research / life dual-path" and unified into a single research / algorithm path: preserving complete mathematical notation and derivations, and enforcing the GPU 8-dimension gate when used for algorithm / operator design.
|
|
220
|
-
|
|
221
|
-
## 8. How to Use This Overview
|
|
222
|
-
|
|
223
|
-
- Start from the problem characteristics: determine whether it is "structural," "dynamic," "stochastic," "interactive," or "countable."
|
|
224
|
-
- Consult the Quick Selection Guide or use the `/ask` command to find the closest thinking weapon.
|
|
225
|
-
- Combined with the "Hierarchical Structure of the Knowledge System," judge whether the current problem is better suited to foundational approaches or frontier methods.
|
|
226
|
-
- If the problem spans multiple categories, invoke multiple thinking weapons simultaneously — e.g., "Modeling + Optimization," "Probability + Causation," "Abstraction + Algorithms."
|
|
227
|
-
- For algorithm / operator design problems, let the activator transfer modern mathematical structures (algebraic geometry / Lie theory / topology, etc.) into the design and pass them through the GPU 8-dimension gate.
|
|
228
|
-
- When studying or reading literature, use this overview as an organizing framework to place scattered concepts into a unified knowledge map.
|
|
39
|
+
For deeper study, `../../references/books/*.md` provides 7 book distillations.
|
|
@@ -1,230 +1,39 @@
|
|
|
1
|
-
|
|
1
|
+
# 数学知识库导航 / Knowledge Base Navigation
|
|
2
2
|
|
|
3
|
-
|
|
3
|
+
> 本文件是 v3 知识库的索引,帮助你从问题类型找到具体的知识卡片。
|
|
4
4
|
|
|
5
|
-
##
|
|
5
|
+
## 知识库结构
|
|
6
6
|
|
|
7
|
-
|
|
7
|
+
知识库按数学领域组织,共 7 个领域、31 张知识卡片。每张卡片包含:最小定义、核心公式、适用问题、AI 设计翻译、工程可行性、风险与失效条件。
|
|
8
8
|
|
|
9
|
-
|
|
9
|
+
| 领域 | 目录 | 卡片 | 典型应用 |
|
|
10
|
+
|------|------|------|---------|
|
|
11
|
+
| 矩阵分析 | `matrix-analysis/` | projection, spectral-decomposition, low-rank-approximation, positive-semidefinite, matrix-perturbation | LoRA、谱归一化、条件数监控 |
|
|
12
|
+
| 最优化 | `optimization/` | lagrangian-duality, convex-optimization, constrained-optimization, riemannian-optimization, proximal-method | GAN minimax、权重约束、Muon 优化器 |
|
|
13
|
+
| 微分几何 | `differential-geometry/` | manifold, tangent-space, metric-tensor, geodesic, curvature, connection | 自然梯度、流形优化、K-FAC |
|
|
14
|
+
| 李理论 | `lie-theory/` | group-action, lie-group, lie-algebra, representation, equivariance | 等变网络、SO(3) 参数化、球谐特征 |
|
|
15
|
+
| 拓扑 | `topology/` | persistent-homology, euler-characteristic, fundamental-group | 拓扑正则、隐空间监控 |
|
|
16
|
+
| 概率与信息 | `probability/` | concentration-inequality, entropy, kl-divergence, information-bottleneck, fisher-information | VAE、知识蒸馏、泛化界 |
|
|
17
|
+
| 信息几何 | `information-geometry/` | natural-gradient, fisher-metric | 自然梯度下降、Fisher-Rao 度量 |
|
|
10
18
|
|
|
11
|
-
|
|
12
|
-
- 理解本项目 16 种思想武器(15 武器 + math-research-activator)与数学分支之间的对应关系;
|
|
13
|
-
- 形成从问题到工具、从概念到应用的整体认知。
|
|
19
|
+
## 从问题找知识卡
|
|
14
20
|
|
|
15
|
-
|
|
21
|
+
| 问题类型 | 推荐知识卡 |
|
|
22
|
+
|---------|-----------|
|
|
23
|
+
| 需要降维/压缩 | low-rank-approximation, projection |
|
|
24
|
+
| 需要约束优化 | constrained-optimization, lagrangian-duality |
|
|
25
|
+
| 需要等变/对称 | group-action, equivariance, representation |
|
|
26
|
+
| 需要稳定训练 | matrix-perturbation, positive-semidefinite, fisher-information |
|
|
27
|
+
| 需要流形参数化 | manifold, riemannian-optimization, tangent-space |
|
|
28
|
+
| 需要信息压缩 | information-bottleneck, entropy, kl-divergence |
|
|
29
|
+
| 需要拓扑正则 | persistent-homology, euler-characteristic |
|
|
16
30
|
|
|
17
|
-
##
|
|
31
|
+
## 与思想透镜的关系
|
|
18
32
|
|
|
19
|
-
|
|
33
|
+
思想透镜(`../../lenses/`)负责"用什么视角看问题",知识库负责"提供具体数学工具"。典型链路:
|
|
20
34
|
|
|
21
|
-
|
|
35
|
+
```
|
|
36
|
+
透镜诊断 → 知识卡片提供工具 → 设计模式翻译成 AI 模块
|
|
37
|
+
```
|
|
22
38
|
|
|
23
|
-
|
|
24
|
-
|
|
25
|
-
| 层次 | 内容 | 核心概念 |
|
|
26
|
-
|------|------|---------|
|
|
27
|
-
| 初等代数 | 方程、不等式、多项式运算 | 变量、等式、运算律 |
|
|
28
|
-
| 高等代数(线性代数) | 向量空间、线性变换、矩阵 | 线性空间、基、维数、特征值 |
|
|
29
|
-
| 抽象代数 | 群、环、域 | 代数结构、同态、同构 |
|
|
30
|
-
| 范畴论 | 对象与态射的抽象理论 | 函子、自然变换、泛性质 |
|
|
31
|
-
|
|
32
|
-
### 几何学(Geometry)
|
|
33
|
-
|
|
34
|
-
研究空间、形状、结构及其关系。
|
|
35
|
-
|
|
36
|
-
| 层次 | 内容 | 核心概念 |
|
|
37
|
-
|------|------|---------|
|
|
38
|
-
| 欧几里得几何 | 平面与立体几何 | 点、线、面、角、距离 |
|
|
39
|
-
| 解析几何 | 用代数方法研究几何 | 坐标系、方程、曲线 |
|
|
40
|
-
| 非欧几何 | 改变平行公理的几何 | 双曲几何、椭圆几何 |
|
|
41
|
-
| 微分几何 | 用微积分研究几何 | 曲率、测地线、流形 |
|
|
42
|
-
| 分形几何 | 自相似的几何结构 | 分形维数、迭代函数系统 |
|
|
43
|
-
|
|
44
|
-
### 分析学(Analysis)
|
|
45
|
-
|
|
46
|
-
研究函数、极限、连续、微分、积分等。
|
|
47
|
-
|
|
48
|
-
| 层次 | 内容 | 核心概念 |
|
|
49
|
-
|------|------|---------|
|
|
50
|
-
| 微积分 | 极限、导数、积分 | 连续、可微、可积 |
|
|
51
|
-
| 数学分析 | 严格的极限理论 | ε-δ语言、一致收敛 |
|
|
52
|
-
| 实分析 | 测度论、Lebesgue 积分 | 测度空间、L^p 空间 |
|
|
53
|
-
| 复分析 | 复变函数理论 | 解析函数、留数、共形映射 |
|
|
54
|
-
| 泛函分析 | 无限维空间上的分析 | Banach 空间、Hilbert 空间、算子 |
|
|
55
|
-
| 微分方程 | ODE 与 PDE | 存在唯一性、稳定性、数值解法 |
|
|
56
|
-
|
|
57
|
-
## 二、主要分支
|
|
58
|
-
|
|
59
|
-
### 1. 数论(Number Theory)
|
|
60
|
-
|
|
61
|
-
研究整数性质,如素数分布、同余、丢番图方程等。
|
|
62
|
-
|
|
63
|
-
- **初等数论**:整除、同余、素数
|
|
64
|
-
- **解析数论**:用分析方法研究数论问题(如素数定理)
|
|
65
|
-
- **代数数论**:用代数方法研究数论问题(如代数数域)
|
|
66
|
-
- **几何数论**:用几何方法研究数论问题
|
|
67
|
-
|
|
68
|
-
### 2. 概率论与数理统计(Probability & Statistics)
|
|
69
|
-
|
|
70
|
-
研究随机现象和数据分析,广泛应用于金融、生物、社会科学等。对应思想武器:**概率与统计**、**信息论思想**、**因果推断思想**。
|
|
71
|
-
|
|
72
|
-
- **概率论**:随机变量、分布、极限定理 → 详见 **概率与统计**(Kolmogorov 公理)
|
|
73
|
-
- **数理统计**:参数估计、假设检验、回归分析 → 详见 **概率与统计**(回归建模、实验设计)
|
|
74
|
-
- **随机过程**:马尔可夫链、布朗运动、鞅论
|
|
75
|
-
- **贝叶斯统计**:先验、后验、MCMC → 详见 **信息论思想**(最大熵原则)
|
|
76
|
-
|
|
77
|
-
### 3. 拓扑学(Topology)
|
|
78
|
-
|
|
79
|
-
研究空间在连续变形下的不变性质。对应思想武器:**拓扑思想**。
|
|
80
|
-
|
|
81
|
-
- **点集拓扑**:开集、闭集、连通性、紧致性 → 详见 **对称与不变性**(不变量视角)
|
|
82
|
-
- **代数拓扑**:同伦、同调、上同调 → 详见 **拓扑思想**(基本群、Betti 数)
|
|
83
|
-
- **微分拓扑**:流形、切空间、微分形式
|
|
84
|
-
|
|
85
|
-
### 4. 离散数学(Discrete Mathematics)
|
|
86
|
-
|
|
87
|
-
集合论、图论、数理逻辑等,是计算机科学的数学基础。对应思想武器:**算法与计算思想**、**离散与组合思想**。
|
|
88
|
-
|
|
89
|
-
- **集合论**:集合、关系、函数、基数、序数
|
|
90
|
-
- **图论**:图、路径、连通性、着色、网络流
|
|
91
|
-
- **数理逻辑**:命题逻辑、谓词逻辑、可计算性 → 详见 **公理化思想**、**逻辑演绎**
|
|
92
|
-
- **组合数学**:计数、排列组合、生成函数 → 详见 **离散与组合思想**
|
|
93
|
-
- **算法与复杂度**:排序、搜索、P/NP、可判定性 → 详见 **算法与计算思想**
|
|
94
|
-
|
|
95
|
-
### 5. 应用数学分支
|
|
96
|
-
|
|
97
|
-
将数学方法应用于实际问题。对应思想武器:**优化思想**、**信息论思想**、**博弈论思想**、**算法与计算思想**、**因果推断思想**。
|
|
98
|
-
|
|
99
|
-
- **运筹学**:线性规划、整数规划、动态规划、排队论 → 详见 **优化思想**(LP/IP/DP 分类)、**算法与计算思想**(求解算法)
|
|
100
|
-
- **控制理论**:系统控制、最优控制、鲁棒控制 → 详见 **优化思想**(最优控制即变分优化)
|
|
101
|
-
- **信息论**:熵、信道容量、数据压缩、编码理论 → 详见 **信息论思想**(Shannon 熵、编码定理)
|
|
102
|
-
- **博弈论**:策略互动、均衡分析、机制设计 → 详见 **博弈论思想**(Nash 均衡、minimax)
|
|
103
|
-
- **因果推断**:因果图模型、干预分析、反事实推理 → 详见 **因果推断思想**(DAG、do 算子)
|
|
104
|
-
- **金融数学**:期权定价、风险管理、随机微积分 → 详见 **建模思想**(Black-Scholes)、**概率与统计**
|
|
105
|
-
- **计算数学**:数值分析、有限元、蒙特卡洛方法 → 详见 **算法与计算思想**(数值算法)
|
|
106
|
-
- **机器学习数学基础**:优化、统计学习理论、核方法 → 详见 **优化思想**、**概率与统计**、**信息论思想**(MDL/AIC)
|
|
107
|
-
|
|
108
|
-
## 三、知识体系的层次结构
|
|
109
|
-
|
|
110
|
-
从学习路径看,数学知识可分层次:
|
|
111
|
-
|
|
112
|
-
### 地基层
|
|
113
|
-
|
|
114
|
-
数感、逻辑与分类、算术与基础几何。
|
|
115
|
-
|
|
116
|
-
- 数的概念与运算
|
|
117
|
-
- 基本逻辑推理
|
|
118
|
-
- 算术运算(加减乘除)
|
|
119
|
-
- 基础几何图形与性质
|
|
120
|
-
|
|
121
|
-
### 代数层
|
|
122
|
-
|
|
123
|
-
变量、方程、函数、几何证明。
|
|
124
|
-
|
|
125
|
-
- 代数表达式与方程
|
|
126
|
-
- 函数概念与基本函数族
|
|
127
|
-
- 平面几何证明
|
|
128
|
-
- 向量与坐标
|
|
129
|
-
|
|
130
|
-
### 综合层
|
|
131
|
-
|
|
132
|
-
函数与导数、微积分、数列、立体几何、概率统计深化。
|
|
133
|
-
|
|
134
|
-
- 极限与连续
|
|
135
|
-
- 微分与积分
|
|
136
|
-
- 数列与级数
|
|
137
|
-
- 立体几何
|
|
138
|
-
- 概率分布与统计推断
|
|
139
|
-
|
|
140
|
-
### 前沿层
|
|
141
|
-
|
|
142
|
-
数学分析、高等代数、解析/微分几何、数论、拓扑学等。
|
|
143
|
-
|
|
144
|
-
- 严格的分析理论(ε-δ)
|
|
145
|
-
- 抽象代数结构(群环域)
|
|
146
|
-
- 流形与微分几何
|
|
147
|
-
- 代数/解析数论
|
|
148
|
-
- 点集/代数拓扑
|
|
149
|
-
- 泛函分析与算子理论
|
|
150
|
-
|
|
151
|
-
## 四、数学思想方法的层次
|
|
152
|
-
|
|
153
|
-
| 层次 | 思想方法 | 说明 |
|
|
154
|
-
|------|---------|------|
|
|
155
|
-
| 基础层 | 逻辑演绎、归纳类比 | 所有数学思维的基础 |
|
|
156
|
-
| 方法层 | 公理化、抽象化、建模 | 构建数学理论的方法 |
|
|
157
|
-
| 工具层 | 优化、变换、概率统计 | 解决具体问题的工具 |
|
|
158
|
-
| 拓展层 | 算法与计算、信息论、博弈论、因果推断 | 应用于计算、信息、互动和因果的工具 |
|
|
159
|
-
| 哲学层 | 对称不变性、拓扑思想、离散组合 | 理解结构与本质的哲学视角 |
|
|
160
|
-
|
|
161
|
-
## 五、数学与其他学科的联系
|
|
162
|
-
|
|
163
|
-
| 学科 | 使用的数学工具 | 典型应用 |
|
|
164
|
-
|------|--------------|---------|
|
|
165
|
-
| 物理学 | 微积分、线性代数、群论 | 力学、量子力学、相对论 |
|
|
166
|
-
| 计算机科学 | 离散数学、图论、概率 | 算法分析、密码学、AI |
|
|
167
|
-
| 经济学 | 优化、博弈论、微分方程 | 市场均衡、定价模型 |
|
|
168
|
-
| 生物学 | 微分方程、统计、图论 | 种群动力学、系统生物学 |
|
|
169
|
-
| 工程学 | 微分方程、傅里叶分析、数值方法 | 控制系统、信号处理 |
|
|
170
|
-
| 社会科学 | 统计、博弈论、网络分析 | 社会网络、决策分析 |
|
|
171
|
-
|
|
172
|
-
## 六、思维武器与数学分支的映射
|
|
173
|
-
|
|
174
|
-
本项目的 16 种思想武器(15 种专业武器 + 1 个 math-research-activator 自动触发入口)不是孤立存在的,它们与数学分支形成了互补的工具集。下面展示一个简化映射,帮助你从问题类型直接找到适合的数学方法。v2 另有 `references/books/*.md` × 7 把代数几何 / 微分几何 / 李理论 / 抽象代数 / 矩阵分析 / 最优化 / 流形等现代数学结构按需激活进算法设计(见 README「三层渐进式披露」)。
|
|
175
|
-
|
|
176
|
-
| 思维武器 | 对应数学分支 | 典型方法/概念 |
|
|
177
|
-
|---------|-------------|--------------|
|
|
178
|
-
| 🧭 数学研究激活器 | 元认知、问题分类、现代数学映射 | 诊断→映射→路由→GPU 筛选、双验收门 |
|
|
179
|
-
| 📐 公理化思想 | 数理逻辑、集合论 | 公理体系、形式语言、相容性、独立性 |
|
|
180
|
-
| 🧩 抽象化思想 | 代数、范畴论、拓扑学 | 抽象结构、同构、泛性质 |
|
|
181
|
-
| 🧠 逻辑演绎 | 数理逻辑、证明论 | 命题逻辑、谓词逻辑、推理规则 |
|
|
182
|
-
| 🌉 建模思想 | 应用数学、统计 | 方程建模、量纲分析、验证 |
|
|
183
|
-
| ⚖️ 优化思想 | 最优化、运筹学 | 凸优化、KKT、动态规划 |
|
|
184
|
-
| 🎲 概率与统计 | 概率论、数理统计 | 随机变量、假设检验、回归分析 |
|
|
185
|
-
| 🔄 变换思想 | 分析学、生成函数 | 傅里叶、拉普拉斯、代数变换 |
|
|
186
|
-
| ⚛️ 对称与不变性 | 群论、几何 | 群作用、不变量、商空间 |
|
|
187
|
-
| 📈 归纳与类比 | 初等数学、数论 | 归纳证明、类比推理、模式识别 |
|
|
188
|
-
| 🖥️ 算法与计算思想 | 计算理论、离散数学 | 复杂度、可计算性、算法范式 |
|
|
189
|
-
| 📡 信息论思想 | 信息论、统计学习 | 熵、互信息、编码极限 |
|
|
190
|
-
| 🎯 博弈论思想 | 数理经济学、机制设计 | 纳什均衡、激励相容、最优策略 |
|
|
191
|
-
| 🔗 因果推断思想 | 因果推断、统计学 | DAG、do-演算、干预分析 |
|
|
192
|
-
| 🌀 拓扑思想 | 拓扑学、代数拓扑 | 同伦、同调、拓扑不变量 |
|
|
193
|
-
| 🧮 离散与组合思想 | 组合数学、图论 | 鸽巢原理、生成函数、枚举 |
|
|
194
|
-
|
|
195
|
-
## 七、如何选择思想武器
|
|
196
|
-
|
|
197
|
-
面对一个问题时,最重要的第一步不是”用力分析”,而是”选对工具”。以下是选择指南:
|
|
198
|
-
|
|
199
|
-
### 快速选择指南
|
|
200
|
-
|
|
201
|
-
| 问题核心特征 | 最可能适合的思想武器 |
|
|
202
|
-
|-------------|-------------------|
|
|
203
|
-
| 多方互动,我的最优取决于他人 | 🎯 博弈论 |
|
|
204
|
-
| 不确定性/随机性 | 🎲 概率与统计 |
|
|
205
|
-
| 在限制下做最优选择 | ⚖️ 优化 |
|
|
206
|
-
| 当前视角下难以处理 | 🔄 变换 |
|
|
207
|
-
| 需要提取本质结构 | 🧩 抽象化 |
|
|
208
|
-
| 需要严格推理验证 | 🧠 逻辑演绎 |
|
|
209
|
-
| 需要从经验中发现规律 | 📈 归纳与类比 |
|
|
210
|
-
| 需要构建模型预测 | 🌉 建模 |
|
|
211
|
-
| 变化中的不变性 | ⚛️ 对称与不变性 |
|
|
212
|
-
| 需要可执行步骤 | 🖥️ 算法与计算 |
|
|
213
|
-
| 有限对象的计数/结构 | 🧮 离散与组合 |
|
|
214
|
-
|
|
215
|
-
### 使用激活器
|
|
216
|
-
|
|
217
|
-
如果不确定该用哪个工具,直接使用 `/ask` 命令调用 math-research-activator,它会诊断问题、映射现代数学结构、推荐 1–3 个最合适的思想武器并做 GPU 可行性筛选。工作区出现算法 / kernel / 模型代码时,激活器也会自动介入。
|
|
218
|
-
|
|
219
|
-
### 路径
|
|
220
|
-
|
|
221
|
-
v2 已移除「科研 / 生活双路径」,统一为单一研究 / 算法路径:保留完整数学符号与推导,并在用于算法 / 算子设计时强制过 GPU 八维门。
|
|
222
|
-
|
|
223
|
-
## 八、如何使用本概述
|
|
224
|
-
|
|
225
|
-
- 先从问题特征出发:判断它是”结构性””动态性””随机性””交互性”还是”可数性”。
|
|
226
|
-
- 对照快速选择指南或使用 `/ask` 命令,找到最贴近的思想武器。
|
|
227
|
-
- 结合”知识体系层次结构”,判断当前问题更适合基础思路还是前沿方法。
|
|
228
|
-
- 若问题横跨多个类别,可同时调用多个思想武器,例如"建模+优化"、"概率+因果"、"抽象+算法"。
|
|
229
|
-
- 算法 / 算子设计问题可让激活器把现代数学结构(代数几何 / 李理论 / 拓扑等)迁移进来,并过 GPU 八维门。
|
|
230
|
-
- 在学习或阅读文献时,把本概述作为归纳框架,将零散概念归入统一的知识地图。
|
|
39
|
+
深入查阅时,`../../references/books/*.md` 提供 7 本书的蒸馏稿。
|
|
@@ -0,0 +1,45 @@
|
|
|
1
|
+
# Concentration Inequality
|
|
2
|
+
|
|
3
|
+
## Minimal Definition
|
|
4
|
+
Concentration inequalities bound the **probability that a sum of independent random variables (or a Lipschitz function) deviates from its expectation**. The core intuition: when many independent random factors are superimposed, the outcome is highly concentrated around the mean, with tail probabilities decaying exponentially. They serve as a "quantitative strengthening of the law of large numbers."
|
|
5
|
+
|
|
6
|
+
## Core Formulas
|
|
7
|
+
|
|
8
|
+
**Markov's Inequality** (weakest, most general):
|
|
9
|
+
$$P(X \geq a) \leq \frac{\mathbb{E}[X]}{a}, \quad X \geq 0$$
|
|
10
|
+
|
|
11
|
+
**Hoeffding's Inequality** (sum of bounded independent variables):
|
|
12
|
+
$$P\left(\left|\frac{1}{n}\sum_{i=1}^n X_i - \mathbb{E}\left[\frac{1}{n}\sum X_i\right]\right| \geq t\right) \leq 2\exp\left(-\frac{2n^2 t^2}{\sum(b_i - a_i)^2}\right)$$
|
|
13
|
+
|
|
14
|
+
**Bernstein's Inequality** (exploits variance information, tighter tails):
|
|
15
|
+
$$P\left(\sum X_i \geq t\right) \leq \exp\left(-\frac{t^2/2}{\sigma^2 + Mt/3}\right)$$
|
|
16
|
+
|
|
17
|
+
**McDiarmid's Inequality** (bounded-difference functions): If $f$ has sensitivity $c_i$ to changes in the $i$-th variable, then
|
|
18
|
+
$$P(|f(X_1,\ldots,X_n) - \mathbb{E}[f]| \geq t) \leq 2\exp\left(-\frac{2t^2}{\sum c_i^2}\right)$$
|
|
19
|
+
|
|
20
|
+
## Applicable Problems
|
|
21
|
+
- **Generalization bound derivation**: Given training set size $n$, with what probability does the gap between model predictions and true risk fall within $\epsilon$
|
|
22
|
+
- **Stochastic algorithm reliability**: Probabilistic control of the deviation between mini-batch gradients and full-batch gradients
|
|
23
|
+
- **Sampling estimation accuracy**: Quantitative computation of confidence intervals for Monte Carlo estimators
|
|
24
|
+
|
|
25
|
+
## AI Design Translation
|
|
26
|
+
- **PAC learning bounds / generalization bounds**: Hoeffding/McDiarmid provides probabilistic bounds on the gap between empirical risk and true risk
|
|
27
|
+
- **Variance control for Dropout / Stochastic Depth**: Bernstein's inequality guarantees output concentration under stochastic regularization
|
|
28
|
+
- **Gradient compression / communication efficiency**: Concentration bounds on gradient deviation after quantization or sparsification, ensuring convergence of distributed training
|
|
29
|
+
|
|
30
|
+
## Engineering Feasibility
|
|
31
|
+
- **Dimension 1 Tensorization ✅**: The bounds themselves are scalar formulas with no tensor operations; zero overhead as an analytical tool
|
|
32
|
+
- **Dimension 2 GEMM-mappability ✅**: Does not directly participate in GEMM, but can serve as a theoretical basis for hyperparameter selection (batch size, compression ratio)
|
|
33
|
+
- **Dimension 3 Complexity ✅**: Computing the bound itself is $O(1)$ or $O(n)$, very low cost
|
|
34
|
+
- **Dimension 5 Low Precision ✅**: Bounds can be computed in fp32; does not enter the training backbone
|
|
35
|
+
- **Dimension 8 Operator Fusion ✅**: Does not enter the computation graph; no fusion overhead
|
|
36
|
+
|
|
37
|
+
## Risks and Failure Conditions
|
|
38
|
+
- **Independence assumption violated**: In sequential data and autoregressive models, tokens are strongly correlated, and Hoeffding's exponential decay guarantee fails. Martingale versions (Azuma-Hoeffding) or mixing-time corrections are required.
|
|
39
|
+
- **Boundedness assumption violated**: Under heavy-tailed distributions (e.g., power laws), Hoeffding does not apply; Bernstein or truncation tricks are needed. In LLM training, when gradients occasionally take extreme values, naive concentration bounds yield a false sense of security.
|
|
40
|
+
|
|
41
|
+
## Further References
|
|
42
|
+
- Distillation draft: `references/books/` — no dedicated probability distillation draft at present; this card is based on standard probability theory textbooks
|
|
43
|
+
- Boucheron, Lugosi, Massart. *Concentration Inequalities: A Nonasymptotic Theory of Independence*. Oxford, 2013
|
|
44
|
+
- Vershynin. *High-Dimensional Probability*. Cambridge, 2018 (Chapters 2-3)
|
|
45
|
+
- Related knowledge cards: `probability/entropy.md`, `probability/fisher-information.md`
|
|
@@ -0,0 +1,45 @@
|
|
|
1
|
+
# 浓度不等式 / Concentration Inequality
|
|
2
|
+
|
|
3
|
+
## 最小定义
|
|
4
|
+
浓度不等式界定了**独立随机变量之和(或 Lipschitz 函数)偏离其期望的概率上界**。核心直觉:大量独立随机因素叠加后,结果高度集中在期望附近,尾部概率指数衰减。它是"大数定律的定量加强版"。
|
|
5
|
+
|
|
6
|
+
## 核心公式
|
|
7
|
+
|
|
8
|
+
**Markov 不等式**(最弱、最通用):
|
|
9
|
+
$$P(X \geq a) \leq \frac{\mathbb{E}[X]}{a}, \quad X \geq 0$$
|
|
10
|
+
|
|
11
|
+
**Hoeffding 不等式**(有界独立变量之和):
|
|
12
|
+
$$P\left(\left|\frac{1}{n}\sum_{i=1}^n X_i - \mathbb{E}\left[\frac{1}{n}\sum X_i\right]\right| \geq t\right) \leq 2\exp\left(-\frac{2n^2 t^2}{\sum(b_i - a_i)^2}\right)$$
|
|
13
|
+
|
|
14
|
+
**Bernstein 不等式**(利用方差信息,尾部更紧):
|
|
15
|
+
$$P\left(\sum X_i \geq t\right) \leq \exp\left(-\frac{t^2/2}{\sigma^2 + Mt/3}\right)$$
|
|
16
|
+
|
|
17
|
+
**McDiarmid 不等式**(有界差分函数):若 $f$ 对第 $i$ 个变量的变化敏感度为 $c_i$,则
|
|
18
|
+
$$P(|f(X_1,\ldots,X_n) - \mathbb{E}[f]| \geq t) \leq 2\exp\left(-\frac{2t^2}{\sum c_i^2}\right)$$
|
|
19
|
+
|
|
20
|
+
## 适用问题
|
|
21
|
+
- **泛化界推导**:给定训练集大小 $n$,模型预测与真实风险之差以多大概率落在 $\epsilon$ 内
|
|
22
|
+
- **随机算法可靠性**:Mini-batch 梯度与全量梯度的偏差概率控制
|
|
23
|
+
- **采样估算精度**:Monte Carlo 估计的置信区间定量计算
|
|
24
|
+
|
|
25
|
+
## AI 设计翻译
|
|
26
|
+
- **PAC 学习界 / 泛化界**:Hoeffding/McDiarmid → 经验风险与真实风险之差的概率界
|
|
27
|
+
- **Dropout / Stochastic Depth 的方差控制**:Bernstein 不等式给出随机正则化后输出集中度的保证
|
|
28
|
+
- **梯度压缩 / 通信效率**:量化或稀疏化后梯度偏差的浓度界,确保分布式训练收敛
|
|
29
|
+
|
|
30
|
+
## 工程可行性
|
|
31
|
+
- **维度 1 张量化 ✅**:界本身是标量公式,不涉及张量运算,作为分析工具零开销
|
|
32
|
+
- **维度 2 GEMM 可映射 ✅**:不直接参与 GEMM,但可作为超参数选择(batch size、压缩率)的理论依据
|
|
33
|
+
- **维度 3 复杂度 ✅**:计算界本身 $O(1)$ 或 $O(n)$,极低
|
|
34
|
+
- **维度 5 低精度 ✅**:界用 fp32 计算即可,不进入训练主干
|
|
35
|
+
- **维度 8 算子融合 ✅**:不进入计算图,无融合负担
|
|
36
|
+
|
|
37
|
+
## 风险与失效条件
|
|
38
|
+
- **独立性假设不成立**:序列数据、自回归模型中 token 间强相关,Hoeffding 的指数衰减保证失效。需用 Martingale 版本(Azuma-Hoeffding)或混合时间修正。
|
|
39
|
+
- **有界性假设违反**:重尾分布(如幂律)下 Hoeffding 不适用,需改用 Bernstein 或截断技巧。在 LLM 训练中梯度偶尔出现极大值时,朴素浓度界给出虚假安全感。
|
|
40
|
+
|
|
41
|
+
## 深入参考
|
|
42
|
+
- 蒸馏稿:`references/books/` 暂无专用概率蒸馏稿,本卡基于标准概率论教材
|
|
43
|
+
- Boucheron, Lugosi, Massart. *Concentration Inequalities: A Nonasymptotic Theory of Independence*. Oxford, 2013
|
|
44
|
+
- Vershynin. *High-Dimensional Probability*. Cambridge, 2018(第 2-3 章)
|
|
45
|
+
- 关联知识卡:`probability/entropy.md`、`probability/fisher-information.md`
|