math-skill 3.0.1 → 3.1.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.en-US.md +42 -30
- package/README.md +18 -6
- package/agents/math-critic.en.md +6 -6
- package/agents/math-critic.md +6 -6
- package/commands/ask.en.md +6 -1
- package/commands/ask.md +6 -1
- package/design-patterns/attention/equivariant-attention.en.md +8 -2
- package/design-patterns/attention/equivariant-attention.md +7 -1
- package/design-patterns/attention/geometry-aware-attention.en.md +2 -2
- package/design-patterns/attention/geometry-aware-attention.md +1 -1
- package/design-patterns/attention/information-bottleneck-attention.en.md +32 -12
- package/design-patterns/attention/information-bottleneck-attention.md +32 -12
- package/design-patterns/attention/projection-attention.en.md +3 -3
- package/design-patterns/attention/projection-attention.md +2 -2
- package/design-patterns/attention/spectral-attention.en.md +19 -5
- package/design-patterns/attention/spectral-attention.md +18 -4
- package/design-patterns/compression/leverage-score-selection.en.md +13 -13
- package/design-patterns/compression/leverage-score-selection.md +13 -13
- package/design-patterns/compression/low-rank-kv-cache.en.md +39 -12
- package/design-patterns/compression/low-rank-kv-cache.md +38 -12
- package/design-patterns/compression/spectral-token-pruning.en.md +16 -14
- package/design-patterns/compression/spectral-token-pruning.md +16 -14
- package/design-patterns/compression/topology-preserving-compression.en.md +10 -10
- package/design-patterns/compression/topology-preserving-compression.md +10 -10
- package/design-patterns/loss/constraint-penalty.en.md +8 -4
- package/design-patterns/loss/constraint-penalty.md +9 -6
- package/design-patterns/loss/contrastive-loss.en.md +37 -11
- package/design-patterns/loss/contrastive-loss.md +38 -12
- package/design-patterns/loss/information-bottleneck-loss.en.md +5 -5
- package/design-patterns/loss/information-bottleneck-loss.md +6 -6
- package/design-patterns/loss/orthogonality-loss.en.md +24 -17
- package/design-patterns/loss/orthogonality-loss.md +24 -18
- package/design-patterns/loss/variational-loss.en.md +4 -4
- package/design-patterns/loss/variational-loss.md +5 -5
- package/design-patterns/overview.en.md +36 -0
- package/design-patterns/overview.md +36 -0
- package/design-patterns/representation/equivariant-split.en.md +4 -4
- package/design-patterns/representation/equivariant-split.md +4 -5
- package/design-patterns/representation/manifold-representation.en.md +12 -12
- package/design-patterns/representation/manifold-representation.md +13 -14
- package/design-patterns/representation/shared-private-decomposition.en.md +12 -7
- package/design-patterns/representation/shared-private-decomposition.md +12 -9
- package/design-patterns/representation/subspace-alignment.en.md +12 -12
- package/design-patterns/representation/subspace-alignment.md +12 -12
- package/design-patterns/routing/graph-routing.en.md +11 -11
- package/design-patterns/routing/graph-routing.md +11 -11
- package/design-patterns/routing/moe-routing.en.md +12 -12
- package/design-patterns/routing/moe-routing.md +12 -14
- package/design-patterns/routing/optimal-transport-routing.en.md +5 -5
- package/design-patterns/routing/optimal-transport-routing.md +6 -6
- package/design-patterns/routing/spectral-clustering-routing.en.md +26 -15
- package/design-patterns/routing/spectral-clustering-routing.md +26 -17
- package/knowledge-base/differential-geometry/connection.en.md +17 -2
- package/knowledge-base/differential-geometry/connection.md +17 -2
- package/knowledge-base/differential-geometry/curvature.en.md +14 -1
- package/knowledge-base/differential-geometry/curvature.md +14 -1
- package/knowledge-base/differential-geometry/geodesic.en.md +16 -2
- package/knowledge-base/differential-geometry/geodesic.md +16 -2
- package/knowledge-base/differential-geometry/index.en.md +52 -0
- package/knowledge-base/differential-geometry/index.md +52 -0
- package/knowledge-base/differential-geometry/manifold.en.md +15 -2
- package/knowledge-base/differential-geometry/manifold.md +15 -2
- package/knowledge-base/differential-geometry/metric-tensor.en.md +16 -2
- package/knowledge-base/differential-geometry/metric-tensor.md +16 -2
- package/knowledge-base/differential-geometry/tangent-space.en.md +17 -3
- package/knowledge-base/differential-geometry/tangent-space.md +17 -3
- package/knowledge-base/information-geometry/fisher-metric.en.md +24 -5
- package/knowledge-base/information-geometry/fisher-metric.md +24 -5
- package/knowledge-base/information-geometry/index.en.md +45 -0
- package/knowledge-base/information-geometry/index.md +45 -0
- package/knowledge-base/information-geometry/natural-gradient.en.md +17 -3
- package/knowledge-base/information-geometry/natural-gradient.md +17 -3
- package/knowledge-base/lie-theory/equivariance.en.md +18 -3
- package/knowledge-base/lie-theory/equivariance.md +18 -3
- package/knowledge-base/lie-theory/group-action.en.md +16 -2
- package/knowledge-base/lie-theory/group-action.md +16 -2
- package/knowledge-base/lie-theory/index.en.md +52 -0
- package/knowledge-base/lie-theory/index.md +52 -0
- package/knowledge-base/lie-theory/lie-algebra.en.md +17 -2
- package/knowledge-base/lie-theory/lie-algebra.md +17 -2
- package/knowledge-base/lie-theory/lie-group.en.md +17 -3
- package/knowledge-base/lie-theory/lie-group.md +17 -3
- package/knowledge-base/lie-theory/representation.en.md +17 -2
- package/knowledge-base/lie-theory/representation.md +17 -2
- package/knowledge-base/matrix-analysis/index.en.md +49 -0
- package/knowledge-base/matrix-analysis/index.md +49 -0
- package/knowledge-base/matrix-analysis/low-rank-approximation.en.md +20 -7
- package/knowledge-base/matrix-analysis/low-rank-approximation.md +20 -7
- package/knowledge-base/matrix-analysis/matrix-perturbation.en.md +13 -1
- package/knowledge-base/matrix-analysis/matrix-perturbation.md +13 -1
- package/knowledge-base/matrix-analysis/positive-semidefinite.en.md +20 -6
- package/knowledge-base/matrix-analysis/positive-semidefinite.md +20 -6
- package/knowledge-base/matrix-analysis/projection.en.md +14 -1
- package/knowledge-base/matrix-analysis/projection.md +14 -1
- package/knowledge-base/matrix-analysis/spectral-decomposition.en.md +14 -1
- package/knowledge-base/matrix-analysis/spectral-decomposition.md +14 -1
- package/knowledge-base/optimization/constrained-optimization.en.md +17 -3
- package/knowledge-base/optimization/constrained-optimization.md +17 -3
- package/knowledge-base/optimization/convex-optimization.en.md +15 -2
- package/knowledge-base/optimization/convex-optimization.md +15 -2
- package/knowledge-base/optimization/index.en.md +50 -0
- package/knowledge-base/optimization/index.md +50 -0
- package/knowledge-base/optimization/lagrangian-duality.en.md +18 -4
- package/knowledge-base/optimization/lagrangian-duality.md +18 -4
- package/knowledge-base/optimization/proximal-method.en.md +15 -1
- package/knowledge-base/optimization/proximal-method.md +15 -1
- package/knowledge-base/optimization/riemannian-optimization.en.md +18 -4
- package/knowledge-base/optimization/riemannian-optimization.md +18 -4
- package/knowledge-base/overview.en.md +20 -8
- package/knowledge-base/overview.md +20 -8
- package/knowledge-base/probability/concentration-inequality.en.md +16 -2
- package/knowledge-base/probability/concentration-inequality.md +16 -2
- package/knowledge-base/probability/entropy.en.md +19 -3
- package/knowledge-base/probability/entropy.md +18 -2
- package/knowledge-base/probability/fisher-information.en.md +17 -3
- package/knowledge-base/probability/fisher-information.md +17 -3
- package/knowledge-base/probability/index.en.md +51 -0
- package/knowledge-base/probability/index.md +51 -0
- package/knowledge-base/probability/information-bottleneck.en.md +18 -2
- package/knowledge-base/probability/information-bottleneck.md +18 -2
- package/knowledge-base/probability/kl-divergence.en.md +15 -2
- package/knowledge-base/probability/kl-divergence.md +15 -2
- package/knowledge-base/topology/euler-characteristic.en.md +15 -2
- package/knowledge-base/topology/euler-characteristic.md +15 -2
- package/knowledge-base/topology/fundamental-group.en.md +16 -2
- package/knowledge-base/topology/fundamental-group.md +16 -2
- package/knowledge-base/topology/index.en.md +48 -0
- package/knowledge-base/topology/index.md +48 -0
- package/knowledge-base/topology/persistent-homology.en.md +17 -2
- package/knowledge-base/topology/persistent-homology.md +17 -2
- package/lenses/spectral.en.md +1 -1
- package/lenses/spectral.md +1 -1
- package/lenses/topological.en.md +1 -1
- package/lenses/topological.md +1 -1
- package/package.json +5 -5
- package/references/agentic-workflow.en.md +2 -2
- package/references/books/abstract-algebra.en.md +12 -12
- package/references/books/abstract-algebra.md +9 -9
- package/references/books/algebraic-geometry-rising-sea.en.md +2 -2
- package/references/books/differential-geometry.en.md +16 -16
- package/references/books/differential-geometry.md +14 -14
- package/references/books/matrix-analysis.en.md +3 -3
- package/references/books/matrix-analysis.md +24 -24
- package/references/books/micro-lie-theory.en.md +1 -1
- package/references/books/optimization-ml.en.md +15 -15
- package/references/books/optimization-ml.md +14 -14
- package/references/books/smooth-manifolds.en.md +3 -3
- package/references/books/smooth-manifolds.md +6 -6
- package/references/gpu-friendly-math.en.md +21 -8
- package/references/gpu-friendly-math.md +19 -4
- package/references/skill-index.en.md +105 -0
- package/references/skill-index.md +105 -0
- package/skills/math-research-activator/SKILL.en.md +70 -112
- package/skills/math-research-activator/SKILL.md +60 -100
|
@@ -26,7 +26,7 @@ $$I(X; Y) = H(X) - H(X|Y) = H(Y) - H(Y|X) = \sum_{x,y} p(x,y) \log \frac{p(x,y)}
|
|
|
26
26
|
|
|
27
27
|
## AI Design Translation
|
|
28
28
|
- **Cross-Entropy Loss**: $H(p, q) = -\sum p(x)\log q(x)$, the default loss function for classification tasks; it is essentially the "coding redundancy" between the true distribution $p$ and the model distribution $q$
|
|
29
|
-
- **KL Divergence** (see `kl-divergence.md`): $D_{KL}(p\|q) = H(p,q) - H(p)$, i.e., the difference between cross-entropy and entropy
|
|
29
|
+
- **KL Divergence** (see `kl-divergence.en.md`): $D_{KL}(p\|q) = H(p,q) - H(p)$, i.e., the difference between cross-entropy and entropy
|
|
30
30
|
- **Variational Autoencoder (VAE)**: ELBO = reconstruction likelihood $-$ KL regularization term; it fundamentally balances information compression (low $H(Z)$) against reconstruction fidelity
|
|
31
31
|
|
|
32
32
|
## Engineering Feasibility
|
|
@@ -41,7 +41,23 @@ $$I(X; Y) = H(X) - H(X|Y) = H(Y) - H(Y|X) = \sum_{x,y} p(x,y) \log \frac{p(x,y)}
|
|
|
41
41
|
- **Sensitive to vocabulary size**: With large vocabularies (e.g., 128K tokenizers for LLMs), the peak memory usage of softmax + cross-entropy can reach tens of GB, requiring chunked/online softmax or label smoothing for mitigation.
|
|
42
42
|
|
|
43
43
|
## Further References
|
|
44
|
-
- Distillation draft:
|
|
44
|
+
- Distillation draft: `../../references/books/` — no dedicated information theory distillation draft at present
|
|
45
45
|
- Cover & Thomas. *Elements of Information Theory*, 2nd Edition. Wiley, 2006
|
|
46
46
|
- MacKay. *Information Theory, Inference, and Learning Algorithms*. Cambridge, 2003
|
|
47
|
-
- Related knowledge cards: `
|
|
47
|
+
- Related knowledge cards: `kl-divergence.en.md`, `information-bottleneck.en.md`
|
|
48
|
+
|
|
49
|
+
|
|
50
|
+
## Routing Extensions
|
|
51
|
+
- If relative entropy is needed -> `kl-divergence.en.md` (KL divergence is relative entropy)
|
|
52
|
+
- If information compression is involved -> `information-bottleneck.en.md` (information bottleneck uses entropy and mutual information)
|
|
53
|
+
- If entropy-power inequality is involved -> `fisher-information.en.md` (relationship between Fisher information and entropy)
|
|
54
|
+
|
|
55
|
+
## Extensible Directions
|
|
56
|
+
- Renyi entropy: parameterized family of generalized entropies
|
|
57
|
+
- Tsallis entropy: entropy for non-extensive statistical mechanics
|
|
58
|
+
- Conditional / mutual information: multi-variable information measures
|
|
59
|
+
- Entropy rate: asymptotic entropy of stochastic processes
|
|
60
|
+
- Maximum entropy principle: distribution selection under minimal assumptions
|
|
61
|
+
- Entropy estimation: methods for estimating entropy from samples
|
|
62
|
+
- Differential entropy: entropy for continuous distributions
|
|
63
|
+
- Entropy power inequality: lower bound on entropy of independent sums
|
|
@@ -41,7 +41,23 @@ $$I(X; Y) = H(X) - H(X|Y) = H(Y) - H(Y|X) = \sum_{x,y} p(x,y) \log \frac{p(x,y)}
|
|
|
41
41
|
- **对 vocab 大小敏感**:大 vocab(如 LLM 的 128K tokenizer)下 softmax + 交叉熵的显存峰值可达数十 GB,需 chunked/online softmax 或 label smoothing 缓解。
|
|
42
42
|
|
|
43
43
|
## 深入参考
|
|
44
|
-
-
|
|
44
|
+
- 蒸馏稿:`../../references/books/` 暂无专用信息论蒸馏稿
|
|
45
45
|
- Cover & Thomas. *Elements of Information Theory*, 2nd Edition. Wiley, 2006
|
|
46
46
|
- MacKay. *Information Theory, Inference, and Learning Algorithms*. Cambridge, 2003
|
|
47
|
-
- 关联知识卡:`
|
|
47
|
+
- 关联知识卡:`kl-divergence.md`、`information-bottleneck.md`
|
|
48
|
+
|
|
49
|
+
|
|
50
|
+
## 路由扩展
|
|
51
|
+
- 若需要相对熵 → `kl-divergence.md`(KL 散度即相对熵)
|
|
52
|
+
- 若涉及信息压缩 → `information-bottleneck.md`(信息瓶颈使用熵和互信息)
|
|
53
|
+
- 若涉及熵-功率不等式 → `fisher-information.md`(Fisher 信息与熵的关系)
|
|
54
|
+
|
|
55
|
+
## 可扩展方向
|
|
56
|
+
- Renyi 熵(Renyi entropy):广义熵的参数族
|
|
57
|
+
- Tsallis 熵(Tsallis entropy):非广延统计力学的熵
|
|
58
|
+
- 条件/互信息(conditional / mutual information):多变量信息度量
|
|
59
|
+
- 熵率(entropy rate):随机过程的渐近熵
|
|
60
|
+
- 最大熵原理(maximum entropy principle):最少假设下的分布选择
|
|
61
|
+
- 熵估计(entropy estimation):从样本估计熵的方法
|
|
62
|
+
- 微分熵(differential entropy):连续分布的熵
|
|
63
|
+
- 熵功率不等式(entropy power inequality):独立和的熵下界
|
|
@@ -19,7 +19,7 @@ $$D_{KL}(p_\theta \| p_{\theta + d\theta}) \approx \frac{1}{2} d\theta^T \mathca
|
|
|
19
19
|
|
|
20
20
|
## Applicable Problems
|
|
21
21
|
- **Parameter estimation efficiency assessment**: The Cramér-Rao bound gives the theoretical limit on the precision of any unbiased estimator
|
|
22
|
-
- **Natural gradient descent**: Use $\mathcal{I}(\theta)^{-1} \nabla_\theta \mathcal{L}$ instead of the naive gradient, updating along geodesic directions on the statistical manifold (see
|
|
22
|
+
- **Natural gradient descent**: Use $\mathcal{I}(\theta)^{-1} \nabla_\theta \mathcal{L}$ instead of the naive gradient, updating along geodesic directions on the statistical manifold (see `../information-geometry/natural-gradient.en.md`)
|
|
23
23
|
- **Experimental design / active learning**: Select data points that maximize Fisher information, maximizing the information gain for parameter learning
|
|
24
24
|
|
|
25
25
|
## AI Design Translation
|
|
@@ -41,8 +41,22 @@ $$D_{KL}(p_\theta \| p_{\theta + d\theta}) \approx \frac{1}{2} d\theta^T \mathca
|
|
|
41
41
|
- **Empirical Fisher ≠ True Fisher**: Replacing the expectation with a training set average introduces significant estimation bias when the sample size is insufficient, potentially causing the natural gradient direction to point in the wrong direction. This should be paired with learning rate warmup.
|
|
42
42
|
|
|
43
43
|
## Further References
|
|
44
|
-
- Distillation draft:
|
|
44
|
+
- Distillation draft: `../../references/books/` — no dedicated information geometry distillation draft at present
|
|
45
45
|
- Amari. *Information Geometry and Its Applications*. Springer, 2016
|
|
46
46
|
- Amari & Nagaoka. *Methods of Information Geometry*. AMS, 2000
|
|
47
47
|
- Martens. "Optimizing Neural Networks with Kronecker-Factored Approximate Curvature." *ICML*, 2015
|
|
48
|
-
- Related knowledge cards:
|
|
48
|
+
- Related knowledge cards: `../information-geometry/natural-gradient.en.md`, `../information-geometry/fisher-metric.en.md`
|
|
49
|
+
|
|
50
|
+
|
|
51
|
+
## Routing Extensions
|
|
52
|
+
- If a geometric perspective is needed -> `../information-geometry/fisher-metric.en.md` (Fisher information as Riemannian metric)
|
|
53
|
+
- If Fisher-based optimization is needed -> `../information-geometry/natural-gradient.en.md` (natural gradient driven by Fisher information)
|
|
54
|
+
- If Cramer-Rao bounds are needed -> `concentration-inequality.en.md` (Fisher information and estimation accuracy bounds)
|
|
55
|
+
|
|
56
|
+
## Extensible Directions
|
|
57
|
+
- Observed vs expected Fisher: two types of Fisher information matrices
|
|
58
|
+
- Fisher information matrix properties: positive definiteness, chain rule, sufficient statistics
|
|
59
|
+
- Jeffreys prior: non-informative prior defined by Fisher information
|
|
60
|
+
- Fisher information distance: Fisher metric distance between distributions
|
|
61
|
+
- Mutual information and Fisher: relationship between Fisher information and mutual information
|
|
62
|
+
- Fisher in deep learning: approximation methods such as K-FAC, Shampoo
|
|
@@ -19,7 +19,7 @@ $$D_{KL}(p_\theta \| p_{\theta + d\theta}) \approx \frac{1}{2} d\theta^T \mathca
|
|
|
19
19
|
|
|
20
20
|
## 适用问题
|
|
21
21
|
- **参数估计效率评估**:Cramér-Rao 界给出任何无偏估计器精度的理论极限
|
|
22
|
-
- **自然梯度下降**:用 $\mathcal{I}(\theta)^{-1} \nabla_\theta \mathcal{L}$ 替代朴素梯度,沿统计流形的测地线方向更新(详见
|
|
22
|
+
- **自然梯度下降**:用 $\mathcal{I}(\theta)^{-1} \nabla_\theta \mathcal{L}$ 替代朴素梯度,沿统计流形的测地线方向更新(详见 `../information-geometry/natural-gradient.md`)
|
|
23
23
|
- **实验设计 / 主动学习**:选择使 Fisher 信息最大的数据点采集,最大化参数学习的信息增益
|
|
24
24
|
|
|
25
25
|
## AI 设计翻译
|
|
@@ -41,8 +41,22 @@ $$D_{KL}(p_\theta \| p_{\theta + d\theta}) \approx \frac{1}{2} d\theta^T \mathca
|
|
|
41
41
|
- **经验 Fisher ≠ 真实 Fisher**:用训练集均值替代期望,在样本量不足时估计偏差大,自然梯度方向可能指向错误方向。需与 learning rate warmup 配合。
|
|
42
42
|
|
|
43
43
|
## 深入参考
|
|
44
|
-
-
|
|
44
|
+
- 蒸馏稿:`../../references/books/` 暂无专用信息几何蒸馏稿
|
|
45
45
|
- Amari. *Information Geometry and Its Applications*. Springer, 2016
|
|
46
46
|
- Amari & Nagaoka. *Methods of Information Geometry*. AMS, 2000
|
|
47
47
|
- Martens. "Optimizing Neural Networks with Kronecker-Factored Approximate Curvature." *ICML*, 2015
|
|
48
|
-
-
|
|
48
|
+
- 关联知识卡:`../information-geometry/natural-gradient.md`、`../information-geometry/fisher-metric.md`
|
|
49
|
+
|
|
50
|
+
|
|
51
|
+
## 路由扩展
|
|
52
|
+
- 若需要几何视角 → `../information-geometry/fisher-metric.md`(Fisher 信息作为黎曼度量)
|
|
53
|
+
- 若需要基于 Fisher 的优化 → `../information-geometry/natural-gradient.md`(Fisher 信息驱动的自然梯度)
|
|
54
|
+
- 若需要 Cramer-Rao 界 → `concentration-inequality.md`(Fisher 信息与估计精度界)
|
|
55
|
+
|
|
56
|
+
## 可扩展方向
|
|
57
|
+
- 观测 vs 期望 Fisher(observed vs expected Fisher):两种 Fisher 信息矩阵
|
|
58
|
+
- Fisher 信息矩阵性质:正定性、链式法则、充分统计量
|
|
59
|
+
- Jeffreys 先验(Jeffreys prior):Fisher 信息定义的无信息先验
|
|
60
|
+
- Fisher 信息距离(Fisher information distance):分布间的 Fisher 度量距离
|
|
61
|
+
- 互信息与 Fisher(mutual information and Fisher):Fisher 信息与互信息的关系
|
|
62
|
+
- 深度学习中的 Fisher(Fisher in deep learning):K-FAC, Shampoo 等近似方法
|
|
@@ -0,0 +1,51 @@
|
|
|
1
|
+
# Probability & Information Activation Index
|
|
2
|
+
|
|
3
|
+
## Domain Signals
|
|
4
|
+
Activate this domain direction when the problem involves:
|
|
5
|
+
- Uncertainty quantification: need to quantify the concentration or tail behavior of random variables
|
|
6
|
+
- Generalization bounds: need to derive theoretical upper bounds on model generalization
|
|
7
|
+
- Distribution distance: need to measure the difference between two distributions
|
|
8
|
+
- Information compression: need to compress representations while preserving information
|
|
9
|
+
- Sample efficiency: need to analyze the ability to learn from finite samples
|
|
10
|
+
- Tail control: need to control the probability of extreme deviations of random variables
|
|
11
|
+
|
|
12
|
+
## Core Anchors
|
|
13
|
+
- `concentration-inequality.en.md` — Concentration inequalities
|
|
14
|
+
- `entropy.en.md` — Entropy
|
|
15
|
+
- `kl-divergence.en.md` — KL divergence
|
|
16
|
+
- `information-bottleneck.en.md` — Information bottleneck
|
|
17
|
+
- `fisher-information.en.md` — Fisher information
|
|
18
|
+
|
|
19
|
+
## Extended Concepts
|
|
20
|
+
When core anchors are insufficient, the following concepts may need temporary activation:
|
|
21
|
+
- optimal transport (Wasserstein distance, Sinkhorn): optimal transport and Wasserstein distance
|
|
22
|
+
- total variation distance: total variation distance
|
|
23
|
+
- f-divergence family: f-divergence family (chi-squared, Hellinger, Jensen-Shannon, etc.)
|
|
24
|
+
- mutual information estimation (MINE / NWJ): neural estimation methods for mutual information
|
|
25
|
+
- variational inference (ELBO / VI): variational inference and evidence lower bound
|
|
26
|
+
- Markov chain Monte Carlo: Markov chain Monte Carlo methods
|
|
27
|
+
- stochastic process (martingale, Brownian motion, SDE): stochastic process fundamentals
|
|
28
|
+
- PAC-Bayes bounds: PAC-Bayes generalization bounds
|
|
29
|
+
- Rademacher complexity: Rademacher complexity
|
|
30
|
+
- VC dimension: VC dimension and hypothesis space capacity
|
|
31
|
+
- generalization via compression: compression-based generalization theory
|
|
32
|
+
- differential privacy: differential privacy
|
|
33
|
+
- normalizing flow theory: normalizing flow theory
|
|
34
|
+
- score matching: score matching
|
|
35
|
+
- diffusion process theory: diffusion process theory
|
|
36
|
+
|
|
37
|
+
## Reference Book Directions
|
|
38
|
+
- `../../references/books/optimization-ml.en.md`: variational methods and probabilistic inference chapters
|
|
39
|
+
|
|
40
|
+
## AI Translation Directions
|
|
41
|
+
- concentration inequality → generalization bounds / confidence-aware predictions / tail-risk loss
|
|
42
|
+
- entropy → entropy regularization / uncertainty estimation / exploration bonus
|
|
43
|
+
- kl-divergence → distribution matching loss / knowledge distillation / policy regularization
|
|
44
|
+
- information bottleneck → representation compression / VIB loss / uncertainty routing
|
|
45
|
+
- fisher information → natural gradient / parameter sensitivity monitor / active learning
|
|
46
|
+
|
|
47
|
+
## Temporary Activation Rules
|
|
48
|
+
When the problem requires mathematics not in the core anchors:
|
|
49
|
+
1. First check whether extended concepts contain a match
|
|
50
|
+
2. If yes, generate a temporary knowledge card based on the lens
|
|
51
|
+
3. If no, enter the Knowledge Gap Protocol
|
|
@@ -0,0 +1,51 @@
|
|
|
1
|
+
# 概率与信息 激活索引 / Probability & Information Activation Index
|
|
2
|
+
|
|
3
|
+
## 领域信号
|
|
4
|
+
当问题涉及以下信号时,激活本领域方向:
|
|
5
|
+
- 不确定性量化:需要量化随机变量的集中程度或尾部行为
|
|
6
|
+
- 泛化界:需要推导模型泛化的理论上界
|
|
7
|
+
- 分布距离:需要度量两个分布之间的差异
|
|
8
|
+
- 信息压缩:需要在保持信息的前提下压缩表示
|
|
9
|
+
- 样本效率:需要分析从有限样本中学习的能力
|
|
10
|
+
- 尾部控制:需要控制随机变量的极端偏差概率
|
|
11
|
+
|
|
12
|
+
## 核心锚点
|
|
13
|
+
- `concentration-inequality.md` — 集中不等式
|
|
14
|
+
- `entropy.md` — 熵
|
|
15
|
+
- `kl-divergence.md` — KL 散度
|
|
16
|
+
- `information-bottleneck.md` — 信息瓶颈
|
|
17
|
+
- `fisher-information.md` — Fisher 信息
|
|
18
|
+
|
|
19
|
+
## 扩展概念
|
|
20
|
+
当核心锚点不够时,以下概念可能需要临时激活:
|
|
21
|
+
- optimal transport(Wasserstein distance, Sinkhorn):最优传输与 Wasserstein 距离
|
|
22
|
+
- total variation distance:全变差距离
|
|
23
|
+
- f-divergence family:f-散度族(chi-squared, Hellinger, Jensen-Shannon 等)
|
|
24
|
+
- mutual information estimation(MINE / NWJ):互信息的神经估计方法
|
|
25
|
+
- variational inference(ELBO / VI):变分推断与证据下界
|
|
26
|
+
- Markov chain Monte Carlo:马尔可夫链蒙特卡罗方法
|
|
27
|
+
- stochastic process(martingale, Brownian motion, SDE):随机过程基础
|
|
28
|
+
- PAC-Bayes bounds:PAC-Bayes 泛化界
|
|
29
|
+
- Rademacher complexity:Rademacher 复杂度
|
|
30
|
+
- VC dimension:VC 维与假设空间容量
|
|
31
|
+
- generalization via compression:基于压缩的泛化理论
|
|
32
|
+
- differential privacy:差分隐私
|
|
33
|
+
- normalizing flow theory:规范化流理论
|
|
34
|
+
- score matching:得分匹配
|
|
35
|
+
- diffusion process theory:扩散过程理论
|
|
36
|
+
|
|
37
|
+
## 参考书方向
|
|
38
|
+
- `../../references/books/optimization-ml.md`:变分方法和概率推断相关章节
|
|
39
|
+
|
|
40
|
+
## AI 翻译方向
|
|
41
|
+
- concentration inequality → generalization bounds / confidence-aware predictions / tail-risk loss
|
|
42
|
+
- entropy → entropy regularization / uncertainty estimation / exploration bonus
|
|
43
|
+
- kl-divergence → distribution matching loss / knowledge distillation / policy regularization
|
|
44
|
+
- information bottleneck → representation compression / VIB loss / uncertainty routing
|
|
45
|
+
- fisher information → natural gradient / parameter sensitivity monitor / active learning
|
|
46
|
+
|
|
47
|
+
## 临时激活规则
|
|
48
|
+
当问题需要的数学不在核心锚点中时:
|
|
49
|
+
1. 先检查扩展概念中是否有匹配
|
|
50
|
+
2. 若有,根据透镜生成临时知识卡
|
|
51
|
+
3. 若无,进入 Knowledge Gap Protocol
|
|
@@ -42,8 +42,24 @@ where $q_\phi(y|z)$ is the classifier/decoder, $r(z)$ is the prior distribution
|
|
|
42
42
|
- **Sensitive to $\beta$ tuning**: If $\beta$ is too large, excessive compression leads to underfitting; if too small, the objective degenerates to standard ERM (no compression effect). Information plane analysis or adaptive $\beta$ scheduling is required.
|
|
43
43
|
|
|
44
44
|
## Further References
|
|
45
|
-
- Distillation draft:
|
|
45
|
+
- Distillation draft: `../../references/books/` — no dedicated IB distillation draft at present
|
|
46
46
|
- Tishby, Pereira, Bialek. "The Information Bottleneck Method." *arXiv:physics/0004057*, 2000
|
|
47
47
|
- Alemi, Poole, Fischer, Dillon, Suresh, Murphy. "Deep Variational Information Bottleneck." *ICLR*, 2017
|
|
48
48
|
- Shwartz-Ziv, Tishby. "Opening the Black Box of Deep Neural Networks via Information." *arXiv:1703.00810*, 2017
|
|
49
|
-
- Related knowledge cards: `
|
|
49
|
+
- Related knowledge cards: `entropy.en.md`, `kl-divergence.en.md`
|
|
50
|
+
|
|
51
|
+
|
|
52
|
+
## Routing Extensions
|
|
53
|
+
- If the KL component in IB objective is needed -> `kl-divergence.en.md` (KL component of IB objective)
|
|
54
|
+
- If rate-distortion theory is involved -> `entropy.en.md` (relationship between IB and rate-distortion theory)
|
|
55
|
+
- If used for VIB loss design -> `variational-loss` (design pattern layer for variational information bottleneck loss)
|
|
56
|
+
|
|
57
|
+
## Extensible Directions
|
|
58
|
+
- Rate-distortion theory: optimal compression bounds from information theory
|
|
59
|
+
- Deterministic IB: IB variant with deterministic encoding
|
|
60
|
+
- Geometric IB: information bottleneck under geometric structure
|
|
61
|
+
- IB for representation learning: feature learning under IB framework
|
|
62
|
+
- IB for clustering: IB-driven clustering algorithms
|
|
63
|
+
- Deep IB: information bottleneck in deep networks
|
|
64
|
+
- IB with multiple bottlenecks: multi-layer information constraints
|
|
65
|
+
- IB generalization bounds: theoretical connection between IB and generalization
|
|
@@ -42,8 +42,24 @@ $$\mathcal{L}_{VIB} = \mathbb{E}_{p(x,y)}[-\log q_\phi(y|z)] + D_{KL}(p_\theta(z
|
|
|
42
42
|
- **$\beta$ 调参敏感**:$\beta$ 过大会过度压缩(欠拟合),过小则退化为标准 ERM(无压缩效果)。需要信息平面分析或自适应 $\beta$ 调度。
|
|
43
43
|
|
|
44
44
|
## 深入参考
|
|
45
|
-
-
|
|
45
|
+
- 蒸馏稿:`../../references/books/` 暂无专用 IB 蒸馏稿
|
|
46
46
|
- Tishby, Pereira, Bialek. "The Information Bottleneck Method." *arXiv:physics/0004057*, 2000
|
|
47
47
|
- Alemi, Poole, Fischer, Dillon, Suresh, Murphy. "Deep Variational Information Bottleneck." *ICLR*, 2017
|
|
48
48
|
- Shwartz-Ziv, Tishby. "Opening the Black Box of Deep Neural Networks via Information." *arXiv:1703.00810*, 2017
|
|
49
|
-
- 关联知识卡:`
|
|
49
|
+
- 关联知识卡:`entropy.md`、`kl-divergence.md`
|
|
50
|
+
|
|
51
|
+
|
|
52
|
+
## 路由扩展
|
|
53
|
+
- 若需要 IB 目标中的 KL → `kl-divergence.md`(IB 目标的 KL 分量)
|
|
54
|
+
- 若涉及速率-失真理论 → `entropy.md`(IB 与率失真理论的关系)
|
|
55
|
+
- 若用于 VIB 损失设计 → `variational-loss`(设计模式层的变分信息瓶颈损失)
|
|
56
|
+
|
|
57
|
+
## 可扩展方向
|
|
58
|
+
- 速率-失真理论(rate-distortion theory):信息论的最优压缩界
|
|
59
|
+
- 确定性 IB(deterministic IB):确定性编码的 IB 变体
|
|
60
|
+
- 几何 IB(geometric IB):几何结构下的信息瓶颈
|
|
61
|
+
- IB 用于表示学习(IB for representation learning):IB 框架下的特征学习
|
|
62
|
+
- IB 用于聚类(IB for clustering):IB 驱动的聚类算法
|
|
63
|
+
- 深度 IB(deep IB):深度网络中的信息瓶颈
|
|
64
|
+
- 多瓶颈 IB(IB with multiple bottlenecks):多层信息约束
|
|
65
|
+
- IB 泛化界(IB generalization bounds):IB 与泛化能力的理论联系
|
|
@@ -45,7 +45,20 @@ $$D_{KL}(p \| q) = H(p, q) - H(p)$$
|
|
|
45
45
|
- **High gradient variance**: In RL (PPO/RLHF), KL estimation relies on sampling; high variance can lead to training instability. A clipped + linear approximation $\mathbb{E}[\log p - \log q]$ is commonly used in place of the exact KL.
|
|
46
46
|
|
|
47
47
|
## Further References
|
|
48
|
-
- Distillation draft:
|
|
48
|
+
- Distillation draft: `../../references/books/` — no dedicated information theory distillation draft at present
|
|
49
49
|
- Cover & Thomas. *Elements of Information Theory*, Ch. 2-3. Wiley, 2006
|
|
50
50
|
- Murphy. *Probabilistic Machine Learning: Advanced Topics*, Ch. 6. MIT Press, 2023
|
|
51
|
-
- Related knowledge cards: `
|
|
51
|
+
- Related knowledge cards: `entropy.en.md`, `information-bottleneck.en.md`, `fisher-information.en.md`
|
|
52
|
+
|
|
53
|
+
|
|
54
|
+
## Routing Extensions
|
|
55
|
+
- If used for IB objective -> `information-bottleneck.en.md` (IB defines objective using KL)
|
|
56
|
+
- If the absolute version is needed -> `entropy.en.md` (KL divergence reduces to entropy)
|
|
57
|
+
- If local KL geometry is needed -> `fisher-information.en.md` (Fisher information is local curvature of KL)
|
|
58
|
+
|
|
59
|
+
## Extensible Directions
|
|
60
|
+
- f-divergence family (chi-squared, Hellinger, Jensen-Shannon, total variation): unified divergence framework
|
|
61
|
+
- Reverse KL (mode-seeking): mode-seeking behavior in variational inference
|
|
62
|
+
- Bregman divergence: divergence family generated by convex functions
|
|
63
|
+
- Variational representations (Donsker-Varadhan, Barber-Agakov): variational upper/lower bounds of KL divergence
|
|
64
|
+
- KL in exponential families: geometry of sufficient statistics
|
|
@@ -45,7 +45,20 @@ $$D_{KL}(p \| q) = H(p, q) - H(p)$$
|
|
|
45
45
|
- **梯度方差大**:在 RL(PPO/RLHF)中,KL 估计依赖采样,高方差可导致训练不稳定。常用 clip + 线性近似 $\mathbb{E}[\log p - \log q]$ 替代精确 KL。
|
|
46
46
|
|
|
47
47
|
## 深入参考
|
|
48
|
-
-
|
|
48
|
+
- 蒸馏稿:`../../references/books/` 暂无专用信息论蒸馏稿
|
|
49
49
|
- Cover & Thomas. *Elements of Information Theory*, Ch. 2-3. Wiley, 2006
|
|
50
50
|
- Murphy. *Probabilistic Machine Learning: Advanced Topics*, Ch. 6. MIT Press, 2023
|
|
51
|
-
- 关联知识卡:`
|
|
51
|
+
- 关联知识卡:`entropy.md`、`information-bottleneck.md`、`fisher-information.md`
|
|
52
|
+
|
|
53
|
+
|
|
54
|
+
## 路由扩展
|
|
55
|
+
- 若用于 IB 目标函数 → `information-bottleneck.md`(IB 使用 KL 定义目标)
|
|
56
|
+
- 若需要绝对版本 → `entropy.md`(KL 散度退化为熵)
|
|
57
|
+
- 若需要局部 KL 几何 → `fisher-information.md`(Fisher 信息是 KL 的局部曲率)
|
|
58
|
+
|
|
59
|
+
## 可扩展方向
|
|
60
|
+
- f-散度族(chi-squared, Hellinger, Jensen-Shannon, total variation):统一的散度框架
|
|
61
|
+
- 逆 KL(reverse KL / mode-seeking):变分推断中的模式搜索行为
|
|
62
|
+
- Bregman 散度(Bregman divergence):凸函数生成的散度族
|
|
63
|
+
- 变分表示(Donsker-Varadhan, Barber-Agakov):KL 散度的变分上/下界
|
|
64
|
+
- 指数族中的 KL(KL in exponential families):充分统计量的几何
|
|
@@ -48,7 +48,20 @@ High GPU friendliness. Computing the Euler characteristic is extremely cheap:
|
|
|
48
48
|
|
|
49
49
|
## Further References
|
|
50
50
|
|
|
51
|
-
- Distillation notes: references/books/smooth-manifolds.md (Ch 17--18 De Rham Cohomology, Betti numbers and cohomology)
|
|
52
|
-
- Distillation notes: references/books/differential-geometry.md (Ch 4 Curves and Hypersurfaces, intuition source for Gauss curvature)
|
|
51
|
+
- Distillation notes: ../../references/books/smooth-manifolds.en.md (Ch 17--18 De Rham Cohomology, Betti numbers and cohomology)
|
|
52
|
+
- Distillation notes: ../../references/books/differential-geometry.en.md (Ch 4 Curves and Hypersurfaces, intuition source for Gauss curvature)
|
|
53
53
|
- Original text: John M. Lee, *Introduction to Smooth Manifolds*, Ch 17--18 (de Rham cohomology and topological invariants)
|
|
54
54
|
- Extended reading: Hatcher, *Algebraic Topology*, Ch 2 (standard treatment of simplicial homology and the Euler characteristic)
|
|
55
|
+
|
|
56
|
+
|
|
57
|
+
## Routing Extensions
|
|
58
|
+
- If multi-scale topology analysis is needed -> `persistent-homology.en.md` (persistent homology provides scale-dependent topology)
|
|
59
|
+
- If curvature-topology connection is involved -> `../differential-geometry/curvature.md` (Gauss-Bonnet theorem connects curvature and Euler characteristic)
|
|
60
|
+
|
|
61
|
+
## Extensible Directions
|
|
62
|
+
- Betti numbers: counting independent loops at each dimension
|
|
63
|
+
- Poincare polynomial: generating function of Betti numbers
|
|
64
|
+
- Lefschetz fixed point theorem: Euler characteristic and map fixed points
|
|
65
|
+
- Morse inequalities: relationship between critical points and Betti numbers
|
|
66
|
+
- Discrete Morse theory: Morse functions on complexes
|
|
67
|
+
- Euler characteristic curve: Euler characteristic variation across thresholds
|
|
@@ -48,7 +48,20 @@ GPU 友好度高。欧拉示性数的计算极其廉价:
|
|
|
48
48
|
|
|
49
49
|
## 深入参考
|
|
50
50
|
|
|
51
|
-
-
|
|
52
|
-
-
|
|
51
|
+
- 蒸馏稿:../../references/books/smooth-manifolds.md(Ch 17-18 De Rham Cohomology,Betti 数与上同调)
|
|
52
|
+
- 蒸馏稿:../../references/books/differential-geometry.md(Ch 4 Curves and Hypersurfaces, Gauss curvature 直觉来源)
|
|
53
53
|
- 原书:John M. Lee, *Introduction to Smooth Manifolds*, Ch 17-18(de Rham 上同调与拓扑不变量)
|
|
54
54
|
- 延伸:Hatcher, *Algebraic Topology*, Ch 2(单纯同调与欧拉示性数的标准处理)
|
|
55
|
+
|
|
56
|
+
|
|
57
|
+
## 路由扩展
|
|
58
|
+
- 若需要多尺度拓扑分析 → `persistent-homology.md`(持续同调提供尺度依赖的拓扑)
|
|
59
|
+
- 若涉及曲率-拓扑联系 → `../differential-geometry/curvature.md`(Gauss-Bonnet 定理连接曲率与 Euler 示性数)
|
|
60
|
+
|
|
61
|
+
## 可扩展方向
|
|
62
|
+
- Betti 数(Betti numbers):各维度的独立环路计数
|
|
63
|
+
- Poincare 多项式(Poincare polynomial):Betti 数的生成函数
|
|
64
|
+
- Lefschetz 不动点定理:Euler 示性数与映射不动点
|
|
65
|
+
- Morse 不等式(Morse inequalities):临界点与 Betti 数的关系
|
|
66
|
+
- 离散 Morse 理论(discrete Morse theory):复形上的 Morse 函数
|
|
67
|
+
- Euler 示性数曲线(Euler characteristic curve):多阈值的 Euler 示性数变化
|
|
@@ -46,7 +46,21 @@ Low GPU friendliness. Computation of the fundamental group is inherently combina
|
|
|
46
46
|
|
|
47
47
|
## Further References
|
|
48
48
|
|
|
49
|
-
- Distillation notes: references/books/smooth-manifolds.md (Ch 17--18 De Rham Cohomology, cohomology and topological invariants)
|
|
50
|
-
- Distillation notes: references/books/algebraic-geometry-rising-sea.md (Section 18 Cech Cohomology, local gluing and global obstructions)
|
|
49
|
+
- Distillation notes: ../../references/books/smooth-manifolds.en.md (Ch 17--18 De Rham Cohomology, cohomology and topological invariants)
|
|
50
|
+
- Distillation notes: ../../references/books/algebraic-geometry-rising-sea.en.md (Section 18 Cech Cohomology, local gluing and global obstructions)
|
|
51
51
|
- Original text: John M. Lee, *Introduction to Smooth Manifolds*, Ch 17 (de Rham cohomology, the loop integral perspective)
|
|
52
52
|
- Extended reading: Hatcher, *Algebraic Topology*, Ch 1 (standard textbook treatment of the fundamental group, including the Seifert-van Kampen theorem)
|
|
53
|
+
|
|
54
|
+
|
|
55
|
+
## Routing Extensions
|
|
56
|
+
- If higher-dimensional homology is needed -> `persistent-homology.en.md` (higher homology groups)
|
|
57
|
+
- If geometric structure is involved -> `../differential-geometry/curvature.md` (relationship between geometry and topology)
|
|
58
|
+
|
|
59
|
+
## Extensible Directions
|
|
60
|
+
- Covering space theory: Galois correspondence between fundamental group and coverings
|
|
61
|
+
- Van Kampen theorem: computational tool for fundamental groups
|
|
62
|
+
- Higher homotopy groups: computation and obstructions of pi_n
|
|
63
|
+
- Hurewicz theorem: relationship between homotopy and homology groups
|
|
64
|
+
- Loop space: space of all loops based at a point
|
|
65
|
+
- Braid group: algebraic structure of braids
|
|
66
|
+
- Knot group: invariants of knots
|
|
@@ -46,7 +46,21 @@ GPU 友好度低。基本群的计算本质上是组合/代数的,而非数值
|
|
|
46
46
|
|
|
47
47
|
## 深入参考
|
|
48
48
|
|
|
49
|
-
-
|
|
50
|
-
-
|
|
49
|
+
- 蒸馏稿:../../references/books/smooth-manifolds.md(Ch 17-18 De Rham Cohomology,上同调与拓扑不变量)
|
|
50
|
+
- 蒸馏稿:../../references/books/algebraic-geometry-rising-sea.md(§18 Cech Cohomology,局部黏合与全局障碍)
|
|
51
51
|
- 原书:John M. Lee, *Introduction to Smooth Manifolds*, Ch 17(de Rham 上同调,环路积分的视角)
|
|
52
52
|
- 延伸:Hatcher, *Algebraic Topology*, Ch 1(基本群的标准教材处理,含 Seifert-van Kampen 定理)
|
|
53
|
+
|
|
54
|
+
|
|
55
|
+
## 路由扩展
|
|
56
|
+
- 若需要更高维同调 → `persistent-homology.md`(高阶同调群)
|
|
57
|
+
- 若涉及几何结构 → `../differential-geometry/curvature.md`(几何与拓扑的关系)
|
|
58
|
+
|
|
59
|
+
## 可扩展方向
|
|
60
|
+
- 覆叠空间理论(covering space theory):基本群与覆叠的 Galois 对应
|
|
61
|
+
- Van Kampen 定理:基本群的计算工具
|
|
62
|
+
- 高阶同伦群(higher homotopy groups):pi_n 的计算与障碍
|
|
63
|
+
- Hurewicz 定理:同伦群与同调群的关系
|
|
64
|
+
- 环路空间(loop space):基于某点的环路全体
|
|
65
|
+
- 辫群(braid group):辫子的代数结构
|
|
66
|
+
- 纽群(knot group):纽结的不变量
|
|
@@ -0,0 +1,48 @@
|
|
|
1
|
+
# Topology Activation Index
|
|
2
|
+
|
|
3
|
+
## Domain Signals
|
|
4
|
+
Activate this domain direction when the problem involves:
|
|
5
|
+
- Connectivity preservation: need to maintain or detect connectivity structure of a space
|
|
6
|
+
- Representation space tearing: latent space or representation space exhibits topological tearing
|
|
7
|
+
- Local-to-global consistency: whether local information can be consistently glued into a global structure
|
|
8
|
+
- Multimodal alignment obstruction: whether topological obstructions exist for multimodal alignment
|
|
9
|
+
- Whether compression destroys structure: whether dimensionality reduction or compression alters the topological features of data
|
|
10
|
+
|
|
11
|
+
## Core Anchors
|
|
12
|
+
- `persistent-homology.en.md` — Persistent homology
|
|
13
|
+
- `euler-characteristic.en.md` — Euler characteristic
|
|
14
|
+
- `fundamental-group.en.md` — Fundamental group
|
|
15
|
+
|
|
16
|
+
## Extended Concepts
|
|
17
|
+
When core anchors are insufficient, the following concepts may need temporary activation:
|
|
18
|
+
- simplicial complex: simplicial complexes (Vietoris-Rips, alpha complex, etc.)
|
|
19
|
+
- Cech complex: Cech complex and coverings
|
|
20
|
+
- sheaf theory (section, restriction map, gluing, Cech cohomology): sheaf theory basics and Cech cohomology
|
|
21
|
+
- covering space: covering spaces and covering maps
|
|
22
|
+
- homotopy group: higher homotopy groups
|
|
23
|
+
- CW complex: CW complexes and cell structure
|
|
24
|
+
- Morse theory: Morse theory and critical point analysis
|
|
25
|
+
- Betti numbers: Betti numbers and topological invariants
|
|
26
|
+
- topological data analysis (Mapper algorithm): topological data analysis and Mapper algorithm
|
|
27
|
+
- obstruction theory: obstruction theory
|
|
28
|
+
- classifying space: classifying spaces
|
|
29
|
+
- K-theory: K-theory
|
|
30
|
+
- cobordism: cobordism theory
|
|
31
|
+
|
|
32
|
+
## Reference Book Directions
|
|
33
|
+
- `../../references/books/smooth-manifolds.en.md`: Chapters 17-18, covering homology theory basics
|
|
34
|
+
- `../../references/books/algebraic-geometry-rising-sea.en.md`: Cech cohomology sections
|
|
35
|
+
|
|
36
|
+
## AI Translation Directions
|
|
37
|
+
- persistent homology → representation topology monitor / topological regularization loss
|
|
38
|
+
- euler characteristic → complexity metric / model selection criterion
|
|
39
|
+
- fundamental group → loop structure detection / cycle-preserving compression
|
|
40
|
+
- sheaf / gluing → cross-modal consistency loss / multi-view alignment
|
|
41
|
+
- obstruction theory → alignment failure signal / topological bottleneck detection
|
|
42
|
+
- simplicial complex → higher-order token relation graph / hypergraph attention
|
|
43
|
+
|
|
44
|
+
## Temporary Activation Rules
|
|
45
|
+
When the problem requires mathematics not in the core anchors:
|
|
46
|
+
1. First check whether extended concepts contain a match
|
|
47
|
+
2. If yes, generate a temporary knowledge card based on the lens
|
|
48
|
+
3. If no, enter the Knowledge Gap Protocol
|
|
@@ -0,0 +1,48 @@
|
|
|
1
|
+
# 拓扑 激活索引 / Topology Activation Index
|
|
2
|
+
|
|
3
|
+
## 领域信号
|
|
4
|
+
当问题涉及以下信号时,激活本领域方向:
|
|
5
|
+
- 连通性保持:需要保持或检测空间的连通性结构
|
|
6
|
+
- 表示空间断裂:隐空间或表示空间出现拓扑断裂
|
|
7
|
+
- 局部到全局一致性:局部信息是否能一致地拼接成全局结构
|
|
8
|
+
- 多模态对齐 obstruction:多模态对齐是否存在拓扑障碍
|
|
9
|
+
- 压缩是否破坏结构:降维或压缩是否改变了数据的拓扑特征
|
|
10
|
+
|
|
11
|
+
## 核心锚点
|
|
12
|
+
- `persistent-homology.md` — 持续同调
|
|
13
|
+
- `euler-characteristic.md` — Euler 示性数
|
|
14
|
+
- `fundamental-group.md` — 基本群
|
|
15
|
+
|
|
16
|
+
## 扩展概念
|
|
17
|
+
当核心锚点不够时,以下概念可能需要临时激活:
|
|
18
|
+
- simplicial complex:单纯复形(Vietoris-Rips, alpha complex 等)
|
|
19
|
+
- Cech complex:Cech 复形与覆盖
|
|
20
|
+
- sheaf theory(section, restriction map, gluing, Cech cohomology):层论基础与 Cech 上同调
|
|
21
|
+
- covering space:覆叠空间与覆叠映射
|
|
22
|
+
- homotopy group:高阶同伦群
|
|
23
|
+
- CW complex:CW 复形与胞腔结构
|
|
24
|
+
- Morse theory:Morse 理论与临界点分析
|
|
25
|
+
- Betti numbers:Betti 数与拓扑不变量
|
|
26
|
+
- topological data analysis(Mapper algorithm):拓扑数据分析与 Mapper 算法
|
|
27
|
+
- obstruction theory:障碍理论
|
|
28
|
+
- classifying space:分类空间
|
|
29
|
+
- K-theory:K 理论
|
|
30
|
+
- cobordism:配边理论
|
|
31
|
+
|
|
32
|
+
## 参考书方向
|
|
33
|
+
- `../../references/books/smooth-manifolds.md`:第 17-18 章,覆盖同调论基础
|
|
34
|
+
- `../../references/books/algebraic-geometry-rising-sea.md`:Cech 上同调部分
|
|
35
|
+
|
|
36
|
+
## AI 翻译方向
|
|
37
|
+
- persistent homology → representation topology monitor / topological regularization loss
|
|
38
|
+
- euler characteristic → complexity metric / model selection criterion
|
|
39
|
+
- fundamental group → loop structure detection / cycle-preserving compression
|
|
40
|
+
- sheaf / gluing → cross-modal consistency loss / multi-view alignment
|
|
41
|
+
- obstruction theory → alignment failure signal / topological bottleneck detection
|
|
42
|
+
- simplicial complex → higher-order token relation graph / hypergraph attention
|
|
43
|
+
|
|
44
|
+
## 临时激活规则
|
|
45
|
+
当问题需要的数学不在核心锚点中时:
|
|
46
|
+
1. 先检查扩展概念中是否有匹配
|
|
47
|
+
2. 若有,根据透镜生成临时知识卡
|
|
48
|
+
3. 若无,进入 Knowledge Gap Protocol
|
|
@@ -48,7 +48,22 @@ Limited GPU friendliness, which is the main bottleneck for deploying persistent
|
|
|
48
48
|
|
|
49
49
|
## Further References
|
|
50
50
|
|
|
51
|
-
- Distillation notes: references/books/smooth-manifolds.md (Ch 17--18 De Rham Cohomology, conceptual origin of topological invariants)
|
|
52
|
-
- Distillation notes: references/books/algebraic-geometry-rising-sea.md (Section 18 Cech Cohomology, Section 23 Derived Functors, cohomology computations)
|
|
51
|
+
- Distillation notes: ../../references/books/smooth-manifolds.en.md (Ch 17--18 De Rham Cohomology, conceptual origin of topological invariants)
|
|
52
|
+
- Distillation notes: ../../references/books/algebraic-geometry-rising-sea.en.md (Section 18 Cech Cohomology, Section 23 Derived Functors, cohomology computations)
|
|
53
53
|
- Original text: John M. Lee, *Introduction to Smooth Manifolds*, Ch 17--18 (de Rham cohomology)
|
|
54
54
|
- Extended reading: Edelsbrunner & Harer, *Computational Topology: An Introduction* (standard textbook on persistent homology)
|
|
55
|
+
|
|
56
|
+
|
|
57
|
+
## Routing Extensions
|
|
58
|
+
- If topological invariant computation is needed -> `euler-characteristic.en.md` (Euler characteristic as alternating sum of Betti numbers)
|
|
59
|
+
- If 1-dimensional topology analysis is needed -> `fundamental-group.en.md` (fundamental group captures loop structure)
|
|
60
|
+
- If used for information-preserving compression -> `../probability/information-bottleneck.md` (topology-preserving information compression)
|
|
61
|
+
|
|
62
|
+
## Extensible Directions
|
|
63
|
+
- Simplicial complex types (Cech, Vietoris-Rips, alpha): advantages and disadvantages of different constructions
|
|
64
|
+
- Sheaf theory: local-to-global consistent data structures
|
|
65
|
+
- Mapper algorithm: visualization and clustering based on persistent homology
|
|
66
|
+
- Topological data analysis (TDA): complete TDA methodology
|
|
67
|
+
- Persistence image / landscape: vectorized representations of persistence diagrams
|
|
68
|
+
- Multiparameter persistence: homology with multi-scale filtrations
|
|
69
|
+
- Zigzag persistence: persistent homology allowing bidirectional filtrations
|
|
@@ -48,7 +48,22 @@ GPU 友好度有限,是持续同调落地的主要瓶颈:
|
|
|
48
48
|
|
|
49
49
|
## 深入参考
|
|
50
50
|
|
|
51
|
-
-
|
|
52
|
-
-
|
|
51
|
+
- 蒸馏稿:../../references/books/smooth-manifolds.md(Ch 17-18 De Rham Cohomology,拓扑不变量概念来源)
|
|
52
|
+
- 蒸馏稿:../../references/books/algebraic-geometry-rising-sea.md(§18 Cech Cohomology, §23 Derived Functors,上同调计算)
|
|
53
53
|
- 原书:John M. Lee, *Introduction to Smooth Manifolds*, Ch 17-18(de Rham 上同调)
|
|
54
54
|
- 延伸:Edelsbrunner & Harer, *Computational Topology: An Introduction*(持续同调标准教材)
|
|
55
|
+
|
|
56
|
+
|
|
57
|
+
## 路由扩展
|
|
58
|
+
- 若需要拓扑不变量的计算 → `euler-characteristic.md`(Euler 示性数作为 Betti 数的交替和)
|
|
59
|
+
- 若需要 1 维拓扑分析 → `fundamental-group.md`(基本群捕捉环路结构)
|
|
60
|
+
- 若用于信息保持压缩 → `../probability/information-bottleneck.md`(拓扑保持的信息压缩)
|
|
61
|
+
|
|
62
|
+
## 可扩展方向
|
|
63
|
+
- 单纯复形类型(Cech, Vietoris-Rips, alpha):不同复形构造的优缺点
|
|
64
|
+
- 层论(sheaf theory):局部到全局的一致数据结构
|
|
65
|
+
- Mapper 算法:基于持续同调的可视化与聚类
|
|
66
|
+
- 拓扑数据分析(topological data analysis):TDA 的完整方法论
|
|
67
|
+
- 持续图像/景观(persistence image / landscape):持续图的向量化表示
|
|
68
|
+
- 多参数持续(multiparameter persistence):多尺度过滤的同调
|
|
69
|
+
- zigzag 持续(zigzag persistence):允许双向过滤的持续同调
|
package/lenses/spectral.en.md
CHANGED
|
@@ -17,7 +17,7 @@ This is a "decomposer's" perspective — breaking complex linear operators (matr
|
|
|
17
17
|
## What Problems It Is Not Suited For
|
|
18
18
|
|
|
19
19
|
- Problems dominated by nonlinear effects — spectral decomposition is a linear tool
|
|
20
|
-
- Operators that are
|
|
20
|
+
- Operators that are non-diagonalizable or non-normal — Jordan form is mainly theoretical; for numerical / engineering use prefer Schur decomposition, SVD, or pseudospectral stability analysis
|
|
21
21
|
- Problems that require preserving global topological structure — spectral methods may destroy topology
|
|
22
22
|
|
|
23
23
|
## Which Knowledge Domains It Routes To
|
package/lenses/spectral.md
CHANGED
package/lenses/topological.en.md
CHANGED
|
@@ -23,7 +23,7 @@ Topology is a way of "ignoring precise measurements and focusing only on qualita
|
|
|
23
23
|
|
|
24
24
|
- `topology/persistent-homology`: Fundamental group, homology groups, Betti numbers, and cohomology — computational tools for topological invariants
|
|
25
25
|
- **tda**: Persistent homology, filtrations, and simplicial complexes — extracting topological features from data
|
|
26
|
-
- `topology/fundamental-group`:
|
|
26
|
+
- `topology/fundamental-group`: Fundamental group, loop homotopy classes, covering spaces — detecting non-contractible loops and path-connectivity structure
|
|
27
27
|
|
|
28
28
|
## What AI Designs It May Inspire
|
|
29
29
|
|
package/lenses/topological.md
CHANGED
|
@@ -23,7 +23,7 @@
|
|
|
23
23
|
|
|
24
24
|
- `topology/persistent-homology`:基本群、同调群、Betti 数、上同调——拓扑不变量的计算工具
|
|
25
25
|
- **tda**:持续同调、滤流、单纯复形——从数据中提取拓扑特征
|
|
26
|
-
- `topology/fundamental-group
|
|
26
|
+
- `topology/fundamental-group`:基本群、环路同伦类、覆盖空间——检测不可收缩环路与路径连通性结构
|
|
27
27
|
|
|
28
28
|
## 可能产生哪些 AI 设计
|
|
29
29
|
|