PyPI - mindstudio-probe - Versions diffs - 1.2.2__tar.gz → 8.1.0__tar.gz - Mend

mindstudio-probe 1.2.2tar.gz → 8.1.0tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (520) hide show

{mindstudio_probe-1.2.2 → mindstudio_probe-8.1.0}/PKG-INFO RENAMED Viewed

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: mindstudio-probe
-Version: 1.2.2
+Version: 8.1.0
 Summary: Ascend Probe Utils
 Home-page: https://gitee.com/ascend/mstt/tree/master/debug/accuracy_tools/msprobe
 Author: Ascend Team
@@ -22,16 +22,17 @@ Requires-Python: >=3.6.2
 License-File: LICENSE
 Requires-Dist: wheel
 Requires-Dist: einops
-Requires-Dist: numpy<2.0
+Requires-Dist: numpy<2.0,>=1.23.0
 Requires-Dist: pandas<2.1,>=1.3.5
 Requires-Dist: pyyaml
 Requires-Dist: rich
 Requires-Dist: tqdm
-Requires-Dist: openpyxl
+Requires-Dist: openpyxl>=3.0.6
 Requires-Dist: pyopenssl
 Requires-Dist: twisted
 Requires-Dist: matplotlib
 Requires-Dist: tensorboard
 Requires-Dist: tabulate
+Requires-Dist: pwinput
 MindStudio-Probe is a set of tools for diagnosing and improving model accuracy on Ascend NPU, including API acc checker, ptdbg, grad tool etc.

{mindstudio_probe-1.2.2 → mindstudio_probe-8.1.0}/mindstudio_probe.egg-info/PKG-INFO RENAMED Viewed

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: mindstudio-probe
-Version: 1.2.2
+Version: 8.1.0
 Summary: Ascend Probe Utils
 Home-page: https://gitee.com/ascend/mstt/tree/master/debug/accuracy_tools/msprobe
 Author: Ascend Team
@@ -22,16 +22,17 @@ Requires-Python: >=3.6.2
 License-File: LICENSE
 Requires-Dist: wheel
 Requires-Dist: einops
-Requires-Dist: numpy<2.0
+Requires-Dist: numpy<2.0,>=1.23.0
 Requires-Dist: pandas<2.1,>=1.3.5
 Requires-Dist: pyyaml
 Requires-Dist: rich
 Requires-Dist: tqdm
-Requires-Dist: openpyxl
+Requires-Dist: openpyxl>=3.0.6
 Requires-Dist: pyopenssl
 Requires-Dist: twisted
 Requires-Dist: matplotlib
 Requires-Dist: tensorboard
 Requires-Dist: tabulate
+Requires-Dist: pwinput
 MindStudio-Probe is a set of tools for diagnosing and improving model accuracy on Ascend NPU, including API acc checker, ptdbg, grad tool etc.

{mindstudio_probe-1.2.2 → mindstudio_probe-8.1.0}/mindstudio_probe.egg-info/SOURCES.txt RENAMED Viewed

@@ -15,20 +15,28 @@ msprobe/config.json
 msprobe/msprobe.py
 msprobe/core/__init__.py
 msprobe/core/common_config.py
+msprobe/core/hook_manager.py
+msprobe/core/service.py
 msprobe/core/advisor/advisor.py
 msprobe/core/advisor/advisor_const.py
 msprobe/core/advisor/advisor_result.py
 msprobe/core/common/const.py
+msprobe/core/common/decorator.py
 msprobe/core/common/exceptions.py
 msprobe/core/common/file_utils.py
+msprobe/core/common/framework_adapter.py
+msprobe/core/common/global_lock.py
 msprobe/core/common/inplace_op_checker.py
 msprobe/core/common/inplace_ops.yaml
 msprobe/core/common/log.py
+msprobe/core/common/runtime.py
 msprobe/core/common/utils.py
 msprobe/core/compare/acc_compare.py
 msprobe/core/compare/check.py
 msprobe/core/compare/compare_cli.py
+msprobe/core/compare/config.py
 msprobe/core/compare/highlight.py
+msprobe/core/compare/ms_to_pt_api.yaml
 msprobe/core/compare/multiprocessing_compute.py
 msprobe/core/compare/npy_compare.py
 msprobe/core/compare/utils.py
@@ -39,6 +47,27 @@ msprobe/core/compare/layer_mapping/postprocess_pass.py
 msprobe/core/compare/merge_result/merge_result.py
 msprobe/core/compare/merge_result/merge_result_cli.py
 msprobe/core/compare/merge_result/utils.py
+msprobe/core/config_check/__init__.py
+msprobe/core/config_check/config_check_cli.py
+msprobe/core/config_check/config_checker.py
+msprobe/core/config_check/checkers/__init__.py
+msprobe/core/config_check/checkers/base_checker.py
+msprobe/core/config_check/checkers/dataset_checker.py
+msprobe/core/config_check/checkers/env_args_checker.py
+msprobe/core/config_check/checkers/hyperparameter_checker.py
+msprobe/core/config_check/checkers/pip_checker.py
+msprobe/core/config_check/checkers/random_checker.py
+msprobe/core/config_check/checkers/weights_checker.py
+msprobe/core/config_check/ckpt_compare/ckpt_comparator.py
+msprobe/core/config_check/ckpt_compare/megatron_loader.py
+msprobe/core/config_check/ckpt_compare/metrics.py
+msprobe/core/config_check/ckpt_compare/name_mapping.yaml
+msprobe/core/config_check/resource/dependency.yaml
+msprobe/core/config_check/resource/env.yaml
+msprobe/core/config_check/resource/hyperparameter.yaml
+msprobe/core/config_check/utils/hyperparameter_parser.py
+msprobe/core/config_check/utils/utils.py
+msprobe/core/data_dump/api_registry.py
 msprobe/core/data_dump/data_collector.py
 msprobe/core/data_dump/json_writer.py
 msprobe/core/data_dump/scope.py
@@ -46,10 +75,14 @@ msprobe/core/data_dump/data_processor/base.py
 msprobe/core/data_dump/data_processor/factory.py
 msprobe/core/data_dump/data_processor/mindspore_processor.py
 msprobe/core/data_dump/data_processor/pytorch_processor.py
+msprobe/core/debugger/precision_debugger.py
 msprobe/core/grad_probe/__init__.py
 msprobe/core/grad_probe/constant.py
 msprobe/core/grad_probe/grad_compare.py
 msprobe/core/grad_probe/utils.py
+msprobe/core/kernel_dump/kernel_config.py
+msprobe/core/monitor/__init__.py
+msprobe/core/monitor/anomaly_processor.py
 msprobe/core/overflow_check/abnormal_scene.py
 msprobe/core/overflow_check/api_info.py
 msprobe/core/overflow_check/checker.py
@@ -57,6 +90,9 @@ msprobe/core/overflow_check/filter.py
 msprobe/core/overflow_check/ignore_rules.yaml
 msprobe/core/overflow_check/level.py
 msprobe/core/overflow_check/utils.py
+msprobe/core/single_save/__init__.py
+msprobe/core/single_save/single_comparator.py
+msprobe/core/single_save/single_saver.py
 msprobe/docs/01.installation.md
 msprobe/docs/02.config_introduction.md
 msprobe/docs/03.config_examples.md
@@ -86,6 +122,13 @@ msprobe/docs/26.data_dump_PyTorch_baseline.md
 msprobe/docs/27.dump_json_instruction.md
 msprobe/docs/28.debugger_save_instruction.md
 msprobe/docs/28.kernel_dump_MindSpore.md
+msprobe/docs/29.data_dump_MSAdapter.md
+msprobe/docs/30.overflow_check_MSAdapter.md
+msprobe/docs/31.config_check.md
+msprobe/docs/32.ckpt_compare.md
+msprobe/docs/33.generate_operator_MindSpore.md
+msprobe/docs/34.RL_collect.md
+msprobe/docs/35.nan_analyze.md
 msprobe/docs/FAQ.md
 msprobe/docs/S02.report_free_benchmarking_validation_performance_baseline.md
 msprobe/docs/accuracy_checker_MindSpore/accuracy_checker_MindSpore_baseline.md
@@ -126,14 +169,17 @@ msprobe/docs/img/module_compare.png
 msprobe/docs/img/ms_dump.png
 msprobe/docs/img/ms_layer.png
 msprobe/docs/img/pt_dump.png
+msprobe/docs/img/save_compare_result_sample.png
 msprobe/docs/img/monitor/cpu_info.png
 msprobe/docs/img/monitor/step_count_per_record.png
 msprobe/docs/img/visualization/fuzzy_match_ms.png
 msprobe/docs/img/visualization/fuzzy_match_pt.png
+msprobe/docs/img/visualization/proxy.png
 msprobe/docs/img/visualization/tensorboard_1.png
 msprobe/docs/img/visualization/tensorboard_2.png
 msprobe/docs/img/visualization/vis_browser_1.png
 msprobe/docs/img/visualization/vis_browser_2.png
+msprobe/docs/img/visualization/vis_match_info.png
 msprobe/docs/img/visualization/vis_precision_info.png
 msprobe/docs/img/visualization/vis_search_info.png
 msprobe/docs/img/visualization/vis_show_info.png
@@ -152,9 +198,8 @@ msprobe/docs/visualization/no_mapping_analyze.png
 msprobe/docs/visualization/top_layer.png
 msprobe/mindspore/__init__.py
 msprobe/mindspore/cell_processor.py
+msprobe/mindspore/mindspore_service.py
 msprobe/mindspore/ms_config.py
-msprobe/mindspore/runtime.py
-msprobe/mindspore/service.py
 msprobe/mindspore/task_handler_factory.py
 msprobe/mindspore/api_accuracy_checker/__init__.py
 msprobe/mindspore/api_accuracy_checker/api_accuracy_checker.py
@@ -171,6 +216,11 @@ msprobe/mindspore/api_accuracy_checker/multi_data_manager.py
 msprobe/mindspore/api_accuracy_checker/torch_mindtorch_importer.py
 msprobe/mindspore/api_accuracy_checker/type_mapping.py
 msprobe/mindspore/api_accuracy_checker/utils.py
+msprobe/mindspore/api_accuracy_checker/bench_functions/flash_attention_score.py
+msprobe/mindspore/api_accuracy_checker/bench_functions/fusion_operator.py
+msprobe/mindspore/api_accuracy_checker/generate_op_script/config_op.json
+msprobe/mindspore/api_accuracy_checker/generate_op_script/op_generator.py
+msprobe/mindspore/api_accuracy_checker/generate_op_script/operator_replication.template
 msprobe/mindspore/code_mapping/__init__.py
 msprobe/mindspore/code_mapping/bind.py
 msprobe/mindspore/code_mapping/cmd_parser.py
@@ -181,25 +231,29 @@ msprobe/mindspore/code_mapping/processor.py
 msprobe/mindspore/common/const.py
 msprobe/mindspore/common/log.py
 msprobe/mindspore/common/utils.py
+msprobe/mindspore/compare/common_dir_compare.py
 msprobe/mindspore/compare/distributed_compare.py
 msprobe/mindspore/compare/ms_compare.py
 msprobe/mindspore/compare/ms_graph_compare.py
-msprobe/mindspore/compare/ms_to_pt_api.yaml
+msprobe/mindspore/compare/utils.py
 msprobe/mindspore/debugger/__init__.py
 msprobe/mindspore/debugger/debugger_config.py
 msprobe/mindspore/debugger/precision_debugger.py
 msprobe/mindspore/dump/__init__.py
+msprobe/mindspore/dump/cell_dump_process.py
+msprobe/mindspore/dump/cell_dump_with_insert_gradient.py
 msprobe/mindspore/dump/dump_tool_factory.py
+msprobe/mindspore/dump/graph_mode_cell_dump.py
+msprobe/mindspore/dump/graph_tensor_dump.py
 msprobe/mindspore/dump/jit_dump.py
 msprobe/mindspore/dump/kernel_graph_dump.py
 msprobe/mindspore/dump/kernel_kbyk_dump.py
-msprobe/mindspore/dump/hook_cell/api_registry.py
+msprobe/mindspore/dump/hook_cell/api_register.py
 msprobe/mindspore/dump/hook_cell/hook_cell.py
+msprobe/mindspore/dump/hook_cell/ms_hook_manager.py
 msprobe/mindspore/dump/hook_cell/primitive_hooks.py
 msprobe/mindspore/dump/hook_cell/support_wrap_ops.yaml
-msprobe/mindspore/dump/hook_cell/wrap_api.py
-msprobe/mindspore/dump/kernel_dump/kernel_config.py
-msprobe/mindspore/dym_loader/hook_dynamic_loader.cc
+msprobe/mindspore/dym_loader/hook_dynamic_loader.cpp
 msprobe/mindspore/dym_loader/hook_dynamic_loader.h
 msprobe/mindspore/free_benchmark/__init__.py
 msprobe/mindspore/free_benchmark/api_pynative_self_check.py
@@ -230,10 +284,11 @@ msprobe/mindspore/grad_probe/hook.py
 msprobe/mindspore/grad_probe/utils.py
 msprobe/mindspore/mindtorch/__init__.py
 msprobe/mindspore/mindtorch/mindtorch_adaptor.py
-msprobe/mindspore/monitor/anomaly_detect.py
+msprobe/mindspore/monitor/common_func.py
+msprobe/mindspore/monitor/data_writers.py
 msprobe/mindspore/monitor/features.py
 msprobe/mindspore/monitor/module_hook.py
-msprobe/mindspore/monitor/module_spec_verifier.py
+msprobe/mindspore/monitor/optimizer_collect.py
 msprobe/mindspore/monitor/utils.py
 msprobe/mindspore/monitor/distributed/__init__.py
 msprobe/mindspore/monitor/distributed/distributed_ops.yaml
@@ -242,11 +297,15 @@ msprobe/mindspore/monitor/distributed/wrap_distributed.py
 msprobe/mindspore/overflow_check/__init__.py
 msprobe/mindspore/overflow_check/kernel_graph_overflow_check.py
 msprobe/mindspore/overflow_check/overflow_check_tool_factory.py
+msprobe/nan_analyze/__init__.py
+msprobe/nan_analyze/analyzer.py
+msprobe/nan_analyze/graph.py
+msprobe/nan_analyze/utils.py
 msprobe/pytorch/__init__.py
+msprobe/pytorch/attl_manager.py
 msprobe/pytorch/function_factory.py
-msprobe/pytorch/parse.py
 msprobe/pytorch/pt_config.py
-msprobe/pytorch/service.py
+msprobe/pytorch/pytorch_service.py
 msprobe/pytorch/api_accuracy_checker/.keep
 msprobe/pytorch/api_accuracy_checker/__init__.py
 msprobe/pytorch/api_accuracy_checker/config.yaml
@@ -317,11 +376,12 @@ msprobe/pytorch/compare/distributed_compare.py
 msprobe/pytorch/compare/mapping.yaml
 msprobe/pytorch/compare/match.py
 msprobe/pytorch/compare/pt_compare.py
+msprobe/pytorch/compare/utils.py
 msprobe/pytorch/debugger/__init__.py
 msprobe/pytorch/debugger/debugger_config.py
 msprobe/pytorch/debugger/precision_debugger.py
-msprobe/pytorch/dump/kernel_dump/kernel_config.py
 msprobe/pytorch/dump/module_dump/__init__.py
+msprobe/pytorch/dump/module_dump/hook_wrapper.py
 msprobe/pytorch/dump/module_dump/module_dump.py
 msprobe/pytorch/dump/module_dump/module_processer.py
 msprobe/pytorch/free_benchmark/__init__.py
@@ -355,26 +415,20 @@ msprobe/pytorch/grad_probe/__init__.py
 msprobe/pytorch/grad_probe/grad_monitor.py
 msprobe/pytorch/grad_probe/grad_stat_csv.py
 msprobe/pytorch/hook_module/__init__.py
-msprobe/pytorch/hook_module/api_registry.py
+msprobe/pytorch/hook_module/api_register.py
 msprobe/pytorch/hook_module/hook_module.py
+msprobe/pytorch/hook_module/jit_script_wrapper.py
+msprobe/pytorch/hook_module/pt_hook_manager.py
 msprobe/pytorch/hook_module/register_optimizer_hook.py
 msprobe/pytorch/hook_module/support_wrap_ops.yaml
 msprobe/pytorch/hook_module/utils.py
 msprobe/pytorch/hook_module/wrap_aten.py
-msprobe/pytorch/hook_module/wrap_distributed.py
-msprobe/pytorch/hook_module/wrap_functional.py
-msprobe/pytorch/hook_module/wrap_npu_custom.py
-msprobe/pytorch/hook_module/wrap_tensor.py
-msprobe/pytorch/hook_module/wrap_torch.py
-msprobe/pytorch/hook_module/wrap_vf.py
 msprobe/pytorch/monitor/__init__.py
-msprobe/pytorch/monitor/anomaly_analyse.py
-msprobe/pytorch/monitor/anomaly_detect.py
 msprobe/pytorch/monitor/csv2tb.py
+msprobe/pytorch/monitor/data_writers.py
 msprobe/pytorch/monitor/features.py
 msprobe/pytorch/monitor/module_hook.py
 msprobe/pytorch/monitor/module_metric.py
-msprobe/pytorch/monitor/module_spec_verifier.py
 msprobe/pytorch/monitor/optimizer_collect.py
 msprobe/pytorch/monitor/utils.py
 msprobe/pytorch/monitor/visualizer.py
@@ -382,8 +436,6 @@ msprobe/pytorch/monitor/distributed/__init__.py
 msprobe/pytorch/monitor/distributed/distributed_ops.yaml
 msprobe/pytorch/monitor/distributed/stack_blacklist.yaml
 msprobe/pytorch/monitor/distributed/wrap_distributed.py
-msprobe/pytorch/monitor/unittest/__init__.py
-msprobe/pytorch/monitor/unittest/test_monitor.py
 msprobe/pytorch/online_dispatch/__init__.py
 msprobe/pytorch/online_dispatch/compare.py
 msprobe/pytorch/online_dispatch/dispatch.py

{mindstudio_probe-1.2.2 → mindstudio_probe-8.1.0}/mindstudio_probe.egg-info/requires.txt RENAMED Viewed

@@ -1,13 +1,14 @@
 wheel
 einops
-numpy<2.0
+numpy<2.0,>=1.23.0
 pandas<2.1,>=1.3.5
 pyyaml
 rich
 tqdm
-openpyxl
+openpyxl>=3.0.6
 pyopenssl
 twisted
 matplotlib
 tensorboard
 tabulate
+pwinput

{mindstudio_probe-1.2.2 → mindstudio_probe-8.1.0}/msprobe/README.md RENAMED Viewed

@@ -44,6 +44,7 @@ export MSPROBE_LOG_LEVEL={x}
 - msprobe支持AscendPyTorch 1.11.0或更高版本，支持的PyTorch和CANN以及PyTorch和python软件版本配套关系请参见《[Ascend Extension for PyTorch插件](https://gitee.com/ascend/pytorch)》。
 - msprobe支持MindSpore 2.4.0或更高版本，支持的MindSpore和CANN以及MindSpore和python软件版本配套关系请参见《[MindSpore版本发布列表](https://www.mindspore.cn/versions)》。
+- msprobe支持MSAdapter 2.1.0。
 - msprobe支持的固件驱动版本与配套CANN软件支持的固件驱动版本相同，开发者可通过“[昇腾社区-固件与驱动](https://gitee.com/link?target=https%3A%2F%2Fwww.hiascend.com%2Fhardware%2Ffirmware-drivers%2Fcommunity%3Fproduct%3D2%26model%3D28%26cann%3D8.0.RC3.alpha003%26driver%3D1.0.25.alpha)”页面根据产品型号与CANN软件版本获取配套的固件与驱动。
@@ -53,7 +54,9 @@ export MSPROBE_LOG_LEVEL={x}
 **2. 工具读写的所有路径，如config_path、dump_path等，只允许包含大小写字母、数字、下划线、斜杠、点和短横线。**
-## ⚙️ [安装](./docs/01.installation.md)
+## ⚙️ 安装
+请参见[安装指导说明](./docs/01.installation.md)。
 ## 🌟 新版本特性
@@ -69,35 +72,37 @@ export MSPROBE_LOG_LEVEL={x}
 ### 1 数据采集
-msprobe 通过在训练脚本中添加 PrecisionDebugger 接口的方式对 API 执行精度数据 dump 操作，对应 config.json 中的 task 为 statistics 或 tensor。
+msprobe 通过在训练脚本中添加 PrecisionDebugger 接口的方式对 API 执行精度数据 dump 操作。对应 config.json 中的 "statistics" 或 "tensor" task。
 [PyTorch 场景的数据采集](./docs/05.data_dump_PyTorch.md)
 [MindSpore 场景的数据采集](./docs/06.data_dump_MindSpore.md)
+[MSAdapter 场景的数据采集](./docs/29.data_dump_MSAdapter.md)
 ### 2 精度预检
-精度预检旨在昇腾 NPU 上扫描训练模型中的所有 API 进行 API 复现，给出精度情况的诊断和分析。对应 config.json 中的 task 为 run_ut。
+精度预检旨在昇腾 NPU 上扫描训练模型中的所有 API 进行 API 复现，给出精度情况的诊断和分析。对应 config.json 中的 "run_ut" task。
 PyTorch 场景的[离线预检](./docs/07.accuracy_checker_PyTorch.md)和[在线预检](./docs/08.accuracy_checker_online_PyTorch.md)
 MindSpore 动态图场景的[离线预检](./docs/09.accuracy_checker_MindSpore.md)
-### 3 精度比对
+### 3 分级可视化构图比对
-该功能进行 PyTorch 整网 API 粒度的数据 dump、精度比对，进而定位训练场景下的精度问题。
+该功能将msprobe工具dump的精度数据进行解析，还原模型图结构，实现模型各个层级的精度数据比对，方便用户理解模型结构、分析精度问题。
-[PyTorch 场景的精度比对](./docs/10.accuracy_compare_PyTorch.md)
+[PyTorch 场景的分级可视化构图比对](./docs/21.visualization_PyTorch.md)
-[MindSpore 场景的精度比对](./docs/11.accuracy_compare_MindSpore.md)
+[MindSpore 场景的分级可视化构图比对](./docs/22.visualization_MindSpore.md)
-### 4 溢出检测与解析
+### 4 精度比对
-溢出检测与解析是在执行精度数据 dump 时，判断是否存在输入正常但输出存在溢出的 API，从而判断是否为正常溢出。对应 config.json 中的 overflow_check。
+该功能进行 PyTorch 整网 API 粒度的数据 dump、精度比对，进而定位训练场景下的精度问题。
-[PyTorch 场景的溢出检测与解析](./docs/12.overflow_check_PyTorch.md)
+[PyTorch 场景的精度比对](./docs/10.accuracy_compare_PyTorch.md)
-[MindSpore 场景的溢出检测与解析](./docs/13.overflow_check_MindSpore.md)
+[MindSpore 场景的精度比对](./docs/11.accuracy_compare_MindSpore.md)
 ### 5 数据解析
@@ -129,26 +134,57 @@ MindSpore 动态图场景的[离线预检](./docs/09.accuracy_checker_MindSpore.
 [兼容 PyTorch 和 MindSpore 框架的训练状态监控](./docs/19.monitor.md)
-### 10 分级可视化构图比对
+### 10 单算子API自动生成脚本
-该功能将msprobe工具dump的精度数据进行解析，还原模型图结构，实现模型各个层级的精度数据比对，方便用户理解模型结构、分析精度问题。
+该功能将msprobe工具dump的精度数据进行解析，自动生成单API脚本，用于复现整网中出现的算子问题，降低用户复现问题的成本，供开发分析算子问题。
-[PyTorch 场景的分级可视化构图比对](./docs/21.visualization_PyTorch.md)
+[PyTorch 单算子API自动生成脚本](./docs/23.generate_operator_PyTorch.md)
-[MindSpore 场景的分级可视化构图比对](./docs/22.visualization_MindSpore.md)
+[MindSpore 单算子API自动生成脚本](./docs/33.generate_operator_MindSpore.md)
+### 11 数码关联
-### 11 单算子API自动生成脚本
+该功能只支持 MindSpore 静态图场景，用于将IR图与dump数据进行关联，获取dump数据和代码调用栈的关联关系。
-该功能将msprobe工具dump的精度数据进行解析，自动生成单API脚本，用于复现整网中出现的算子问题，降低用户复现问题的成本，供开发分析算子问题。
+[MindSpore 场景的数码关联](./docs/24.code_mapping_Mindspore.md)
-[PyTorch 单算子API自动生成脚本](./docs/23.generate_operator_PyTorch.md)
+### 12 溢出检测与解析
-### 12 数码关联
+溢出检测用于采集溢出 API 或 模块的精度数据，而溢出解析则是通过对溢出数据的分析，进一步判断是否为正常溢出。对应 config.json 中的 "overflow_check" task。
+推荐直接使用[数据采集](#1-数据采集)功能采集统计量信息,检测溢出问题。
-该功能只支持 MindSpore 静态图场景，用于将IR图与dump数据进行关联，获取dump数据和代码调用栈的关联关系。
+[PyTorch 场景的溢出检测与解析](./docs/12.overflow_check_PyTorch.md)
+[MindSpore 场景的溢出检测](./docs/13.overflow_check_MindSpore.md)
+[MSAdapter 场景的溢出检测](./docs/30.overflow_check_MSAdapter.md)
+### 13 训练检查
+该工具主要包括：
+训练前或精度比对前，对比两个环境下可能影响训练精度的配置差异。
+[PyTorch 训练前配置检查](./docs/31.config_check.md)
+训练过程中或结束后，比较两个不同的checkpoint，评估模型相似度。
+[checkpoint比对](./docs/32.ckpt_compare.md)
+### 14 强化学习数据采集
+主要能力：
+灵活采集强化学习中重要关键过程数据，并支持比对。
+[强化学习数据采集](./docs/34.RL_collect.md)
+### 15 整网首个溢出节点分析
+多rank场景下通过dump数据找到首个出现Nan或Inf的节点。
+[PyTorch 场景整网首个溢出节点分析](./docs/35.nan_analyze.md)
-[MindSpore 场景的数码关联](./docs/24.code_mapping_Mindspore.md)
 ## 📑 补充材料

mindstudio_probe-8.1.0/msprobe/core/__init__.py ADDED Viewed

@@ -0,0 +1,17 @@
+# Copyright (c) 2025-2025, Huawei Technologies Co., Ltd.
+# All rights reserved.
+#
+# Licensed under the Apache License, Version 2.0  (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+from msprobe.core.single_save.single_saver import SingleSave
+from msprobe.core.single_save.single_comparator import SingleComparator

mindstudio-probe 1.2.2__tar.gz → 8.1.0__tar.gz

mindstudio-probe 1.2.2tar.gz → 8.1.0tar.gz