mindspore 2.6.0__cp39-cp39-manylinux1_x86_64.whl → 2.7.0__cp39-cp39-manylinux1_x86_64.whl

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Potentially problematic release.


This version of mindspore might be problematic. Click here for more details.

Files changed (4810) hide show
  1. mindspore/.commit_id +1 -1
  2. mindspore/Third_Party_Open_Source_Software_Notice +1290 -0
  3. mindspore/__init__.py +2 -2
  4. mindspore/_c_dataengine.cpython-39-x86_64-linux-gnu.so +0 -0
  5. mindspore/_c_expression.cpython-39-x86_64-linux-gnu.so +0 -0
  6. mindspore/_c_mindrecord.cpython-39-x86_64-linux-gnu.so +0 -0
  7. mindspore/_checkparam.py +42 -11
  8. mindspore/_extends/builtin_operations.py +3 -3
  9. mindspore/_extends/optimize/__init__.py +23 -0
  10. mindspore/_extends/optimize/cell_utils.py +96 -0
  11. mindspore/_extends/parallel_compile/akg_compiler/custom.py +1109 -0
  12. mindspore/_extends/parallel_compile/akg_compiler/gen_custom_op_files.py +1 -1
  13. mindspore/_extends/parse/__init__.py +3 -3
  14. mindspore/_extends/parse/compile_config.py +44 -22
  15. mindspore/_extends/parse/deprecated/deprecated_tensor_method.py +1 -2
  16. mindspore/_extends/parse/parser.py +64 -83
  17. mindspore/_extends/parse/resources.py +39 -0
  18. mindspore/_extends/parse/standard_method.py +47 -14
  19. mindspore/_extends/parse/trope.py +8 -1
  20. mindspore/_extends/pijit/__init__.py +1 -2
  21. mindspore/_extends/pijit/pijit_func_white_list.py +2 -5
  22. mindspore/amp.py +4 -22
  23. mindspore/boost/adasum.py +1 -1
  24. mindspore/boost/boost_cell_wrapper.py +4 -4
  25. mindspore/common/__init__.py +43 -12
  26. mindspore/common/_grad_function.py +2 -1
  27. mindspore/common/_pijit_context.py +28 -7
  28. mindspore/common/_stub_tensor.py +1 -209
  29. mindspore/common/_tensor_cpp_method.py +1 -1
  30. mindspore/common/_tensor_docs.py +3152 -3027
  31. mindspore/common/_utils.py +9 -1
  32. mindspore/common/api.py +338 -208
  33. mindspore/common/dtype.py +108 -57
  34. mindspore/common/dump.py +11 -16
  35. mindspore/common/dynamic_shape/__init__.py +0 -0
  36. mindspore/common/dynamic_shape/auto_dynamic_shape.py +498 -0
  37. mindspore/common/dynamic_shape/enable_dynamic.py +197 -0
  38. mindspore/common/file_system.py +59 -9
  39. mindspore/common/generator.py +2 -3
  40. mindspore/common/hook_handle.py +33 -5
  41. mindspore/common/jit_config.py +1 -1
  42. mindspore/common/jit_trace.py +84 -105
  43. mindspore/common/np_dtype.py +3 -3
  44. mindspore/common/parameter.py +27 -29
  45. mindspore/common/recompute.py +5 -7
  46. mindspore/common/sparse_tensor.py +0 -3
  47. mindspore/common/symbol.py +0 -1
  48. mindspore/common/tensor.py +84 -133
  49. mindspore/communication/_comm_helper.py +46 -4
  50. mindspore/communication/management.py +79 -7
  51. mindspore/context.py +47 -38
  52. mindspore/dataset/__init__.py +1 -1
  53. mindspore/dataset/audio/transforms.py +1 -1
  54. mindspore/dataset/core/config.py +38 -4
  55. mindspore/dataset/engine/datasets.py +350 -322
  56. mindspore/dataset/engine/datasets_user_defined.py +69 -23
  57. mindspore/dataset/engine/iterators.py +2 -2
  58. mindspore/dataset/engine/obs/config_loader.py +2 -2
  59. mindspore/dataset/engine/obs/obs_mindrecord_dataset.py +8 -0
  60. mindspore/dataset/transforms/c_transforms.py +2 -2
  61. mindspore/dataset/transforms/py_transforms.py +7 -3
  62. mindspore/dataset/transforms/transforms.py +10 -6
  63. mindspore/dataset/vision/__init__.py +1 -1
  64. mindspore/dataset/vision/py_transforms.py +8 -8
  65. mindspore/dataset/vision/transforms.py +17 -5
  66. mindspore/dataset/vision/utils.py +632 -21
  67. mindspore/dataset/vision/validators.py +1 -0
  68. mindspore/device_context/ascend/device.py +1 -1
  69. mindspore/device_context/ascend/op_tuning.py +35 -1
  70. mindspore/device_context/gpu/__init__.py +2 -2
  71. mindspore/device_context/gpu/device.py +1 -1
  72. mindspore/device_context/gpu/op_precision.py +4 -2
  73. mindspore/device_context/gpu/op_tuning.py +6 -3
  74. mindspore/device_manager.py +16 -9
  75. mindspore/experimental/llm_boost/ascend_native/llama_boost_ascend_native.py +5 -4
  76. mindspore/experimental/llm_boost/atb/boost_base.py +2 -3
  77. mindspore/experimental/optim/adadelta.py +13 -20
  78. mindspore/experimental/optim/adagrad.py +15 -22
  79. mindspore/experimental/optim/adam.py +17 -24
  80. mindspore/experimental/optim/adamax.py +14 -22
  81. mindspore/experimental/optim/adamw.py +28 -34
  82. mindspore/experimental/optim/asgd.py +15 -25
  83. mindspore/experimental/optim/lr_scheduler.py +27 -45
  84. mindspore/experimental/optim/nadam.py +14 -24
  85. mindspore/experimental/optim/optimizer.py +13 -23
  86. mindspore/experimental/optim/radam.py +18 -24
  87. mindspore/experimental/optim/rmsprop.py +14 -25
  88. mindspore/experimental/optim/rprop.py +15 -26
  89. mindspore/experimental/optim/sgd.py +9 -19
  90. mindspore/hal/__init__.py +4 -4
  91. mindspore/hal/contiguous_tensors_handle.py +2 -2
  92. mindspore/hal/memory.py +1 -0
  93. mindspore/include/api/cell.h +65 -5
  94. mindspore/include/api/cfg.h +24 -7
  95. mindspore/include/api/context.h +1 -0
  96. mindspore/include/api/delegate.h +10 -2
  97. mindspore/include/api/dual_abi_helper.h +100 -19
  98. mindspore/include/api/graph.h +14 -1
  99. mindspore/include/api/kernel.h +16 -3
  100. mindspore/include/api/kernel_api.h +9 -1
  101. mindspore/include/api/metrics/accuracy.h +9 -0
  102. mindspore/include/api/model.h +8 -1
  103. mindspore/include/api/model_group.h +4 -0
  104. mindspore/include/api/model_parallel_runner.h +2 -0
  105. mindspore/include/api/status.h +48 -10
  106. mindspore/include/api/types.h +8 -3
  107. mindspore/include/c_api/model_c.h +0 -58
  108. mindspore/include/c_api/tensor_c.h +0 -26
  109. mindspore/include/dataset/constants.h +9 -0
  110. mindspore/include/dataset/vision_ascend.h +1 -1
  111. mindspore/include/mindapi/base/type_id.h +3 -0
  112. mindspore/include/mindapi/base/types.h +7 -0
  113. mindspore/include/mindspore/ccsrc/availability/silent_check/silent_check.h +3 -4
  114. mindspore/include/mindspore/ccsrc/backend/backend_manager/backend_jit_config.h +47 -4
  115. mindspore/include/mindspore/ccsrc/backend/common/graph_kernel/adapter/graph_kernel_cluster_cloud.h +1 -0
  116. mindspore/include/mindspore/ccsrc/backend/common/graph_kernel/adapter/graph_kernel_comm_info_manager.h +1 -1
  117. mindspore/include/mindspore/ccsrc/backend/common/graph_kernel/core/eliminate_redundant_output.h +1 -0
  118. mindspore/include/mindspore/ccsrc/backend/common/graph_kernel/core/graph_kernel_expander.h +1 -1
  119. mindspore/include/mindspore/ccsrc/backend/common/graph_kernel/core/graph_kernel_utils.h +23 -1
  120. mindspore/include/mindspore/ccsrc/backend/common/graph_kernel/core/update_state_formatter.h +2 -1
  121. mindspore/include/mindspore/ccsrc/backend/common/graph_kernel/depend_edge_elimination.h +61 -0
  122. mindspore/include/mindspore/ccsrc/backend/common/graph_kernel/graph_kernel_flags.h +10 -1
  123. mindspore/include/mindspore/ccsrc/backend/common/graph_kernel/model/lite_graph.h +1 -1
  124. mindspore/include/mindspore/ccsrc/backend/common/graph_kernel/model/node.h +5 -6
  125. mindspore/include/mindspore/ccsrc/backend/common/mem_reuse/mem_reuse.h +1 -2
  126. mindspore/include/mindspore/ccsrc/backend/common/mem_reuse/mem_reuse_checker.h +0 -1
  127. mindspore/include/mindspore/ccsrc/backend/common/mem_reuse/mem_swap_manager.h +0 -1
  128. mindspore/include/mindspore/ccsrc/backend/common/optimizer/cache_manager.h +1 -1
  129. mindspore/include/mindspore/ccsrc/backend/common/optimizer/dynamic_shape/convert_custom_op.h +2 -2
  130. mindspore/include/mindspore/ccsrc/backend/common/optimizer/dynamic_shape/link_custom_op.h +1 -1
  131. mindspore/include/mindspore/ccsrc/backend/common/pass/add_attr_to_node/add_attr_to_node_register.h +1 -3
  132. mindspore/include/mindspore/ccsrc/backend/common/pass/adjust_depend_for_parallel_optimizer_recompute_all_gather.h +1 -1
  133. mindspore/include/mindspore/ccsrc/backend/common/pass/convert_list_to_tuple.h +2 -1
  134. mindspore/include/mindspore/ccsrc/backend/common/pass/custom_defined_depend.h +1 -3
  135. mindspore/include/mindspore/ccsrc/backend/common/pass/gradients_allreduce_depend_last_send.h +1 -2
  136. mindspore/include/mindspore/ccsrc/backend/common/pass/graph_view_replace_pass.h +1 -1
  137. mindspore/include/mindspore/ccsrc/backend/common/pass/insert_tensor_move_for_communication.h +2 -1
  138. mindspore/include/mindspore/ccsrc/backend/common/pass/ir_fusion/flash_attention_fusion.h +72 -0
  139. mindspore/include/mindspore/ccsrc/backend/common/pass/label_1f1b_overlap_node.h +1 -1
  140. mindspore/include/mindspore/ccsrc/backend/common/pass/mindir/add_depend_for_adamw.h +1 -3
  141. mindspore/include/mindspore/ccsrc/backend/common/pass/mindir/all_to_all_unify_mindir.h +8 -1
  142. mindspore/include/mindspore/ccsrc/backend/common/pass/optimize_gradients_allreduce_overlap.h +1 -1
  143. mindspore/include/mindspore/ccsrc/backend/common/pass/replace_node_by_proxy.h +1 -0
  144. mindspore/include/mindspore/ccsrc/backend/common/session/exec_order_builder.h +0 -2
  145. mindspore/include/mindspore/ccsrc/backend/common/session/executor.h +0 -41
  146. mindspore/include/mindspore/ccsrc/backend/common/session/kernel_graph_mgr.h +14 -10
  147. mindspore/include/mindspore/ccsrc/backend/common/session/session_basic.h +15 -31
  148. mindspore/include/mindspore/ccsrc/backend/common/somas/somas.h +1 -1
  149. mindspore/include/mindspore/ccsrc/backend/common/somas/somas_node.h +8 -2
  150. mindspore/include/mindspore/ccsrc/backend/ge_backend/dump/hook_dynamic_loader.h +5 -0
  151. mindspore/include/mindspore/ccsrc/backend/ge_backend/executor/ge_device_res_manager.h +1 -2
  152. mindspore/include/mindspore/ccsrc/backend/ge_backend/executor/ge_graph_executor.h +13 -14
  153. mindspore/include/mindspore/ccsrc/backend/ge_backend/executor/ge_utils.h +0 -2
  154. mindspore/include/mindspore/ccsrc/backend/ge_backend/ge_backend.h +10 -9
  155. mindspore/include/mindspore/ccsrc/backend/ge_backend/graph_ir/convert.h +2 -1
  156. mindspore/include/mindspore/ccsrc/backend/ge_backend/graph_ir/graph_runner.h +2 -1
  157. mindspore/include/mindspore/ccsrc/backend/ge_backend/graph_ir/utils.h +12 -14
  158. mindspore/include/mindspore/ccsrc/backend/ge_backend/pass/matmul_allreduce_fusion.h +51 -0
  159. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/abstract_actor.h +26 -19
  160. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/actor_common.h +14 -5
  161. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/actor_dump.h +2 -1
  162. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/actor_set.h +1 -1
  163. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/control_flow/control_actor.h +38 -38
  164. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/control_flow/entrance_actor.h +9 -9
  165. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/control_flow/exit_actor.h +8 -8
  166. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/control_flow/gather_actor.h +6 -6
  167. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/control_flow/stack_actor.h +11 -11
  168. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/control_flow/switch_actor.h +2 -2
  169. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/data_prepare_actor.h +16 -16
  170. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/data_source_actor.h +9 -9
  171. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/debug_actor.h +8 -8
  172. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/debug_aware_actor.h +2 -2
  173. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/loop_count_actor.h +6 -6
  174. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/memory_aware_actor.h +6 -6
  175. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/memory_manager_actor.h +8 -11
  176. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/output_actor.h +8 -5
  177. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/profiler_actor.h +2 -2
  178. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/recorder_actor.h +2 -2
  179. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/actor/super_kernel_actor.h +17 -17
  180. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/device_tensor_store.h +24 -24
  181. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/graph_compiler.h +8 -12
  182. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/graph_partition.h +49 -0
  183. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/scheduler_helper.h +1 -1
  184. mindspore/include/mindspore/ccsrc/backend/ge_backend/runtime/segment_runner.h +50 -0
  185. mindspore/include/mindspore/ccsrc/backend/ge_backend/utils/device_address_utils.h +4 -7
  186. mindspore/include/mindspore/ccsrc/backend/graph_compiler/op_backend.h +13 -24
  187. mindspore/include/mindspore/ccsrc/backend/graph_compiler/transform.h +2 -8
  188. mindspore/include/mindspore/ccsrc/backend/graph_compiler/vm.h +1 -5
  189. mindspore/include/mindspore/ccsrc/backend/ms_backend/ms_backend.h +0 -39
  190. mindspore/include/mindspore/ccsrc/backend/ms_backend/ms_backend_base.h +10 -5
  191. mindspore/include/mindspore/ccsrc/debug/checksum/checksum.h +35 -0
  192. mindspore/include/mindspore/ccsrc/debug/checksum/checksum_kernel.h +64 -0
  193. mindspore/include/mindspore/ccsrc/debug/checksum/checksum_mgr.h +50 -0
  194. mindspore/include/mindspore/ccsrc/debug/data_dump/device_statistic/check_overflow.h +1 -11
  195. mindspore/include/mindspore/ccsrc/debug/data_dump/device_statistic/common.h +0 -13
  196. mindspore/include/mindspore/ccsrc/debug/data_dump/device_statistic/kernel_launcher.h +3 -3
  197. mindspore/include/mindspore/ccsrc/debug/data_dump/device_statistic/mean.h +1 -1
  198. mindspore/include/mindspore/ccsrc/debug/data_dump/device_statistic/mem_manager.h +65 -0
  199. mindspore/include/mindspore/ccsrc/debug/data_dump/device_statistic/statistic_kernel.h +7 -8
  200. mindspore/include/mindspore/ccsrc/debug/data_dump/overflow_counter.h +6 -1
  201. mindspore/include/mindspore/ccsrc/debug/data_dump/tensor_info_collect.h +21 -6
  202. mindspore/include/mindspore/ccsrc/debug/data_dump/tensor_statistic.h +2 -2
  203. mindspore/include/mindspore/ccsrc/debug/debug_services.h +1 -4
  204. mindspore/include/mindspore/ccsrc/debug/debugger/debugger_utils.h +7 -8
  205. mindspore/include/mindspore/ccsrc/debug/debugger/tensor_summary.h +0 -53
  206. mindspore/include/mindspore/ccsrc/debug/dump/tensordump_control.h +6 -2
  207. mindspore/include/mindspore/ccsrc/debug/dump/utils.h +30 -0
  208. mindspore/include/mindspore/ccsrc/debug/profiler/mstx/mstx_impl.h +37 -24
  209. mindspore/include/mindspore/ccsrc/debug/profiler/mstx/mstx_symbol.h +63 -4
  210. mindspore/include/mindspore/ccsrc/debug/profiler/profiler.h +37 -15
  211. mindspore/include/mindspore/ccsrc/debug/profiler/profiling.h +9 -6
  212. mindspore/include/mindspore/ccsrc/debug/profiler/profiling_framework_data.h +2 -0
  213. mindspore/include/mindspore/ccsrc/debug/profiler/python_obj_pointer.h +7 -7
  214. mindspore/include/mindspore/ccsrc/debug/profiler/report_data.h +23 -0
  215. mindspore/include/mindspore/ccsrc/debug/profiler/thread.h +2 -2
  216. mindspore/include/mindspore/ccsrc/debug/summary/summary.h +1 -1
  217. mindspore/include/mindspore/ccsrc/debug/utils.h +0 -5
  218. mindspore/include/mindspore/ccsrc/distributed/cluster/actor_route_table_proxy.h +1 -1
  219. mindspore/include/mindspore/ccsrc/distributed/cluster/actor_route_table_service.h +0 -2
  220. mindspore/include/mindspore/ccsrc/distributed/cluster/topology/meta_server_node.h +5 -5
  221. mindspore/include/mindspore/ccsrc/distributed/persistent/storage/local_file.h +0 -1
  222. mindspore/include/mindspore/ccsrc/distributed/rpc/tcp/connection.h +0 -1
  223. mindspore/include/mindspore/ccsrc/distributed/rpc/tcp/socket_operation.h +0 -1
  224. mindspore/include/mindspore/ccsrc/distributed/rpc/tcp/tcp_comm.h +0 -1
  225. mindspore/include/mindspore/ccsrc/distributed/rpc/tcp/tcp_socket_operation.h +0 -1
  226. mindspore/include/mindspore/ccsrc/frontend/ir/primitive_py.h +1 -1
  227. mindspore/include/mindspore/ccsrc/frontend/ir/py_execute_py.h +11 -28
  228. mindspore/include/mindspore/ccsrc/frontend/ir/storage.h +44 -0
  229. mindspore/include/mindspore/ccsrc/frontend/ir/storage_base.h +45 -0
  230. mindspore/include/mindspore/ccsrc/frontend/ir/tensor_py.h +13 -22
  231. mindspore/include/mindspore/ccsrc/frontend/np_dtypes/np_dtypes.h +29 -0
  232. mindspore/include/mindspore/ccsrc/frontend/operator/composite/composite.h +73 -3
  233. mindspore/include/mindspore/ccsrc/frontend/operator/composite/functional_overload.h +46 -0
  234. mindspore/include/mindspore/ccsrc/frontend/operator/meta_dsl/common/meta_impl.h +113 -22
  235. mindspore/include/mindspore/ccsrc/frontend/operator/meta_dsl/common/utils.h +38 -61
  236. mindspore/include/mindspore/ccsrc/frontend/operator/meta_dsl/func_op/any.h +27 -0
  237. mindspore/include/mindspore/ccsrc/frontend/operator/meta_dsl/func_op/any_ext.h +27 -0
  238. mindspore/include/mindspore/ccsrc/frontend/operator/meta_dsl/func_op/conv3d_padding.h +41 -0
  239. mindspore/include/mindspore/ccsrc/frontend/operator/meta_dsl/func_op/einsum_ext.h +47 -0
  240. mindspore/include/mindspore/ccsrc/frontend/operator/meta_dsl/func_op/func_dropout_ext.h +28 -0
  241. mindspore/include/mindspore/ccsrc/frontend/operator/meta_dsl/func_op/func_max_pool2d.h +28 -0
  242. mindspore/include/mindspore/ccsrc/frontend/operator/meta_dsl/func_op/inplace_exponential.h +7 -4
  243. mindspore/include/mindspore/ccsrc/frontend/operator/meta_dsl/func_op/moe_token_unpermute.h +28 -0
  244. mindspore/include/mindspore/ccsrc/frontend/optimizer/ad/adjoint.h +22 -3
  245. mindspore/include/mindspore/ccsrc/frontend/optimizer/ad/dfunctor.h +21 -10
  246. mindspore/include/mindspore/ccsrc/frontend/optimizer/ad/grad.h +5 -2
  247. mindspore/include/mindspore/ccsrc/frontend/optimizer/ad/pynative_jit_grad.h +11 -2
  248. mindspore/include/mindspore/ccsrc/frontend/optimizer/auto_monad_eliminate.h +3 -13
  249. mindspore/include/mindspore/ccsrc/frontend/optimizer/cse_pass.h +3 -7
  250. mindspore/include/mindspore/ccsrc/frontend/optimizer/graph_transform.h +3 -2
  251. mindspore/include/mindspore/ccsrc/frontend/optimizer/inplace_input_replace.h +30 -0
  252. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/add_forward_monad_depend.h +51 -37
  253. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/branch_culling.h +7 -104
  254. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/call_graph_tuple_transform.h +2 -1
  255. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/check_invalid_view_inplace_dout.h +46 -0
  256. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/const_output_eliminate.h +4 -0
  257. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/expand_dump_flag.h +1 -0
  258. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/get_grad_eliminate.h +5 -1
  259. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/incorporate_call.h +3 -3
  260. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/inline.h +35 -9
  261. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/item_dict_eliminate.h +3 -1
  262. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/item_tuple_or_list_eliminate.h +1 -17
  263. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/j_node_and_user_rematch.h +1 -1
  264. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/loop_unroll.h +1 -0
  265. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/parameter_eliminate.h +3 -3
  266. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/partial_eliminate.h +5 -3
  267. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/recompute_prepare.h +1 -0
  268. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/special_op_eliminate.h +9 -3
  269. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/stack_unstack_eliminate.h +13 -6
  270. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/stopgrad_eliminate.h +3 -1
  271. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass/switch_or_switch_layer_defer_inline.h +13 -5
  272. mindspore/include/mindspore/ccsrc/frontend/optimizer/irpass.h +7 -7
  273. mindspore/include/mindspore/ccsrc/frontend/optimizer/opt.h +10 -5
  274. mindspore/include/mindspore/ccsrc/frontend/optimizer/optimizer.h +55 -280
  275. mindspore/include/mindspore/ccsrc/frontend/optimizer/pattern_matcher.h +8 -2
  276. mindspore/include/mindspore/ccsrc/frontend/parallel/auto_parallel/operator_costmodel.h +5 -0
  277. mindspore/include/mindspore/ccsrc/frontend/parallel/costmodel_context.h +1 -1
  278. mindspore/include/mindspore/ccsrc/frontend/parallel/dynamic_creator.h +1 -1
  279. mindspore/include/mindspore/ccsrc/frontend/parallel/graph_util/grad_accumulation_utils.h +1 -0
  280. mindspore/include/mindspore/ccsrc/frontend/parallel/graph_util/graph_splitter.h +2 -0
  281. mindspore/include/mindspore/ccsrc/frontend/parallel/graph_util/graph_utils.h +2 -1
  282. mindspore/include/mindspore/ccsrc/frontend/parallel/graph_util/node_info.h +2 -0
  283. mindspore/include/mindspore/ccsrc/frontend/parallel/graph_util/parallel_tensordump.h +49 -13
  284. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/activation_info.h +0 -11
  285. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/arithmetic_info.h +44 -0
  286. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/flash_attention_score_info.h +19 -19
  287. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/fused_infer_attention_score_info.h +14 -14
  288. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/gather_info.h +16 -0
  289. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/index_add_info.h +55 -0
  290. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/loss_info.h +34 -0
  291. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/matmul_info.h +14 -1
  292. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/operator_info.h +7 -2
  293. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/ops_utils.h +18 -1
  294. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/reduce_base_method_info.h +3 -1
  295. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/reshape_info.h +9 -4
  296. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/topprouter_info.h +55 -0
  297. mindspore/include/mindspore/ccsrc/frontend/parallel/parallel_preprocessor.h +1 -1
  298. mindspore/include/mindspore/ccsrc/frontend/parallel/parallel_processor.h +4 -3
  299. mindspore/include/mindspore/ccsrc/frontend/parallel/parameter_manager.h +0 -1
  300. mindspore/include/mindspore/ccsrc/frontend/parallel/pass/merge_recompute_call_nodes.h +28 -0
  301. mindspore/include/mindspore/ccsrc/frontend/parallel/pass/overlap_recompute_comm.h +28 -0
  302. mindspore/include/mindspore/ccsrc/frontend/parallel/pipeline_transformer/detach_backward.h +70 -0
  303. mindspore/include/mindspore/ccsrc/frontend/parallel/pipeline_transformer/pipeline_interleave.h +14 -3
  304. mindspore/include/mindspore/ccsrc/frontend/parallel/pipeline_transformer/zero_bubble_v.h +124 -0
  305. mindspore/include/mindspore/ccsrc/frontend/parallel/step_parallel_utils.h +10 -3
  306. mindspore/include/mindspore/ccsrc/frontend/parallel/tensor_layout/tensor_layout.h +3 -0
  307. mindspore/include/mindspore/ccsrc/frontend/parallel/tensor_layout/tensor_transform.h +1 -1
  308. mindspore/include/mindspore/ccsrc/include/backend/anf_runtime_algorithm.h +29 -13
  309. mindspore/include/mindspore/ccsrc/include/backend/data_queue/data_queue_mgr.h +1 -5
  310. mindspore/include/mindspore/ccsrc/include/backend/debug/data_dump/dump_control.h +1 -0
  311. mindspore/include/mindspore/ccsrc/include/backend/debug/data_dump/dump_json_parser.h +4 -5
  312. mindspore/include/mindspore/ccsrc/include/backend/debug/data_dump/dump_utils.h +1 -0
  313. mindspore/include/mindspore/ccsrc/include/backend/debug/data_dump/tensor_stat_dump.h +0 -3
  314. mindspore/include/mindspore/ccsrc/include/backend/debug/debugger/debugger.h +0 -2
  315. mindspore/include/mindspore/ccsrc/include/backend/debug/execute_order_tracker/execute_order_tracker.h +14 -4
  316. mindspore/include/mindspore/ccsrc/include/backend/debug/tensor_data.h +0 -19
  317. mindspore/include/mindspore/ccsrc/include/backend/distributed/cluster/tcp_store.h +53 -0
  318. mindspore/include/mindspore/ccsrc/include/backend/distributed/collective/collective_manager.h +17 -10
  319. mindspore/include/mindspore/ccsrc/include/backend/distributed/constants.h +1 -10
  320. mindspore/include/mindspore/ccsrc/include/backend/distributed/embedding_cache/embedding_hash_map.h +0 -2
  321. mindspore/include/mindspore/ccsrc/include/backend/distributed/ps/ps_context.h +0 -6
  322. mindspore/include/mindspore/ccsrc/include/backend/distributed/rpc/tcp/constants.h +2 -1
  323. mindspore/include/mindspore/ccsrc/include/backend/kernel_graph.h +0 -1
  324. mindspore/include/mindspore/ccsrc/include/backend/kernel_info.h +8 -10
  325. mindspore/include/mindspore/ccsrc/include/backend/mbuf_device_address.h +5 -5
  326. mindspore/include/mindspore/ccsrc/include/backend/mem_reuse/abstract_dynamic_mem_pool.h +6 -5
  327. mindspore/include/mindspore/ccsrc/include/backend/mem_reuse/address_discretizer.h +63 -0
  328. mindspore/include/mindspore/ccsrc/include/backend/mem_reuse/dynamic_mem_pool.h +8 -0
  329. mindspore/include/mindspore/ccsrc/include/backend/mem_reuse/max_segment_tree.h +181 -0
  330. mindspore/include/mindspore/ccsrc/include/backend/mem_reuse/mem_dynamic_allocator.h +0 -1
  331. mindspore/include/mindspore/ccsrc/include/backend/mem_reuse/mem_pool_util.h +98 -0
  332. mindspore/include/mindspore/ccsrc/include/backend/mem_reuse/mem_tracker.h +11 -107
  333. mindspore/include/mindspore/ccsrc/include/backend/mem_reuse/race_checker.h +64 -0
  334. mindspore/include/mindspore/ccsrc/include/backend/mem_reuse/tracker_graph.h +91 -0
  335. mindspore/include/mindspore/ccsrc/include/backend/optimizer/helper.h +0 -2
  336. mindspore/include/mindspore/ccsrc/include/backend/optimizer/inplace_node_pass.h +1 -9
  337. mindspore/include/mindspore/ccsrc/include/backend/optimizer/optimizer.h +3 -6
  338. mindspore/include/mindspore/ccsrc/include/backend/optimizer/pattern_engine.h +0 -2
  339. mindspore/include/mindspore/ccsrc/include/backend/optimizer/visitor.h +2 -0
  340. mindspore/include/mindspore/ccsrc/include/backend/py_execute_utils.h +2 -1
  341. mindspore/include/mindspore/ccsrc/include/common/debug/common.h +2 -1
  342. mindspore/include/mindspore/ccsrc/include/common/debug/draw.h +3 -1
  343. mindspore/include/mindspore/ccsrc/include/common/debug/dump_proto.h +2 -10
  344. mindspore/include/mindspore/ccsrc/include/common/expander/core/emitter.h +3 -2
  345. mindspore/include/mindspore/ccsrc/include/common/expander/core/node.h +1 -1
  346. mindspore/include/mindspore/ccsrc/include/common/fallback.h +9 -0
  347. mindspore/include/mindspore/ccsrc/include/common/pybind_api/api_register.h +7 -1
  348. mindspore/include/mindspore/ccsrc/include/common/pynative/abstract_converter.h +0 -4
  349. mindspore/include/mindspore/ccsrc/include/common/pynative/adapter.h +2 -5
  350. mindspore/include/mindspore/ccsrc/include/common/pynative/common_utils.h +5 -1
  351. mindspore/include/mindspore/ccsrc/include/common/pynative/grad_state.h +12 -0
  352. mindspore/include/mindspore/ccsrc/include/common/pynative/variable.h +326 -0
  353. mindspore/include/mindspore/ccsrc/include/common/runtime_conf/runtime_conf.h +11 -7
  354. mindspore/include/mindspore/ccsrc/include/common/runtime_conf/thread_bind_core.h +12 -10
  355. mindspore/include/mindspore/ccsrc/include/common/symbol_engine/symbol_engine_impl.h +16 -1
  356. mindspore/include/mindspore/ccsrc/include/common/utils/anfalgo.h +12 -2
  357. mindspore/include/mindspore/ccsrc/include/common/utils/comm_manager.h +0 -1
  358. mindspore/include/mindspore/ccsrc/include/common/utils/compile_cache_context.h +4 -2
  359. mindspore/include/mindspore/ccsrc/include/common/utils/convert_utils.h +18 -4
  360. mindspore/include/mindspore/ccsrc/include/common/utils/convert_utils_py.h +2 -10
  361. mindspore/include/mindspore/ccsrc/include/common/utils/cse.h +0 -1
  362. mindspore/include/mindspore/ccsrc/include/common/utils/json_operation_utils.h +1 -1
  363. mindspore/include/mindspore/ccsrc/include/common/utils/ms_device_shape_transfer.h +0 -1
  364. mindspore/include/mindspore/ccsrc/include/common/utils/parallel_context.h +10 -2
  365. mindspore/include/mindspore/ccsrc/include/common/utils/python_adapter.h +3 -3
  366. mindspore/include/mindspore/ccsrc/include/common/utils/stub_tensor.h +1 -3
  367. mindspore/include/mindspore/ccsrc/include/common/utils/summary/event_writer.h +1 -1
  368. mindspore/include/mindspore/ccsrc/include/common/utils/tensor_py.h +24 -117
  369. mindspore/include/mindspore/ccsrc/include/common/utils/tensor_py_wrapper.h +1 -7
  370. mindspore/include/mindspore/ccsrc/include/common/utils/tensor_utils.h +3 -3
  371. mindspore/include/mindspore/ccsrc/include/common/utils/utils.h +8 -8
  372. mindspore/include/mindspore/ccsrc/include/common/visible.h +0 -10
  373. mindspore/include/mindspore/ccsrc/kernel/environ_manager.h +2 -0
  374. mindspore/include/mindspore/ccsrc/kernel/graph_kernel_info.h +1 -1
  375. mindspore/include/mindspore/ccsrc/kernel/philox_random.h +47 -87
  376. mindspore/include/mindspore/ccsrc/minddata/dataset/api/python/python_mp.h +26 -6
  377. mindspore/include/mindspore/ccsrc/minddata/dataset/core/config_manager.h +9 -0
  378. mindspore/include/mindspore/ccsrc/minddata/dataset/core/cv_tensor.h +1 -1
  379. mindspore/include/mindspore/ccsrc/minddata/dataset/core/data_type.h +1 -56
  380. mindspore/include/mindspore/ccsrc/minddata/dataset/core/device_buffer.h +74 -0
  381. mindspore/include/mindspore/ccsrc/minddata/dataset/core/message_queue.h +29 -20
  382. mindspore/include/mindspore/ccsrc/minddata/dataset/core/shared_memory_queue.h +47 -2
  383. mindspore/include/mindspore/ccsrc/minddata/dataset/core/tensor.h +26 -2
  384. mindspore/include/mindspore/ccsrc/minddata/dataset/engine/connector.h +7 -0
  385. mindspore/include/mindspore/ccsrc/minddata/dataset/engine/datasetops/batch_info.h +61 -0
  386. mindspore/include/mindspore/ccsrc/minddata/dataset/engine/datasetops/batch_op.h +28 -39
  387. mindspore/include/mindspore/ccsrc/minddata/dataset/engine/datasetops/map_op/cpu_map_job.h +3 -3
  388. mindspore/include/mindspore/ccsrc/minddata/dataset/engine/datasetops/map_op/gpu_map_job.h +3 -3
  389. mindspore/include/mindspore/ccsrc/minddata/dataset/engine/datasetops/map_op/map_job.h +2 -2
  390. mindspore/include/mindspore/ccsrc/minddata/dataset/engine/datasetops/map_op/map_op.h +12 -2
  391. mindspore/include/mindspore/ccsrc/minddata/dataset/engine/datasetops/map_op/npu_map_job.h +3 -3
  392. mindspore/include/mindspore/ccsrc/minddata/dataset/engine/datasetops/receive_bridge_op.h +4 -0
  393. mindspore/include/mindspore/ccsrc/minddata/dataset/engine/datasetops/send_bridge_op.h +1 -1
  394. mindspore/include/mindspore/ccsrc/minddata/dataset/engine/datasetops/source/mindrecord_op.h +0 -1
  395. mindspore/include/mindspore/ccsrc/minddata/dataset/include/dataset/constants.h +9 -0
  396. mindspore/include/mindspore/ccsrc/minddata/dataset/include/dataset/vision_ascend.h +1 -1
  397. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/data/parse_example_op.h +19 -15
  398. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/dvpp/acl_adapter.h +28 -1
  399. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/dvpp/utils/AclLiteType.h +6 -1
  400. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/dvpp/utils/AclLiteUtils.h +6 -1
  401. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/dvpp/utils/DvppCommon.h +1 -1
  402. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/dvpp/utils/ErrorCode.h +2 -2
  403. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/dvpp/utils/ThreadSafeQueue.h +3 -1
  404. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/dvpp/utils/VdecHelper.h +9 -12
  405. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/dvpp/utils/acl_plugin.h +19 -0
  406. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/dvpp/utils/dvpp_video.h +29 -10
  407. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/dvpp/utils/dvpp_video_utils.h +80 -0
  408. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/lite_cv/image_process.h +1 -1
  409. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/pyav/container.h +100 -0
  410. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/pyav/context.h +102 -0
  411. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/pyav/format.h +45 -0
  412. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/pyav/frame.h +74 -0
  413. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/pyav/packet.h +59 -0
  414. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/pyav/stream.h +93 -0
  415. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/py_func_op.h +37 -0
  416. mindspore/include/mindspore/ccsrc/minddata/dataset/util/btree.h +1 -1
  417. mindspore/include/mindspore/ccsrc/minddata/dataset/util/command.h +29 -0
  418. mindspore/include/mindspore/ccsrc/minddata/dataset/util/cond_var.h +0 -1
  419. mindspore/include/mindspore/ccsrc/minddata/dataset/util/ftok_key.h +2 -2
  420. mindspore/include/mindspore/ccsrc/minddata/dataset/util/json_helper.h +1 -1
  421. mindspore/include/mindspore/ccsrc/minddata/dataset/util/log_adapter.h +0 -5
  422. mindspore/include/mindspore/ccsrc/minddata/dataset/util/queue.h +1 -1
  423. mindspore/include/mindspore/ccsrc/minddata/dataset/util/sig_handler.h +11 -3
  424. mindspore/include/mindspore/ccsrc/minddata/dataset/util/system_pool.h +1 -1
  425. mindspore/include/mindspore/ccsrc/minddata/dataset/util/task_manager.h +0 -1
  426. mindspore/include/mindspore/ccsrc/minddata/mindrecord/include/common/log_adapter.h +0 -5
  427. mindspore/include/mindspore/ccsrc/minddata/mindrecord/include/shard_distributed_sample.h +0 -1
  428. mindspore/include/mindspore/ccsrc/minddata/mindrecord/include/shard_header.h +0 -1
  429. mindspore/include/mindspore/ccsrc/minddata/mindrecord/include/shard_index.h +0 -1
  430. mindspore/include/mindspore/ccsrc/minddata/mindrecord/include/shard_pk_sample.h +0 -1
  431. mindspore/include/mindspore/ccsrc/minddata/mindrecord/include/shard_reader.h +0 -1
  432. mindspore/include/mindspore/ccsrc/minddata/mindrecord/include/shard_schema.h +0 -1
  433. mindspore/include/mindspore/ccsrc/minddata/mindrecord/include/shard_statistics.h +0 -1
  434. mindspore/include/mindspore/ccsrc/minddata/mindrecord/include/shard_writer.h +0 -1
  435. mindspore/include/mindspore/ccsrc/minddata/utils.h +30 -2
  436. mindspore/include/mindspore/ccsrc/ms_extension/all.h +46 -0
  437. mindspore/include/mindspore/ccsrc/ms_extension/api.h +33 -0
  438. mindspore/include/mindspore/ccsrc/ms_extension/ascend/atb/atb_common.h +98 -0
  439. mindspore/include/mindspore/ccsrc/ms_extension/ascend/atb/operation_cache.h +229 -0
  440. mindspore/include/mindspore/ccsrc/ms_extension/common/tensor.h +319 -0
  441. mindspore/include/mindspore/ccsrc/ms_extension/common/tensor_utils.h +83 -0
  442. mindspore/include/mindspore/ccsrc/ms_extension/common/visible.h +28 -0
  443. mindspore/include/mindspore/ccsrc/ms_extension/pynative/pyboost_extension.h +312 -0
  444. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/capture_context.h +1 -1
  445. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/eval_frame_hook.h +2 -2
  446. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_build/build_graph_utils.h +1 -7
  447. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_build/func_graph_builder.h +25 -6
  448. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_capture/abstract_object.h +92 -19
  449. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_capture/cfg.h +19 -5
  450. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_capture/code_generator.h +53 -49
  451. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_capture/graph.h +40 -10
  452. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_capture/graph_analyzer.h +3 -19
  453. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_capture/graph_arguments_optimizer.h +145 -0
  454. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_capture/graph_build.h +13 -26
  455. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_capture/node.h +33 -3
  456. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_capture/side_effect.h +116 -27
  457. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_compiler/abstract_type.h +2 -2
  458. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_compiler/compiler.h +4 -0
  459. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_compiler/utils.h +2 -0
  460. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_guard/cache.h +32 -8
  461. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_guard/guard.h +11 -15
  462. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_guard/guard_utils.h +17 -8
  463. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_guard/infer.h +0 -2
  464. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_guard/shape_ctx.h +3 -3
  465. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/graph_guard/trace.h +50 -93
  466. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/jit_compile_results.h +1 -16
  467. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/pi_jit_config.h +11 -22
  468. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/python_adapter/py_code.h +56 -5
  469. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/python_adapter/py_frame.h +6 -7
  470. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/python_adapter/pydef.h +0 -6
  471. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/runtime.h +1 -1
  472. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/utils/opcode_util.h +5 -0
  473. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/utils/stop_trace_reason.h +26 -17
  474. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/utils/utils.h +15 -11
  475. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/action.h +3 -4
  476. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/executor/executor_py.h +116 -0
  477. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/executor/graph_executor_py.h +118 -0
  478. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/executor/jit_executor_py.h +68 -0
  479. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/graph_circle_handler.h +35 -0
  480. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/parse/data_converter.h +6 -0
  481. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/parse/function_block.h +1 -0
  482. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/parse/parse.h +10 -0
  483. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/parse/parse_base.h +17 -3
  484. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/parse/resolve.h +7 -1
  485. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/pass.h +4 -1
  486. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/pass_config.h +4 -0
  487. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/pipeline.h +17 -171
  488. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/resource.h +2 -16
  489. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/static_analysis/auto_monad.h +1 -1
  490. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/static_analysis/builtin_prim.h +3 -3
  491. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/static_analysis/evaluator.h +14 -12
  492. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/static_analysis/order_enforce.h +1 -1
  493. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/static_analysis/prim.h +12 -76
  494. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/static_analysis/prim_utils.h +78 -0
  495. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/static_analysis/static_analysis.h +4 -5
  496. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/validator.h +3 -0
  497. mindspore/include/mindspore/ccsrc/pipeline/jit/trace/trace_recorder.h +19 -4
  498. mindspore/include/mindspore/ccsrc/pipeline/llm_boost/llm_boost_binder.h +1 -1
  499. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_dma_handle.h +0 -2
  500. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/device/kernel_select_ascend.h +2 -3
  501. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/hardware/acl_stream_assign.h +2 -2
  502. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_device_context.h +69 -0
  503. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_device_res_manager.h +14 -13
  504. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_graph_optimization.h +0 -1
  505. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_kernel_executor.h +6 -7
  506. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/hardware/stress_detect.h +40 -0
  507. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/profiler/ascend_profiling.h +32 -7
  508. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/profiler/feature_mgr.h +1 -1
  509. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/profiler/mstx/mstx_dispatcher.h +10 -8
  510. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/atb/add_atb_kernel.h +2 -1
  511. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/atb/atb_adapter.h +24 -0
  512. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/atb/atb_kernel_mod.h +3 -1
  513. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/atb/inplace_grouped_matmul_add_atb_kernel.h +2 -1
  514. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/atb/inplace_matmul_add_atb_kernel.h +39 -0
  515. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/dvm/dvm_comm_info.h +1 -0
  516. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/dvm/dvm_kernel_mod.h +1 -1
  517. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_kernel.h +15 -16
  518. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/dvm/lazy_fusion_op.h +119 -93
  519. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_gather_matmul.h +63 -0
  520. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_all_gather_v.h +51 -0
  521. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_matmul_all_reduce.h +2 -1
  522. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_matmul_reduce_scatter.h +61 -0
  523. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_receive.h +3 -1
  524. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_reduce_scatter_v.h +51 -0
  525. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_send.h +1 -0
  526. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/hcom_util.h +26 -11
  527. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_all_gather.h +1 -1
  528. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_all_gather_into_tensor.h +1 -1
  529. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_all_gather_into_tensor_uneven.h +40 -0
  530. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_all_reduce.h +1 -1
  531. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_all_to_all_v.h +1 -1
  532. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_all_to_all_v_single.h +1 -1
  533. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_barrier.h +1 -1
  534. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_batch_isend_irecv.h +1 -1
  535. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_broadcast.h +1 -1
  536. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_gather.h +1 -1
  537. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_gather_into_tensor.h +1 -1
  538. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_irecv.h +1 -1
  539. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_isend.h +1 -1
  540. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_reduce.h +1 -1
  541. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_reduce_scatter.h +1 -1
  542. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_reduce_scatter_tensor.h +1 -1
  543. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_reduce_scatter_tensor_uneven.h +40 -0
  544. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_scatter.h +1 -1
  545. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/dist_comm_scatter_tensor.h +1 -1
  546. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/inner_comm_all_gather.h +1 -1
  547. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/inner_comm_all_reduce.h +1 -1
  548. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/inner_comm_all_to_all_v.h +1 -1
  549. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/inner_comm_irecv.h +1 -1
  550. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/inner_comm_isend.h +1 -1
  551. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/auto_generate/inner_comm_reduce_scatter.h +1 -1
  552. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/comm_common.h +4 -4
  553. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_all_gather.h +1 -1
  554. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_all_gather_into_tensor.h +2 -2
  555. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_all_gather_into_tensor_uneven.h +38 -0
  556. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_all_reduce.h +1 -1
  557. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_all_to_all_v.h +1 -1
  558. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_all_to_all_v_single.h +2 -2
  559. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_broadcast.h +1 -1
  560. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_gather.h +1 -1
  561. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_gather_into_tensor.h +2 -2
  562. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_irecv.h +1 -1
  563. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_isend.h +1 -1
  564. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_reduce.h +1 -1
  565. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_reduce_scatter.h +1 -1
  566. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_reduce_scatter_tensor.h +2 -2
  567. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_reduce_scatter_tensor_uneven.h +39 -0
  568. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_scatter.h +1 -1
  569. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/dist_comm_scatter_tensor.h +2 -2
  570. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/inner_comm_all_gather.h +1 -1
  571. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/inner_comm_all_reduce.h +1 -1
  572. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/inner_comm_all_to_all_v.h +1 -1
  573. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/inner_comm_isend.h +1 -1
  574. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/hccl/pyboost/inner_comm_reduce_scatter.h +1 -1
  575. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/internal_kernel_in_out_map.h +16 -0
  576. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/internal_tiling_cache.h +3 -3
  577. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/kv_scale_cache.h +30 -0
  578. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/mla.h +48 -0
  579. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/mla_preprocess.h +32 -0
  580. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/multi_weight_matmul.h +2 -0
  581. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/pyboost/apply_rotary_pos_emb.h +46 -0
  582. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/pyboost/auto_gen/internal_kernel_info_adapter.h +95 -0
  583. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/pyboost/auto_gen/kernel_info_adapter.h +78 -0
  584. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/pyboost/flash_attention_score.h +54 -0
  585. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/pyboost/internal_kernel_info.h +162 -0
  586. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/pyboost/internal_pyboost_utils.h +121 -0
  587. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/pyboost/mla.h +53 -0
  588. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/pyboost/paged_attention.h +91 -0
  589. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/internal/pyboost/reshape_and_cache.h +43 -0
  590. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/rts/reshape_ext.h +5 -0
  591. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/atb_speed/base/event_manager.h +0 -2
  592. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/atb_speed/utils/ModelTaskExecutor.h +0 -1
  593. mindspore/include/mindspore/ccsrc/plugin/device/ascend/optimizer/expander_fallback.h +33 -0
  594. mindspore/include/mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/matmul_assignadd_fusion.h +61 -0
  595. mindspore/include/mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion_infer/inference_matmul_split_fusion.h +31 -8
  596. mindspore/include/mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion_infer/inference_qbmm_elemwise_fusion.h +46 -0
  597. mindspore/include/mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion_infer/moe_init_routing_dyn_quantv2_fusion.h +66 -0
  598. mindspore/include/mindspore/ccsrc/plugin/device/cpu/hal/device/cpu_common.h +1 -1
  599. mindspore/include/mindspore/ccsrc/plugin/device/cpu/hal/hardware/cpu_device_context.h +16 -11
  600. mindspore/include/mindspore/ccsrc/plugin/device/cpu/hal/hardware/cpu_somas.h +1 -1
  601. mindspore/include/mindspore/ccsrc/plugin/device/cpu/hal/hardware/mpi_collective_comm_lib.h +3 -1
  602. mindspore/include/mindspore/ccsrc/plugin/device/cpu/hal/hardware/ms_collective_comm_lib.h +3 -1
  603. mindspore/include/mindspore/ccsrc/plugin/device/cpu/kernel/cpu_kernel.h +2 -2
  604. mindspore/include/mindspore/ccsrc/plugin/device/cpu/kernel/custom/custom_kernel_input_info.h +99 -0
  605. mindspore/include/mindspore/ccsrc/plugin/device/cpu/kernel/custom/custom_op_plugin_kernel.h +62 -0
  606. mindspore/include/mindspore/ccsrc/plugin/device/cpu/kernel/pyexecute/joinedstr_cpu_kernel.h +46 -0
  607. mindspore/include/mindspore/ccsrc/plugin/device/cpu/kernel/pyexecute/py_execute_cpu_kernel.h +1 -6
  608. mindspore/include/mindspore/ccsrc/plugin/device/gpu/hal/device/gpu_kernel_task.h +1 -0
  609. mindspore/include/mindspore/ccsrc/plugin/device/gpu/hal/hardware/gpu_device_context.h +13 -18
  610. mindspore/include/mindspore/ccsrc/plugin/device/gpu/hal/hardware/gpu_somas.h +1 -1
  611. mindspore/include/mindspore/ccsrc/plugin/device/gpu/hal/hardware/nvidia_collective_comm_lib.h +3 -1
  612. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/ascend_device_address/ascend_device_address.h +27 -16
  613. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/ascend_res_manager.h +25 -11
  614. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/capture_graph/ascend_capture_graph.h +45 -0
  615. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_collective_comm_lib.h +6 -5
  616. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/collective/ascend_communication_group.h +27 -12
  617. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/collective/ccool_collective_comm_lib.h +4 -5
  618. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/collective/ccool_communication_group.h +4 -4
  619. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/collective/dummy_ascend_collective_comm_lib.h +3 -5
  620. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/collective/dvm_collective_comm_lib.h +5 -5
  621. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/collective/dvm_communication_group.h +1 -1
  622. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/collective/hccl_watch_dog_thread.h +5 -3
  623. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/collective/leaper_trans.h +2 -5
  624. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/collective/lowlatency_collective_comm_lib.h +20 -5
  625. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_collective_comm_lib.h +6 -6
  626. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/collective/multi_ascend_communication_group.h +4 -2
  627. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/collective/utils.h +83 -0
  628. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/device_context_conf/op_tuning_conf.h +14 -0
  629. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/dvm/dvm.h +246 -0
  630. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/hal_manager/ascend_hal_manager.h +1 -0
  631. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/hccl_adapter.h +31 -3
  632. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/hccl_adapter/plugin/hccl_plugin.h +8 -0
  633. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/mbuf_receive_manager.h +6 -1
  634. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/mbuf_manager/tdt_manager.h +44 -0
  635. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_memory_pool.h +6 -0
  636. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/mem_manager/ascend_vmm_adapter.h +9 -9
  637. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/op_adapter/custom_op_proto/cust_array_ops.h +11 -0
  638. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/op_adapter/custom_op_proto/cust_other_ops.h +0 -22
  639. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/op_adapter/op_adapter_base.h +38 -33
  640. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/op_adapter/op_adapter_map.h +5 -2
  641. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/op_adapter/op_adapter_util.h +3 -0
  642. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/op_adapter/op_declare/array_ops_declare.h +3 -0
  643. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/op_adapter/op_declare/hcom_ops_declare.h +3 -0
  644. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/op_adapter/op_declare/transform_fusion_ops_declare.h +0 -6
  645. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/op_adapter/transform_util.h +1 -1
  646. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/stream_manager/ascend_stream_manager.h +6 -4
  647. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_mdl_symbol.h +14 -0
  648. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/acl_rt_symbol.h +6 -0
  649. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/symbol_interface/symbol_utils.h +11 -6
  650. mindspore/include/mindspore/ccsrc/plugin/res_manager/cpu/cpu_device_address/cpu_device_address.h +17 -12
  651. mindspore/include/mindspore/ccsrc/plugin/res_manager/cpu/cpu_mem_manager/cpu_hash_table.h +128 -0
  652. mindspore/include/mindspore/ccsrc/plugin/res_manager/cpu/cpu_mem_manager/cpu_hash_table_util.h +114 -0
  653. mindspore/include/mindspore/ccsrc/plugin/res_manager/cpu/cpu_mem_manager/cpu_memory_manager.h +4 -10
  654. mindspore/include/mindspore/ccsrc/plugin/res_manager/cpu/cpu_mem_manager/cpu_memory_pool.h +3 -1
  655. mindspore/include/mindspore/ccsrc/plugin/res_manager/cpu/cpu_res_manager.h +8 -15
  656. mindspore/include/mindspore/ccsrc/plugin/res_manager/cpu/visible.h +32 -0
  657. mindspore/include/mindspore/ccsrc/plugin/res_manager/gpu/device/gpu_device_address.h +19 -11
  658. mindspore/include/mindspore/ccsrc/plugin/res_manager/gpu/gpu_res_manager.h +9 -9
  659. mindspore/include/mindspore/ccsrc/ps/core/communicator/http_request_handler.h +0 -1
  660. mindspore/include/mindspore/ccsrc/ps/core/file_configuration.h +2 -2
  661. mindspore/include/mindspore/ccsrc/ps/core/node.h +1 -1
  662. mindspore/include/mindspore/ccsrc/pybind_api/hal/event_py.h +2 -2
  663. mindspore/include/mindspore/ccsrc/pybind_api/hal/memory_py.h +2 -0
  664. mindspore/include/mindspore/ccsrc/pybind_api/hal/stream_py.h +3 -4
  665. mindspore/include/mindspore/ccsrc/pybind_api/ir/tensor_api/auto_generate/tensor_api.h +136 -131
  666. mindspore/include/mindspore/ccsrc/pybind_api/ir/tensor_index_py.h +10 -107
  667. mindspore/include/mindspore/ccsrc/pybind_api/ir/tensor_register/auto_generate/tensor_py_gen.h +136 -132
  668. mindspore/include/mindspore/ccsrc/pybind_api/ir/tensor_register/tensor_func_reg.h +0 -1
  669. mindspore/include/mindspore/ccsrc/pybind_api/resource/manager.h +2 -2
  670. mindspore/include/mindspore/ccsrc/pybind_api/storage_py.h +36 -0
  671. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/abs.h +1 -1
  672. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/acos_ext.h +1 -1
  673. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/acosh_ext.h +1 -1
  674. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/adamw.h +1 -1
  675. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/adaptive_avg_pool1d.h +1 -1
  676. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/adaptive_avg_pool2d_ext.h +1 -1
  677. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/adaptive_avg_pool2d_grad_ext.h +1 -1
  678. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/adaptive_avg_pool3d_ext.h +1 -1
  679. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/adaptive_avg_pool3d_grad_ext.h +1 -1
  680. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/adaptive_max_pool1d.h +1 -1
  681. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/adaptive_max_pool2d.h +1 -1
  682. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/add.h +1 -1
  683. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/add_ext.h +1 -1
  684. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/add_layer_norm_grad.h +1 -1
  685. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/add_layernorm_v2.h +1 -1
  686. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/add_rms_norm.h +1 -1
  687. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/add_rmsnorm_quant_v2.h +1 -1
  688. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/add_scalar.h +1 -1
  689. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/addbmm.h +1 -1
  690. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/addcdiv_ext.h +1 -1
  691. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/addcmul_ext.h +1 -1
  692. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/addmm.h +1 -1
  693. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/addmv.h +1 -1
  694. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/all_finite.h +1 -1
  695. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/all_gather_matmul.h +1 -1
  696. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/any.h +44 -0
  697. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/any_ext.h +44 -0
  698. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/apply_rotary_pos_emb.h +44 -0
  699. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/arange.h +1 -1
  700. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/argmax_ext.h +1 -1
  701. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/argmax_with_value.h +1 -1
  702. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/argmin_ext.h +1 -1
  703. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/argmin_with_value.h +1 -1
  704. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/argsort.h +1 -1
  705. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/as_strided.h +1 -1
  706. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/asin_ext.h +1 -1
  707. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/asinh_ext.h +1 -1
  708. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/atan2_ext.h +1 -1
  709. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/atan_ext.h +1 -1
  710. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/atanh.h +1 -1
  711. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/avg_pool1d.h +1 -1
  712. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/avg_pool2d.h +1 -1
  713. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/avg_pool2d_grad.h +1 -1
  714. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/avg_pool3d_ext.h +1 -1
  715. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/avg_pool3d_grad_ext.h +1 -1
  716. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/baddbmm.h +1 -1
  717. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/batch_mat_mul.h +1 -1
  718. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/batch_norm_elemt.h +1 -1
  719. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/batch_norm_elemt_grad.h +1 -1
  720. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/batch_norm_ext.h +1 -1
  721. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/batch_norm_gather_stats_with_counts.h +1 -1
  722. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/batch_norm_grad_ext.h +1 -1
  723. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/batch_norm_reduce_grad.h +1 -1
  724. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/batch_norm_stats.h +1 -1
  725. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/bernoulli_ext.h +1 -1
  726. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/binary_cross_entropy.h +1 -1
  727. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/binary_cross_entropy_grad.h +1 -1
  728. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/binary_cross_entropy_with_logits.h +1 -1
  729. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/binary_cross_entropy_with_logits_backward.h +1 -1
  730. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/bincount_ext.h +1 -1
  731. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/bitwise_and_scalar.h +1 -1
  732. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/bitwise_and_tensor.h +1 -1
  733. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/bitwise_not.h +1 -1
  734. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/bitwise_or_scalar.h +1 -1
  735. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/bitwise_or_tensor.h +1 -1
  736. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/bitwise_xor_scalar.h +1 -1
  737. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/bitwise_xor_tensor.h +1 -1
  738. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/bmm_ext.h +1 -1
  739. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/broadcast_to.h +1 -1
  740. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/broadcast_to_view.h +1 -1
  741. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/cast.h +1 -1
  742. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/ceil.h +1 -1
  743. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/cell_backward_hook.h +44 -0
  744. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/chunk.h +1 -1
  745. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/chunk_view.h +1 -1
  746. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/clamp_scalar.h +1 -1
  747. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/clamp_tensor.h +1 -1
  748. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/clone.h +1 -1
  749. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/col2im_ext.h +1 -1
  750. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/col2im_grad.h +1 -1
  751. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/concat.h +1 -1
  752. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/constant_pad_nd.h +1 -1
  753. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/contiguous.h +1 -1
  754. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/conv1d_ext.h +1 -1
  755. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/conv1d_padding.h +1 -1
  756. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/conv2d_ext.h +1 -1
  757. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/conv2d_padding.h +1 -1
  758. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/conv3d_ext.h +1 -1
  759. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/conv3d_padding.h +1 -1
  760. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/conv_transpose2d.h +1 -1
  761. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/convolution.h +1 -1
  762. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/convolution_grad.h +1 -1
  763. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/convolution_str.h +1 -1
  764. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/convolution_str_grad.h +1 -1
  765. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/copy.h +1 -1
  766. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/cos.h +1 -1
  767. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/cosh.h +1 -1
  768. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/count_nonzero.h +1 -1
  769. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/cross.h +1 -1
  770. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/cross_entropy_loss.h +44 -0
  771. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/cross_entropy_loss_grad.h +44 -0
  772. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/cummax.h +1 -1
  773. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/cummin_ext.h +1 -1
  774. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/cumsum_ext.h +1 -1
  775. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/custom_ext.h +1 -1
  776. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dense.h +1 -1
  777. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/diag_ext.h +1 -1
  778. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/diagonal_view.h +44 -0
  779. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_all_gather.h +1 -1
  780. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_all_gather_into_tensor.h +1 -1
  781. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_all_gather_into_tensor_uneven.h +44 -0
  782. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_all_reduce.h +1 -1
  783. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_all_to_all_v.h +1 -1
  784. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_all_to_all_v_single.h +1 -1
  785. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_barrier.h +1 -1
  786. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_batch_isend_irecv.h +1 -1
  787. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_broadcast.h +1 -1
  788. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_gather.h +1 -1
  789. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_gather_into_tensor.h +1 -1
  790. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_irecv.h +1 -1
  791. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_isend.h +1 -1
  792. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_reduce.h +1 -1
  793. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_reduce_scatter.h +1 -1
  794. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_reduce_scatter_tensor.h +1 -1
  795. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_reduce_scatter_tensor_uneven.h +44 -0
  796. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_scatter.h +1 -1
  797. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dist_comm_scatter_tensor.h +1 -1
  798. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/div.h +1 -1
  799. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/divmod.h +1 -1
  800. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/divmods.h +1 -1
  801. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/divs.h +1 -1
  802. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dot.h +1 -1
  803. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dropout_do_mask_ext.h +1 -1
  804. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dropout_ext.h +1 -1
  805. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dropout_gen_mask_ext.h +1 -1
  806. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dropout_grad_ext.h +1 -1
  807. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/dynamic_quant_ext.h +1 -1
  808. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/einsum_ext.h +44 -0
  809. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/elu.h +1 -1
  810. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/elu_ext.h +1 -1
  811. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/elu_grad_ext.h +1 -1
  812. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/embedding.h +1 -1
  813. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/embedding_dense_backward.h +1 -1
  814. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/empty.h +44 -0
  815. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/empty_like.h +44 -0
  816. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/equal.h +1 -1
  817. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/equal_ext.h +1 -1
  818. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/erf.h +1 -1
  819. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/erfc.h +1 -1
  820. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/erfinv.h +1 -1
  821. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/exp.h +1 -1
  822. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/exp2.h +1 -1
  823. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/expand_as.h +1 -1
  824. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/expand_dims.h +1 -1
  825. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/expand_dims_view.h +1 -1
  826. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/expm1.h +1 -1
  827. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/eye.h +1 -1
  828. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/ffn_ext.h +1 -1
  829. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/fill_scalar.h +1 -1
  830. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/fill_tensor.h +1 -1
  831. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/flash_attention_score.h +1 -1
  832. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/flash_attention_score_grad.h +1 -1
  833. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/flatten_ext.h +1 -1
  834. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/floor.h +1 -1
  835. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/floor_div.h +1 -1
  836. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/floor_div_scalar.h +1 -1
  837. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/fmod_scalar.h +1 -1
  838. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/fmod_tensor.h +1 -1
  839. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/frac.h +1 -1
  840. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/full_like.h +1 -1
  841. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/func_dropout_ext.h +44 -0
  842. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/func_max_pool2d.h +44 -0
  843. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/fused_infer_attention_score.h +1 -1
  844. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/gather_d.h +1 -1
  845. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/gather_d_grad_v2.h +1 -1
  846. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/gcd.h +1 -1
  847. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/gelu.h +1 -1
  848. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/gelu_ext.h +1 -1
  849. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/gelu_grad.h +1 -1
  850. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/gelu_grad_ext.h +1 -1
  851. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/generator.h +1 -1
  852. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/glu.h +1 -1
  853. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/glu_grad.h +1 -1
  854. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/gmm.h +1 -1
  855. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/gmm_backward.h +1 -1
  856. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/gmm_backward_fusion.h +1 -1
  857. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/gmm_v2.h +1 -1
  858. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/gmm_v2_backward.h +1 -1
  859. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/gmm_v2_backward_fusion.h +1 -1
  860. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/greater.h +1 -1
  861. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/greater_equal.h +1 -1
  862. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/greater_equal_scalar.h +1 -1
  863. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/grid_sampler_2d.h +1 -1
  864. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/grid_sampler_2d_grad.h +1 -1
  865. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/grid_sampler_3d.h +1 -1
  866. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/grid_sampler_3d_grad.h +1 -1
  867. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/group_norm.h +1 -1
  868. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/group_norm_grad.h +1 -1
  869. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/grouped_matmul.h +1 -1
  870. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/grouped_matmul_v2.h +1 -1
  871. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/grouped_matmul_v4.h +1 -1
  872. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/hardtanh.h +1 -1
  873. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/hardtanh_grad.h +1 -1
  874. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/histc_ext.h +1 -1
  875. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/hshrink.h +1 -1
  876. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/hshrink_grad.h +1 -1
  877. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/hsigmoid.h +1 -1
  878. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/hsigmoid_grad.h +1 -1
  879. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/hswish.h +1 -1
  880. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/hswish_grad.h +1 -1
  881. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/identity.h +1 -1
  882. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/im2col_ext.h +1 -1
  883. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/incre_flash_attention.h +1 -1
  884. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/index.h +1 -1
  885. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/index_add_ext.h +1 -1
  886. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/index_fill_scalar.h +1 -1
  887. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/index_fill_tensor.h +1 -1
  888. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/index_select.h +1 -1
  889. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inner_comm_all_gather.h +1 -1
  890. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inner_comm_all_reduce.h +1 -1
  891. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inner_comm_all_to_all_v.h +1 -1
  892. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inner_comm_irecv.h +1 -1
  893. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inner_comm_isend.h +1 -1
  894. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inner_comm_reduce_scatter.h +1 -1
  895. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inner_index.h +1 -1
  896. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inner_inplace_index_put.h +1 -1
  897. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inner_moe_token_unpermute.h +44 -0
  898. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inner_non_zero.h +1 -1
  899. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_add_ext.h +1 -1
  900. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_addmm.h +1 -1
  901. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_adds_ext.h +1 -1
  902. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_bernoulli_scalar.h +44 -0
  903. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_bernoulli_tensor.h +44 -0
  904. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_clamp_scalar.h +1 -1
  905. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_clamp_tensor.h +1 -1
  906. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_copy.h +1 -1
  907. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_div.h +1 -1
  908. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_divmod.h +1 -1
  909. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_divmods.h +1 -1
  910. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_divs.h +1 -1
  911. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_elu.h +1 -1
  912. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_erfinv.h +1 -1
  913. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_exp.h +1 -1
  914. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_exponential.h +1 -1
  915. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_fill_diagonal.h +1 -1
  916. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_fill_scalar.h +1 -1
  917. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_fill_tensor.h +1 -1
  918. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_floor.h +1 -1
  919. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_floor_divide.h +1 -1
  920. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_floor_divides.h +1 -1
  921. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_grouped_matmul_add.h +1 -1
  922. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_hardtanh.h +1 -1
  923. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_index_add.h +1 -1
  924. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_index_put.h +1 -1
  925. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_log.h +1 -1
  926. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_masked_fill_scalar.h +1 -1
  927. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_masked_fill_tensor.h +1 -1
  928. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_matmul_add.h +44 -0
  929. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_mul.h +1 -1
  930. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_muls.h +1 -1
  931. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_normal.h +1 -1
  932. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_put.h +1 -1
  933. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_random.h +1 -1
  934. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_relu.h +1 -1
  935. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_remainder_tensor_scalar.h +44 -0
  936. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_remainder_tensor_tensor.h +44 -0
  937. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_scatter_add.h +1 -1
  938. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_scatter_src.h +1 -1
  939. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_scatter_src_reduce.h +1 -1
  940. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_scatter_value.h +1 -1
  941. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_scatter_value_reduce.h +1 -1
  942. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_silu.h +44 -0
  943. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_stop_gradient.h +1 -1
  944. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_sub_ext.h +1 -1
  945. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_sub_scalar.h +1 -1
  946. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_tanh.h +1 -1
  947. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_threshold.h +1 -1
  948. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_uniform.h +1 -1
  949. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/inplace_zero.h +1 -1
  950. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/isclose.h +1 -1
  951. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/isfinite.h +1 -1
  952. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/isinf.h +1 -1
  953. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/isneginf.h +1 -1
  954. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/kl_div.h +1 -1
  955. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/kl_div_grad.h +1 -1
  956. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/kthvalue.h +1 -1
  957. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/kv_cache_scatter_update.h +1 -1
  958. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/l1_loss_backward_ext.h +1 -1
  959. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/l1_loss_ext.h +1 -1
  960. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/layer_norm_ext.h +1 -1
  961. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/layer_norm_grad_ext.h +1 -1
  962. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/leaky_relu_ext.h +1 -1
  963. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/leaky_relu_grad_ext.h +1 -1
  964. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/lerp.h +1 -1
  965. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/lerp_scalar.h +1 -1
  966. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/less.h +1 -1
  967. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/less_equal.h +1 -1
  968. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/lin_space_ext.h +1 -1
  969. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/linalg_qr.h +1 -1
  970. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/linalg_vector_norm.h +1 -1
  971. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/log.h +1 -1
  972. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/log10.h +1 -1
  973. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/log1p.h +1 -1
  974. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/log2.h +1 -1
  975. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/log_softmax.h +1 -1
  976. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/log_softmax_ext.h +1 -1
  977. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/log_softmax_grad.h +1 -1
  978. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/logaddexp.h +1 -1
  979. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/logaddexp2.h +1 -1
  980. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/logical_and.h +1 -1
  981. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/logical_not.h +1 -1
  982. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/logical_or.h +1 -1
  983. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/logical_xor.h +1 -1
  984. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/logsigmoid.h +1 -1
  985. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/logsigmoid_grad.h +1 -1
  986. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/logsumexp.h +1 -1
  987. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/masked_fill.h +1 -1
  988. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/masked_scatter.h +44 -0
  989. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/masked_select.h +1 -1
  990. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/masked_select_grad.h +1 -1
  991. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/matmul.h +1 -1
  992. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/matmul_allreduce_add_rmsnorm.h +1 -1
  993. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/matmul_ext.h +1 -1
  994. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/matmul_reduce_scatter.h +1 -1
  995. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/matrix_inverse_ext.h +1 -1
  996. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/max.h +1 -1
  997. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/max_dim.h +1 -1
  998. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/max_pool_grad_with_indices.h +1 -1
  999. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/max_pool_grad_with_mask.h +1 -1
  1000. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/max_pool_with_indices.h +1 -1
  1001. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/max_pool_with_mask.h +1 -1
  1002. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/max_unpool2d_ext.h +1 -1
  1003. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/maximum.h +1 -1
  1004. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/mean_ext.h +1 -1
  1005. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/median_dim.h +1 -1
  1006. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/median_ext.h +1 -1
  1007. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/meshgrid.h +1 -1
  1008. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/min.h +1 -1
  1009. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/min_dim.h +1 -1
  1010. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/minimum.h +1 -1
  1011. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/mish_ext.h +1 -1
  1012. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/mish_grad_ext.h +1 -1
  1013. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/mla.h +44 -0
  1014. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/mm_ext.h +1 -1
  1015. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/moe_compute_expert_tokens.h +1 -1
  1016. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/moe_distribute_combine.h +44 -0
  1017. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/moe_distribute_dispatch.h +44 -0
  1018. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/moe_finalize_routing.h +1 -1
  1019. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/moe_gating_top_k_softmax.h +1 -1
  1020. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/moe_init_routing.h +1 -1
  1021. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/moe_init_routing_quant_v2.h +44 -0
  1022. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/moe_init_routing_v2.h +1 -1
  1023. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/moe_token_permute.h +1 -1
  1024. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/moe_token_permute_grad.h +1 -1
  1025. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/moe_token_unpermute.h +1 -1
  1026. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/moe_token_unpermute_grad.h +1 -1
  1027. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/mse_loss_ext.h +1 -1
  1028. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/mse_loss_grad_ext.h +1 -1
  1029. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/mul.h +1 -1
  1030. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/muls.h +1 -1
  1031. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/multi_scale_deformable_attn.h +1 -1
  1032. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/multi_scale_deformable_attn_grad.h +1 -1
  1033. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/multinomial_ext.h +1 -1
  1034. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/mv.h +1 -1
  1035. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/nan_to_num.h +1 -1
  1036. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/nansum.h +1 -1
  1037. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/narrow.h +1 -1
  1038. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/narrow_view.h +1 -1
  1039. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/ne_scalar.h +1 -1
  1040. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/neg.h +1 -1
  1041. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/new_empty.h +44 -0
  1042. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/new_full.h +44 -0
  1043. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/new_ones.h +1 -1
  1044. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/new_zeros.h +1 -1
  1045. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/nllloss.h +1 -1
  1046. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/nllloss_2d.h +1 -1
  1047. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/nllloss_2d_grad.h +1 -1
  1048. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/nllloss_grad.h +1 -1
  1049. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/non_zero.h +1 -1
  1050. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/non_zero_ext.h +1 -1
  1051. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/norm.h +1 -1
  1052. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/normal_float_float.h +1 -1
  1053. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/normal_float_tensor.h +1 -1
  1054. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/normal_tensor_float.h +1 -1
  1055. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/normal_tensor_tensor.h +1 -1
  1056. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/not_equal.h +1 -1
  1057. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/one_hot_ext.h +1 -1
  1058. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/ones.h +1 -1
  1059. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/ones_like_ext.h +1 -1
  1060. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/outer.h +1 -1
  1061. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/paged_attention.h +44 -0
  1062. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/pixel_shuffle.h +1 -1
  1063. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/polar.h +1 -1
  1064. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/pow.h +1 -1
  1065. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/pow_scalar_tensor.h +1 -1
  1066. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/pow_tensor_scalar.h +1 -1
  1067. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/prelu.h +1 -1
  1068. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/prelu_grad.h +1 -1
  1069. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/prod_ext.h +1 -1
  1070. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/prompt_flash_attention.h +1 -1
  1071. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/quant_batch_matmul.h +1 -1
  1072. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/quant_matmul.h +44 -0
  1073. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/quant_v2.h +1 -1
  1074. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/rand_ext.h +1 -1
  1075. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/rand_like_ext.h +1 -1
  1076. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/randint.h +1 -1
  1077. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/randint_like.h +1 -1
  1078. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/randn.h +1 -1
  1079. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/randn_like.h +1 -1
  1080. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/randperm_ext.h +1 -1
  1081. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/reciprocal.h +1 -1
  1082. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/reduce_all.h +1 -1
  1083. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/reduce_any.h +1 -1
  1084. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/reduce_max.h +1 -1
  1085. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/reduce_min.h +1 -1
  1086. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/reflection_pad_1d.h +1 -1
  1087. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/reflection_pad_1d_grad.h +1 -1
  1088. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/reflection_pad_2d.h +1 -1
  1089. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/reflection_pad_2d_grad.h +1 -1
  1090. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/reflection_pad_3d.h +1 -1
  1091. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/reflection_pad_3d_grad.h +1 -1
  1092. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/relu.h +1 -1
  1093. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/relu_grad.h +1 -1
  1094. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/remainder_scalar_tensor.h +1 -1
  1095. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/remainder_tensor_scalar.h +1 -1
  1096. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/remainder_tensor_tensor.h +1 -1
  1097. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/repeat.h +1 -1
  1098. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/repeat_interleave_grad.h +1 -1
  1099. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/repeat_interleave_int.h +1 -1
  1100. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/repeat_interleave_tensor.h +1 -1
  1101. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/replication_pad_1d.h +1 -1
  1102. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/replication_pad_1d_grad.h +1 -1
  1103. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/replication_pad_2d.h +1 -1
  1104. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/replication_pad_2d_grad.h +1 -1
  1105. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/replication_pad_3d.h +1 -1
  1106. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/replication_pad_3d_grad.h +1 -1
  1107. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/reshape.h +1 -1
  1108. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/reshape_and_cache.h +44 -0
  1109. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/reverse_v2.h +1 -1
  1110. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/ring_attention_update.h +44 -0
  1111. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/rms_norm.h +1 -1
  1112. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/rms_norm_grad.h +1 -1
  1113. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/roll.h +1 -1
  1114. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/rotary_position_embedding.h +1 -1
  1115. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/rotary_position_embedding_grad.h +1 -1
  1116. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/round.h +1 -1
  1117. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/rsqrt.h +1 -1
  1118. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/scatter.h +1 -1
  1119. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/scatter_add_ext.h +1 -1
  1120. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/scatter_value.h +1 -1
  1121. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/searchsorted.h +1 -1
  1122. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/select.h +1 -1
  1123. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/select_ext_view.h +1 -1
  1124. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/select_v2.h +1 -1
  1125. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/selu_ext.h +1 -1
  1126. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/selu_grad.h +1 -1
  1127. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/sigmoid.h +1 -1
  1128. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/sigmoid_grad.h +1 -1
  1129. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/sign.h +1 -1
  1130. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/silent_check_v2.h +1 -1
  1131. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/silent_check_v3.h +1 -1
  1132. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/silu.h +1 -1
  1133. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/silu_grad.h +1 -1
  1134. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/sin.h +1 -1
  1135. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/sinc.h +1 -1
  1136. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/sinh.h +1 -1
  1137. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/slice.h +1 -1
  1138. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/slice_ext.h +1 -1
  1139. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/slice_ext_view.h +1 -1
  1140. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/smooth_l1_loss.h +1 -1
  1141. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/smooth_l1_loss_grad.h +1 -1
  1142. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/soft_margin_loss.h +1 -1
  1143. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/soft_margin_loss_grad.h +1 -1
  1144. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/softmax.h +1 -1
  1145. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/softmax_backward.h +1 -1
  1146. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/softplus_ext.h +1 -1
  1147. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/softplus_grad_ext.h +1 -1
  1148. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/softshrink.h +1 -1
  1149. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/softshrink_grad.h +1 -1
  1150. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/sort_ext.h +1 -1
  1151. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/speed_fusion_attention.h +1 -1
  1152. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/speed_fusion_attention_grad.h +1 -1
  1153. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/split.h +1 -1
  1154. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/split_tensor.h +1 -1
  1155. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/split_tensor_view.h +1 -1
  1156. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/split_with_size.h +1 -1
  1157. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/split_with_size_view.h +1 -1
  1158. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/sqrt.h +1 -1
  1159. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/square.h +1 -1
  1160. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/squeeze.h +1 -1
  1161. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/stack_ext.h +1 -1
  1162. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/std.h +1 -1
  1163. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/std_mean.h +1 -1
  1164. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/sub.h +1 -1
  1165. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/sub_ext.h +1 -1
  1166. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/sub_scalar.h +1 -1
  1167. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/sum_ext.h +1 -1
  1168. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/swiglu.h +1 -1
  1169. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/swiglu_grad.h +1 -1
  1170. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/t_ext.h +1 -1
  1171. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/take.h +1 -1
  1172. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/tan.h +1 -1
  1173. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/tanh.h +1 -1
  1174. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/tanh_grad.h +1 -1
  1175. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/tensor_scatter_elements.h +1 -1
  1176. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/threshold.h +1 -1
  1177. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/threshold_grad.h +1 -1
  1178. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/tile.h +1 -1
  1179. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/topk_ext.h +1 -1
  1180. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/trace_ext.h +1 -1
  1181. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/transpose.h +1 -1
  1182. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/transpose_ext_view.h +1 -1
  1183. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/transpose_view.h +1 -1
  1184. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/triangular_solve.h +1 -1
  1185. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/tril_ext.h +1 -1
  1186. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/triu.h +1 -1
  1187. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/trunc.h +1 -1
  1188. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/type_as.h +1 -1
  1189. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/uniform_ext.h +1 -1
  1190. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/unique2.h +1 -1
  1191. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/unique_consecutive.h +1 -1
  1192. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/unique_dim.h +1 -1
  1193. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/unstack_ext_view.h +1 -1
  1194. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/upsample_bicubic2d.h +1 -1
  1195. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/upsample_bicubic2d_grad.h +1 -1
  1196. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/upsample_bilinear2d.h +1 -1
  1197. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/upsample_bilinear2d_grad.h +1 -1
  1198. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/upsample_linear1d.h +1 -1
  1199. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/upsample_linear1d_grad.h +1 -1
  1200. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/upsample_nearest1d.h +1 -1
  1201. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/upsample_nearest1d_grad.h +1 -1
  1202. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/upsample_nearest2d.h +1 -1
  1203. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/upsample_nearest2d_grad.h +1 -1
  1204. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/upsample_nearest3d.h +1 -1
  1205. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/upsample_nearest3d_grad.h +1 -1
  1206. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/upsample_trilinear3d.h +1 -1
  1207. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/upsample_trilinear3d_grad.h +1 -1
  1208. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/var.h +1 -1
  1209. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/var_mean.h +1 -1
  1210. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/view.h +1 -1
  1211. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/view_as.h +1 -1
  1212. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/weight_quant_batch_matmul.h +1 -1
  1213. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/xlogy.h +1 -1
  1214. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/xlogy_scalar_other.h +1 -1
  1215. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/xlogy_scalar_self.h +1 -1
  1216. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/zeros.h +1 -1
  1217. mindspore/include/mindspore/ccsrc/pyboost/auto_generate/zeros_like_ext.h +1 -1
  1218. mindspore/include/mindspore/ccsrc/pyboost/comm_handle.h +6 -2
  1219. mindspore/include/mindspore/ccsrc/pyboost/customize/any.h +39 -0
  1220. mindspore/include/mindspore/ccsrc/pyboost/customize/cell_backward_hook.h +27 -0
  1221. mindspore/include/mindspore/ccsrc/pyboost/customize/divmod.h +3 -3
  1222. mindspore/include/mindspore/ccsrc/pyboost/customize/einsum_ext.h +38 -0
  1223. mindspore/include/mindspore/ccsrc/pyboost/customize/identity.h +2 -2
  1224. mindspore/include/mindspore/ccsrc/pyboost/customize/meshgrid.h +7 -4
  1225. mindspore/include/mindspore/ccsrc/pyboost/customize/op_common.h +12 -15
  1226. mindspore/include/mindspore/ccsrc/pyboost/customize/pixel_shuffle.h +2 -3
  1227. mindspore/include/mindspore/ccsrc/pyboost/customize/reshape.h +4 -3
  1228. mindspore/include/mindspore/ccsrc/pyboost/customize/searchsorted.h +4 -5
  1229. mindspore/include/mindspore/ccsrc/pyboost/functions/auto_generate/auto_grad_op_reg.h +1573 -1408
  1230. mindspore/include/mindspore/ccsrc/pyboost/functions/auto_generate/functions.h +578 -494
  1231. mindspore/include/mindspore/ccsrc/pyboost/grad_functions/pyboost_grad_functions.h +3 -0
  1232. mindspore/include/mindspore/ccsrc/pyboost/grad_functions/value_converter.h +30 -4
  1233. mindspore/include/mindspore/ccsrc/pyboost/op_register.h +52 -0
  1234. mindspore/include/mindspore/ccsrc/pyboost/op_runner.h +45 -19
  1235. mindspore/include/mindspore/ccsrc/pyboost/pyboost_utils.h +106 -62
  1236. mindspore/include/mindspore/ccsrc/pynative/base.h +22 -24
  1237. mindspore/include/mindspore/ccsrc/pynative/forward/do_pyboost_cast.h +71 -67
  1238. mindspore/include/mindspore/ccsrc/pynative/forward/forward.h +14 -12
  1239. mindspore/include/mindspore/ccsrc/pynative/forward/forward_task.h +34 -2
  1240. mindspore/include/mindspore/ccsrc/pynative/grad/custom_function.h +14 -7
  1241. mindspore/include/mindspore/ccsrc/pynative/grad/function/auto_generate/pyboost_native_grad_functions.h +485 -454
  1242. mindspore/include/mindspore/ccsrc/pynative/grad/function/func_builder.h +3 -3
  1243. mindspore/include/mindspore/ccsrc/pynative/grad/function/func_grad.h +280 -96
  1244. mindspore/include/mindspore/ccsrc/pynative/grad/function/func_pass.h +0 -1
  1245. mindspore/include/mindspore/ccsrc/pynative/grad/function.h +28 -23
  1246. mindspore/include/mindspore/ccsrc/pynative/grad/function_py.h +19 -11
  1247. mindspore/include/mindspore/ccsrc/pynative/grad/grad.h +30 -97
  1248. mindspore/include/mindspore/ccsrc/pynative/grad/grad_utils.h +39 -23
  1249. mindspore/include/mindspore/ccsrc/pynative/grad/hook_py.h +21 -22
  1250. mindspore/include/mindspore/ccsrc/pynative/grad/jit/jit_grad.h +2 -26
  1251. mindspore/include/mindspore/ccsrc/pynative/grad/top_cell.h +8 -150
  1252. mindspore/include/mindspore/ccsrc/pynative/op_function/auto_generate/pyboost_api.h +564 -0
  1253. mindspore/include/mindspore/ccsrc/pynative/op_function/auto_generate/pyboost_core.h +564 -0
  1254. mindspore/include/mindspore/ccsrc/pynative/op_function/auto_generate/tensor_func_utils.h +484 -482
  1255. mindspore/include/mindspore/ccsrc/pynative/op_function/comm_handle_py.h +2 -0
  1256. mindspore/include/mindspore/ccsrc/pynative/op_function/converter.h +11 -0
  1257. mindspore/include/mindspore/ccsrc/pynative/op_function/customize/direct_ops.h +2 -12
  1258. mindspore/include/mindspore/ccsrc/pynative/predict_out_type_map.h +3 -0
  1259. mindspore/include/mindspore/ccsrc/pynative/pynative_execute.h +6 -2
  1260. mindspore/include/mindspore/ccsrc/pynative/pynative_utils.h +39 -43
  1261. mindspore/include/mindspore/ccsrc/runtime/collective/collective_communication_lib.h +17 -1
  1262. mindspore/include/mindspore/ccsrc/runtime/collective/communication_group.h +5 -0
  1263. mindspore/include/mindspore/ccsrc/runtime/collective/dummy_collective_communication_lib.h +2 -1
  1264. mindspore/include/mindspore/ccsrc/runtime/device/device_address_utils.h +55 -50
  1265. mindspore/include/mindspore/ccsrc/runtime/device/memory_scheduler.h +2 -1
  1266. mindspore/include/mindspore/ccsrc/runtime/device/move_to.h +3 -0
  1267. mindspore/include/mindspore/ccsrc/runtime/device/res_manager/auto_mem_offload.h +0 -1
  1268. mindspore/include/mindspore/ccsrc/runtime/device/res_manager/capture_graph.h +35 -0
  1269. mindspore/include/mindspore/ccsrc/runtime/device/res_manager/hal_res_base.h +18 -17
  1270. mindspore/include/mindspore/ccsrc/runtime/device/res_manager/hal_res_manager.h +7 -3
  1271. mindspore/include/mindspore/ccsrc/runtime/device/res_manager/loadable_device_address.h +1 -1
  1272. mindspore/include/mindspore/ccsrc/runtime/device/res_manager/memory_manager.h +0 -1
  1273. mindspore/include/mindspore/ccsrc/runtime/device/res_manager/swap_manager.h +2 -2
  1274. mindspore/include/mindspore/ccsrc/runtime/device/res_manager/tensor_array.h +1 -1
  1275. mindspore/include/mindspore/ccsrc/runtime/device/res_manager/utils/utils.h +0 -1
  1276. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/abstract_actor.h +46 -33
  1277. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/actor_common.h +30 -19
  1278. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/actor_dump.h +4 -3
  1279. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/actor_set.h +0 -4
  1280. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/any_type_kernel_actor.h +7 -61
  1281. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/control_flow/condition_gather_runner.h +74 -0
  1282. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/control_flow/condition_switch_runner.h +89 -0
  1283. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/control_flow/control_actor.h +37 -41
  1284. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/control_flow/entrance_actor.h +11 -11
  1285. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/control_flow/exit_actor.h +8 -9
  1286. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/control_flow/gather_actor.h +6 -7
  1287. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/control_flow/stack_actor.h +11 -11
  1288. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/control_flow/switch_actor.h +2 -2
  1289. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/copy_actor.h +12 -14
  1290. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/data_prepare_actor.h +28 -20
  1291. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/data_source_actor.h +10 -58
  1292. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/debug_actor.h +11 -10
  1293. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/debug_aware_actor.h +2 -2
  1294. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/fusion/fusion_actor.h +2 -2
  1295. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/kernel_actor.h +79 -86
  1296. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/kernel_async_infer_actor.h +3 -1
  1297. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/kernel_async_launch_actor.h +11 -1
  1298. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/kernel_async_resize_actor.h +3 -1
  1299. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/kernel_infer_actor.h +4 -4
  1300. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/kernel_resize_actor.h +4 -4
  1301. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/kernel_runner.h +405 -0
  1302. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/loop_count_actor.h +11 -11
  1303. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/memory/memory_alloc_actor.h +3 -3
  1304. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/memory/memory_free_actor.h +2 -3
  1305. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/memory/memory_swap_actor.h +4 -4
  1306. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/memory_aware_actor.h +7 -7
  1307. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/memory_manager_actor.h +18 -17
  1308. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/output_actor.h +11 -7
  1309. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/profiler_actor.h +2 -2
  1310. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/recorder_actor.h +2 -2
  1311. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/rpc/mux_send_actor.h +1 -1
  1312. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/rpc/recv_actor.h +6 -10
  1313. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/rpc/rpc_actor.h +2 -14
  1314. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/rpc/send_actor.h +4 -4
  1315. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/super_kernel_actor.h +72 -57
  1316. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/any_type_graph_scheduler.h +0 -33
  1317. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/control_node_parser.h +13 -1
  1318. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/control_node_scheduler.h +1 -2
  1319. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/device_tensor_copy_store.h +14 -14
  1320. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/device_tensor_store.h +28 -27
  1321. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/execution_order_check/comm_execution_order_check.h +17 -7
  1322. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/execution_order_check/kernel_cache.h +24 -4
  1323. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/graph_capture/graph_capture_manager.h +117 -0
  1324. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/graph_compiler.h +4 -71
  1325. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/graph_parameter_store.h +81 -143
  1326. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/graph_scheduler.h +9 -22
  1327. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/parameter_store.h +4 -0
  1328. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/pipeline/async_lf_queue.h +97 -0
  1329. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/pipeline/lf_ring_queue.h +205 -0
  1330. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/pipeline/runtime_pipeline.h +71 -0
  1331. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/pre_launch_comm.h +10 -2
  1332. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/rpc_node_scheduler.h +4 -13
  1333. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/scheduler_helper.h +12 -1
  1334. mindspore/include/mindspore/ccsrc/runtime/hardware/device_context.h +35 -173
  1335. mindspore/include/mindspore/ccsrc/runtime/hardware/device_context_manager.h +1 -1
  1336. mindspore/include/mindspore/ccsrc/runtime/pipeline/async_rqueue.h +2 -2
  1337. mindspore/include/mindspore/ccsrc/runtime/pipeline/ring_queue.h +1 -1
  1338. mindspore/include/mindspore/ccsrc/runtime/pipeline/task/task.h +1 -1
  1339. mindspore/include/mindspore/ccsrc/runtime/pynative/graph_adapter.h +0 -1
  1340. mindspore/include/mindspore/ccsrc/runtime/pynative/ir_converter.h +8 -7
  1341. mindspore/include/mindspore/ccsrc/runtime/pynative/op_runner.h +6 -6
  1342. mindspore/include/mindspore/ccsrc/runtime/pynative/op_runtime_info.h +4 -4
  1343. mindspore/include/mindspore/ccsrc/utils/dlopen_macro.h +2 -2
  1344. mindspore/include/mindspore/core/include/abstract/abstract_function.h +54 -13
  1345. mindspore/include/mindspore/core/include/abstract/abstract_value.h +50 -13
  1346. mindspore/include/mindspore/core/include/abstract/ops/primitive_infer_map.h +1 -1
  1347. mindspore/include/mindspore/core/include/abstract/param_validator.h +3 -2
  1348. mindspore/include/mindspore/core/include/base/bfloat16.h +1 -1
  1349. mindspore/include/mindspore/core/include/base/float16.h +4 -3
  1350. mindspore/include/mindspore/core/include/base/float8_e4m3fn.h +264 -0
  1351. mindspore/include/mindspore/core/include/base/float8_e5m2.h +260 -0
  1352. mindspore/include/mindspore/core/include/base/hifloat8.h +53 -57
  1353. mindspore/include/mindspore/core/include/ir/anf.h +37 -8
  1354. mindspore/include/mindspore/core/include/ir/device_sync.h +17 -1
  1355. mindspore/include/mindspore/core/include/ir/dtype/number.h +123 -9
  1356. mindspore/include/mindspore/core/include/ir/dtype/op_dtype.h +48 -0
  1357. mindspore/include/mindspore/core/include/ir/dtype.h +4 -0
  1358. mindspore/include/mindspore/core/include/ir/func_graph.h +2 -0
  1359. mindspore/include/mindspore/core/include/ir/func_graph_cloner.h +2 -0
  1360. mindspore/include/mindspore/core/include/ir/meta_grad_data.h +4 -13
  1361. mindspore/include/mindspore/core/include/ir/primitive.h +20 -2
  1362. mindspore/include/mindspore/core/include/ir/scalar.h +2 -2
  1363. mindspore/include/mindspore/core/include/ir/scope.h +16 -3
  1364. mindspore/include/mindspore/core/include/ir/tensor.h +922 -41
  1365. mindspore/include/mindspore/core/include/ir/tensor_py_wrapperbase.h +11 -11
  1366. mindspore/include/mindspore/core/include/ir/tensor_storage_info.h +1 -0
  1367. mindspore/include/mindspore/core/include/load_mindir/infer_mindir.h +3 -2
  1368. mindspore/include/mindspore/core/include/mindapi/base/macros.h +3 -3
  1369. mindspore/include/mindspore/core/include/mindapi/base/type_id.h +3 -0
  1370. mindspore/include/mindspore/core/include/mindapi/base/types.h +7 -0
  1371. mindspore/include/mindspore/core/include/ops/op_def.h +2 -31
  1372. mindspore/include/mindspore/core/include/symbolic_shape/operation_builder.h +1 -1
  1373. mindspore/include/mindspore/core/include/utils/anf_utils.h +2 -0
  1374. mindspore/include/mindspore/core/include/utils/callback_handler.h +1 -1
  1375. mindspore/include/mindspore/core/include/utils/compact_set.h +4 -0
  1376. mindspore/include/mindspore/core/include/utils/core_op_utils.h +1 -1
  1377. mindspore/include/mindspore/core/include/utils/device_manager_conf.h +4 -0
  1378. mindspore/include/mindspore/core/include/utils/info.h +7 -0
  1379. mindspore/include/mindspore/core/include/utils/log_adapter.h +11 -2
  1380. mindspore/include/mindspore/core/include/utils/ms_context.h +13 -11
  1381. mindspore/include/mindspore/core/include/utils/ms_exception.h +39 -5
  1382. mindspore/include/mindspore/core/include/utils/ms_utils.h +3 -8
  1383. mindspore/include/mindspore/core/include/utils/ms_utils_secure.h +1 -1
  1384. mindspore/include/mindspore/core/include/utils/phase.h +17 -2
  1385. mindspore/include/mindspore/core/include/utils/system/base.h +1 -1
  1386. mindspore/include/mindspore/core/include/utils/tensor_hook_map.h +30 -0
  1387. mindspore/include/mindspore/core/mindrt/include/actor/op_actor.h +68 -0
  1388. mindspore/include/mindspore/core/mindrt/include/async/async.h +2 -2
  1389. mindspore/include/mindspore/core/mindrt/include/thread/actor_threadpool.h +4 -0
  1390. mindspore/include/mindspore/core/mindrt/include/thread/core_affinity.h +1 -1
  1391. mindspore/include/mindspore/core/mindrt/include/thread/hqueue.h +6 -6
  1392. mindspore/include/mindspore/core/mindrt/include/thread/threadpool.h +6 -2
  1393. mindspore/include/mindspore/ops/grad/grad_utils.h +21 -3
  1394. mindspore/include/mindspore/ops/infer/all_gather_v.h +39 -0
  1395. mindspore/include/mindspore/ops/infer/all_to_all.h +38 -0
  1396. mindspore/include/mindspore/ops/infer/dtype.h +12 -0
  1397. mindspore/include/mindspore/ops/infer/ops_func_impl/acosh.h +2 -9
  1398. mindspore/include/mindspore/ops/infer/ops_func_impl/asinh.h +2 -9
  1399. mindspore/include/mindspore/ops/infer/ops_func_impl/atanh.h +4 -9
  1400. mindspore/include/mindspore/ops/infer/ops_func_impl/batch_norm_ext.h +6 -11
  1401. mindspore/include/mindspore/ops/infer/ops_func_impl/batch_norm_grad_ext.h +5 -4
  1402. mindspore/include/mindspore/ops/infer/ops_func_impl/bitwise_and_scalar.h +4 -5
  1403. mindspore/include/mindspore/ops/infer/ops_func_impl/bitwise_and_tensor.h +3 -5
  1404. mindspore/include/mindspore/ops/infer/ops_func_impl/bitwise_or_scalar.h +3 -10
  1405. mindspore/include/mindspore/ops/infer/ops_func_impl/bitwise_or_tensor.h +2 -10
  1406. mindspore/include/mindspore/ops/infer/ops_func_impl/bitwise_xor_scalar.h +3 -10
  1407. mindspore/include/mindspore/ops/infer/ops_func_impl/bitwise_xor_tensor.h +2 -10
  1408. mindspore/include/mindspore/ops/infer/ops_func_impl/cell_backward_hook.h +32 -0
  1409. mindspore/include/mindspore/ops/infer/ops_func_impl/cross_entropy_loss.h +36 -0
  1410. mindspore/include/mindspore/ops/infer/ops_func_impl/cross_entropy_loss_grad.h +36 -0
  1411. mindspore/include/mindspore/ops/infer/ops_func_impl/diagonal_view.h +32 -0
  1412. mindspore/include/mindspore/ops/infer/ops_func_impl/dist_comm_all_gather_into_tensor_uneven.h +33 -0
  1413. mindspore/include/mindspore/ops/infer/ops_func_impl/dist_comm_reduce_scatter_tensor_uneven.h +33 -0
  1414. mindspore/include/mindspore/ops/infer/ops_func_impl/dump_gradient.h +33 -0
  1415. mindspore/include/mindspore/ops/infer/ops_func_impl/eltwise_op.h +4 -10
  1416. mindspore/include/mindspore/ops/infer/ops_func_impl/empty.h +7 -3
  1417. mindspore/include/mindspore/ops/infer/ops_func_impl/empty_like.h +7 -3
  1418. mindspore/include/mindspore/ops/infer/ops_func_impl/exp.h +3 -4
  1419. mindspore/include/mindspore/ops/infer/ops_func_impl/fused_add_topk_div.h +3 -0
  1420. mindspore/include/mindspore/ops/infer/ops_func_impl/grouped_matmul_base.h +1 -1
  1421. mindspore/include/mindspore/ops/infer/ops_func_impl/inner_moe_token_unpermute.h +36 -0
  1422. mindspore/include/mindspore/ops/infer/ops_func_impl/inplace_bernoulli_scalar.h +25 -0
  1423. mindspore/include/mindspore/ops/infer/ops_func_impl/inplace_bernoulli_tensor.h +40 -0
  1424. mindspore/include/mindspore/ops/infer/ops_func_impl/inplace_matmul_add.h +34 -0
  1425. mindspore/include/mindspore/ops/infer/ops_func_impl/inplace_remainder_tensor_scalar.h +35 -0
  1426. mindspore/include/mindspore/ops/infer/ops_func_impl/inplace_remainder_tensor_tensor.h +35 -0
  1427. mindspore/include/mindspore/ops/infer/ops_func_impl/inplace_silu.h +35 -0
  1428. mindspore/include/mindspore/ops/infer/ops_func_impl/kv_scale_cache.h +48 -0
  1429. mindspore/include/mindspore/ops/infer/ops_func_impl/masked_fill.h +4 -3
  1430. mindspore/include/mindspore/ops/infer/ops_func_impl/masked_scatter.h +37 -0
  1431. mindspore/include/mindspore/ops/infer/ops_func_impl/matmul_fusion_utils.h +6 -0
  1432. mindspore/include/mindspore/ops/infer/ops_func_impl/matmul_split_silu_fastgelu_add_mul_out1.h +34 -0
  1433. mindspore/include/mindspore/ops/infer/ops_func_impl/matmul_split_silu_mul_out1.h +34 -0
  1434. mindspore/include/mindspore/ops/infer/ops_func_impl/matmul_split_silu_out2.h +1 -1
  1435. mindspore/include/mindspore/ops/infer/ops_func_impl/max_pool_grad_with_indices.h +2 -8
  1436. mindspore/include/mindspore/ops/infer/ops_func_impl/max_pool_grad_with_mask.h +4 -2
  1437. mindspore/include/mindspore/ops/infer/ops_func_impl/max_pool_with_indices.h +6 -4
  1438. mindspore/include/mindspore/ops/infer/ops_func_impl/max_pool_with_mask.h +6 -4
  1439. mindspore/include/mindspore/ops/infer/ops_func_impl/mla.h +54 -0
  1440. mindspore/include/mindspore/ops/infer/ops_func_impl/mla_preprocess.h +75 -0
  1441. mindspore/include/mindspore/ops/infer/ops_func_impl/moe_distribute_combine.h +34 -0
  1442. mindspore/include/mindspore/ops/infer/ops_func_impl/moe_distribute_dispatch.h +37 -0
  1443. mindspore/include/mindspore/ops/infer/ops_func_impl/moe_init_routing_quant_v2.h +39 -0
  1444. mindspore/include/mindspore/ops/infer/ops_func_impl/neg.h +1 -6
  1445. mindspore/include/mindspore/ops/infer/ops_func_impl/new_empty.h +7 -3
  1446. mindspore/include/mindspore/ops/infer/ops_func_impl/new_full.h +37 -0
  1447. mindspore/include/mindspore/ops/infer/ops_func_impl/normal_float_float.h +1 -0
  1448. mindspore/include/mindspore/ops/infer/ops_func_impl/ones_like.h +2 -6
  1449. mindspore/include/mindspore/ops/infer/ops_func_impl/ones_like_ext.h +1 -2
  1450. mindspore/include/mindspore/ops/infer/ops_func_impl/q_matmul_split_silu_fastgelu_add_mul_out1.h +34 -0
  1451. mindspore/include/mindspore/ops/infer/ops_func_impl/q_matmul_split_silu_mul_out1.h +34 -0
  1452. mindspore/include/mindspore/ops/infer/ops_func_impl/quant_matmul.h +32 -0
  1453. mindspore/include/mindspore/ops/infer/ops_func_impl/reciprocal.h +4 -9
  1454. mindspore/include/mindspore/ops/infer/ops_func_impl/reduce_any.h +4 -5
  1455. mindspore/include/mindspore/ops/infer/ops_func_impl/reduce_arithmetic.h +2 -1
  1456. mindspore/include/mindspore/ops/infer/ops_func_impl/remainder_tensor_scalar.h +4 -4
  1457. mindspore/include/mindspore/ops/infer/ops_func_impl/ring_attention_update.h +36 -0
  1458. mindspore/include/mindspore/ops/infer/ops_func_impl/sigmoid.h +4 -5
  1459. mindspore/include/mindspore/ops/infer/ops_func_impl/square.h +2 -10
  1460. mindspore/include/mindspore/ops/infer/ops_func_impl/topprouter.h +36 -0
  1461. mindspore/include/mindspore/ops/infer/ops_func_impl/zeros_like_ext.h +1 -2
  1462. mindspore/include/mindspore/ops/infer/reduce_scatter.h +3 -1
  1463. mindspore/include/mindspore/ops/infer/reduce_scatter_v.h +38 -0
  1464. mindspore/include/mindspore/ops/kernel/ascend/acl/acl_kernel_mod.h +3 -0
  1465. mindspore/include/mindspore/ops/kernel/ascend/acl_ir/acl_adapter_info.h +1 -1
  1466. mindspore/include/mindspore/ops/kernel/ascend/acl_ir/custom/custom_aclnn_utils.h +95 -0
  1467. mindspore/include/mindspore/ops/kernel/ascend/acl_ir/custom/custom_op_api_cache.h +12 -5
  1468. mindspore/include/mindspore/ops/kernel/ascend/acl_ir/custom/custom_op_api_exec.h +2 -0
  1469. mindspore/include/mindspore/ops/kernel/ascend/acl_ir/op_api_cache.h +12 -7
  1470. mindspore/include/mindspore/ops/kernel/ascend/acl_ir/op_api_convert.h +32 -101
  1471. mindspore/include/mindspore/ops/kernel/ascend/acl_ir/op_api_exec.h +35 -30
  1472. mindspore/include/mindspore/ops/kernel/ascend/acl_ir/op_api_util.h +5 -1
  1473. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/common/kernel_base.h +1 -1
  1474. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/common/kernel_log.h +11 -11
  1475. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/format_transfer/formats_definitions.h +5 -1
  1476. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/format_transfer/register_format_transfer.h +5 -1
  1477. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/inc/ms_cpu_kernel.h +1 -1
  1478. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/concat.h +1 -1
  1479. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/dct.h +1 -1
  1480. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/dctn.h +1 -1
  1481. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/fft_ortho.h +1 -1
  1482. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/fft_shapecopy.h +1 -1
  1483. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/fftbase.h +1 -1
  1484. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/fftfreq.h +1 -1
  1485. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/fftnbase.h +1 -1
  1486. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/irfft_double.h +1 -1
  1487. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/nms_with_mask.h +0 -1
  1488. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/random/philox_random_dist.h +1 -1
  1489. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/random/random_distributions.h +27 -25
  1490. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/topprouter.h +64 -0
  1491. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/utils/eigen_tensor.h +18 -15
  1492. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/utils/fused_sparse_utils.h +1 -1
  1493. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/utils/kernel_util.h +2 -2
  1494. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/utils/philox_random.h +75 -138
  1495. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/utils/range_sampler.h +7 -3
  1496. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/utils/sampling_kernels.h +18 -15
  1497. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/utils/sparse_group.h +18 -15
  1498. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/utils/sparse_tensor.h +18 -15
  1499. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/adaptive_avg_pool_3d_grad_op.h +0 -11
  1500. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/adaptive_avg_pool_3d_op.h +0 -11
  1501. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/adaptive_max_pool3_d_grad_op.h +0 -14
  1502. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/adaptive_max_pool3d_op.h +0 -18
  1503. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/adaptive_max_pool_2d_grad_op.h +0 -14
  1504. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/adjust_contrastv2_op.h +0 -21
  1505. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/arg_max_op.h +0 -22
  1506. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/bartlett_window_op.h +0 -19
  1507. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/cauchy_op.h +0 -11
  1508. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/cholesky_solve_op.h +0 -23
  1509. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/coalesce_op.h +0 -24
  1510. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/csr_sparse_matrix_to_dense_op.h +0 -15
  1511. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/dense_to_csr_sparse_matrix_op.h +0 -16
  1512. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/eig_op.h +0 -17
  1513. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/exp.h +0 -18
  1514. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/fractional_max_pool_grad_with_fixed_ksize_op.h +0 -22
  1515. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/fractional_max_pool_with_fixed_ksize_op.h +0 -19
  1516. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/geqrf_op.h +0 -14
  1517. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/glu_grad_op.h +0 -17
  1518. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/glu_op.h +0 -20
  1519. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/hamming_window_op.h +0 -20
  1520. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/index_fill.h +0 -18
  1521. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/instance_norm_v2_grad.h +0 -28
  1522. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/layer_norm_grad_grad_op.h +0 -17
  1523. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/log_normal_reverse.h +0 -15
  1524. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/logspace.h +0 -23
  1525. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/lstsq_op.h +0 -15
  1526. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/matrix_logarithm.h +0 -13
  1527. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/matrix_power_op.h +0 -16
  1528. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/max_pool_3d_grad_with_argmax_op.h +0 -26
  1529. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/maximum_grad_grad.h +0 -19
  1530. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/median_grad_op.h +0 -19
  1531. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/median_op.h +0 -17
  1532. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/minimum_grad_grad.h +0 -19
  1533. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/multi_margin_loss_grad_op.h +0 -24
  1534. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/multi_margin_loss_op.h +0 -19
  1535. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/mvlgamma_grad_op.h +0 -17
  1536. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/mvlgamma_op.h +0 -15
  1537. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/pdist_grad_op.h +0 -21
  1538. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/segment_mean_op.h +0 -18
  1539. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/segment_min_op.h +0 -19
  1540. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/sparse_addmm.h +0 -16
  1541. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/sparse_apply_adagrad_da.h +0 -38
  1542. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/sparse_apply_centered_rms_prop.h +0 -47
  1543. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/sparse_apply_momentum.h +0 -36
  1544. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/sparse_apply_proximal_gradient_descent.h +0 -29
  1545. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/sparse_matrix_transpose_op.h +0 -29
  1546. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/sparse_segment_mean_with_num_segments_op.h +0 -19
  1547. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/sparse_segment_sqrt_n_grad_op.h +0 -21
  1548. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/sparse_segment_sqrt_n_op.h +0 -18
  1549. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/sparse_segment_sqrt_n_with_num_segments_op.h +0 -20
  1550. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/sparse_tensor_to_csr_sparse_matrix_op.h +0 -18
  1551. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/sspaddmm_op.h +0 -22
  1552. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/inc/triplet_margin_loss_op.h +0 -22
  1553. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/utils/axis_util.h +5 -1
  1554. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/utils/reduce_infer_util.h +1 -2
  1555. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/customize/op_proto/utils/transfer_shape_according_to_format.h +5 -1
  1556. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/drop_out_gen_mask_kernels.h +2 -2
  1557. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/gather_grad_kernels.h +1 -1
  1558. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/replay_buffer/replay_buffer_factory.h +2 -1
  1559. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_util.h +2 -0
  1560. mindspore/include/mindspore/ops/kernel/ascend/availability/silent_check/ascend_silent_check.h +13 -14
  1561. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/addbmm_aclnn_kernel.h +1 -1
  1562. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/addmm_aclnn_kernel.h +1 -1
  1563. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/addmv_aclnn_kernel.h +1 -1
  1564. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/baddbmm_aclnn_kernel.h +1 -1
  1565. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/batch_norm_ext_aclnn_kernel.h +1 -0
  1566. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/batch_norm_grad_ext_aclnn_kernel.h +2 -1
  1567. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/bincount_ext_aclnn_kernel.h +2 -2
  1568. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/chunk_aclnn_kernel.h +2 -2
  1569. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/conv1d_padding_aclnn_kernel.h +1 -1
  1570. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/conv2d_padding_aclnn_kernel.h +1 -1
  1571. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/convolution_str_aclnn_kernel.h +1 -1
  1572. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/cross_entropy_loss_aclnn_kernel.h +48 -0
  1573. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/cross_entropy_loss_grad_aclnn_kernel.h +47 -0
  1574. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/custom_aclnn_utils.h +1 -1
  1575. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/custom_v2_aclnn_kernel.h +26 -21
  1576. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/dense_aclnn_kernel.h +13 -6
  1577. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/dropout_ext_aclnn_kernel.h +3 -3
  1578. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/empty_aclnn_kernel.h +39 -0
  1579. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/empty_like_aclnn_kernel.h +39 -0
  1580. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/flash_attention_score_aclnn_kernel.h +1 -0
  1581. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/flash_attention_score_grad_aclnn_kernel.h +1 -0
  1582. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/gather_d_grad_v2_aclnn_kernel.h +1 -1
  1583. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/grid_sampler_2d_grad_aclnn_kernel.h +3 -3
  1584. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/grid_sampler_3d_grad_aclnn_kernel.h +3 -3
  1585. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/index_add_ext_aclnn_kernel.h +1 -1
  1586. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/index_fill_scalar_aclnn_kernel.h +1 -1
  1587. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/index_fill_tensor_aclnn_kernel.h +1 -1
  1588. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/inner_inplace_index_put_aclnn_kernel.h +1 -0
  1589. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/inner_moe_token_unpermute_aclnn_kernel.h +45 -0
  1590. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/inplace_bernoulli_scalar_aclnn_kernel.h +47 -0
  1591. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/inplace_bernoulli_tensor_aclnn_kernel.h +46 -0
  1592. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/inplace_clamp_scalar_aclnn_kernel.h +2 -0
  1593. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/inplace_index_add_aclnn_kernel.h +1 -1
  1594. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/inplace_normal_aclnn_kernel.h +2 -2
  1595. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/inplace_scatter_add_aclnn_kernel.h +45 -0
  1596. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/inplace_silu_aclnn_kernel.h +42 -0
  1597. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/inplace_uniform_aclnn_kernel.h +2 -2
  1598. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/isinf_aclnn_kernel.h +1 -1
  1599. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/linalg_vector_norm_aclnn_kernel.h +1 -1
  1600. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/masked_scatter_aclnn_kernel.h +45 -0
  1601. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/matmul_all_reduce_aclnn_kernel.h +2 -2
  1602. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/matmul_reduce_scatter_aclnn_kernel.h +4 -4
  1603. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/moe_distribute_combine_aclnn_kernel.h +56 -0
  1604. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/moe_distribute_dispatch_aclnn_kernel.h +55 -0
  1605. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/moe_init_routing_quant_v2_aclnn_kernel.h +50 -0
  1606. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/mse_loss_ext_aclnn_kernel.h +1 -1
  1607. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/mse_loss_grad_ext_aclnn_kernel.h +1 -1
  1608. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/multinomial_ext_aclnn_kernel.h +1 -1
  1609. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/narrow_aclnn_kernel.h +3 -3
  1610. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/new_empty_aclnn_kernel.h +39 -0
  1611. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/new_full_aclnn_kernel.h +41 -0
  1612. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/norm_aclnn_kernel.h +1 -1
  1613. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/prod_ext_aclnn_kernel.h +1 -1
  1614. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/quant_batch_matmul_all_reduce_aclnn_kernel.h +2 -2
  1615. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/rand_ext_aclnn_kernel.h +2 -2
  1616. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/randint_aclnn_kernel.h +4 -4
  1617. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/randn_aclnn_kernel.h +2 -2
  1618. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/randperm_ext_aclnn_kernel.h +2 -2
  1619. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/repeat_interleave_grad_aclnn_kernel.h +1 -1
  1620. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/ring_attention_update_aclnn_kernel.h +41 -0
  1621. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/split_with_size_aclnn_kernel.h +1 -1
  1622. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/unique2_aclnn_kernel.h +3 -0
  1623. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/unique_consecutive_aclnn_kernel.h +2 -0
  1624. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/unique_dim_aclnn_kernel.h +3 -0
  1625. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/view/diagonal_view.h +42 -0
  1626. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn_auto_gen/apply_rotary_pos_emb_aclnn_kernel.h +41 -0
  1627. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn_auto_gen/mla_aclnn_kernel.h +41 -0
  1628. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn_auto_gen/paged_attention_aclnn_kernel.h +41 -0
  1629. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn_kernel_mod.h +139 -23
  1630. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn_kernel_utils.h +3 -3
  1631. mindspore/include/mindspore/ops/kernel/ascend/pyboost/aclnn_utils.h +42 -17
  1632. mindspore/include/mindspore/ops/kernel/ascend/pyboost/atb_runner.h +124 -0
  1633. mindspore/include/mindspore/ops/kernel/ascend/pyboost/atb_runner_base.h +48 -0
  1634. mindspore/include/mindspore/ops/kernel/ascend/pyboost/atb_utils.h +63 -0
  1635. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/abs.h +1 -1
  1636. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/acos_ext.h +1 -1
  1637. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/acosh_ext.h +1 -1
  1638. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/adamw.h +1 -1
  1639. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/adaptive_avg_pool1d.h +1 -1
  1640. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/adaptive_avg_pool2d_ext.h +1 -1
  1641. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/adaptive_avg_pool2d_grad_ext.h +1 -1
  1642. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/adaptive_avg_pool3d_ext.h +1 -1
  1643. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/adaptive_avg_pool3d_grad_ext.h +1 -1
  1644. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/adaptive_max_pool1d.h +1 -1
  1645. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/adaptive_max_pool2d.h +1 -1
  1646. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/add.h +1 -1
  1647. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/add_ext.h +1 -1
  1648. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/add_layer_norm_grad.h +1 -1
  1649. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/add_layernorm_v2.h +1 -1
  1650. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/add_rms_norm.h +1 -1
  1651. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/add_rmsnorm_quant_v2.h +1 -1
  1652. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/add_scalar.h +1 -1
  1653. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/addbmm.h +1 -1
  1654. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/addcdiv_ext.h +1 -1
  1655. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/addcmul_ext.h +1 -1
  1656. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/addmm.h +1 -1
  1657. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/addmv.h +1 -1
  1658. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/all_finite.h +1 -1
  1659. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/all_gather_matmul.h +1 -1
  1660. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/any.h +40 -0
  1661. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/any_ext.h +40 -0
  1662. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/apply_rotary_pos_emb.h +40 -0
  1663. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/arange.h +1 -1
  1664. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/argmax_ext.h +1 -1
  1665. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/argmax_with_value.h +1 -1
  1666. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/argmin_ext.h +1 -1
  1667. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/argmin_with_value.h +1 -1
  1668. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/argsort.h +1 -1
  1669. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/as_strided.h +1 -1
  1670. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/asin_ext.h +1 -1
  1671. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/asinh_ext.h +1 -1
  1672. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/atan2_ext.h +1 -1
  1673. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/atan_ext.h +1 -1
  1674. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/atanh.h +1 -1
  1675. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/avg_pool1d.h +1 -1
  1676. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/avg_pool2d.h +1 -1
  1677. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/avg_pool2d_grad.h +1 -1
  1678. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/avg_pool3d_ext.h +1 -1
  1679. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/avg_pool3d_grad_ext.h +1 -1
  1680. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/baddbmm.h +1 -1
  1681. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/batch_mat_mul.h +1 -1
  1682. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/batch_norm_elemt.h +1 -1
  1683. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/batch_norm_elemt_grad.h +1 -1
  1684. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/batch_norm_ext.h +1 -1
  1685. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/batch_norm_gather_stats_with_counts.h +1 -1
  1686. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/batch_norm_grad_ext.h +1 -1
  1687. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/batch_norm_reduce_grad.h +1 -1
  1688. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/batch_norm_stats.h +1 -1
  1689. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/bernoulli_ext.h +1 -1
  1690. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/binary_cross_entropy.h +1 -1
  1691. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/binary_cross_entropy_grad.h +1 -1
  1692. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/binary_cross_entropy_with_logits.h +1 -1
  1693. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/binary_cross_entropy_with_logits_backward.h +1 -1
  1694. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/bincount_ext.h +1 -1
  1695. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/bitwise_and_scalar.h +1 -1
  1696. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/bitwise_and_tensor.h +1 -1
  1697. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/bitwise_not.h +1 -1
  1698. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/bitwise_or_scalar.h +1 -1
  1699. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/bitwise_or_tensor.h +1 -1
  1700. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/bitwise_xor_scalar.h +1 -1
  1701. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/bitwise_xor_tensor.h +1 -1
  1702. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/bmm_ext.h +1 -1
  1703. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/broadcast_to.h +1 -1
  1704. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/broadcast_to_view.h +1 -1
  1705. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/cast.h +1 -1
  1706. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/ceil.h +1 -1
  1707. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/cell_backward_hook.h +40 -0
  1708. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/chunk.h +1 -1
  1709. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/chunk_view.h +1 -1
  1710. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/clamp_scalar.h +1 -1
  1711. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/clamp_tensor.h +1 -1
  1712. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/clone.h +1 -1
  1713. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/col2im_ext.h +1 -1
  1714. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/col2im_grad.h +1 -1
  1715. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/concat.h +1 -1
  1716. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/constant_pad_nd.h +1 -1
  1717. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/contiguous.h +1 -1
  1718. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/conv1d_ext.h +1 -1
  1719. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/conv1d_padding.h +1 -1
  1720. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/conv2d_ext.h +1 -1
  1721. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/conv2d_padding.h +1 -1
  1722. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/conv3d_ext.h +1 -1
  1723. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/conv3d_padding.h +1 -1
  1724. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/conv_transpose2d.h +1 -1
  1725. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/convolution.h +1 -1
  1726. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/convolution_grad.h +1 -1
  1727. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/convolution_str.h +1 -1
  1728. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/convolution_str_grad.h +1 -1
  1729. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/copy.h +1 -1
  1730. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/cos.h +1 -1
  1731. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/cosh.h +1 -1
  1732. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/count_nonzero.h +1 -1
  1733. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/cross.h +1 -1
  1734. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/cross_entropy_loss.h +40 -0
  1735. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/cross_entropy_loss_grad.h +40 -0
  1736. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/cummax.h +1 -1
  1737. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/cummin_ext.h +1 -1
  1738. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/cumsum_ext.h +1 -1
  1739. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/custom_ext.h +1 -1
  1740. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/dense.h +1 -1
  1741. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/diag_ext.h +1 -1
  1742. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/diagonal_view.h +40 -0
  1743. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/div.h +1 -1
  1744. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/divmod.h +1 -1
  1745. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/divmods.h +1 -1
  1746. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/divs.h +1 -1
  1747. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/dot.h +1 -1
  1748. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/dropout_do_mask_ext.h +1 -1
  1749. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/dropout_ext.h +1 -1
  1750. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/dropout_gen_mask_ext.h +1 -1
  1751. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/dropout_grad_ext.h +1 -1
  1752. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/dynamic_quant_ext.h +1 -1
  1753. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/einsum_ext.h +40 -0
  1754. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/elu.h +1 -1
  1755. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/elu_ext.h +1 -1
  1756. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/elu_grad_ext.h +1 -1
  1757. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/embedding.h +1 -1
  1758. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/embedding_dense_backward.h +1 -1
  1759. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/empty.h +40 -0
  1760. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/empty_like.h +40 -0
  1761. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/equal.h +1 -1
  1762. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/equal_ext.h +1 -1
  1763. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/erf.h +1 -1
  1764. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/erfc.h +1 -1
  1765. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/erfinv.h +1 -1
  1766. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/exp.h +1 -1
  1767. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/exp2.h +1 -1
  1768. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/expand_as.h +1 -1
  1769. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/expand_dims.h +1 -1
  1770. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/expand_dims_view.h +1 -1
  1771. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/expm1.h +1 -1
  1772. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/eye.h +1 -1
  1773. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/ffn_ext.h +1 -1
  1774. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/fill_scalar.h +1 -1
  1775. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/fill_tensor.h +1 -1
  1776. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/flash_attention_score.h +1 -1
  1777. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/flash_attention_score_grad.h +1 -1
  1778. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/flatten_ext.h +1 -1
  1779. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/floor.h +1 -1
  1780. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/floor_div.h +1 -1
  1781. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/floor_div_scalar.h +1 -1
  1782. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/fmod_scalar.h +1 -1
  1783. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/fmod_tensor.h +1 -1
  1784. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/frac.h +1 -1
  1785. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/full_like.h +1 -1
  1786. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/func_dropout_ext.h +40 -0
  1787. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/func_max_pool2d.h +40 -0
  1788. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/fused_infer_attention_score.h +1 -1
  1789. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/gather_d.h +1 -1
  1790. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/gather_d_grad_v2.h +1 -1
  1791. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/gcd.h +1 -1
  1792. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/gelu.h +1 -1
  1793. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/gelu_ext.h +1 -1
  1794. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/gelu_grad.h +1 -1
  1795. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/gelu_grad_ext.h +1 -1
  1796. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/generator.h +1 -1
  1797. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/glu.h +1 -1
  1798. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/glu_grad.h +1 -1
  1799. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/gmm.h +1 -1
  1800. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/gmm_backward.h +1 -1
  1801. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/gmm_backward_fusion.h +1 -1
  1802. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/gmm_v2.h +1 -1
  1803. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/gmm_v2_backward.h +1 -1
  1804. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/gmm_v2_backward_fusion.h +1 -1
  1805. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/greater.h +1 -1
  1806. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/greater_equal.h +1 -1
  1807. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/greater_equal_scalar.h +1 -1
  1808. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/grid_sampler_2d.h +1 -1
  1809. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/grid_sampler_2d_grad.h +1 -1
  1810. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/grid_sampler_3d.h +1 -1
  1811. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/grid_sampler_3d_grad.h +1 -1
  1812. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/group_norm.h +1 -1
  1813. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/group_norm_grad.h +1 -1
  1814. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/grouped_matmul.h +1 -1
  1815. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/grouped_matmul_v2.h +1 -1
  1816. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/grouped_matmul_v4.h +1 -1
  1817. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/hardtanh.h +1 -1
  1818. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/hardtanh_grad.h +1 -1
  1819. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/histc_ext.h +1 -1
  1820. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/hshrink.h +1 -1
  1821. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/hshrink_grad.h +1 -1
  1822. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/hsigmoid.h +1 -1
  1823. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/hsigmoid_grad.h +1 -1
  1824. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/hswish.h +1 -1
  1825. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/hswish_grad.h +1 -1
  1826. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/identity.h +1 -1
  1827. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/im2col_ext.h +1 -1
  1828. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/incre_flash_attention.h +1 -1
  1829. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/index.h +1 -1
  1830. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/index_add_ext.h +1 -1
  1831. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/index_fill_scalar.h +1 -1
  1832. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/index_fill_tensor.h +1 -1
  1833. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/index_select.h +1 -1
  1834. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inner_index.h +1 -1
  1835. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inner_inplace_index_put.h +1 -1
  1836. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inner_moe_token_unpermute.h +40 -0
  1837. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inner_non_zero.h +1 -1
  1838. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_add_ext.h +1 -1
  1839. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_addmm.h +1 -1
  1840. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_adds_ext.h +1 -1
  1841. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_bernoulli_scalar.h +40 -0
  1842. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_bernoulli_tensor.h +40 -0
  1843. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_clamp_scalar.h +1 -1
  1844. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_clamp_tensor.h +1 -1
  1845. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_copy.h +1 -1
  1846. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_div.h +1 -1
  1847. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_divmod.h +1 -1
  1848. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_divmods.h +1 -1
  1849. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_divs.h +1 -1
  1850. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_elu.h +1 -1
  1851. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_erfinv.h +1 -1
  1852. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_exp.h +1 -1
  1853. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_exponential.h +1 -1
  1854. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_fill_diagonal.h +1 -1
  1855. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_fill_scalar.h +1 -1
  1856. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_fill_tensor.h +1 -1
  1857. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_floor.h +1 -1
  1858. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_floor_divide.h +1 -1
  1859. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_floor_divides.h +1 -1
  1860. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_grouped_matmul_add.h +1 -1
  1861. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_hardtanh.h +1 -1
  1862. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_index_add.h +1 -1
  1863. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_index_put.h +1 -1
  1864. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_log.h +1 -1
  1865. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_masked_fill_scalar.h +1 -1
  1866. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_masked_fill_tensor.h +1 -1
  1867. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_matmul_add.h +40 -0
  1868. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_mul.h +1 -1
  1869. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_muls.h +1 -1
  1870. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_normal.h +1 -1
  1871. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_put.h +1 -1
  1872. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_random.h +1 -1
  1873. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_relu.h +1 -1
  1874. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_remainder_tensor_scalar.h +40 -0
  1875. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_remainder_tensor_tensor.h +40 -0
  1876. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_scatter_add.h +1 -1
  1877. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_scatter_src.h +1 -1
  1878. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_scatter_src_reduce.h +1 -1
  1879. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_scatter_value.h +1 -1
  1880. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_scatter_value_reduce.h +1 -1
  1881. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_silu.h +40 -0
  1882. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_stop_gradient.h +1 -1
  1883. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_sub_ext.h +1 -1
  1884. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_sub_scalar.h +1 -1
  1885. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_tanh.h +1 -1
  1886. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_threshold.h +1 -1
  1887. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_uniform.h +1 -1
  1888. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/inplace_zero.h +1 -1
  1889. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/isclose.h +1 -1
  1890. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/isfinite.h +1 -1
  1891. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/isinf.h +1 -1
  1892. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/isneginf.h +1 -1
  1893. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/kl_div.h +1 -1
  1894. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/kl_div_grad.h +1 -1
  1895. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/kthvalue.h +1 -1
  1896. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/kv_cache_scatter_update.h +1 -1
  1897. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/l1_loss_backward_ext.h +1 -1
  1898. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/l1_loss_ext.h +1 -1
  1899. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/layer_norm_ext.h +1 -1
  1900. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/layer_norm_grad_ext.h +1 -1
  1901. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/leaky_relu_ext.h +1 -1
  1902. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/leaky_relu_grad_ext.h +1 -1
  1903. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/lerp.h +1 -1
  1904. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/lerp_scalar.h +1 -1
  1905. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/less.h +1 -1
  1906. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/less_equal.h +1 -1
  1907. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/lin_space_ext.h +1 -1
  1908. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/linalg_qr.h +1 -1
  1909. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/linalg_vector_norm.h +1 -1
  1910. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/log.h +1 -1
  1911. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/log10.h +1 -1
  1912. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/log1p.h +1 -1
  1913. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/log2.h +1 -1
  1914. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/log_softmax.h +1 -1
  1915. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/log_softmax_ext.h +1 -1
  1916. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/log_softmax_grad.h +1 -1
  1917. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/logaddexp.h +1 -1
  1918. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/logaddexp2.h +1 -1
  1919. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/logical_and.h +1 -1
  1920. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/logical_not.h +1 -1
  1921. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/logical_or.h +1 -1
  1922. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/logical_xor.h +1 -1
  1923. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/logsigmoid.h +1 -1
  1924. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/logsigmoid_grad.h +1 -1
  1925. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/logsumexp.h +1 -1
  1926. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/masked_fill.h +1 -1
  1927. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/masked_scatter.h +40 -0
  1928. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/masked_select.h +1 -1
  1929. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/masked_select_grad.h +1 -1
  1930. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/matmul.h +1 -1
  1931. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/matmul_allreduce_add_rmsnorm.h +1 -1
  1932. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/matmul_ext.h +1 -1
  1933. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/matmul_reduce_scatter.h +1 -1
  1934. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/matrix_inverse_ext.h +1 -1
  1935. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/max.h +1 -1
  1936. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/max_dim.h +1 -1
  1937. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/max_pool_grad_with_indices.h +1 -1
  1938. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/max_pool_grad_with_mask.h +1 -1
  1939. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/max_pool_with_indices.h +1 -1
  1940. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/max_pool_with_mask.h +1 -1
  1941. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/max_unpool2d_ext.h +1 -1
  1942. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/maximum.h +1 -1
  1943. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/mean_ext.h +1 -1
  1944. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/median_dim.h +1 -1
  1945. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/median_ext.h +1 -1
  1946. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/meshgrid.h +1 -1
  1947. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/min.h +1 -1
  1948. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/min_dim.h +1 -1
  1949. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/minimum.h +1 -1
  1950. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/mish_ext.h +1 -1
  1951. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/mish_grad_ext.h +1 -1
  1952. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/mla.h +40 -0
  1953. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/mm_ext.h +1 -1
  1954. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/moe_compute_expert_tokens.h +1 -1
  1955. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/moe_distribute_combine.h +40 -0
  1956. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/moe_distribute_dispatch.h +40 -0
  1957. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/moe_finalize_routing.h +1 -1
  1958. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/moe_gating_top_k_softmax.h +1 -1
  1959. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/moe_init_routing.h +1 -1
  1960. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/moe_init_routing_quant_v2.h +40 -0
  1961. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/moe_init_routing_v2.h +1 -1
  1962. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/moe_token_permute.h +1 -1
  1963. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/moe_token_permute_grad.h +1 -1
  1964. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/moe_token_unpermute.h +1 -1
  1965. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/moe_token_unpermute_grad.h +1 -1
  1966. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/mse_loss_ext.h +1 -1
  1967. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/mse_loss_grad_ext.h +1 -1
  1968. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/mul.h +1 -1
  1969. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/muls.h +1 -1
  1970. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/multi_scale_deformable_attn.h +1 -1
  1971. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/multi_scale_deformable_attn_grad.h +1 -1
  1972. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/multinomial_ext.h +1 -1
  1973. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/mv.h +1 -1
  1974. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/nan_to_num.h +1 -1
  1975. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/nansum.h +1 -1
  1976. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/narrow.h +1 -1
  1977. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/narrow_view.h +1 -1
  1978. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/ne_scalar.h +1 -1
  1979. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/neg.h +1 -1
  1980. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/new_empty.h +40 -0
  1981. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/new_full.h +40 -0
  1982. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/new_ones.h +1 -1
  1983. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/new_zeros.h +1 -1
  1984. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/nllloss.h +1 -1
  1985. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/nllloss_2d.h +1 -1
  1986. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/nllloss_2d_grad.h +1 -1
  1987. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/nllloss_grad.h +1 -1
  1988. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/non_zero.h +1 -1
  1989. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/non_zero_ext.h +1 -1
  1990. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/norm.h +1 -1
  1991. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/normal_float_float.h +1 -1
  1992. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/normal_float_tensor.h +1 -1
  1993. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/normal_tensor_float.h +1 -1
  1994. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/normal_tensor_tensor.h +1 -1
  1995. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/not_equal.h +1 -1
  1996. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/one_hot_ext.h +1 -1
  1997. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/ones.h +1 -1
  1998. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/ones_like_ext.h +1 -1
  1999. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/outer.h +1 -1
  2000. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/paged_attention.h +40 -0
  2001. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/pixel_shuffle.h +1 -1
  2002. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/polar.h +1 -1
  2003. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/pow.h +1 -1
  2004. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/pow_scalar_tensor.h +1 -1
  2005. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/pow_tensor_scalar.h +1 -1
  2006. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/prelu.h +1 -1
  2007. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/prelu_grad.h +1 -1
  2008. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/prod_ext.h +1 -1
  2009. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/prompt_flash_attention.h +1 -1
  2010. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/quant_batch_matmul.h +1 -1
  2011. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/quant_matmul.h +40 -0
  2012. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/quant_v2.h +1 -1
  2013. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/rand_ext.h +1 -1
  2014. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/rand_like_ext.h +1 -1
  2015. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/randint.h +1 -1
  2016. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/randint_like.h +1 -1
  2017. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/randn.h +1 -1
  2018. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/randn_like.h +1 -1
  2019. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/randperm_ext.h +1 -1
  2020. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/reciprocal.h +1 -1
  2021. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/reduce_all.h +1 -1
  2022. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/reduce_any.h +1 -1
  2023. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/reduce_max.h +1 -1
  2024. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/reduce_min.h +1 -1
  2025. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/reflection_pad_1d.h +1 -1
  2026. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/reflection_pad_1d_grad.h +1 -1
  2027. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/reflection_pad_2d.h +1 -1
  2028. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/reflection_pad_2d_grad.h +1 -1
  2029. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/reflection_pad_3d.h +1 -1
  2030. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/reflection_pad_3d_grad.h +1 -1
  2031. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/relu.h +1 -1
  2032. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/relu_grad.h +1 -1
  2033. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/remainder_scalar_tensor.h +1 -1
  2034. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/remainder_tensor_scalar.h +1 -1
  2035. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/remainder_tensor_tensor.h +1 -1
  2036. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/repeat.h +1 -1
  2037. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/repeat_interleave_grad.h +1 -1
  2038. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/repeat_interleave_int.h +1 -1
  2039. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/repeat_interleave_tensor.h +1 -1
  2040. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/replication_pad_1d.h +1 -1
  2041. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/replication_pad_1d_grad.h +1 -1
  2042. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/replication_pad_2d.h +1 -1
  2043. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/replication_pad_2d_grad.h +1 -1
  2044. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/replication_pad_3d.h +1 -1
  2045. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/replication_pad_3d_grad.h +1 -1
  2046. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/reshape.h +1 -1
  2047. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/reshape_and_cache.h +40 -0
  2048. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/reverse_v2.h +1 -1
  2049. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/ring_attention_update.h +40 -0
  2050. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/rms_norm.h +1 -1
  2051. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/rms_norm_grad.h +1 -1
  2052. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/roll.h +1 -1
  2053. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/rotary_position_embedding.h +1 -1
  2054. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/rotary_position_embedding_grad.h +1 -1
  2055. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/round.h +1 -1
  2056. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/rsqrt.h +1 -1
  2057. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/scatter.h +1 -1
  2058. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/scatter_add_ext.h +1 -1
  2059. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/scatter_value.h +1 -1
  2060. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/searchsorted.h +1 -1
  2061. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/select.h +1 -1
  2062. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/select_ext_view.h +1 -1
  2063. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/select_v2.h +1 -1
  2064. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/selu_ext.h +1 -1
  2065. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/selu_grad.h +1 -1
  2066. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/sigmoid.h +1 -1
  2067. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/sigmoid_grad.h +1 -1
  2068. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/sign.h +1 -1
  2069. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/silent_check_v2.h +1 -1
  2070. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/silent_check_v3.h +1 -1
  2071. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/silu.h +1 -1
  2072. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/silu_grad.h +1 -1
  2073. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/sin.h +1 -1
  2074. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/sinc.h +1 -1
  2075. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/sinh.h +1 -1
  2076. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/slice.h +1 -1
  2077. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/slice_ext.h +1 -1
  2078. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/slice_ext_view.h +1 -1
  2079. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/smooth_l1_loss.h +1 -1
  2080. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/smooth_l1_loss_grad.h +1 -1
  2081. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/soft_margin_loss.h +1 -1
  2082. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/soft_margin_loss_grad.h +1 -1
  2083. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/softmax.h +1 -1
  2084. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/softmax_backward.h +1 -1
  2085. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/softplus_ext.h +1 -1
  2086. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/softplus_grad_ext.h +1 -1
  2087. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/softshrink.h +1 -1
  2088. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/softshrink_grad.h +1 -1
  2089. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/sort_ext.h +1 -1
  2090. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/speed_fusion_attention.h +1 -1
  2091. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/speed_fusion_attention_grad.h +1 -1
  2092. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/split.h +1 -1
  2093. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/split_tensor.h +1 -1
  2094. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/split_tensor_view.h +1 -1
  2095. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/split_with_size.h +1 -1
  2096. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/split_with_size_view.h +1 -1
  2097. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/sqrt.h +1 -1
  2098. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/square.h +1 -1
  2099. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/squeeze.h +1 -1
  2100. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/stack_ext.h +1 -1
  2101. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/std.h +1 -1
  2102. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/std_mean.h +1 -1
  2103. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/sub.h +1 -1
  2104. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/sub_ext.h +1 -1
  2105. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/sub_scalar.h +1 -1
  2106. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/sum_ext.h +1 -1
  2107. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/swiglu.h +1 -1
  2108. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/swiglu_grad.h +1 -1
  2109. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/t_ext.h +1 -1
  2110. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/take.h +1 -1
  2111. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/tan.h +1 -1
  2112. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/tanh.h +1 -1
  2113. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/tanh_grad.h +1 -1
  2114. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/tensor_scatter_elements.h +1 -1
  2115. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/threshold.h +1 -1
  2116. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/threshold_grad.h +1 -1
  2117. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/tile.h +1 -1
  2118. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/topk_ext.h +1 -1
  2119. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/trace_ext.h +1 -1
  2120. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/transpose.h +1 -1
  2121. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/transpose_ext_view.h +1 -1
  2122. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/transpose_view.h +1 -1
  2123. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/triangular_solve.h +1 -1
  2124. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/tril_ext.h +1 -1
  2125. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/triu.h +1 -1
  2126. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/trunc.h +1 -1
  2127. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/type_as.h +1 -1
  2128. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/uniform_ext.h +1 -1
  2129. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/unique2.h +1 -1
  2130. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/unique_consecutive.h +1 -1
  2131. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/unique_dim.h +1 -1
  2132. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/unstack_ext_view.h +1 -1
  2133. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/upsample_bicubic2d.h +1 -1
  2134. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/upsample_bicubic2d_grad.h +1 -1
  2135. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/upsample_bilinear2d.h +1 -1
  2136. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/upsample_bilinear2d_grad.h +1 -1
  2137. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/upsample_linear1d.h +1 -1
  2138. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/upsample_linear1d_grad.h +1 -1
  2139. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/upsample_nearest1d.h +1 -1
  2140. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/upsample_nearest1d_grad.h +1 -1
  2141. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/upsample_nearest2d.h +1 -1
  2142. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/upsample_nearest2d_grad.h +1 -1
  2143. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/upsample_nearest3d.h +1 -1
  2144. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/upsample_nearest3d_grad.h +1 -1
  2145. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/upsample_trilinear3d.h +1 -1
  2146. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/upsample_trilinear3d_grad.h +1 -1
  2147. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/var.h +1 -1
  2148. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/var_mean.h +1 -1
  2149. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/view.h +1 -1
  2150. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/view_as.h +1 -1
  2151. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/weight_quant_batch_matmul.h +1 -1
  2152. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/xlogy.h +1 -1
  2153. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/xlogy_scalar_other.h +1 -1
  2154. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/xlogy_scalar_self.h +1 -1
  2155. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/zeros.h +1 -1
  2156. mindspore/include/mindspore/ops/kernel/ascend/pyboost/auto_generate/zeros_like_ext.h +1 -1
  2157. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/adamw.h +5 -5
  2158. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/adaptive_avg_pool1d.h +2 -3
  2159. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/adaptive_avg_pool3d_ext.h +2 -3
  2160. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/adaptive_max_pool1d.h +3 -2
  2161. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/adaptive_max_pool2d.h +3 -2
  2162. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/add.h +2 -2
  2163. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/add_layernorm_v2.h +3 -3
  2164. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/add_rms_norm.h +3 -3
  2165. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/add_rmsnorm_quant_v2.h +3 -3
  2166. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/add_scalar.h +2 -2
  2167. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/addbmm.h +3 -3
  2168. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/addmm.h +3 -3
  2169. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/addmv.h +3 -3
  2170. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/all_finite.h +2 -2
  2171. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/all_gather_matmul.h +3 -3
  2172. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/any.h +34 -0
  2173. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/any_ext.h +35 -0
  2174. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/arange.h +3 -3
  2175. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/argmax_ext.h +2 -2
  2176. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/argmax_with_value.h +4 -3
  2177. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/argmin_ext.h +2 -2
  2178. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/argmin_with_value.h +4 -3
  2179. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/argsort.h +3 -3
  2180. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/avg_pool1d.h +4 -4
  2181. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/avg_pool2d.h +5 -5
  2182. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/avg_pool2d_grad.h +5 -5
  2183. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/avg_pool3d_ext.h +6 -6
  2184. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/avg_pool3d_grad_ext.h +6 -6
  2185. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/baddbmm.h +3 -3
  2186. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/batch_mat_mul.h +3 -3
  2187. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/batch_norm_elemt.h +5 -7
  2188. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/batch_norm_ext.h +6 -5
  2189. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/batch_norm_gather_stats_with_counts.h +5 -5
  2190. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/batch_norm_grad_ext.h +6 -6
  2191. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/batch_norm_stats.h +3 -2
  2192. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/bernoulli_ext.h +2 -3
  2193. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/binary_cross_entropy.h +4 -5
  2194. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/binary_cross_entropy_grad.h +5 -6
  2195. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/binary_cross_entropy_with_logits.h +6 -6
  2196. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/binary_cross_entropy_with_logits_backward.h +4 -4
  2197. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/bincount_ext.h +3 -3
  2198. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/bmm_ext.h +2 -3
  2199. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/cell_backward_hook.h +27 -0
  2200. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/clone.h +1 -1
  2201. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/contiguous.h +1 -1
  2202. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/conv1d_ext.h +4 -5
  2203. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/conv1d_padding.h +5 -6
  2204. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/conv2d_ext.h +4 -5
  2205. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/conv2d_padding.h +5 -6
  2206. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/conv3d_ext.h +4 -5
  2207. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/conv3d_padding.h +5 -6
  2208. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/conv_transpose2d.h +6 -4
  2209. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/convolution.h +6 -6
  2210. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/convolution_grad.h +3 -3
  2211. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/convolution_str.h +6 -7
  2212. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/copy.h +1 -1
  2213. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/count_nonzero.h +2 -3
  2214. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/cross.h +2 -2
  2215. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/cross_entropy_loss.h +37 -0
  2216. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/cross_entropy_loss_grad.h +38 -0
  2217. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/cummax.h +3 -3
  2218. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/cummin_ext.h +3 -3
  2219. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/cumsum_ext.h +2 -2
  2220. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/custom_ext.h +2 -2
  2221. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/custom_kernel.h +3 -3
  2222. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/custom_launch_aclnn.h +1 -1
  2223. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/dense.h +2 -2
  2224. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/diag_ext.h +2 -2
  2225. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/divmod.h +2 -3
  2226. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/divmods.h +2 -2
  2227. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/divs.h +2 -2
  2228. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/dropout_do_mask_ext.h +2 -2
  2229. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/dropout_ext.h +2 -3
  2230. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/dropout_gen_mask_ext.h +3 -3
  2231. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/dropout_grad_ext.h +2 -2
  2232. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/einsum_ext.h +36 -0
  2233. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/elu_ext.h +2 -2
  2234. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/elu_grad_ext.h +3 -3
  2235. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/embedding.h +4 -5
  2236. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/embedding_dense_backward.h +5 -3
  2237. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/empty.h +35 -0
  2238. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/empty_like.h +36 -0
  2239. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/eye.h +2 -2
  2240. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/ffn_ext.h +8 -8
  2241. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/fill_scalar.h +2 -2
  2242. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/fill_tensor.h +2 -3
  2243. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/flash_attention_score.h +4 -4
  2244. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/flash_attention_score_grad.h +6 -6
  2245. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/flatten_ext.h +1 -1
  2246. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/floor_div.h +2 -2
  2247. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/floor_div_scalar.h +2 -2
  2248. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/full_like.h +2 -2
  2249. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/func_dropout_ext.h +38 -0
  2250. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/func_max_pool2d.h +38 -0
  2251. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/fused_infer_attention_score.h +15 -18
  2252. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/gather_d_grad_v2.h +2 -3
  2253. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/gelu_grad.h +2 -2
  2254. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/gelu_grad_ext.h +2 -2
  2255. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/gmm_v2.h +1 -1
  2256. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/gmm_v2_backward.h +1 -1
  2257. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/gmm_v2_backward_fusion.h +1 -2
  2258. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/grid_sampler_2d_grad.h +3 -3
  2259. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/grid_sampler_3d_grad.h +3 -3
  2260. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/group_norm.h +3 -3
  2261. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/group_norm_grad.h +3 -3
  2262. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/grouped_matmul.h +1 -1
  2263. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/grouped_matmul_v4.h +1 -1
  2264. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/hshrink.h +2 -2
  2265. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/hshrink_grad.h +2 -3
  2266. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/identity.h +1 -1
  2267. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/incre_flash_attention.h +11 -11
  2268. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/index.h +2 -2
  2269. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/index_add_ext.h +3 -3
  2270. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/index_fill_scalar.h +3 -3
  2271. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/index_fill_tensor.h +3 -3
  2272. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inner_index.h +2 -2
  2273. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inner_inplace_index_put.h +4 -5
  2274. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inner_moe_token_unpermute.h +39 -0
  2275. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inner_non_zero.h +1 -2
  2276. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_add_ext.h +2 -3
  2277. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_addmm.h +3 -4
  2278. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_adds_ext.h +2 -3
  2279. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_bernoulli_scalar.h +35 -0
  2280. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_bernoulli_tensor.h +35 -0
  2281. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_clamp_scalar.h +3 -4
  2282. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_clamp_tensor.h +3 -4
  2283. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_copy.h +2 -3
  2284. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_div.h +2 -2
  2285. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_divmod.h +3 -3
  2286. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_divmods.h +3 -3
  2287. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_divs.h +2 -2
  2288. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_elu.h +2 -2
  2289. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_erfinv.h +1 -2
  2290. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_exp.h +1 -1
  2291. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_exponential.h +3 -3
  2292. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_fill_diagonal.h +2 -3
  2293. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_fill_scalar.h +2 -2
  2294. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_fill_tensor.h +2 -2
  2295. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_floor.h +1 -2
  2296. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_floor_divide.h +2 -3
  2297. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_floor_divides.h +2 -2
  2298. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_grouped_matmul_add.h +3 -3
  2299. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_hardtanh.h +2 -3
  2300. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_index_add.h +3 -4
  2301. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_index_put.h +3 -4
  2302. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_log.h +1 -1
  2303. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_masked_fill_scalar.h +2 -3
  2304. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_masked_fill_tensor.h +2 -3
  2305. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_matmul_add.h +34 -0
  2306. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_mul.h +2 -2
  2307. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_muls.h +2 -2
  2308. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_normal.h +3 -3
  2309. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_put.h +3 -3
  2310. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_random.h +3 -4
  2311. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_relu.h +1 -2
  2312. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_remainder_tensor_scalar.h +34 -0
  2313. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_remainder_tensor_tensor.h +35 -0
  2314. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_scatter_add.h +3 -4
  2315. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_scatter_src.h +3 -4
  2316. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_scatter_src_reduce.h +4 -5
  2317. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_scatter_value.h +3 -3
  2318. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_scatter_value_reduce.h +4 -5
  2319. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_silu.h +35 -0
  2320. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_stop_gradient.h +1 -1
  2321. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_sub_ext.h +2 -3
  2322. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_sub_scalar.h +2 -3
  2323. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_tanh.h +1 -2
  2324. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_threshold.h +2 -3
  2325. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_uniform.h +3 -4
  2326. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/inplace_zero.h +1 -2
  2327. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/isclose.h +3 -3
  2328. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/isinf.h +1 -1
  2329. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/kl_div.h +3 -3
  2330. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/kl_div_grad.h +3 -6
  2331. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/kv_cache_scatter_update.h +3 -5
  2332. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/l1_loss_backward_ext.h +3 -5
  2333. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/l1_loss_ext.h +2 -2
  2334. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/layer_norm_ext.h +3 -3
  2335. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/layer_norm_grad_ext.h +4 -4
  2336. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/lerp.h +2 -2
  2337. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/lerp_scalar.h +2 -2
  2338. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/lin_space_ext.h +3 -3
  2339. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/linalg_qr.h +1 -2
  2340. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/linalg_vector_norm.h +1 -1
  2341. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/log_softmax_ext.h +3 -4
  2342. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/log_softmax_grad.h +2 -3
  2343. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/masked_fill.h +2 -2
  2344. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/masked_scatter.h +35 -0
  2345. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/masked_select.h +2 -2
  2346. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/masked_select_grad.h +2 -4
  2347. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/matmul.h +3 -3
  2348. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/matmul_allreduce_add_rmsnorm.h +3 -3
  2349. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/matmul_ext.h +2 -2
  2350. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/matmul_reduce_scatter.h +5 -4
  2351. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/max_pool_grad_with_indices.h +6 -7
  2352. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/max_pool_grad_with_mask.h +6 -6
  2353. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/max_pool_with_indices.h +5 -5
  2354. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/max_pool_with_mask.h +4 -5
  2355. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/max_unpool2d_ext.h +6 -6
  2356. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/mean_ext.h +3 -3
  2357. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/meshgrid.h +4 -3
  2358. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/mm_ext.h +2 -2
  2359. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/moe_distribute_combine.h +45 -0
  2360. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/moe_distribute_dispatch.h +41 -0
  2361. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/moe_token_permute.h +2 -2
  2362. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/moe_token_unpermute.h +4 -6
  2363. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/moe_token_unpermute_grad.h +3 -4
  2364. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/move_to.h +2 -2
  2365. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/mse_loss_ext.h +2 -2
  2366. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/mse_loss_grad_ext.h +3 -4
  2367. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/muls.h +2 -2
  2368. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/multi_scale_deformable_attn.h +5 -3
  2369. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/multi_scale_deformable_attn_grad.h +4 -6
  2370. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/multinomial_ext.h +3 -4
  2371. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/mv.h +2 -2
  2372. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/nan_to_num.h +3 -4
  2373. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/nansum.h +3 -3
  2374. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/ne_scalar.h +2 -2
  2375. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/new_empty.h +36 -0
  2376. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/new_full.h +36 -0
  2377. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/new_ones.h +2 -2
  2378. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/new_zeros.h +1 -1
  2379. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/nllloss.h +3 -3
  2380. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/nllloss_2d.h +3 -3
  2381. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/nllloss_2d_grad.h +4 -4
  2382. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/nllloss_grad.h +4 -6
  2383. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/non_zero.h +1 -1
  2384. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/non_zero_ext.h +2 -2
  2385. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/norm.h +1 -1
  2386. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/normal_float_float.h +3 -3
  2387. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/normal_float_tensor.h +3 -3
  2388. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/normal_tensor_float.h +3 -3
  2389. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/normal_tensor_tensor.h +3 -4
  2390. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/one_hot_ext.h +3 -3
  2391. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/ones.h +2 -2
  2392. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/ones_like_ext.h +2 -2
  2393. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/outer.h +2 -2
  2394. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/pixel_shuffle.h +2 -2
  2395. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/pow_scalar_tensor.h +2 -2
  2396. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/pow_tensor_scalar.h +2 -3
  2397. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/prod_ext.h +3 -3
  2398. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/prompt_flash_attention.h +7 -7
  2399. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/quant_batch_matmul.h +7 -7
  2400. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/quant_matmul.h +41 -0
  2401. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/quant_v2.h +3 -3
  2402. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/rand_ext.h +3 -3
  2403. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/rand_like_ext.h +3 -3
  2404. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/randint.h +3 -4
  2405. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/randint_like.h +3 -4
  2406. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/randn.h +3 -3
  2407. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/randn_like.h +3 -3
  2408. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/randperm_ext.h +3 -3
  2409. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/reduce_all.h +2 -2
  2410. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/relu_grad.h +2 -2
  2411. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/repeat_interleave_grad.h +3 -3
  2412. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/repeat_interleave_int.h +3 -4
  2413. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/repeat_interleave_tensor.h +4 -5
  2414. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/reshape.h +4 -2
  2415. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/ring_attention_update.h +38 -0
  2416. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/rms_norm.h +4 -4
  2417. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/rotary_position_embedding_grad.h +3 -3
  2418. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/round.h +2 -2
  2419. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/scatter_add_ext.h +3 -3
  2420. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/searchsorted.h +3 -4
  2421. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/sigmoid_grad.h +2 -2
  2422. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/silent_check_v2.h +5 -5
  2423. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/silent_check_v3.h +6 -4
  2424. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/smooth_l1_loss.h +3 -4
  2425. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/smooth_l1_loss_grad.h +4 -5
  2426. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/soft_margin_loss.h +2 -3
  2427. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/soft_margin_loss_grad.h +3 -4
  2428. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/softmax.h +2 -2
  2429. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/softshrink.h +2 -2
  2430. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/softshrink_grad.h +2 -3
  2431. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/sort_ext.h +5 -5
  2432. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/speed_fusion_attention.h +4 -4
  2433. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/speed_fusion_attention_grad.h +11 -12
  2434. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/square.h +1 -1
  2435. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/std.h +3 -3
  2436. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/std_mean.h +1 -1
  2437. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/sub.h +2 -2
  2438. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/sub_scalar.h +2 -2
  2439. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/sum_ext.h +3 -3
  2440. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/t_ext.h +1 -1
  2441. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/take.h +2 -2
  2442. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/tanh_grad.h +2 -2
  2443. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/threshold.h +2 -2
  2444. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/threshold_grad.h +2 -2
  2445. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/tile.h +1 -1
  2446. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/type_as.h +2 -2
  2447. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/uniform_ext.h +3 -3
  2448. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/unique2.h +2 -2
  2449. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/unique_consecutive.h +2 -2
  2450. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/unique_dim.h +2 -2
  2451. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/unstack_ext_view.h +4 -3
  2452. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/upsample_bicubic2d.h +4 -5
  2453. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/upsample_bicubic2d_grad.h +5 -6
  2454. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/upsample_bilinear2d.h +4 -5
  2455. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/upsample_bilinear2d_grad.h +6 -6
  2456. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/upsample_linear1d.h +4 -5
  2457. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/upsample_linear1d_grad.h +5 -6
  2458. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/upsample_nearest1d.h +3 -4
  2459. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/upsample_nearest1d_grad.h +4 -5
  2460. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/upsample_nearest2d.h +3 -4
  2461. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/upsample_nearest2d_grad.h +4 -5
  2462. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/upsample_nearest3d.h +3 -4
  2463. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/upsample_nearest3d_grad.h +4 -5
  2464. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/upsample_trilinear3d.h +4 -5
  2465. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/upsample_trilinear3d_grad.h +6 -6
  2466. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/var.h +3 -3
  2467. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/var_mean.h +1 -1
  2468. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/view_as.h +2 -2
  2469. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/weight_quant_batch_matmul.h +5 -5
  2470. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/zeros.h +2 -2
  2471. mindspore/include/mindspore/ops/kernel/ascend/pyboost/customize/zeros_like_ext.h +2 -3
  2472. mindspore/include/mindspore/ops/kernel/ascend/pyboost/internal/auto_generate/apply_rotary_pos_emb.h +40 -0
  2473. mindspore/include/mindspore/ops/kernel/ascend/pyboost/internal/auto_generate/flash_attention_score.h +40 -0
  2474. mindspore/include/mindspore/ops/kernel/ascend/pyboost/internal/auto_generate/mla.h +40 -0
  2475. mindspore/include/mindspore/ops/kernel/ascend/pyboost/internal/auto_generate/paged_attention.h +40 -0
  2476. mindspore/include/mindspore/ops/kernel/ascend/pyboost/internal/auto_generate/reshape_and_cache.h +40 -0
  2477. mindspore/include/mindspore/ops/kernel/ascend/pyboost/internal/functions/functions.h +35 -0
  2478. mindspore/include/mindspore/ops/kernel/cpu/empty_cpu_kernel.h +55 -0
  2479. mindspore/include/mindspore/ops/kernel/cpu/empty_like_cpu_kernel.h +55 -0
  2480. mindspore/include/mindspore/ops/kernel/cpu/grid_sampler_2d_grad_cpu_kernel.h +3 -15
  2481. mindspore/include/mindspore/ops/kernel/cpu/map_tensor/map_tensor_get_data_cpu_kernel.h +1 -1
  2482. mindspore/include/mindspore/ops/kernel/cpu/map_tensor/map_tensor_get_grad_cpu_kernel.h +1 -1
  2483. mindspore/include/mindspore/ops/kernel/cpu/masked_fill_cpu_kernel.h +1 -0
  2484. mindspore/include/mindspore/ops/kernel/cpu/multi_margin_loss_cpu_kernel.h +6 -6
  2485. mindspore/include/mindspore/ops/kernel/cpu/new_empty_cpu_kernel.h +55 -0
  2486. mindspore/include/mindspore/ops/kernel/cpu/nnacl/intrinsics/ms_simd_avx512_instructions.h +0 -3
  2487. mindspore/include/mindspore/ops/kernel/cpu/nnacl/intrinsics/ms_simd_avx_instructions.h +0 -3
  2488. mindspore/include/mindspore/ops/kernel/cpu/nnacl/intrinsics/ms_simd_sse_instructions.h +0 -3
  2489. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/abs.h +1 -1
  2490. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/acos_ext.h +38 -0
  2491. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/adaptive_avg_pool1d.h +1 -1
  2492. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/adaptive_avg_pool2d_grad_ext.h +1 -1
  2493. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/adaptive_avg_pool3d_grad_ext.h +1 -1
  2494. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/adaptive_max_pool1d.h +1 -1
  2495. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/adaptive_max_pool2d.h +1 -1
  2496. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/add.h +1 -1
  2497. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/add_ext.h +1 -1
  2498. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/add_layer_norm_grad.h +1 -1
  2499. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/add_rmsnorm_quant_v2.h +1 -1
  2500. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/add_scalar.h +1 -1
  2501. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/addcdiv_ext.h +1 -1
  2502. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/addcmul_ext.h +1 -1
  2503. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/any.h +38 -0
  2504. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/any_ext.h +38 -0
  2505. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/apply_rotary_pos_emb.h +38 -0
  2506. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/argmax_with_value.h +1 -1
  2507. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/argmin_with_value.h +1 -1
  2508. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/argsort.h +1 -1
  2509. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/as_strided.h +1 -1
  2510. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/atan_ext.h +38 -0
  2511. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/atanh.h +1 -1
  2512. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/avg_pool1d.h +1 -1
  2513. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/avg_pool2d.h +1 -1
  2514. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/avg_pool2d_grad.h +1 -1
  2515. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/avg_pool3d_ext.h +1 -1
  2516. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/avg_pool3d_grad_ext.h +1 -1
  2517. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/baddbmm.h +1 -1
  2518. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/batch_mat_mul.h +1 -1
  2519. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/batch_norm_elemt.h +1 -1
  2520. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/batch_norm_elemt_grad.h +1 -1
  2521. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/batch_norm_gather_stats_with_counts.h +1 -1
  2522. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/batch_norm_reduce_grad.h +1 -1
  2523. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/batch_norm_stats.h +1 -1
  2524. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/bernoulli_ext.h +1 -1
  2525. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/binary_cross_entropy.h +1 -1
  2526. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/binary_cross_entropy_grad.h +1 -1
  2527. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/binary_cross_entropy_with_logits.h +1 -1
  2528. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/binary_cross_entropy_with_logits_backward.h +1 -1
  2529. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/bitwise_and_scalar.h +1 -1
  2530. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/bitwise_and_tensor.h +1 -1
  2531. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/bitwise_not.h +1 -1
  2532. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/bitwise_or_scalar.h +1 -1
  2533. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/bitwise_or_tensor.h +1 -1
  2534. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/bitwise_xor_scalar.h +1 -1
  2535. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/bitwise_xor_tensor.h +1 -1
  2536. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/bmm_ext.h +1 -1
  2537. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/broadcast_to.h +1 -1
  2538. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/broadcast_to_view.h +1 -1
  2539. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/cast.h +1 -1
  2540. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/ceil.h +1 -1
  2541. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/cell_backward_hook.h +38 -0
  2542. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/chunk.h +1 -1
  2543. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/chunk_view.h +1 -1
  2544. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/clamp_scalar.h +1 -1
  2545. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/clamp_tensor.h +1 -1
  2546. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/clone.h +1 -1
  2547. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/col2im_ext.h +1 -1
  2548. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/col2im_grad.h +1 -1
  2549. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/concat.h +1 -1
  2550. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/constant_pad_nd.h +1 -1
  2551. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/contiguous.h +1 -1
  2552. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/conv1d_padding.h +1 -1
  2553. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/conv2d_ext.h +1 -1
  2554. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/conv2d_padding.h +1 -1
  2555. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/conv3d_padding.h +1 -1
  2556. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/conv_transpose2d.h +1 -1
  2557. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/convolution.h +1 -1
  2558. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/convolution_grad.h +1 -1
  2559. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/convolution_str.h +1 -1
  2560. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/convolution_str_grad.h +1 -1
  2561. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/copy.h +1 -1
  2562. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/cos.h +1 -1
  2563. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/cosh.h +1 -1
  2564. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/count_nonzero.h +1 -1
  2565. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/cross.h +1 -1
  2566. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/cross_entropy_loss.h +38 -0
  2567. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/cross_entropy_loss_grad.h +38 -0
  2568. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/cummax.h +1 -1
  2569. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dense.h +1 -1
  2570. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/diag_ext.h +1 -1
  2571. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/diagonal_view.h +38 -0
  2572. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_all_gather.h +1 -1
  2573. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_all_gather_into_tensor.h +1 -1
  2574. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_all_gather_into_tensor_uneven.h +38 -0
  2575. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_all_reduce.h +1 -1
  2576. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_all_to_all_v.h +1 -1
  2577. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_all_to_all_v_single.h +1 -1
  2578. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_barrier.h +1 -1
  2579. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_batch_isend_irecv.h +1 -1
  2580. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_broadcast.h +1 -1
  2581. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_gather.h +1 -1
  2582. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_gather_into_tensor.h +1 -1
  2583. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_irecv.h +1 -1
  2584. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_isend.h +1 -1
  2585. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_reduce.h +1 -1
  2586. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_reduce_scatter.h +1 -1
  2587. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_reduce_scatter_tensor.h +1 -1
  2588. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_reduce_scatter_tensor_uneven.h +38 -0
  2589. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_scatter.h +1 -1
  2590. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dist_comm_scatter_tensor.h +1 -1
  2591. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/div.h +1 -1
  2592. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/divmod.h +1 -1
  2593. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/divmods.h +1 -1
  2594. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/divs.h +1 -1
  2595. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dot.h +1 -1
  2596. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/dynamic_quant_ext.h +1 -1
  2597. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/einsum_ext.h +38 -0
  2598. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/elu.h +1 -1
  2599. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/embedding.h +1 -1
  2600. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/embedding_dense_backward.h +1 -1
  2601. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/empty.h +38 -0
  2602. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/empty_like.h +38 -0
  2603. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/equal.h +1 -1
  2604. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/equal_ext.h +1 -1
  2605. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/erf.h +1 -1
  2606. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/erfc.h +1 -1
  2607. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/erfinv.h +1 -1
  2608. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/exp.h +1 -1
  2609. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/exp2.h +1 -1
  2610. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/expand_dims.h +1 -1
  2611. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/expand_dims_view.h +1 -1
  2612. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/expm1.h +1 -1
  2613. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/eye.h +1 -1
  2614. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/ffn_ext.h +1 -1
  2615. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/floor.h +1 -1
  2616. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/floor_div.h +1 -1
  2617. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/floor_div_scalar.h +1 -1
  2618. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/fmod_tensor.h +1 -1
  2619. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/frac.h +1 -1
  2620. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/full_like.h +1 -1
  2621. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/func_dropout_ext.h +38 -0
  2622. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/fused_infer_attention_score.h +1 -1
  2623. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/gather_d.h +1 -1
  2624. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/gather_d_grad_v2.h +1 -1
  2625. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/gcd.h +1 -1
  2626. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/gelu.h +1 -1
  2627. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/gelu_ext.h +1 -1
  2628. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/gelu_grad.h +1 -1
  2629. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/gelu_grad_ext.h +1 -1
  2630. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/generator.h +1 -1
  2631. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/glu.h +1 -1
  2632. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/glu_grad.h +1 -1
  2633. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/greater.h +1 -1
  2634. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/greater_equal.h +1 -1
  2635. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/greater_equal_scalar.h +1 -1
  2636. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/grid_sampler_2d.h +1 -1
  2637. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/grid_sampler_2d_grad.h +1 -1
  2638. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/grid_sampler_3d.h +1 -1
  2639. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/grid_sampler_3d_grad.h +1 -1
  2640. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/group_norm.h +1 -1
  2641. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/group_norm_grad.h +1 -1
  2642. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/grouped_matmul.h +1 -1
  2643. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/grouped_matmul_v2.h +1 -1
  2644. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/grouped_matmul_v4.h +1 -1
  2645. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/hardtanh.h +1 -1
  2646. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/hardtanh_grad.h +1 -1
  2647. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/hshrink.h +1 -1
  2648. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/hshrink_grad.h +1 -1
  2649. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/hsigmoid.h +1 -1
  2650. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/hsigmoid_grad.h +1 -1
  2651. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/hswish.h +1 -1
  2652. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/hswish_grad.h +1 -1
  2653. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/identity.h +1 -1
  2654. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/im2col_ext.h +1 -1
  2655. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/incre_flash_attention.h +1 -1
  2656. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/index.h +1 -1
  2657. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/index_add_ext.h +1 -1
  2658. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/index_fill_scalar.h +1 -1
  2659. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/index_fill_tensor.h +1 -1
  2660. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inner_comm_all_gather.h +1 -1
  2661. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inner_comm_all_reduce.h +1 -1
  2662. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inner_comm_all_to_all_v.h +1 -1
  2663. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inner_comm_irecv.h +1 -1
  2664. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inner_comm_isend.h +1 -1
  2665. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inner_comm_reduce_scatter.h +1 -1
  2666. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inner_index.h +1 -1
  2667. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inner_inplace_index_put.h +1 -1
  2668. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inner_moe_token_unpermute.h +38 -0
  2669. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inner_non_zero.h +1 -1
  2670. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_addmm.h +1 -1
  2671. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_bernoulli_scalar.h +38 -0
  2672. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_bernoulli_tensor.h +38 -0
  2673. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_clamp_scalar.h +1 -1
  2674. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_clamp_tensor.h +1 -1
  2675. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_copy.h +1 -1
  2676. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_div.h +1 -1
  2677. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_divmod.h +1 -1
  2678. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_divmods.h +1 -1
  2679. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_divs.h +1 -1
  2680. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_elu.h +1 -1
  2681. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_erfinv.h +1 -1
  2682. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_exponential.h +1 -1
  2683. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_fill_diagonal.h +1 -1
  2684. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_fill_scalar.h +1 -1
  2685. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_fill_tensor.h +1 -1
  2686. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_floor.h +1 -1
  2687. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_floor_divide.h +1 -1
  2688. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_floor_divides.h +1 -1
  2689. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_grouped_matmul_add.h +1 -1
  2690. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_hardtanh.h +1 -1
  2691. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_index_add.h +1 -1
  2692. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_index_put.h +1 -1
  2693. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_log.h +1 -1
  2694. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_masked_fill_scalar.h +1 -1
  2695. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_masked_fill_tensor.h +1 -1
  2696. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_matmul_add.h +38 -0
  2697. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_mul.h +1 -1
  2698. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_muls.h +1 -1
  2699. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_normal.h +1 -1
  2700. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_put.h +1 -1
  2701. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_random.h +1 -1
  2702. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_relu.h +1 -1
  2703. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_remainder_tensor_scalar.h +38 -0
  2704. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_remainder_tensor_tensor.h +38 -0
  2705. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_scatter_add.h +1 -1
  2706. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_scatter_src.h +1 -1
  2707. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_scatter_src_reduce.h +1 -1
  2708. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_scatter_value.h +1 -1
  2709. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_scatter_value_reduce.h +1 -1
  2710. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_silu.h +38 -0
  2711. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_sub_scalar.h +1 -1
  2712. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_tanh.h +1 -1
  2713. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_threshold.h +1 -1
  2714. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_uniform.h +1 -1
  2715. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/inplace_zero.h +1 -1
  2716. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/isclose.h +1 -1
  2717. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/isfinite.h +1 -1
  2718. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/isinf.h +1 -1
  2719. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/isneginf.h +1 -1
  2720. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/kl_div.h +1 -1
  2721. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/kl_div_grad.h +1 -1
  2722. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/kthvalue.h +1 -1
  2723. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/kv_cache_scatter_update.h +1 -1
  2724. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/layer_norm_ext.h +1 -1
  2725. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/leaky_relu_ext.h +1 -1
  2726. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/leaky_relu_grad_ext.h +1 -1
  2727. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/lerp.h +1 -1
  2728. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/lerp_scalar.h +1 -1
  2729. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/less.h +1 -1
  2730. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/less_equal.h +1 -1
  2731. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/linalg_qr.h +1 -1
  2732. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/linalg_vector_norm.h +1 -1
  2733. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/log.h +1 -1
  2734. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/log1p.h +1 -1
  2735. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/log_softmax.h +1 -1
  2736. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/log_softmax_grad.h +1 -1
  2737. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/logaddexp.h +1 -1
  2738. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/logaddexp2.h +1 -1
  2739. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/logical_and.h +1 -1
  2740. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/logical_not.h +1 -1
  2741. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/logical_or.h +1 -1
  2742. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/logical_xor.h +1 -1
  2743. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/logsigmoid.h +1 -1
  2744. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/logsigmoid_grad.h +1 -1
  2745. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/logsumexp.h +1 -1
  2746. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/masked_fill.h +1 -1
  2747. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/masked_scatter.h +38 -0
  2748. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/masked_select.h +1 -1
  2749. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/masked_select_grad.h +1 -1
  2750. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/matmul.h +1 -1
  2751. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/matmul_allreduce_add_rmsnorm.h +1 -1
  2752. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/matmul_ext.h +1 -1
  2753. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/max.h +1 -1
  2754. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/max_dim.h +1 -1
  2755. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/maximum.h +1 -1
  2756. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/mean_ext.h +1 -1
  2757. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/median_dim.h +1 -1
  2758. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/median_ext.h +1 -1
  2759. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/meshgrid.h +1 -1
  2760. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/min.h +1 -1
  2761. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/min_dim.h +1 -1
  2762. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/minimum.h +1 -1
  2763. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/mish_ext.h +1 -1
  2764. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/mish_grad_ext.h +1 -1
  2765. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/mla.h +38 -0
  2766. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/moe_compute_expert_tokens.h +1 -1
  2767. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/moe_distribute_combine.h +38 -0
  2768. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/moe_distribute_dispatch.h +38 -0
  2769. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/moe_finalize_routing.h +1 -1
  2770. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/moe_gating_top_k_softmax.h +1 -1
  2771. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/moe_init_routing.h +1 -1
  2772. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/moe_init_routing_quant_v2.h +38 -0
  2773. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/moe_init_routing_v2.h +1 -1
  2774. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/moe_token_permute.h +1 -1
  2775. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/moe_token_permute_grad.h +1 -1
  2776. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/moe_token_unpermute.h +1 -1
  2777. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/moe_token_unpermute_grad.h +1 -1
  2778. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/mul.h +1 -1
  2779. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/muls.h +1 -1
  2780. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/multi_scale_deformable_attn.h +1 -1
  2781. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/multi_scale_deformable_attn_grad.h +1 -1
  2782. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/mv.h +1 -1
  2783. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/nan_to_num.h +1 -1
  2784. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/ne_scalar.h +1 -1
  2785. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/neg.h +1 -1
  2786. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/new_empty.h +38 -0
  2787. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/new_full.h +38 -0
  2788. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/new_ones.h +1 -1
  2789. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/new_zeros.h +1 -1
  2790. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/nllloss.h +1 -1
  2791. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/nllloss_2d.h +1 -1
  2792. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/nllloss_2d_grad.h +1 -1
  2793. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/nllloss_grad.h +1 -1
  2794. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/non_zero.h +1 -1
  2795. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/norm.h +1 -1
  2796. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/normal_float_float.h +1 -1
  2797. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/normal_float_tensor.h +1 -1
  2798. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/normal_tensor_float.h +1 -1
  2799. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/normal_tensor_tensor.h +1 -1
  2800. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/not_equal.h +1 -1
  2801. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/ones.h +1 -1
  2802. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/outer.h +1 -1
  2803. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/paged_attention.h +38 -0
  2804. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/pixel_shuffle.h +1 -1
  2805. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/polar.h +1 -1
  2806. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/pow.h +1 -1
  2807. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/pow_scalar_tensor.h +1 -1
  2808. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/pow_tensor_scalar.h +1 -1
  2809. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/prelu.h +1 -1
  2810. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/prelu_grad.h +1 -1
  2811. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/prod_ext.h +1 -1
  2812. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/quant_batch_matmul.h +1 -1
  2813. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/quant_matmul.h +38 -0
  2814. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/quant_v2.h +1 -1
  2815. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/randint.h +1 -1
  2816. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/randint_like.h +1 -1
  2817. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/randn.h +1 -1
  2818. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/randn_like.h +1 -1
  2819. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/reciprocal.h +1 -1
  2820. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/reduce_all.h +1 -1
  2821. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/reduce_any.h +1 -1
  2822. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/reduce_max.h +1 -1
  2823. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/reduce_min.h +1 -1
  2824. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/reflection_pad_1d.h +1 -1
  2825. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/reflection_pad_1d_grad.h +1 -1
  2826. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/reflection_pad_2d.h +1 -1
  2827. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/reflection_pad_2d_grad.h +1 -1
  2828. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/reflection_pad_3d.h +1 -1
  2829. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/reflection_pad_3d_grad.h +1 -1
  2830. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/relu.h +1 -1
  2831. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/relu_grad.h +1 -1
  2832. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/repeat.h +1 -1
  2833. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/replication_pad_1d.h +1 -1
  2834. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/replication_pad_1d_grad.h +1 -1
  2835. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/replication_pad_2d.h +1 -1
  2836. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/replication_pad_2d_grad.h +1 -1
  2837. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/replication_pad_3d.h +1 -1
  2838. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/replication_pad_3d_grad.h +1 -1
  2839. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/reshape.h +1 -1
  2840. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/reshape_and_cache.h +38 -0
  2841. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/reverse_v2.h +1 -1
  2842. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/rms_norm_grad.h +1 -1
  2843. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/roll.h +1 -1
  2844. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/rotary_position_embedding.h +1 -1
  2845. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/rotary_position_embedding_grad.h +1 -1
  2846. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/round.h +1 -1
  2847. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/rsqrt.h +1 -1
  2848. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/scatter.h +1 -1
  2849. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/scatter_add_ext.h +1 -1
  2850. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/scatter_value.h +1 -1
  2851. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/searchsorted.h +1 -1
  2852. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/select.h +1 -1
  2853. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/select_ext_view.h +1 -1
  2854. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/select_v2.h +1 -1
  2855. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/selu_ext.h +1 -1
  2856. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/selu_grad.h +1 -1
  2857. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/sigmoid.h +1 -1
  2858. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/sigmoid_grad.h +1 -1
  2859. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/sign.h +1 -1
  2860. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/silu.h +1 -1
  2861. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/silu_grad.h +1 -1
  2862. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/sin.h +1 -1
  2863. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/sinc.h +1 -1
  2864. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/sinh.h +1 -1
  2865. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/slice.h +1 -1
  2866. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/slice_ext.h +1 -1
  2867. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/slice_ext_view.h +1 -1
  2868. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/smooth_l1_loss.h +1 -1
  2869. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/smooth_l1_loss_grad.h +1 -1
  2870. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/soft_margin_loss.h +1 -1
  2871. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/soft_margin_loss_grad.h +1 -1
  2872. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/softmax.h +1 -1
  2873. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/softmax_backward.h +1 -1
  2874. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/softplus_ext.h +1 -1
  2875. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/softplus_grad_ext.h +1 -1
  2876. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/softshrink.h +1 -1
  2877. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/softshrink_grad.h +1 -1
  2878. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/speed_fusion_attention.h +1 -1
  2879. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/speed_fusion_attention_grad.h +1 -1
  2880. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/split.h +1 -1
  2881. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/sqrt.h +1 -1
  2882. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/square.h +1 -1
  2883. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/squeeze.h +1 -1
  2884. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/stack_ext.h +38 -0
  2885. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/sub.h +1 -1
  2886. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/sub_ext.h +1 -1
  2887. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/sub_scalar.h +1 -1
  2888. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/sum_ext.h +1 -1
  2889. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/take.h +1 -1
  2890. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/tan.h +1 -1
  2891. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/tanh.h +1 -1
  2892. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/tanh_grad.h +1 -1
  2893. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/tensor_scatter_elements.h +1 -1
  2894. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/threshold.h +1 -1
  2895. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/threshold_grad.h +1 -1
  2896. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/tile.h +1 -1
  2897. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/transpose.h +1 -1
  2898. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/transpose_ext_view.h +1 -1
  2899. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/transpose_view.h +1 -1
  2900. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/triangular_solve.h +1 -1
  2901. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/triu.h +1 -1
  2902. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/trunc.h +1 -1
  2903. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/unique_consecutive.h +1 -1
  2904. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/upsample_bicubic2d.h +1 -1
  2905. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/upsample_bicubic2d_grad.h +1 -1
  2906. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/upsample_bilinear2d.h +1 -1
  2907. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/upsample_bilinear2d_grad.h +1 -1
  2908. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/upsample_linear1d.h +1 -1
  2909. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/upsample_linear1d_grad.h +1 -1
  2910. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/upsample_nearest1d.h +1 -1
  2911. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/upsample_nearest1d_grad.h +1 -1
  2912. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/upsample_nearest2d.h +1 -1
  2913. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/upsample_nearest2d_grad.h +1 -1
  2914. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/upsample_nearest3d.h +1 -1
  2915. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/upsample_nearest3d_grad.h +1 -1
  2916. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/upsample_trilinear3d.h +1 -1
  2917. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/upsample_trilinear3d_grad.h +1 -1
  2918. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/view.h +1 -1
  2919. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/weight_quant_batch_matmul.h +1 -1
  2920. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/xlogy.h +1 -1
  2921. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/xlogy_scalar_other.h +1 -1
  2922. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/xlogy_scalar_self.h +1 -1
  2923. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/zeros.h +1 -1
  2924. mindspore/include/mindspore/ops/kernel/cpu/pyboost/auto_generate/zeros_like_ext.h +38 -0
  2925. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/any.h +34 -0
  2926. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/any_ext.h +35 -0
  2927. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/binary_cross_entropy_with_logits.h +4 -4
  2928. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/cell_backward_hook.h +27 -0
  2929. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/clamp_scalar.h +2 -2
  2930. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/clamp_tensor.h +2 -3
  2931. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/contiguous.h +1 -1
  2932. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/copy.h +1 -1
  2933. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/dense.h +2 -2
  2934. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/dist_comm_all_gather.h +1 -1
  2935. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/dist_comm_all_reduce.h +1 -1
  2936. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/dist_comm_broadcast.h +2 -2
  2937. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/dist_comm_gather.h +1 -1
  2938. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/dist_comm_irecv.h +1 -1
  2939. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/dist_comm_isend.h +1 -1
  2940. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/dist_comm_scatter.h +1 -1
  2941. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/divmod.h +2 -3
  2942. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/empty.h +35 -0
  2943. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/empty_like.h +36 -0
  2944. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/group_norm.h +3 -3
  2945. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/grouped_matmul.h +1 -1
  2946. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/identity.h +1 -1
  2947. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/inner_comm_all_reduce.h +2 -3
  2948. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/inplace_copy.h +2 -2
  2949. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/layer_norm_ext.h +3 -3
  2950. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/masked_select.h +2 -2
  2951. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/matmul_ext.h +1 -1
  2952. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/max.h +1 -1
  2953. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/mean_ext.h +1 -1
  2954. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/meshgrid.h +4 -2
  2955. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/min.h +1 -1
  2956. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/new_empty.h +36 -0
  2957. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/new_ones.h +2 -2
  2958. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/new_zeros.h +2 -2
  2959. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/non_zero.h +1 -1
  2960. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/pixel_shuffle.h +2 -2
  2961. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/pow_scalar_tensor.h +1 -1
  2962. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/pow_tensor_scalar.h +1 -1
  2963. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/prod_ext.h +1 -1
  2964. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/reshape.h +4 -2
  2965. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/round.h +1 -1
  2966. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/searchsorted.h +3 -4
  2967. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/silu.h +1 -1
  2968. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/silu_grad.h +1 -2
  2969. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/sum_ext.h +1 -1
  2970. mindspore/include/mindspore/ops/kernel/cpu/pyboost/customize/unique_consecutive.h +2 -2
  2971. mindspore/include/mindspore/ops/kernel/cpu/sample_distorted_bounding_box_v2_cpu_kernel.h +4 -0
  2972. mindspore/include/mindspore/ops/kernel/cpu/sequence/bool_binary_arithmetic_cpu_kernel.h +42 -0
  2973. mindspore/include/mindspore/ops/kernel/cpu/sequence/sequence_len_cpu_kernel.h +0 -1
  2974. mindspore/include/mindspore/ops/kernel/cpu/sparse_apply_adagrad_cpu_kernel.h +1 -1
  2975. mindspore/include/mindspore/ops/kernel/cpu/sparse_apply_adagrad_v2_cpu_kernel.h +2 -2
  2976. mindspore/include/mindspore/ops/kernel/cpu/stft_cpu_kernel.h +16 -16
  2977. mindspore/include/mindspore/ops/kernel/cpu/utils/sampling_kernels.h +18 -15
  2978. mindspore/include/mindspore/ops/kernel/gpu/arrays/broadcast_to_gpu_kernel.h +1 -1
  2979. mindspore/include/mindspore/ops/kernel/gpu/arrays/select_gpu_kernel.h +2 -2
  2980. mindspore/include/mindspore/ops/kernel/gpu/arrays/unique_consecutive_gpu_kernel.h +2 -2
  2981. mindspore/include/mindspore/ops/kernel/gpu/cuda_impl/cuda_class/unique_consecutive_helper.h +1 -1
  2982. mindspore/include/mindspore/ops/kernel/gpu/dynamic_akg/dynamic_utils.h +1 -1
  2983. mindspore/include/mindspore/ops/kernel/gpu/gpu_kernel.h +3 -4
  2984. mindspore/include/mindspore/ops/kernel/gpu/math/binary_ext_ops_gpu_kernel.h +2 -2
  2985. mindspore/include/mindspore/ops/kernel/gpu/math/correlate_gpu_kernel.h +15 -11
  2986. mindspore/include/mindspore/ops/kernel/gpu/math/eps_gpu_kernel.h +4 -4
  2987. mindspore/include/mindspore/ops/kernel/gpu/math/tracev2_grad_gpu_kernel.h +0 -1
  2988. mindspore/include/mindspore/ops/kernel/gpu/nccl/nccl_recv_gpu_kernel.h +1 -1
  2989. mindspore/include/mindspore/ops/kernel/gpu/nccl/nccl_send_gpu_kernel.h +1 -1
  2990. mindspore/include/mindspore/ops/kernel/gpu/nn/activation_grad_kernel.h +3 -3
  2991. mindspore/include/mindspore/ops/kernel/gpu/nn/adagrad_gpu_kernel.h +4 -2
  2992. mindspore/include/mindspore/ops/kernel/gpu/nn/adam_gpu_kernel.h +1 -1
  2993. mindspore/include/mindspore/ops/kernel/gpu/nn/batch_norm_grad_gpu_kernel.h +1 -0
  2994. mindspore/include/mindspore/ops/kernel/gpu/nn/kl_div_loss_grad_kernel.h +3 -2
  2995. mindspore/include/mindspore/ops/kernel/gpu/other/dynamic_stitch_gpu_kernel.h +6 -6
  2996. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/abs.h +1 -1
  2997. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/adaptive_avg_pool1d.h +1 -1
  2998. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/adaptive_avg_pool2d_grad_ext.h +1 -1
  2999. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/adaptive_avg_pool3d_grad_ext.h +1 -1
  3000. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/adaptive_max_pool1d.h +1 -1
  3001. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/adaptive_max_pool2d.h +1 -1
  3002. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/add.h +1 -1
  3003. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/add_ext.h +1 -1
  3004. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/add_layer_norm_grad.h +1 -1
  3005. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/add_rmsnorm_quant_v2.h +1 -1
  3006. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/add_scalar.h +1 -1
  3007. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/addcdiv_ext.h +1 -1
  3008. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/addcmul_ext.h +1 -1
  3009. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/any.h +38 -0
  3010. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/any_ext.h +38 -0
  3011. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/apply_rotary_pos_emb.h +38 -0
  3012. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/argmax_with_value.h +1 -1
  3013. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/argmin_with_value.h +1 -1
  3014. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/argsort.h +1 -1
  3015. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/as_strided.h +1 -1
  3016. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/atanh.h +1 -1
  3017. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/avg_pool1d.h +1 -1
  3018. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/avg_pool2d.h +1 -1
  3019. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/avg_pool2d_grad.h +1 -1
  3020. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/avg_pool3d_ext.h +1 -1
  3021. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/avg_pool3d_grad_ext.h +1 -1
  3022. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/baddbmm.h +1 -1
  3023. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/batch_mat_mul.h +1 -1
  3024. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/batch_norm_elemt.h +1 -1
  3025. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/batch_norm_elemt_grad.h +1 -1
  3026. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/batch_norm_gather_stats_with_counts.h +1 -1
  3027. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/batch_norm_reduce_grad.h +1 -1
  3028. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/batch_norm_stats.h +1 -1
  3029. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/bernoulli_ext.h +1 -1
  3030. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/binary_cross_entropy.h +1 -1
  3031. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/binary_cross_entropy_grad.h +1 -1
  3032. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/binary_cross_entropy_with_logits.h +1 -1
  3033. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/binary_cross_entropy_with_logits_backward.h +1 -1
  3034. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/bitwise_and_scalar.h +1 -1
  3035. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/bitwise_and_tensor.h +1 -1
  3036. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/bitwise_not.h +1 -1
  3037. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/bitwise_or_scalar.h +1 -1
  3038. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/bitwise_or_tensor.h +1 -1
  3039. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/bitwise_xor_scalar.h +1 -1
  3040. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/bitwise_xor_tensor.h +1 -1
  3041. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/bmm_ext.h +1 -1
  3042. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/broadcast_to.h +1 -1
  3043. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/broadcast_to_view.h +1 -1
  3044. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/cast.h +1 -1
  3045. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/ceil.h +1 -1
  3046. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/cell_backward_hook.h +38 -0
  3047. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/chunk.h +1 -1
  3048. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/chunk_view.h +1 -1
  3049. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/clamp_scalar.h +1 -1
  3050. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/clamp_tensor.h +1 -1
  3051. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/clone.h +1 -1
  3052. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/col2im_ext.h +1 -1
  3053. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/col2im_grad.h +1 -1
  3054. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/concat.h +1 -1
  3055. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/constant_pad_nd.h +1 -1
  3056. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/contiguous.h +1 -1
  3057. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/conv1d_padding.h +1 -1
  3058. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/conv2d_ext.h +1 -1
  3059. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/conv2d_padding.h +1 -1
  3060. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/conv3d_padding.h +1 -1
  3061. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/conv_transpose2d.h +1 -1
  3062. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/convolution.h +1 -1
  3063. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/convolution_grad.h +1 -1
  3064. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/convolution_str.h +1 -1
  3065. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/convolution_str_grad.h +1 -1
  3066. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/copy.h +1 -1
  3067. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/cos.h +1 -1
  3068. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/cosh.h +1 -1
  3069. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/count_nonzero.h +1 -1
  3070. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/cross.h +1 -1
  3071. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/cross_entropy_loss.h +38 -0
  3072. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/cross_entropy_loss_grad.h +38 -0
  3073. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/cummax.h +1 -1
  3074. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dense.h +1 -1
  3075. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/diag_ext.h +1 -1
  3076. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/diagonal_view.h +38 -0
  3077. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_all_gather.h +1 -1
  3078. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_all_gather_into_tensor.h +1 -1
  3079. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_all_gather_into_tensor_uneven.h +38 -0
  3080. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_all_reduce.h +1 -1
  3081. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_all_to_all_v.h +1 -1
  3082. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_all_to_all_v_single.h +1 -1
  3083. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_barrier.h +1 -1
  3084. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_batch_isend_irecv.h +1 -1
  3085. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_broadcast.h +1 -1
  3086. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_gather.h +1 -1
  3087. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_gather_into_tensor.h +1 -1
  3088. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_irecv.h +1 -1
  3089. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_isend.h +1 -1
  3090. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_reduce.h +1 -1
  3091. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_reduce_scatter.h +1 -1
  3092. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_reduce_scatter_tensor.h +1 -1
  3093. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_reduce_scatter_tensor_uneven.h +38 -0
  3094. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_scatter.h +1 -1
  3095. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dist_comm_scatter_tensor.h +1 -1
  3096. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/div.h +1 -1
  3097. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/divmod.h +1 -1
  3098. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/divmods.h +1 -1
  3099. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/divs.h +1 -1
  3100. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dot.h +1 -1
  3101. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/dynamic_quant_ext.h +1 -1
  3102. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/einsum_ext.h +38 -0
  3103. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/elu.h +1 -1
  3104. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/embedding.h +1 -1
  3105. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/embedding_dense_backward.h +1 -1
  3106. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/equal.h +1 -1
  3107. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/equal_ext.h +1 -1
  3108. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/erf.h +1 -1
  3109. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/erfc.h +1 -1
  3110. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/erfinv.h +1 -1
  3111. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/exp.h +1 -1
  3112. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/exp2.h +1 -1
  3113. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/expand_dims.h +1 -1
  3114. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/expand_dims_view.h +1 -1
  3115. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/expm1.h +1 -1
  3116. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/eye.h +1 -1
  3117. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/ffn_ext.h +1 -1
  3118. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/floor.h +1 -1
  3119. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/floor_div.h +1 -1
  3120. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/floor_div_scalar.h +1 -1
  3121. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/fmod_tensor.h +1 -1
  3122. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/frac.h +1 -1
  3123. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/full_like.h +1 -1
  3124. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/func_dropout_ext.h +38 -0
  3125. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/fused_infer_attention_score.h +1 -1
  3126. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/gather_d.h +1 -1
  3127. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/gather_d_grad_v2.h +1 -1
  3128. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/gcd.h +1 -1
  3129. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/gelu.h +1 -1
  3130. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/gelu_ext.h +1 -1
  3131. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/gelu_grad.h +1 -1
  3132. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/gelu_grad_ext.h +1 -1
  3133. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/generator.h +1 -1
  3134. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/glu.h +1 -1
  3135. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/glu_grad.h +1 -1
  3136. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/greater.h +1 -1
  3137. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/greater_equal.h +1 -1
  3138. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/greater_equal_scalar.h +1 -1
  3139. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/grid_sampler_2d.h +1 -1
  3140. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/grid_sampler_2d_grad.h +1 -1
  3141. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/grid_sampler_3d.h +1 -1
  3142. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/grid_sampler_3d_grad.h +1 -1
  3143. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/group_norm.h +1 -1
  3144. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/group_norm_grad.h +1 -1
  3145. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/grouped_matmul.h +1 -1
  3146. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/grouped_matmul_v2.h +1 -1
  3147. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/grouped_matmul_v4.h +1 -1
  3148. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/hardtanh.h +1 -1
  3149. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/hardtanh_grad.h +1 -1
  3150. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/hshrink.h +1 -1
  3151. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/hshrink_grad.h +1 -1
  3152. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/hsigmoid.h +1 -1
  3153. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/hsigmoid_grad.h +1 -1
  3154. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/hswish.h +1 -1
  3155. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/hswish_grad.h +1 -1
  3156. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/identity.h +1 -1
  3157. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/im2col_ext.h +1 -1
  3158. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/incre_flash_attention.h +1 -1
  3159. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/index.h +1 -1
  3160. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/index_add_ext.h +1 -1
  3161. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/index_fill_scalar.h +1 -1
  3162. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/index_fill_tensor.h +1 -1
  3163. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inner_comm_all_gather.h +1 -1
  3164. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inner_comm_all_reduce.h +1 -1
  3165. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inner_comm_all_to_all_v.h +1 -1
  3166. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inner_comm_irecv.h +1 -1
  3167. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inner_comm_isend.h +1 -1
  3168. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inner_comm_reduce_scatter.h +1 -1
  3169. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inner_index.h +1 -1
  3170. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inner_inplace_index_put.h +1 -1
  3171. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inner_moe_token_unpermute.h +38 -0
  3172. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inner_non_zero.h +1 -1
  3173. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_addmm.h +1 -1
  3174. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_bernoulli_scalar.h +38 -0
  3175. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_bernoulli_tensor.h +38 -0
  3176. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_clamp_scalar.h +1 -1
  3177. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_clamp_tensor.h +1 -1
  3178. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_copy.h +1 -1
  3179. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_div.h +1 -1
  3180. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_divmod.h +1 -1
  3181. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_divmods.h +1 -1
  3182. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_divs.h +1 -1
  3183. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_elu.h +1 -1
  3184. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_erfinv.h +1 -1
  3185. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_exponential.h +1 -1
  3186. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_fill_diagonal.h +1 -1
  3187. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_fill_scalar.h +1 -1
  3188. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_fill_tensor.h +1 -1
  3189. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_floor.h +1 -1
  3190. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_floor_divide.h +1 -1
  3191. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_floor_divides.h +1 -1
  3192. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_grouped_matmul_add.h +1 -1
  3193. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_hardtanh.h +1 -1
  3194. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_index_add.h +1 -1
  3195. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_index_put.h +1 -1
  3196. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_log.h +1 -1
  3197. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_masked_fill_scalar.h +1 -1
  3198. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_masked_fill_tensor.h +1 -1
  3199. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_matmul_add.h +38 -0
  3200. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_mul.h +1 -1
  3201. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_muls.h +1 -1
  3202. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_normal.h +1 -1
  3203. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_put.h +1 -1
  3204. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_random.h +1 -1
  3205. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_relu.h +1 -1
  3206. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_scatter_add.h +1 -1
  3207. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_scatter_src.h +1 -1
  3208. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_scatter_src_reduce.h +1 -1
  3209. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_scatter_value.h +1 -1
  3210. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_scatter_value_reduce.h +1 -1
  3211. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_silu.h +38 -0
  3212. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_sub_scalar.h +1 -1
  3213. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_tanh.h +1 -1
  3214. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_threshold.h +1 -1
  3215. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_uniform.h +1 -1
  3216. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/inplace_zero.h +1 -1
  3217. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/isclose.h +1 -1
  3218. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/isfinite.h +1 -1
  3219. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/isinf.h +1 -1
  3220. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/isneginf.h +1 -1
  3221. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/kl_div.h +1 -1
  3222. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/kl_div_grad.h +1 -1
  3223. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/kthvalue.h +1 -1
  3224. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/kv_cache_scatter_update.h +1 -1
  3225. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/leaky_relu_ext.h +1 -1
  3226. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/leaky_relu_grad_ext.h +1 -1
  3227. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/lerp.h +1 -1
  3228. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/lerp_scalar.h +1 -1
  3229. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/less.h +1 -1
  3230. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/less_equal.h +1 -1
  3231. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/linalg_qr.h +1 -1
  3232. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/linalg_vector_norm.h +1 -1
  3233. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/log.h +1 -1
  3234. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/log1p.h +1 -1
  3235. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/log_softmax.h +1 -1
  3236. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/log_softmax_grad.h +1 -1
  3237. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/logaddexp.h +1 -1
  3238. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/logaddexp2.h +1 -1
  3239. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/logical_and.h +1 -1
  3240. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/logical_not.h +1 -1
  3241. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/logical_or.h +1 -1
  3242. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/logical_xor.h +1 -1
  3243. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/logsigmoid.h +1 -1
  3244. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/logsigmoid_grad.h +1 -1
  3245. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/logsumexp.h +1 -1
  3246. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/masked_fill.h +1 -1
  3247. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/masked_scatter.h +38 -0
  3248. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/masked_select.h +1 -1
  3249. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/masked_select_grad.h +1 -1
  3250. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/matmul.h +1 -1
  3251. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/matmul_allreduce_add_rmsnorm.h +1 -1
  3252. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/matmul_ext.h +1 -1
  3253. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/max.h +1 -1
  3254. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/max_dim.h +1 -1
  3255. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/maximum.h +1 -1
  3256. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/mean_ext.h +1 -1
  3257. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/median_dim.h +1 -1
  3258. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/median_ext.h +1 -1
  3259. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/meshgrid.h +1 -1
  3260. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/min.h +1 -1
  3261. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/min_dim.h +1 -1
  3262. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/minimum.h +1 -1
  3263. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/mish_ext.h +1 -1
  3264. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/mish_grad_ext.h +1 -1
  3265. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/mla.h +38 -0
  3266. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/moe_compute_expert_tokens.h +1 -1
  3267. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/moe_distribute_combine.h +38 -0
  3268. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/moe_distribute_dispatch.h +38 -0
  3269. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/moe_finalize_routing.h +1 -1
  3270. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/moe_gating_top_k_softmax.h +1 -1
  3271. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/moe_init_routing.h +1 -1
  3272. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/moe_init_routing_quant_v2.h +38 -0
  3273. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/moe_init_routing_v2.h +1 -1
  3274. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/moe_token_permute.h +1 -1
  3275. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/moe_token_permute_grad.h +1 -1
  3276. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/moe_token_unpermute.h +1 -1
  3277. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/moe_token_unpermute_grad.h +1 -1
  3278. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/mul.h +1 -1
  3279. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/muls.h +1 -1
  3280. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/multi_scale_deformable_attn.h +1 -1
  3281. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/multi_scale_deformable_attn_grad.h +1 -1
  3282. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/mv.h +1 -1
  3283. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/nan_to_num.h +1 -1
  3284. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/ne_scalar.h +1 -1
  3285. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/neg.h +1 -1
  3286. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/new_full.h +38 -0
  3287. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/new_ones.h +1 -1
  3288. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/new_zeros.h +1 -1
  3289. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/nllloss.h +1 -1
  3290. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/nllloss_2d.h +1 -1
  3291. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/nllloss_2d_grad.h +1 -1
  3292. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/nllloss_grad.h +1 -1
  3293. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/non_zero.h +1 -1
  3294. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/norm.h +1 -1
  3295. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/normal_float_float.h +1 -1
  3296. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/normal_float_tensor.h +1 -1
  3297. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/normal_tensor_float.h +1 -1
  3298. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/normal_tensor_tensor.h +1 -1
  3299. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/not_equal.h +1 -1
  3300. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/ones.h +1 -1
  3301. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/outer.h +1 -1
  3302. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/paged_attention.h +38 -0
  3303. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/pixel_shuffle.h +1 -1
  3304. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/polar.h +1 -1
  3305. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/pow.h +1 -1
  3306. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/pow_scalar_tensor.h +1 -1
  3307. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/pow_tensor_scalar.h +1 -1
  3308. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/prelu.h +1 -1
  3309. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/prelu_grad.h +1 -1
  3310. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/prod_ext.h +1 -1
  3311. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/quant_batch_matmul.h +1 -1
  3312. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/quant_matmul.h +38 -0
  3313. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/quant_v2.h +1 -1
  3314. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/randint.h +1 -1
  3315. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/randint_like.h +1 -1
  3316. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/randn.h +1 -1
  3317. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/randn_like.h +1 -1
  3318. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/reciprocal.h +1 -1
  3319. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/reduce_all.h +1 -1
  3320. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/reduce_any.h +1 -1
  3321. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/reduce_max.h +1 -1
  3322. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/reduce_min.h +1 -1
  3323. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/reflection_pad_1d.h +1 -1
  3324. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/reflection_pad_1d_grad.h +1 -1
  3325. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/reflection_pad_2d.h +1 -1
  3326. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/reflection_pad_2d_grad.h +1 -1
  3327. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/reflection_pad_3d.h +1 -1
  3328. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/reflection_pad_3d_grad.h +1 -1
  3329. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/relu.h +1 -1
  3330. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/relu_grad.h +1 -1
  3331. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/repeat.h +1 -1
  3332. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/replication_pad_1d.h +1 -1
  3333. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/replication_pad_1d_grad.h +1 -1
  3334. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/replication_pad_2d.h +1 -1
  3335. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/replication_pad_2d_grad.h +1 -1
  3336. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/replication_pad_3d.h +1 -1
  3337. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/replication_pad_3d_grad.h +1 -1
  3338. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/reshape.h +1 -1
  3339. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/reshape_and_cache.h +38 -0
  3340. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/reverse_v2.h +1 -1
  3341. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/rms_norm_grad.h +1 -1
  3342. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/roll.h +1 -1
  3343. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/rotary_position_embedding.h +1 -1
  3344. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/rotary_position_embedding_grad.h +1 -1
  3345. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/round.h +1 -1
  3346. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/rsqrt.h +1 -1
  3347. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/scatter.h +1 -1
  3348. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/scatter_add_ext.h +1 -1
  3349. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/scatter_value.h +1 -1
  3350. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/searchsorted.h +1 -1
  3351. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/select.h +1 -1
  3352. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/select_ext_view.h +1 -1
  3353. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/select_v2.h +1 -1
  3354. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/selu_ext.h +1 -1
  3355. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/selu_grad.h +1 -1
  3356. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/sigmoid.h +1 -1
  3357. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/sigmoid_grad.h +1 -1
  3358. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/sign.h +1 -1
  3359. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/silu.h +1 -1
  3360. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/silu_grad.h +1 -1
  3361. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/sin.h +1 -1
  3362. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/sinc.h +1 -1
  3363. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/sinh.h +1 -1
  3364. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/slice.h +1 -1
  3365. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/slice_ext.h +1 -1
  3366. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/slice_ext_view.h +1 -1
  3367. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/smooth_l1_loss.h +1 -1
  3368. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/smooth_l1_loss_grad.h +1 -1
  3369. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/soft_margin_loss.h +1 -1
  3370. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/soft_margin_loss_grad.h +1 -1
  3371. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/softmax.h +1 -1
  3372. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/softmax_backward.h +1 -1
  3373. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/softplus_ext.h +1 -1
  3374. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/softplus_grad_ext.h +1 -1
  3375. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/softshrink.h +1 -1
  3376. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/softshrink_grad.h +1 -1
  3377. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/speed_fusion_attention.h +1 -1
  3378. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/speed_fusion_attention_grad.h +1 -1
  3379. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/split.h +1 -1
  3380. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/sqrt.h +1 -1
  3381. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/square.h +1 -1
  3382. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/squeeze.h +1 -1
  3383. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/sub.h +1 -1
  3384. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/sub_ext.h +1 -1
  3385. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/sub_scalar.h +1 -1
  3386. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/sum_ext.h +1 -1
  3387. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/take.h +1 -1
  3388. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/tan.h +1 -1
  3389. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/tanh.h +1 -1
  3390. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/tanh_grad.h +1 -1
  3391. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/tensor_scatter_elements.h +1 -1
  3392. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/threshold.h +1 -1
  3393. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/threshold_grad.h +1 -1
  3394. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/tile.h +1 -1
  3395. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/transpose.h +1 -1
  3396. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/transpose_ext_view.h +1 -1
  3397. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/transpose_view.h +1 -1
  3398. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/triangular_solve.h +1 -1
  3399. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/triu.h +1 -1
  3400. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/trunc.h +1 -1
  3401. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/upsample_bicubic2d.h +1 -1
  3402. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/upsample_bicubic2d_grad.h +1 -1
  3403. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/upsample_bilinear2d.h +1 -1
  3404. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/upsample_bilinear2d_grad.h +1 -1
  3405. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/upsample_linear1d.h +1 -1
  3406. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/upsample_linear1d_grad.h +1 -1
  3407. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/upsample_nearest1d.h +1 -1
  3408. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/upsample_nearest1d_grad.h +1 -1
  3409. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/upsample_nearest2d.h +1 -1
  3410. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/upsample_nearest2d_grad.h +1 -1
  3411. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/upsample_nearest3d.h +1 -1
  3412. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/upsample_nearest3d_grad.h +1 -1
  3413. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/upsample_trilinear3d.h +1 -1
  3414. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/upsample_trilinear3d_grad.h +1 -1
  3415. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/view.h +1 -1
  3416. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/weight_quant_batch_matmul.h +1 -1
  3417. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/xlogy.h +1 -1
  3418. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/xlogy_scalar_other.h +1 -1
  3419. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/xlogy_scalar_self.h +1 -1
  3420. mindspore/include/mindspore/ops/kernel/gpu/pyboost/auto_generate/zeros.h +1 -1
  3421. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/any.h +34 -0
  3422. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/any_ext.h +35 -0
  3423. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/cell_backward_hook.h +27 -0
  3424. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/clamp_scalar.h +2 -2
  3425. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/clamp_tensor.h +2 -3
  3426. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/contiguous.h +1 -1
  3427. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/copy.h +1 -1
  3428. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/dense.h +2 -2
  3429. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/divmod.h +2 -3
  3430. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/grouped_matmul.h +1 -1
  3431. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/identity.h +1 -1
  3432. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/inner_comm_all_gather.h +1 -1
  3433. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/inner_comm_all_reduce.h +1 -1
  3434. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/inner_comm_isend.h +1 -1
  3435. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/inner_comm_reduce_scatter.h +1 -1
  3436. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/masked_select.h +2 -2
  3437. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/matmul_ext.h +1 -1
  3438. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/max.h +1 -1
  3439. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/mean_ext.h +1 -1
  3440. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/meshgrid.h +4 -2
  3441. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/min.h +1 -1
  3442. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/new_ones.h +2 -2
  3443. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/new_zeros.h +2 -2
  3444. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/non_zero.h +1 -1
  3445. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/pixel_shuffle.h +2 -2
  3446. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/pow_scalar_tensor.h +1 -1
  3447. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/pow_tensor_scalar.h +1 -1
  3448. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/prod_ext.h +1 -1
  3449. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/reshape.h +4 -2
  3450. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/searchsorted.h +3 -4
  3451. mindspore/include/mindspore/ops/kernel/gpu/pyboost/customize/sum_ext.h +1 -1
  3452. mindspore/include/mindspore/ops/kernel/gpu/random/random_categorical_gpu_kernel.h +4 -8
  3453. mindspore/include/mindspore/ops/kernel/gpu/rl/buffer_sample_gpu_kernel.h +8 -8
  3454. mindspore/include/mindspore/ops/kernel/gpu/rl/gru_gpu_kernel.h +1 -0
  3455. mindspore/include/mindspore/ops/kernel/gpu/sparse/csr_sparse_matrix_to_sparse_tensor_gpu_kernel.h +1 -1
  3456. mindspore/include/mindspore/ops/kernel/gpu/sparse/dense_to_csr_sparse_matrix_gpu_kernel.h +3 -3
  3457. mindspore/include/mindspore/ops/kernel/gpu/sparse/sparse_matrix_sparse_matmul_gpu_kernel.h +2 -2
  3458. mindspore/include/mindspore/ops/kernel/include/common/common_utils.h +9 -0
  3459. mindspore/include/mindspore/ops/kernel/include/common/device_address.h +290 -33
  3460. mindspore/include/mindspore/ops/kernel/include/common/device_type.h +3 -5
  3461. mindspore/include/mindspore/ops/kernel/include/common/kernel.h +26 -1
  3462. mindspore/include/mindspore/ops/kernel/include/common/kernel_tensor.h +119 -306
  3463. mindspore/include/mindspore/ops/op_def/array_ops.h +0 -2
  3464. mindspore/include/mindspore/ops/op_def/auto_generate/gen_lite_ops.h +3153 -2925
  3465. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_def.h +797 -766
  3466. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_a.h +60 -58
  3467. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_b.h +25 -25
  3468. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_c.h +36 -33
  3469. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_d.h +28 -25
  3470. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_e.h +28 -27
  3471. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_f.h +20 -18
  3472. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_g.h +19 -19
  3473. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_h.h +7 -7
  3474. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_i.h +67 -60
  3475. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_k.h +2 -1
  3476. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_l.h +30 -30
  3477. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_m.h +48 -40
  3478. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_n.h +18 -17
  3479. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_o.h +2 -2
  3480. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_p.h +6 -7
  3481. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_q.h +6 -3
  3482. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_r.h +60 -59
  3483. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_s.h +67 -67
  3484. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_t.h +23 -22
  3485. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_u.h +12 -12
  3486. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_name_v.h +2 -2
  3487. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_a.h +60 -58
  3488. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_b.h +25 -25
  3489. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_c.h +36 -33
  3490. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_d.h +28 -25
  3491. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_e.h +28 -27
  3492. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_f.h +20 -18
  3493. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_g.h +19 -19
  3494. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_h.h +7 -7
  3495. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_i.h +67 -60
  3496. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_k.h +2 -1
  3497. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_l.h +30 -30
  3498. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_m.h +48 -40
  3499. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_n.h +18 -17
  3500. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_o.h +2 -2
  3501. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_p.h +6 -7
  3502. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_q.h +6 -3
  3503. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_r.h +60 -59
  3504. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_s.h +67 -67
  3505. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_t.h +23 -22
  3506. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_u.h +12 -12
  3507. mindspore/include/mindspore/ops/op_def/auto_generate/gen_ops_primitive_v.h +2 -2
  3508. mindspore/include/mindspore/ops/op_def/framework_op_name.h +0 -1
  3509. mindspore/include/mindspore/ops/op_def/framework_ops.h +3 -2
  3510. mindspore/include/mindspore/ops/op_def/nn_op_name.h +4 -0
  3511. mindspore/include/mindspore/ops/op_def/op_enum.h +4 -0
  3512. mindspore/include/mindspore/ops/op_def/other_op_name.h +6 -0
  3513. mindspore/include/mindspore/ops/op_def/other_ops.h +2 -0
  3514. mindspore/include/mindspore/ops/op_def/structure_ops.h +4 -1
  3515. mindspore/include/mindspore/ops/ops_utils/memory_overlap.h +4 -5
  3516. mindspore/include/mindspore/ops/ops_utils/op_constants.h +12 -0
  3517. mindspore/include/mindspore/ops/ops_utils/op_utils.h +14 -5
  3518. mindspore/include/mindspore/ops/ops_utils/type_dispatch.h +51 -42
  3519. mindspore/include/mindspore/ops/view/as_strided_strides_calc.h +5 -1
  3520. mindspore/include/mindspore/ops/view/broadcast_to_strides_calc.h +4 -2
  3521. mindspore/include/mindspore/ops/view/broadcast_to_view_strides_calc.h +3 -1
  3522. mindspore/include/mindspore/ops/view/chunk_strides_calc.h +3 -1
  3523. mindspore/include/mindspore/ops/view/chunk_view_strides_calc.h +3 -1
  3524. mindspore/include/mindspore/ops/view/diagonal_strides_calc.h +6 -3
  3525. mindspore/include/mindspore/ops/view/diagonal_view_strides_calc.h +32 -0
  3526. mindspore/include/mindspore/ops/view/expand_dims_strides_calc.h +3 -1
  3527. mindspore/include/mindspore/ops/view/expand_dims_view_strides_calc.h +3 -1
  3528. mindspore/include/mindspore/ops/view/narrow_strides_calc.h +4 -2
  3529. mindspore/include/mindspore/ops/view/narrow_view_strides_calc.h +4 -2
  3530. mindspore/include/mindspore/ops/view/reshape_strides_calc.h +2 -1
  3531. mindspore/include/mindspore/ops/view/select_ext_view_strides_calc.h +3 -1
  3532. mindspore/include/mindspore/ops/view/slice_ext_strides_calc.h +4 -1
  3533. mindspore/include/mindspore/ops/view/slice_ext_view_strides_calc.h +4 -2
  3534. mindspore/include/mindspore/ops/view/slice_strides_calc.h +4 -1
  3535. mindspore/include/mindspore/ops/view/split_strides_calc.h +3 -1
  3536. mindspore/include/mindspore/ops/view/split_tensor_strides_calc.h +3 -1
  3537. mindspore/include/mindspore/ops/view/split_tensor_view_strides_calc.h +3 -1
  3538. mindspore/include/mindspore/ops/view/split_with_size_strides_calc.h +3 -1
  3539. mindspore/include/mindspore/ops/view/split_with_size_view_strides_calc.h +4 -1
  3540. mindspore/include/mindspore/ops/view/squeeze_strides_calc.h +3 -0
  3541. mindspore/include/mindspore/ops/view/transpose_ext_view_strides_calc.h +3 -0
  3542. mindspore/include/mindspore/ops/view/transpose_strides_calc.h +3 -1
  3543. mindspore/include/mindspore/ops/view/transpose_view_strides_calc.h +3 -0
  3544. mindspore/include/mindspore/ops/view/unstack_ext_view_strides_calc.h +1 -1
  3545. mindspore/include/mindspore/ops/view/view_strides_calc.h +3 -2
  3546. mindspore/include/mindspore/ops/view/view_strides_calculator.h +1 -2
  3547. mindspore/include/ms_extension.h +12 -5
  3548. mindspore/lib/libavcodec.so.59 +0 -0
  3549. mindspore/lib/libavdevice.so.59 +0 -0
  3550. mindspore/lib/libavfilter.so.8 +0 -0
  3551. mindspore/lib/libavformat.so.59 +0 -0
  3552. mindspore/lib/libavutil.so.57 +0 -0
  3553. mindspore/lib/libdnnl.so.2 +0 -0
  3554. mindspore/lib/libmindspore_backend_common.so +0 -0
  3555. mindspore/lib/libmindspore_backend_manager.so +0 -0
  3556. mindspore/lib/libmindspore_common.so +0 -0
  3557. mindspore/lib/libmindspore_core.so +0 -0
  3558. mindspore/lib/libmindspore_dump.so +0 -0
  3559. mindspore/lib/libmindspore_extension.so +0 -0
  3560. mindspore/lib/libmindspore_frontend.so +0 -0
  3561. mindspore/lib/libmindspore_ge_backend.so +0 -0
  3562. mindspore/lib/libmindspore_glog.so.0 +0 -0
  3563. mindspore/lib/libmindspore_gpr.so.15 +0 -0
  3564. mindspore/lib/libmindspore_grpc++.so.1 +0 -0
  3565. mindspore/lib/libmindspore_grpc.so.15 +0 -0
  3566. mindspore/lib/libmindspore_memory_pool.so +0 -0
  3567. mindspore/lib/libmindspore_ms_backend.so +0 -0
  3568. mindspore/lib/libmindspore_ops.so +0 -0
  3569. mindspore/lib/libmindspore_ops_kernel_common.so +0 -0
  3570. mindspore/lib/libmindspore_profiler.so +0 -0
  3571. mindspore/lib/libmindspore_pyboost.so +0 -0
  3572. mindspore/lib/libmindspore_pynative.so +0 -0
  3573. mindspore/lib/libmindspore_res_manager.so +0 -0
  3574. mindspore/lib/libmindspore_runtime_pipeline.so +0 -0
  3575. mindspore/lib/libmpi_adapter.so +0 -0
  3576. mindspore/lib/libmpi_collective.so +0 -0
  3577. mindspore/lib/libnnacl.so +0 -0
  3578. mindspore/lib/libopencv_core.so.4.5 +0 -0
  3579. mindspore/lib/libopencv_imgcodecs.so.4.5 +0 -0
  3580. mindspore/lib/libopencv_imgproc.so.4.5 +0 -0
  3581. mindspore/lib/libps_cache.so +0 -0
  3582. mindspore/lib/libswresample.so.4 +0 -0
  3583. mindspore/lib/libswscale.so.6 +0 -0
  3584. mindspore/lib/plugin/ascend/custom_aicpu_ops/op_impl/cpu/aicpu_kernel/impl/libcust_cpu_kernels.so +0 -0
  3585. mindspore/lib/plugin/ascend/custom_aicpu_ops/op_impl/cpu/config/cust_aicpu_kernel.json +96 -152
  3586. mindspore/lib/plugin/ascend/custom_aicpu_ops/op_proto/libcust_op_proto.so +0 -0
  3587. mindspore/lib/plugin/ascend/custom_ascendc_910b/framework/plugin/npu_supported_ops.json +0 -8
  3588. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_api/lib/libcust_opapi.so +0 -0
  3589. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/config/ascend310p/aic-ascend310p-ops-info.json +0 -180
  3590. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/config/ascend910_93/aic-ascend910_93-ops-info.json +0 -180
  3591. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/config/ascend910b/aic-ascend910b-ops-info.json +0 -180
  3592. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/custom_ascendc_910b_impl/dynamic/all_finite.py +28 -12
  3593. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/all_finite/AllFinite_52f59e2a65d9b1bb002de35c2819754a.json +2 -1
  3594. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/all_finite/AllFinite_52f59e2a65d9b1bb002de35c2819754a.o +0 -0
  3595. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/all_finite/AllFinite_6b5e50e30256d85838d6ce83514df20f.json +2 -1
  3596. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/all_finite/AllFinite_6b5e50e30256d85838d6ce83514df20f.o +0 -0
  3597. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/all_finite/AllFinite_74e4ac02880d452e3308c94af273562e.json +2 -1
  3598. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/all_finite/AllFinite_74e4ac02880d452e3308c94af273562e.o +0 -0
  3599. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/all_finite/AllFinite_52f59e2a65d9b1bb002de35c2819754a.json +2 -1
  3600. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/all_finite/AllFinite_52f59e2a65d9b1bb002de35c2819754a.o +0 -0
  3601. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/all_finite/AllFinite_6b5e50e30256d85838d6ce83514df20f.json +2 -1
  3602. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/all_finite/AllFinite_6b5e50e30256d85838d6ce83514df20f.o +0 -0
  3603. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/all_finite/AllFinite_74e4ac02880d452e3308c94af273562e.json +2 -1
  3604. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/all_finite/AllFinite_74e4ac02880d452e3308c94af273562e.o +0 -0
  3605. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/all_finite/AllFinite_52f59e2a65d9b1bb002de35c2819754a.json +2 -1
  3606. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/all_finite/AllFinite_52f59e2a65d9b1bb002de35c2819754a.o +0 -0
  3607. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/all_finite/AllFinite_6b5e50e30256d85838d6ce83514df20f.json +2 -1
  3608. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/all_finite/AllFinite_6b5e50e30256d85838d6ce83514df20f.o +0 -0
  3609. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/all_finite/AllFinite_74e4ac02880d452e3308c94af273562e.json +2 -1
  3610. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/all_finite/AllFinite_74e4ac02880d452e3308c94af273562e.o +0 -0
  3611. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/config/ascend310p/binary_info_config.json +0 -300
  3612. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/config/ascend910_93/binary_info_config.json +0 -300
  3613. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/config/ascend910b/binary_info_config.json +0 -300
  3614. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/lib/linux/x86_64/libcust_opmaster_rt2.0.so +0 -0
  3615. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/op_tiling/liboptiling.so +0 -0
  3616. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/inc/op_proto.h +0 -22
  3617. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_proto/lib/linux/x86_64/libcust_opsproto_rt2.0.so +0 -0
  3618. mindspore/lib/plugin/ascend/custom_ascendc_910b/version.info +1 -1
  3619. mindspore/lib/plugin/ascend/custom_compiler/OWNERS +1 -3
  3620. mindspore/lib/plugin/ascend/libakg.so +0 -0
  3621. mindspore/lib/plugin/ascend/libascend_collective.so +0 -0
  3622. mindspore/lib/plugin/ascend/libd_collective.so +0 -0
  3623. mindspore/lib/plugin/ascend/libdvpp_utils.so +0 -0
  3624. mindspore/lib/plugin/ascend/libhccl_plugin.so +0 -0
  3625. mindspore/lib/plugin/ascend/liblowlatency_collective.so +0 -0
  3626. mindspore/lib/plugin/ascend/libmindspore_ascend_res_manager.so +0 -0
  3627. mindspore/lib/plugin/ascend/libmindspore_atb_kernels.so +0 -0
  3628. mindspore/lib/plugin/ascend/libmindspore_cpu_kernels.so +0 -0
  3629. mindspore/lib/plugin/ascend/libmindspore_extension_ascend_atb.a +0 -0
  3630. mindspore/lib/plugin/ascend/libmindspore_graph_ir.so +0 -0
  3631. mindspore/lib/plugin/ascend/libmindspore_internal_kernels.so +0 -0
  3632. mindspore/lib/plugin/ascend/libmindspore_pyboost_atb_kernels.so +0 -0
  3633. mindspore/lib/plugin/ascend/libms_ascend_native_boost.so +0 -0
  3634. mindspore/lib/plugin/ascend/libms_atb_boost.so +0 -0
  3635. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/asdops/params/faUpdate.h +35 -0
  3636. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/asdops/params/logprobs.h +28 -0
  3637. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/asdops/params/params.h +3 -0
  3638. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/asdops/params/scatter_elements_v2.h +39 -0
  3639. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/atbops/params/fused_add_topk_div.h +3 -1
  3640. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/atbops/params/mla.h +14 -1
  3641. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/atbops/params/mla_preprocess.h +8 -1
  3642. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/atbops/params/params.h +1 -0
  3643. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/atbops/params/toppsample_rand.h +31 -0
  3644. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/atbops/params/unpad_flash_attention.h +12 -1
  3645. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/lcal/lcal_api.h +1 -1
  3646. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/lcal/lcal_comm.h +3 -2
  3647. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/lcal/lcal_types.h +1 -0
  3648. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/lcal/lccl.h +2 -0
  3649. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/lcal/lcoc/lcoc_args.h +7 -4
  3650. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/lcal/lcoc/lcoc_func.h +2 -1
  3651. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/lcal/lcoc_args.h +7 -4
  3652. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/lcal/lcoc_func.h +2 -1
  3653. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/mki/tensor.h +2 -1
  3654. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/mki/utils/log/log.h +7 -7
  3655. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/include/mki/utils/log/log_sink_file.h +1 -0
  3656. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/lib/libasdops.so +0 -0
  3657. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/lib/libasdops_static.a +0 -0
  3658. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/lib/libatb_mixops.so +0 -0
  3659. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/lib/libatb_mixops_static.a +0 -0
  3660. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/lib/libexp_mixops_static.a +0 -0
  3661. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/lib/libexp_ops_static.a +0 -0
  3662. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/lib/liblcal.so +0 -0
  3663. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/lib/liblcal_static.a +0 -0
  3664. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/lib/libmki.so +0 -0
  3665. mindspore/lib/plugin/ascend/ms_kernels_internal/asdops/lib/libtbe_adapter.so +0 -0
  3666. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/include/base_type.h +9 -4
  3667. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/include/op_creator.h +41 -12
  3668. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/include/op_param.h +68 -0
  3669. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/include/tiling_utils.h +3 -138
  3670. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libadd_layer_norm_op.so +0 -0
  3671. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libadd_rms_norm_op.so +0 -0
  3672. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libadd_rms_norm_quant_op.so +0 -0
  3673. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libapply_rotary_pos_emb_310p_op.so +0 -0
  3674. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libapply_rotary_pos_emb_op.so +0 -0
  3675. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libcast_op.so +0 -0
  3676. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libcompare_op.so +0 -0
  3677. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libfused_add_topk_div_op.so +0 -0
  3678. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libgelu_op.so +0 -0
  3679. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libgroup_topk_op.so +0 -0
  3680. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libkv_scale_cache_op.so +0 -0
  3681. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libllama_op.so +0 -0
  3682. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libmatmul_op.so +0 -0
  3683. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libmoe_gating_group_topk_op.so +0 -0
  3684. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libmoe_init_routing_op.so +0 -0
  3685. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libmoe_token_unpermute_op.so +0 -0
  3686. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libms_kernels_internal.so +0 -0
  3687. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libmulti_weight_matmul_kernel_gelu_op.so +0 -0
  3688. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libmulti_weight_matmul_kernel_op.so +0 -0
  3689. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libreshape_and_cache_nz_op.so +0 -0
  3690. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libreshape_and_cache_op.so +0 -0
  3691. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/librms_norm_op.so +0 -0
  3692. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libswft_dynamic_quant_op.so +0 -0
  3693. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libswft_matmul_op.so +0 -0
  3694. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libswft_moe_init_routing_op.so +0 -0
  3695. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libswft_paged_attention_op.so +0 -0
  3696. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libswft_reshape_and_cache_nz_op.so +0 -0
  3697. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libswft_transpose_batch_matmul_transpose_op.so +0 -0
  3698. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libswiglu_dynamic_quant_op.so +0 -0
  3699. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/lib/libtranspose_batch_matmul_transpose_op.so +0 -0
  3700. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/object_kernels/internal_grouped_matmul_f16_310p/internal_grouped_matmul_f16_310p.o +0 -0
  3701. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/object_kernels/internal_grouped_matmul_f16_310p/internal_grouped_matmul_f16_310p_0.o +0 -0
  3702. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/object_kernels/internal_grouped_matmul_i8_310p/internal_grouped_matmul_i8_310p.o +0 -0
  3703. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/object_kernels/internal_grouped_matmul_i8_310p/internal_grouped_matmul_i8_310p_0.o +0 -0
  3704. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/object_kernels/internal_pp_matmul_f16_nz/internal_pp_matmul_f16_nz.o +0 -0
  3705. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/object_kernels/internal_pp_matmul_f16_nz/internal_pp_matmul_f16_nz_0.o +0 -0
  3706. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/object_kernels/internal_pp_matmul_i8_nz_compress/internal_pp_matmul_i8_nz_compress.o +0 -0
  3707. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/object_kernels/internal_pp_matmul_i8_nz_compress/internal_pp_matmul_i8_nz_compress_0.o +0 -0
  3708. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/object_kernels/internal_pp_matmul_int8_nz/internal_pp_matmul_int8_nz.o +0 -0
  3709. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/object_kernels/internal_pp_matmul_int8_nz/internal_pp_matmul_int8_nz_0.o +0 -0
  3710. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libadd_rms_norm_ascend310p.so +0 -0
  3711. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libadd_rms_norm_quant_ascend310p.so +0 -0
  3712. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libapply_rotary_pos_emb_310p_ascend310p.so +0 -0
  3713. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libcast_ascend310p.so +0 -0
  3714. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libcompare_ascend310p.so +0 -0
  3715. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libfused_add_topk_div_ascend310p.so +0 -0
  3716. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libgelu_ascend310p.so +0 -0
  3717. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libmatmul_ascend310p.so +0 -0
  3718. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libmoe_gating_group_topk_ascend310p.so +0 -0
  3719. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libmoe_init_routing_ascend310p.so +0 -0
  3720. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libmoe_token_unpermute_ascend310p.so +0 -0
  3721. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libmulti_weight_matmul_kernel_ascend310p.so +0 -0
  3722. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libmulti_weight_matmul_kernel_gelu_ascend310p.so +0 -0
  3723. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libreshape_and_cache_nz_ascend310p.so +0 -0
  3724. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libswft_dynamic_quant_ascend310p.so +0 -0
  3725. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libswft_matmul_ascend310p.so +0 -0
  3726. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libswft_moe_init_routing_ascend310p.so +0 -0
  3727. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libswft_paged_attention_ascend310p.so +0 -0
  3728. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libswft_reshape_and_cache_nz_ascend310p.so +0 -0
  3729. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libswft_transpose_batch_matmul_transpose_ascend310p.so +0 -0
  3730. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend310p/so_kernels/libswiglu_dynamic_quant_ascend310p.so +0 -0
  3731. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/flash_attention_score/flash_attention_score_bf16_bnsd_full_mix.o +0 -0
  3732. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/flash_attention_score/flash_attention_score_bf16_bnsd_tri_mix.o +0 -0
  3733. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/flash_attention_score/flash_attention_score_bf16_bsh_full_mix.o +0 -0
  3734. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/flash_attention_score/flash_attention_score_bf16_bsh_tri_mix.o +0 -0
  3735. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/flash_attention_score/flash_attention_score_fp16_bnsd_full_mix.o +0 -0
  3736. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/flash_attention_score/flash_attention_score_fp16_bnsd_tri_mix.o +0 -0
  3737. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/flash_attention_score/flash_attention_score_fp16_bsh_full_mix.o +0 -0
  3738. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/flash_attention_score/flash_attention_score_fp16_bsh_tri_mix.o +0 -0
  3739. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/internal_matmul_postfusion_mix/internal_matmul_postfusion_mix.o +0 -0
  3740. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/internal_matmul_postfusion_mix/internal_matmul_postfusion_mix_mix_aic_0.o +0 -0
  3741. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/internal_matmul_postfusion_mix/internal_matmul_postfusion_mix_mix_aiv_0.o +0 -0
  3742. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/internal_multi_weight_matmul_postfusion_mix/internal_multi_weight_matmul_postfusion_mix.o +0 -0
  3743. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/internal_multi_weight_matmul_postfusion_mix/internal_multi_weight_matmul_postfusion_mix_mix_aic_0.o +0 -0
  3744. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/internal_multi_weight_matmul_postfusion_mix/internal_multi_weight_matmul_postfusion_mix_mix_aiv_0.o +0 -0
  3745. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/matmul_add_rmsnorm/matmul_add_rmsnorm_bf16_bf16.o +0 -0
  3746. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/matmul_add_rmsnorm/matmul_add_rmsnorm_bf16_fp16.o +0 -0
  3747. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/matmul_add_rmsnorm/matmul_add_rmsnorm_bf16_fp32.o +0 -0
  3748. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/matmul_add_rmsnorm/matmul_add_rmsnorm_fp16_bf16.o +0 -0
  3749. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/matmul_add_rmsnorm/matmul_add_rmsnorm_fp16_fp16.o +0 -0
  3750. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/matmul_add_rmsnorm/matmul_add_rmsnorm_fp16_fp32.o +0 -0
  3751. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/paged_attention_v2/paged_attention_v2.o +0 -0
  3752. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/paged_attention_v2/paged_attention_v2_mix_aic_0.o +0 -0
  3753. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/object_kernels/paged_attention_v2/paged_attention_v2_mix_aiv_0.o +0 -0
  3754. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libadd_layer_norm_ascend910b.so +0 -0
  3755. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libadd_rms_norm_ascend910b.so +0 -0
  3756. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libadd_rms_norm_quant_ascend910b.so +0 -0
  3757. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libapply_rotary_pos_emb_ascend910b.so +0 -0
  3758. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libcast_ascend910b.so +0 -0
  3759. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libcompare_ascend910b.so +0 -0
  3760. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libgelu_ascend910b.so +0 -0
  3761. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libgroup_topk_ascend910b.so +0 -0
  3762. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libkv_scale_cache_ascend910b.so +0 -0
  3763. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libllama_ascend910b.so +0 -0
  3764. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libmatmul_ascend910b.so +0 -0
  3765. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libmoe_gating_group_topk_ascend910b.so +0 -0
  3766. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libmulti_weight_matmul_kernel_ascend910b.so +0 -0
  3767. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libreshape_and_cache_ascend910b.so +0 -0
  3768. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/librms_norm_ascend910b.so +0 -0
  3769. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libswiglu_dynamic_quant_ascend910b.so +0 -0
  3770. mindspore/lib/plugin/ascend/ms_kernels_internal/internal_kernel/op_kernels/ascend910b/so_kernels/libtranspose_batch_matmul_transpose_ascend910b.so +0 -0
  3771. mindspore/lib/plugin/cpu/libakg.so +0 -0
  3772. mindspore/lib/plugin/cpu/libmindspore_cpu_res_manager.so +0 -0
  3773. mindspore/lib/plugin/gpu/libcuda_ops.so.11 +0 -0
  3774. mindspore/lib/plugin/gpu/libmindspore_gpu_res_manager.so +0 -0
  3775. mindspore/lib/plugin/gpu11.1/libakg.so +0 -0
  3776. mindspore/lib/plugin/gpu11.1/libnccl.so.2 +0 -0
  3777. mindspore/lib/plugin/gpu11.1/libnvidia_collective.so +0 -0
  3778. mindspore/lib/plugin/gpu11.6/libakg.so +0 -0
  3779. mindspore/lib/plugin/gpu11.6/libnccl.so.2 +0 -0
  3780. mindspore/lib/plugin/gpu11.6/libnvidia_collective.so +0 -0
  3781. mindspore/lib/plugin/libmindspore_ascend.so.2 +0 -0
  3782. mindspore/lib/plugin/libmindspore_gpu.so.11.1 +0 -0
  3783. mindspore/lib/plugin/libmindspore_gpu.so.11.6 +0 -0
  3784. mindspore/lib/plugin/libmindspore_ops_ascend.so +0 -0
  3785. mindspore/lib/plugin/libmindspore_ops_host.so +0 -0
  3786. mindspore/mindrecord/tools/cifar10.py +61 -11
  3787. mindspore/mindrecord/tools/cifar10_to_mr.py +5 -0
  3788. mindspore/mint/__init__.py +4 -44
  3789. mindspore/mint/distributed/__init__.py +5 -0
  3790. mindspore/mint/distributed/distributed.py +425 -19
  3791. mindspore/mint/nn/__init__.py +1 -1
  3792. mindspore/mint/nn/functional.py +53 -6
  3793. mindspore/mint/nn/layer/_functions.py +163 -294
  3794. mindspore/mint/nn/layer/activation.py +8 -6
  3795. mindspore/mint/nn/layer/conv.py +125 -101
  3796. mindspore/mint/nn/layer/normalization.py +11 -25
  3797. mindspore/mint/optim/adam.py +19 -18
  3798. mindspore/mint/optim/adamw.py +14 -8
  3799. mindspore/mint/optim/sgd.py +5 -5
  3800. mindspore/nn/cell.py +488 -620
  3801. mindspore/nn/grad/cell_grad.py +11 -12
  3802. mindspore/nn/layer/activation.py +36 -36
  3803. mindspore/nn/layer/basic.py +74 -77
  3804. mindspore/nn/layer/channel_shuffle.py +4 -4
  3805. mindspore/nn/layer/combined.py +4 -2
  3806. mindspore/nn/layer/conv.py +86 -85
  3807. mindspore/nn/layer/dense.py +9 -7
  3808. mindspore/nn/layer/embedding.py +50 -52
  3809. mindspore/nn/layer/image.py +38 -40
  3810. mindspore/nn/layer/math.py +111 -112
  3811. mindspore/nn/layer/normalization.py +56 -44
  3812. mindspore/nn/layer/pooling.py +58 -63
  3813. mindspore/nn/layer/rnn_cells.py +33 -33
  3814. mindspore/nn/layer/rnns.py +56 -56
  3815. mindspore/nn/layer/thor_layer.py +74 -73
  3816. mindspore/nn/layer/transformer.py +11 -1
  3817. mindspore/nn/learning_rate_schedule.py +20 -20
  3818. mindspore/nn/loss/loss.py +79 -81
  3819. mindspore/nn/optim/adam.py +2 -4
  3820. mindspore/nn/optim/adasum.py +2 -2
  3821. mindspore/nn/optim/lamb.py +1 -3
  3822. mindspore/nn/optim/optimizer.py +1 -1
  3823. mindspore/nn/optim/tft_wrapper.py +2 -3
  3824. mindspore/nn/optim/thor.py +2 -2
  3825. mindspore/nn/probability/distribution/_utils/utils.py +2 -2
  3826. mindspore/nn/probability/distribution/exponential.py +2 -1
  3827. mindspore/nn/probability/distribution/poisson.py +2 -1
  3828. mindspore/nn/sparse/sparse.py +3 -3
  3829. mindspore/nn/wrap/cell_wrapper.py +73 -42
  3830. mindspore/nn/wrap/grad_reducer.py +37 -52
  3831. mindspore/nn/wrap/loss_scale.py +72 -74
  3832. mindspore/numpy/array_creations.py +7 -7
  3833. mindspore/numpy/fft.py +1 -1
  3834. mindspore/numpy/math_ops.py +1 -1
  3835. mindspore/numpy/utils_const.py +1 -1
  3836. mindspore/ops/_grad_experimental/grad_comm_ops.py +51 -13
  3837. mindspore/ops/_grad_experimental/grad_debug_ops.py +14 -0
  3838. mindspore/ops/_grad_experimental/grad_inner_ops.py +0 -9
  3839. mindspore/ops/_op_impl/cpu/__init__.py +1 -0
  3840. mindspore/ops/_op_impl/cpu/joinedstr_op.py +28 -0
  3841. mindspore/ops/_vmap/vmap_array_ops.py +6 -13
  3842. mindspore/ops/_vmap/vmap_nn_ops.py +8 -16
  3843. mindspore/ops/auto_generate/cpp_create_prim_instance_helper.py +452 -433
  3844. mindspore/ops/auto_generate/gen_extend_func.py +1223 -1273
  3845. mindspore/ops/auto_generate/gen_ops_def.py +6762 -6282
  3846. mindspore/ops/auto_generate/gen_ops_prim.py +16470 -15741
  3847. mindspore/ops/auto_generate/pyboost_inner_prim.py +346 -316
  3848. mindspore/ops/composite/__init__.py +10 -0
  3849. mindspore/ops/composite/base.py +9 -5
  3850. mindspore/ops/composite/multitype_ops/__init__.py +12 -1
  3851. mindspore/ops/composite/multitype_ops/_compile_utils.py +132 -108
  3852. mindspore/ops/composite/multitype_ops/_constexpr_utils.py +1 -1
  3853. mindspore/ops/composite/multitype_ops/add_impl.py +70 -2
  3854. mindspore/ops/composite/multitype_ops/div_impl.py +49 -0
  3855. mindspore/ops/composite/multitype_ops/floordiv_impl.py +29 -0
  3856. mindspore/ops/composite/multitype_ops/getitem_impl.py +11 -0
  3857. mindspore/ops/composite/multitype_ops/mod_impl.py +5 -3
  3858. mindspore/ops/composite/multitype_ops/mul_impl.py +49 -0
  3859. mindspore/ops/composite/multitype_ops/setitem_impl.py +57 -0
  3860. mindspore/ops/composite/multitype_ops/sub_impl.py +34 -0
  3861. mindspore/ops/composite/multitype_ops/zeros_like_impl.py +14 -0
  3862. mindspore/ops/function/__init__.py +4 -1
  3863. mindspore/ops/function/_add_attr_func.py +11 -6
  3864. mindspore/ops/function/array_func.py +17 -100
  3865. mindspore/ops/function/debug_func.py +8 -5
  3866. mindspore/ops/function/grad/grad_func.py +5 -13
  3867. mindspore/ops/function/math_func.py +65 -399
  3868. mindspore/ops/function/nn_func.py +44 -61
  3869. mindspore/ops/function/other_func.py +4 -1
  3870. mindspore/ops/function/random_func.py +31 -4
  3871. mindspore/ops/functional.py +2 -3
  3872. mindspore/ops/functional_overload.py +1271 -803
  3873. mindspore/ops/op_info_register.py +21 -0
  3874. mindspore/ops/operations/__init__.py +5 -2
  3875. mindspore/ops/operations/_custom_ops_utils.py +675 -8
  3876. mindspore/ops/operations/_inner_ops.py +14 -18
  3877. mindspore/ops/operations/_sequence_ops.py +1 -1
  3878. mindspore/ops/operations/array_ops.py +4 -50
  3879. mindspore/ops/operations/comm_ops.py +186 -41
  3880. mindspore/ops/operations/custom_ops.py +244 -175
  3881. mindspore/ops/operations/debug_ops.py +55 -4
  3882. mindspore/ops/operations/image_ops.py +13 -13
  3883. mindspore/ops/operations/manually_defined/ops_def.py +27 -28
  3884. mindspore/ops/operations/math_ops.py +8 -9
  3885. mindspore/ops/operations/nn_ops.py +6 -7
  3886. mindspore/ops/primitive.py +9 -20
  3887. mindspore/ops/tensor_method.py +52 -11
  3888. mindspore/ops_generate/api/cpp_create_prim_instance_helper_generator.py +1 -1
  3889. mindspore/ops_generate/api/functional_map_cpp_generator.py +10 -9
  3890. mindspore/ops_generate/api/functions_cc_generator.py +58 -10
  3891. mindspore/ops_generate/api/tensor_func_reg_cpp_generator.py +1 -1
  3892. mindspore/ops_generate/common/base_generator.py +14 -0
  3893. mindspore/ops_generate/common/gen_constants.py +7 -2
  3894. mindspore/ops_generate/common/gen_utils.py +0 -19
  3895. mindspore/ops_generate/common/op_proto.py +11 -4
  3896. mindspore/ops_generate/common/template.py +88 -11
  3897. mindspore/ops_generate/gen_ops.py +1 -1
  3898. mindspore/ops_generate/op_def/lite_ops_cpp_generator.py +4 -4
  3899. mindspore/ops_generate/op_def/ops_name_h_generator.py +0 -3
  3900. mindspore/ops_generate/op_def/ops_primitive_h_generator.py +0 -4
  3901. mindspore/ops_generate/op_def_py/op_prim_py_generator.py +5 -2
  3902. mindspore/ops_generate/pyboost/auto_grad_impl_cc_generator.py +49 -8
  3903. mindspore/ops_generate/pyboost/auto_grad_reg_cc_generator.py +2 -2
  3904. mindspore/ops_generate/pyboost/gen_pyboost_func.py +31 -16
  3905. mindspore/ops_generate/pyboost/op_template_parser.py +98 -72
  3906. mindspore/ops_generate/pyboost/pyboost_functions_cpp_generator.py +70 -273
  3907. mindspore/ops_generate/pyboost/pyboost_functions_h_generator.py +14 -6
  3908. mindspore/ops_generate/pyboost/pyboost_functions_impl_cpp_generator.py +316 -0
  3909. mindspore/ops_generate/pyboost/pyboost_functions_py_generator.py +1 -1
  3910. mindspore/ops_generate/pyboost/pyboost_grad_function_cpp_generator.py +5 -3
  3911. mindspore/ops_generate/pyboost/pyboost_inner_prim_generator.py +1 -1
  3912. mindspore/ops_generate/pyboost/pyboost_internal_functions_cpp_generator.py +76 -0
  3913. mindspore/ops_generate/pyboost/pyboost_internal_functions_h_generator.py +76 -0
  3914. mindspore/ops_generate/pyboost/pyboost_internal_kernel_info_adapter_generator.py +125 -0
  3915. mindspore/ops_generate/pyboost/pyboost_native_grad_functions_generator.py +4 -3
  3916. mindspore/ops_generate/pyboost/pyboost_op_cpp_code_generator.py +348 -61
  3917. mindspore/ops_generate/pyboost/pyboost_overload_functions_cpp_generator.py +1 -1
  3918. mindspore/ops_generate/pyboost/pyboost_utils.py +118 -9
  3919. mindspore/ops_generate/tensor_py_cc_generator.py +1 -24
  3920. mindspore/parallel/_auto_parallel_context.py +9 -17
  3921. mindspore/parallel/_cell_wrapper.py +106 -40
  3922. mindspore/parallel/_parallel_serialization.py +4 -3
  3923. mindspore/parallel/_ps_context.py +4 -6
  3924. mindspore/parallel/_tensor.py +167 -12
  3925. mindspore/parallel/_transformer/moe.py +1 -1
  3926. mindspore/parallel/_transformer/transformer.py +17 -12
  3927. mindspore/parallel/_utils.py +5 -11
  3928. mindspore/parallel/auto_parallel.py +33 -12
  3929. mindspore/parallel/checkpoint_convert.py +3 -3
  3930. mindspore/parallel/checkpoint_transform.py +5 -1
  3931. mindspore/parallel/cluster/process_entity/_api.py +88 -49
  3932. mindspore/parallel/cluster/process_entity/_utils.py +95 -7
  3933. mindspore/parallel/cluster/run.py +48 -7
  3934. mindspore/parallel/function/__init__.py +8 -1
  3935. mindspore/parallel/function/reshard_func.py +7 -6
  3936. mindspore/parallel/nn/__init__.py +15 -2
  3937. mindspore/parallel/nn/parallel_cell_wrapper.py +50 -14
  3938. mindspore/parallel/nn/parallel_grad_reducer.py +7 -14
  3939. mindspore/parallel/shard.py +9 -23
  3940. mindspore/parallel/transform_safetensors.py +468 -174
  3941. mindspore/profiler/__init__.py +2 -1
  3942. mindspore/profiler/analysis/parser/timeline_assembly_factory/ascend_timeline_assembler.py +7 -7
  3943. mindspore/profiler/analysis/parser/timeline_assembly_factory/base_timeline_assembler.py +3 -0
  3944. mindspore/profiler/analysis/parser/timeline_assembly_factory/trace_view_container.py +3 -0
  3945. mindspore/profiler/analysis/parser/timeline_creator/cpu_op_timeline_creator.py +3 -3
  3946. mindspore/profiler/analysis/parser/timeline_creator/fwk_timeline_creator.py +3 -3
  3947. mindspore/profiler/analysis/parser/timeline_creator/msprof_timeline_creator.py +4 -4
  3948. mindspore/profiler/analysis/parser/timeline_creator/scope_layer_timeline_creator.py +3 -3
  3949. mindspore/profiler/analysis/parser/timeline_event/fwk_event.py +4 -1
  3950. mindspore/profiler/analysis/parser/timeline_event/timeline_event_pool.py +2 -1
  3951. mindspore/profiler/analysis/task_manager.py +1 -1
  3952. mindspore/profiler/analysis/viewer/ascend_communication_viewer.py +5 -1
  3953. mindspore/profiler/analysis/viewer/ascend_integrate_viewer.py +2 -1
  3954. mindspore/profiler/analysis/viewer/ascend_kernel_details_viewer.py +10 -9
  3955. mindspore/profiler/analysis/viewer/ascend_op_memory_viewer.py +43 -23
  3956. mindspore/profiler/analysis/viewer/ascend_step_trace_time_viewer.py +3 -2
  3957. mindspore/profiler/analysis/viewer/ms_minddata_viewer.py +9 -5
  3958. mindspore/profiler/analysis/viewer/ms_operator_details_viewer.py +132 -0
  3959. mindspore/profiler/common/constant.py +16 -0
  3960. mindspore/profiler/common/msprof_cmd_tool.py +2 -2
  3961. mindspore/profiler/common/path_manager.py +9 -0
  3962. mindspore/profiler/common/profiler_context.py +50 -29
  3963. mindspore/profiler/common/profiler_info.py +0 -16
  3964. mindspore/profiler/common/profiler_meta_data.py +1 -0
  3965. mindspore/profiler/common/profiler_op_analyse.py +239 -0
  3966. mindspore/profiler/common/profiler_output_path.py +23 -8
  3967. mindspore/profiler/common/profiler_parameters.py +128 -35
  3968. mindspore/profiler/dynamic_profile/__init__.py +0 -0
  3969. mindspore/profiler/dynamic_profile/dynamic_monitor_proxy.py +39 -0
  3970. mindspore/profiler/dynamic_profile/dynamic_profiler_config_context.py +666 -0
  3971. mindspore/profiler/dynamic_profile/dynamic_profiler_utils.py +62 -0
  3972. mindspore/profiler/dynamic_profiler.py +374 -338
  3973. mindspore/profiler/envprofiler.py +42 -12
  3974. mindspore/profiler/experimental_config.py +112 -7
  3975. mindspore/profiler/mstx.py +33 -12
  3976. mindspore/profiler/platform/__init__.py +2 -3
  3977. mindspore/profiler/platform/cpu_profiler.py +10 -4
  3978. mindspore/profiler/platform/npu_profiler.py +30 -20
  3979. mindspore/profiler/profiler.py +218 -154
  3980. mindspore/profiler/profiler_action_controller.py +65 -77
  3981. mindspore/profiler/profiler_interface.py +2 -2
  3982. mindspore/profiler/schedule.py +10 -4
  3983. mindspore/rewrite/common/config.py +1 -0
  3984. mindspore/rewrite/common/namer.py +1 -0
  3985. mindspore/rewrite/common/namespace.py +1 -0
  3986. mindspore/rewrite/node/node.py +31 -11
  3987. mindspore/rewrite/parsers/assign_parser.py +1 -1
  3988. mindspore/rewrite/symbol_tree/symbol_tree.py +2 -2
  3989. mindspore/run_check/_check_version.py +7 -10
  3990. mindspore/runtime/__init__.py +8 -6
  3991. mindspore/runtime/event.py +10 -4
  3992. mindspore/runtime/executor.py +87 -45
  3993. mindspore/runtime/memory.py +22 -30
  3994. mindspore/runtime/thread_bind_core.py +299 -165
  3995. mindspore/safeguard/rewrite_obfuscation.py +12 -13
  3996. mindspore/scipy/linalg.py +2 -2
  3997. mindspore/scipy/utils_const.py +0 -17
  3998. mindspore/train/_utils.py +9 -5
  3999. mindspore/train/amp.py +43 -23
  4000. mindspore/train/callback/__init__.py +5 -5
  4001. mindspore/train/callback/_callback.py +2 -1
  4002. mindspore/train/callback/_checkpoint.py +4 -14
  4003. mindspore/train/callback/_flops_collector.py +11 -7
  4004. mindspore/train/callback/_landscape.py +0 -1
  4005. mindspore/train/callback/_train_fault_tolerance.py +72 -18
  4006. mindspore/train/data_sink.py +15 -6
  4007. mindspore/train/dataset_helper.py +14 -5
  4008. mindspore/train/model.py +49 -47
  4009. mindspore/train/serialization.py +168 -126
  4010. mindspore/train/summary/summary_record.py +13 -2
  4011. mindspore/train/train_thor/model_thor.py +2 -2
  4012. mindspore/utils/__init__.py +3 -2
  4013. mindspore/utils/bin/dataset-cache +0 -0
  4014. mindspore/utils/bin/dataset-cache-server +0 -0
  4015. mindspore/utils/dryrun.py +0 -6
  4016. mindspore/utils/runtime_execution_order_check.py +162 -78
  4017. mindspore/utils/sdc_detect.py +68 -0
  4018. mindspore/utils/utils.py +14 -17
  4019. mindspore/version.py +1 -1
  4020. mindspore-2.7.0.dist-info/METADATA +368 -0
  4021. mindspore-2.7.0.dist-info/RECORD +12025 -0
  4022. mindspore-2.7.0.dist-info/WHEEL +5 -0
  4023. mindspore/_deprecated/__init__.py +0 -17
  4024. mindspore/_deprecated/jit.py +0 -198
  4025. mindspore/_extends/remote/kernel_build_server_ascend.py +0 -75
  4026. mindspore/common/auto_dynamic_shape.py +0 -504
  4027. mindspore/communication/_hccl_management.py +0 -297
  4028. mindspore/experimental/es/__init__.py +0 -22
  4029. mindspore/experimental/es/embedding_service.py +0 -891
  4030. mindspore/experimental/es/embedding_service_layer.py +0 -581
  4031. mindspore/include/mindspore/ccsrc/backend/common/graph_kernel/proactive_fallback_expander.h +0 -39
  4032. mindspore/include/mindspore/ccsrc/backend/common/session/session_context.h +0 -47
  4033. mindspore/include/mindspore/ccsrc/backend/ge_backend/pass/matmul_allreduce_add_rmsnorm_fusion.h +0 -67
  4034. mindspore/include/mindspore/ccsrc/backend/graph_compiler/backend.h +0 -124
  4035. mindspore/include/mindspore/ccsrc/backend/graph_compiler/backend_base.h +0 -205
  4036. mindspore/include/mindspore/ccsrc/backend/graph_compiler/ge_backend/ge_backend.h +0 -86
  4037. mindspore/include/mindspore/ccsrc/debug/data_dump/data_dumper.h +0 -56
  4038. mindspore/include/mindspore/ccsrc/debug/hooker/acl_data_adapter.h +0 -51
  4039. mindspore/include/mindspore/ccsrc/debug/hooker/adapter.h +0 -75
  4040. mindspore/include/mindspore/ccsrc/debug/hooker/deprecated_env.h +0 -27
  4041. mindspore/include/mindspore/ccsrc/debug/hooker/hook_debugger.h +0 -55
  4042. mindspore/include/mindspore/ccsrc/debug/hooker/hook_dynamic_loader.h +0 -52
  4043. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/decoder_k_v_cache_info.h +0 -58
  4044. mindspore/include/mindspore/ccsrc/frontend/parallel/ops_info/prompt_k_v_cache_info.h +0 -59
  4045. mindspore/include/mindspore/ccsrc/include/backend/debug/data_dump/overflow_dumper.h +0 -50
  4046. mindspore/include/mindspore/ccsrc/include/backend/device_synchronizer.h +0 -49
  4047. mindspore/include/mindspore/ccsrc/include/backend/distributed/rpc/rdma/constants.h +0 -174
  4048. mindspore/include/mindspore/ccsrc/include/backend/distributed/rpc/rdma/rdma_client.h +0 -83
  4049. mindspore/include/mindspore/ccsrc/include/backend/distributed/rpc/rdma/rdma_server.h +0 -71
  4050. mindspore/include/mindspore/ccsrc/include/common/np_dtype/np_dtypes.h +0 -42
  4051. mindspore/include/mindspore/ccsrc/minddata/dataset/kernels/image/lite_image_utils.h +0 -239
  4052. mindspore/include/mindspore/ccsrc/pipeline/jit/pi/utils/ptr_list_ref.h +0 -423
  4053. mindspore/include/mindspore/ccsrc/pipeline/jit/ps/pipeline_jit.h +0 -68
  4054. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/common/ascend_utils.h +0 -43
  4055. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_kernel_runtime.h +0 -88
  4056. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/device/ascend_stream_assign.h +0 -255
  4057. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/hardware/ascend_deprecated_interface.h +0 -46
  4058. mindspore/include/mindspore/ccsrc/plugin/device/ascend/hal/hardware/ge_device_context.h +0 -81
  4059. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/dvm/dvm.h +0 -232
  4060. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/ge/ge_kernel_build.h +0 -28
  4061. mindspore/include/mindspore/ccsrc/plugin/device/ascend/kernel/ge/ge_kernel_mod.h +0 -78
  4062. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/async.h +0 -100
  4063. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/async_logger-inl.h +0 -86
  4064. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/async_logger.h +0 -74
  4065. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/cfg/argv.h +0 -40
  4066. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/cfg/env.h +0 -36
  4067. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/cfg/helpers-inl.h +0 -107
  4068. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/cfg/helpers.h +0 -29
  4069. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/common-inl.h +0 -68
  4070. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/common.h +0 -411
  4071. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/backtracer-inl.h +0 -63
  4072. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/backtracer.h +0 -45
  4073. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/circular_q.h +0 -115
  4074. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/console_globals.h +0 -28
  4075. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/file_helper-inl.h +0 -152
  4076. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/file_helper.h +0 -61
  4077. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/fmt_helper.h +0 -141
  4078. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/log_msg-inl.h +0 -44
  4079. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/log_msg.h +0 -40
  4080. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/log_msg_buffer-inl.h +0 -54
  4081. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/log_msg_buffer.h +0 -32
  4082. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/mpmc_blocking_q.h +0 -177
  4083. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/null_mutex.h +0 -35
  4084. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/os-inl.h +0 -594
  4085. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/os.h +0 -123
  4086. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/periodic_worker-inl.h +0 -26
  4087. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/periodic_worker.h +0 -58
  4088. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/registry-inl.h +0 -261
  4089. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/registry.h +0 -129
  4090. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/synchronous_factory.h +0 -22
  4091. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/tcp_client-windows.h +0 -135
  4092. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/tcp_client.h +0 -127
  4093. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/thread_pool-inl.h +0 -132
  4094. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/thread_pool.h +0 -128
  4095. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/udp_client-windows.h +0 -98
  4096. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/udp_client.h +0 -81
  4097. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/details/windows_include.h +0 -11
  4098. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bin_to_hex.h +0 -224
  4099. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bundled/args.h +0 -235
  4100. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bundled/chrono.h +0 -2240
  4101. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bundled/color.h +0 -643
  4102. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bundled/compile.h +0 -535
  4103. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bundled/core.h +0 -2969
  4104. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bundled/format-inl.h +0 -1678
  4105. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bundled/format.h +0 -4535
  4106. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bundled/locale.h +0 -2
  4107. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bundled/os.h +0 -455
  4108. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bundled/ostream.h +0 -245
  4109. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bundled/printf.h +0 -675
  4110. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bundled/ranges.h +0 -738
  4111. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bundled/std.h +0 -537
  4112. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/bundled/xchar.h +0 -259
  4113. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/chrono.h +0 -23
  4114. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/compile.h +0 -23
  4115. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/fmt.h +0 -30
  4116. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/ostr.h +0 -23
  4117. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/ranges.h +0 -23
  4118. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/std.h +0 -24
  4119. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fmt/xchar.h +0 -23
  4120. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/formatter.h +0 -17
  4121. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/fwd.h +0 -18
  4122. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/logger-inl.h +0 -198
  4123. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/logger.h +0 -379
  4124. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/mdc.h +0 -50
  4125. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/pattern_formatter-inl.h +0 -1338
  4126. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/pattern_formatter.h +0 -118
  4127. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/android_sink.h +0 -137
  4128. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/ansicolor_sink-inl.h +0 -135
  4129. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/ansicolor_sink.h +0 -115
  4130. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/base_sink-inl.h +0 -59
  4131. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/base_sink.h +0 -51
  4132. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/basic_file_sink-inl.h +0 -42
  4133. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/basic_file_sink.h +0 -65
  4134. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/callback_sink.h +0 -56
  4135. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/daily_file_sink.h +0 -255
  4136. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/dist_sink.h +0 -81
  4137. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/dup_filter_sink.h +0 -92
  4138. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/hourly_file_sink.h +0 -193
  4139. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/kafka_sink.h +0 -119
  4140. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/mongo_sink.h +0 -108
  4141. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/msvc_sink.h +0 -68
  4142. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/null_sink.h +0 -41
  4143. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/ostream_sink.h +0 -43
  4144. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/qt_sinks.h +0 -304
  4145. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/ringbuffer_sink.h +0 -67
  4146. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/rotating_file_sink-inl.h +0 -144
  4147. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/rotating_file_sink.h +0 -89
  4148. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/sink-inl.h +0 -22
  4149. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/sink.h +0 -34
  4150. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/stdout_color_sinks-inl.h +0 -38
  4151. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/stdout_color_sinks.h +0 -49
  4152. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/stdout_sinks-inl.h +0 -126
  4153. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/stdout_sinks.h +0 -84
  4154. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/syslog_sink.h +0 -104
  4155. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/systemd_sink.h +0 -121
  4156. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/tcp_sink.h +0 -75
  4157. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/udp_sink.h +0 -69
  4158. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/win_eventlog_sink.h +0 -260
  4159. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/wincolor_sink-inl.h +0 -172
  4160. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/sinks/wincolor_sink.h +0 -82
  4161. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/spdlog-inl.h +0 -92
  4162. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/spdlog.h +0 -352
  4163. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/stopwatch.h +0 -66
  4164. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/tweakme.h +0 -141
  4165. mindspore/include/mindspore/ccsrc/plugin/device/ascend/llm_boost/atb/include/spdlog/version.h +0 -11
  4166. mindspore/include/mindspore/ccsrc/plugin/device/ascend/optimizer/format_type/rectify_do_mask_kernel_info.h +0 -44
  4167. mindspore/include/mindspore/ccsrc/plugin/device/ascend/optimizer/ir_fusion/flash_attention_fusion.h +0 -73
  4168. mindspore/include/mindspore/ccsrc/plugin/device/cpu/hal/device/cpu_hash_table.h +0 -127
  4169. mindspore/include/mindspore/ccsrc/plugin/device/cpu/hal/device/cpu_hash_table_util.h +0 -114
  4170. mindspore/include/mindspore/ccsrc/plugin/device/cpu/hal/device/cpu_kernel_runtime.h +0 -82
  4171. mindspore/include/mindspore/ccsrc/plugin/device/cpu/hal/hardware/cpu_session.h +0 -61
  4172. mindspore/include/mindspore/ccsrc/plugin/device/cpu/kernel/custom/custom_julia_cpu_kernel.h +0 -50
  4173. mindspore/include/mindspore/ccsrc/plugin/device/cpu/kernel/custom/julia_api.h +0 -443
  4174. mindspore/include/mindspore/ccsrc/plugin/device/gpu/hal/device/gpu_kernel_runtime.h +0 -145
  4175. mindspore/include/mindspore/ccsrc/plugin/device/gpu/hal/hardware/gpu_deprecated_interface.h +0 -43
  4176. mindspore/include/mindspore/ccsrc/plugin/device/gpu/hal/hardware/gpu_inference_session.h +0 -50
  4177. mindspore/include/mindspore/ccsrc/plugin/device/gpu/hal/hardware/gpu_session.h +0 -93
  4178. mindspore/include/mindspore/ccsrc/plugin/res_manager/ascend/ascend_device_address/ascend_device_synchronizer.h +0 -45
  4179. mindspore/include/mindspore/ccsrc/plugin/res_manager/cpu/cpu_device_address/cpu_device_synchronizer.h +0 -45
  4180. mindspore/include/mindspore/ccsrc/plugin/res_manager/gpu/device/gpu_device_synchronizer.h +0 -44
  4181. mindspore/include/mindspore/ccsrc/ps/core/communicator/ssl_http.h +0 -60
  4182. mindspore/include/mindspore/ccsrc/pynative/grad/auto_grad.h +0 -77
  4183. mindspore/include/mindspore/ccsrc/pynative/grad/ir/bprop_tensor_replace.h +0 -58
  4184. mindspore/include/mindspore/ccsrc/pynative/grad/ir/dynamic_shape.h +0 -204
  4185. mindspore/include/mindspore/ccsrc/pynative/grad/ir/ir_bprop.h +0 -163
  4186. mindspore/include/mindspore/ccsrc/pynative/grad/ir/ir_grad.h +0 -114
  4187. mindspore/include/mindspore/ccsrc/pynative/grad/ir/ir_pass.h +0 -71
  4188. mindspore/include/mindspore/ccsrc/pynative/grad/jit/jit_dfunctor.h +0 -28
  4189. mindspore/include/mindspore/ccsrc/pynative/grad/variable.h +0 -466
  4190. mindspore/include/mindspore/ccsrc/pynative/op_function/auto_generate/pyboost_functions.h +0 -1045
  4191. mindspore/include/mindspore/ccsrc/runtime/device/kernel_runtime.h +0 -223
  4192. mindspore/include/mindspore/ccsrc/runtime/device/kernel_runtime_manager.h +0 -71
  4193. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/control_flow/condition_gather_actor.h +0 -78
  4194. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/control_flow/condition_switch_actor.h +0 -91
  4195. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/actor/custom_actor.h +0 -66
  4196. mindspore/include/mindspore/ccsrc/runtime/graph_scheduler/inline_control_flow_scheduler.h +0 -81
  4197. mindspore/include/mindspore/ccsrc/runtime/hardware/deprecated_interface.h +0 -47
  4198. mindspore/include/mindspore/core/include/base/fp8_e4m3.h +0 -263
  4199. mindspore/include/mindspore/core/include/base/fp8_e5m2.h +0 -258
  4200. mindspore/include/mindspore/core/include/ir/base_tensor.h +0 -1073
  4201. mindspore/include/mindspore/ops/infer/masked_scatter.h +0 -44
  4202. mindspore/include/mindspore/ops/infer/ops_func_impl/decoder_k_v_cache.h +0 -40
  4203. mindspore/include/mindspore/ops/infer/ops_func_impl/moe_token_unpermute.h +0 -36
  4204. mindspore/include/mindspore/ops/infer/ops_func_impl/prompt_k_v_cache.h +0 -40
  4205. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/densetodense_set_operation.h +0 -47
  4206. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/densetosparsesetoperation.h +0 -74
  4207. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/lu.h +0 -35
  4208. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/ragged_tensor_to_sparse.h +0 -92
  4209. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/ragged_tensor_to_tensor.h +0 -120
  4210. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/sample_distorted_bounding_box_ext2.h +0 -103
  4211. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/scale_and_translate.h +0 -77
  4212. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/sparse_cross.h +0 -111
  4213. mindspore/include/mindspore/ops/kernel/ascend/aicpu/aicpu_ops/cpu_kernel/ms_kernel/sparse_sparse_maximum.h +0 -61
  4214. mindspore/include/mindspore/ops/kernel/ascend/ascendc/op_host/decoder_kv_cache_tiling.h +0 -40
  4215. mindspore/include/mindspore/ops/kernel/ascend/ascendc/op_host/prompt_kv_cache_tiling.h +0 -39
  4216. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/conv3d_padding_aclnn_kernel.h +0 -78
  4217. mindspore/include/mindspore/ops/kernel/ascend/opapi/aclnn/moe_token_unpermute_aclnn_kernel.h +0 -45
  4218. mindspore/include/mindspore/ops/kernel/cpu/nnacl/arithmetic_self_parameter.h +0 -30
  4219. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/batch_to_space_base.h +0 -33
  4220. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/cast_base.h +0 -74
  4221. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/concat_base.h +0 -32
  4222. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/conv1x1_base.h +0 -32
  4223. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/conv_common_base.h +0 -41
  4224. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/crop_base.h +0 -35
  4225. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/depth_to_space_base.h +0 -31
  4226. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/fill_base.h +0 -33
  4227. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/format_transpose.h +0 -30
  4228. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/gather_d_base.h +0 -55
  4229. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/minimal_filtering_generator.h +0 -58
  4230. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/scatter_nd_binary.h +0 -37
  4231. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/space_to_depth_base.h +0 -31
  4232. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/split_with_over_lap_base.h +0 -33
  4233. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/stack_base.h +0 -30
  4234. mindspore/include/mindspore/ops/kernel/cpu/nnacl/base/transpose_base.h +0 -69
  4235. mindspore/include/mindspore/ops/kernel/cpu/nnacl/batchnorm_parameter.h +0 -29
  4236. mindspore/include/mindspore/ops/kernel/cpu/nnacl/call_parameter.h +0 -28
  4237. mindspore/include/mindspore/ops/kernel/cpu/nnacl/clip_parameter.h +0 -29
  4238. mindspore/include/mindspore/ops/kernel/cpu/nnacl/conv3d_parameter.h +0 -26
  4239. mindspore/include/mindspore/ops/kernel/cpu/nnacl/cumsum_parameter.h +0 -29
  4240. mindspore/include/mindspore/ops/kernel/cpu/nnacl/custom_gru_parameter.h +0 -31
  4241. mindspore/include/mindspore/ops/kernel/cpu/nnacl/custom_is_inf_parameter.h +0 -26
  4242. mindspore/include/mindspore/ops/kernel/cpu/nnacl/custom_masked_fill_parameter.h +0 -26
  4243. mindspore/include/mindspore/ops/kernel/cpu/nnacl/custom_parameter.h +0 -30
  4244. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fill_parameter.h +0 -25
  4245. mindspore/include/mindspore/ops/kernel/cpu/nnacl/format_transpose_parameter.h +0 -29
  4246. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/activation_fp16.h +0 -43
  4247. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/arg_min_max_fp16.h +0 -33
  4248. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/arithmetic_self_fp16.h +0 -57
  4249. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/batchnorm_fp16.h +0 -36
  4250. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/cast_fp16.h +0 -94
  4251. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/common_func_fp16.h +0 -40
  4252. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/constant_of_shape_fp16.h +0 -38
  4253. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/conv_depthwise_fp16.h +0 -65
  4254. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/conv_fp16.h +0 -60
  4255. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/crop_fp16.h +0 -26
  4256. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/custom_gru_fp16.h +0 -32
  4257. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/deconv_fp16.h +0 -36
  4258. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/deconv_winograd_fp16.h +0 -48
  4259. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/dynamic_quant_fp16.h +0 -35
  4260. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/fill_fp16.h +0 -34
  4261. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/gru_fp16.h +0 -30
  4262. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/instance_norm_fp16.h +0 -32
  4263. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/layer_norm_fp16.h +0 -33
  4264. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/log_softmax_fp16.h +0 -35
  4265. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/lstm_fp16.h +0 -54
  4266. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/matmul_fp16.h +0 -128
  4267. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/matrix_fp16.h +0 -36
  4268. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/pack_fp16.h +0 -93
  4269. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/pad_fp16.h +0 -32
  4270. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/power_fp16.h +0 -64
  4271. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/prelu_fp16.h +0 -31
  4272. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/quant_dtype_cast_fp16.h +0 -35
  4273. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/range_fp16.h +0 -27
  4274. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/reduce_fp16.h +0 -41
  4275. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/resize_fp16.h +0 -56
  4276. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/scale_fp16.h +0 -38
  4277. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/softmax_fp16.h +0 -35
  4278. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/sparse_to_dense_fp16.h +0 -31
  4279. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/splice_fp16.h +0 -31
  4280. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/topk_fp16.h +0 -35
  4281. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/transpose_fp16.h +0 -35
  4282. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/unique_fp16.h +0 -29
  4283. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/utils_fp16.h +0 -25
  4284. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/where_fp16.h +0 -32
  4285. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/winograd_transform_fp16.h +0 -57
  4286. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16/winograd_utils_fp16.h +0 -571
  4287. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16_grad/activation_grad_fp16.h +0 -44
  4288. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16_grad/arithmetic_grad.h +0 -41
  4289. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16_grad/arithmetic_self_grad.h +0 -39
  4290. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16_grad/batch_norm.h +0 -40
  4291. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16_grad/convolution_grad_filter.h +0 -33
  4292. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16_grad/convolution_grad_input.h +0 -33
  4293. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16_grad/dropout_grad.h +0 -32
  4294. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16_grad/gemm_fp16.h +0 -46
  4295. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16_grad/layernorm_grad.h +0 -32
  4296. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16_grad/pack_fp16_ext.h +0 -37
  4297. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16_grad/pooling_grad.h +0 -34
  4298. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16_grad/resize_grad.h +0 -45
  4299. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16_grad/strided_slice_grad.h +0 -31
  4300. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp16_grad/unsorted_segment_sum.h +0 -31
  4301. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/adder_fp32.h +0 -47
  4302. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/arg_min_max_fp32.h +0 -34
  4303. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/arithmetic_compare_fp32.h +0 -77
  4304. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/attention_fp32.h +0 -72
  4305. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/batchnorm_fp32.h +0 -40
  4306. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/bias_add.h +0 -34
  4307. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/common_func_fp32.h +0 -106
  4308. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/constant_of_shape_fp32.h +0 -52
  4309. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/conv_1x1_avx_fp32.h +0 -40
  4310. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/conv_1x1_x86_fp32.h +0 -21
  4311. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/conv_common_fp32.h +0 -60
  4312. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/conv_depthwise_avx_fp32.h +0 -37
  4313. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/conv_depthwise_fp32.h +0 -148
  4314. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/conv_im2col_avx512_fp32.h +0 -38
  4315. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/conv_im2col_fp32.h +0 -33
  4316. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/conv_sw.h +0 -132
  4317. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/conv_sw_arm64_fp32.h +0 -33
  4318. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/conv_sw_avx_fp32.h +0 -42
  4319. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/conv_winograd_fp32.h +0 -48
  4320. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/crop_fp32.h +0 -34
  4321. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/cumsum_fp32.h +0 -32
  4322. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/custom_gru_fp32.h +0 -32
  4323. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/deconv_fp32.h +0 -37
  4324. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/deconv_winograd_fp32.h +0 -46
  4325. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/detection_post_process_fp32.h +0 -60
  4326. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/embedding_lookup_fp32.h +0 -43
  4327. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/group_norm_fp32.h +0 -35
  4328. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/gru_fp32.h +0 -30
  4329. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/instance_norm_fp32.h +0 -50
  4330. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/invert_permutation_fp32.h +0 -30
  4331. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/l2_norm_fp32.h +0 -34
  4332. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/layer_norm_fp32.h +0 -33
  4333. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/local_response_norm_fp32.h +0 -26
  4334. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/log_softmax_fp32.h +0 -31
  4335. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/matmul_avx512_mask_fp32.h +0 -209
  4336. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/non_max_suppression_fp32.h +0 -25
  4337. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/online_fusion/cast_gather_reduce_fp32.h +0 -37
  4338. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/online_fusion/reduce_concat_fp32.h +0 -34
  4339. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/online_fusion/split_reduce_concat_fp32.h +0 -33
  4340. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/pad_fp32.h +0 -40
  4341. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/prelu_fp32.h +0 -31
  4342. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/prior_box_fp32.h +0 -41
  4343. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/range_fp32.h +0 -34
  4344. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/rank_fp32.h +0 -32
  4345. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/resize_fp32.h +0 -74
  4346. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/reverse_fp32.h +0 -31
  4347. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/reverse_sequence_fp32.h +0 -33
  4348. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/scale_fp32.h +0 -35
  4349. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/sparse_to_dense_fp32.h +0 -31
  4350. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/splice_fp32.h +0 -26
  4351. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/transpose_fp32.h +0 -35
  4352. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/transpose_server_fp32.h +0 -40
  4353. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/triu_tril_fp32.h +0 -42
  4354. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/unique_fp32.h +0 -36
  4355. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/where_fp32.h +0 -32
  4356. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/winograd_avx.h +0 -299
  4357. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/winograd_transform.h +0 -51
  4358. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32/winograd_utils.h +0 -373
  4359. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/batch_norm_grad.h +0 -37
  4360. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/batch_norm_parameter.h +0 -28
  4361. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/binary_cross_entropy_grad.h +0 -36
  4362. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/convolution_grad_filter.h +0 -32
  4363. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/convolution_grad_input.h +0 -32
  4364. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/dropout_parameter.h +0 -27
  4365. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/layernorm_grad.h +0 -29
  4366. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/nllloss_grad_fp32.h +0 -31
  4367. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/optimizer.h +0 -40
  4368. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/pack_ext.h +0 -39
  4369. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/pooling_grad.h +0 -34
  4370. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/reduce_grad.h +0 -30
  4371. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/smooth_l1_loss.h +0 -27
  4372. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/softmax_cross_entropy_with_logits.h +0 -33
  4373. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_grad/softmax_grad_utils.h +0 -33
  4374. mindspore/include/mindspore/ops/kernel/cpu/nnacl/fp32_sparse/matmul_sparse_x1_fp32.h +0 -41
  4375. mindspore/include/mindspore/ops/kernel/cpu/nnacl/gather_nd_parameter.h +0 -26
  4376. mindspore/include/mindspore/ops/kernel/cpu/nnacl/gelu_parameter.h +0 -28
  4377. mindspore/include/mindspore/ops/kernel/cpu/nnacl/grid_sampler_parameter.h +0 -28
  4378. mindspore/include/mindspore/ops/kernel/cpu/nnacl/group_norm_parameter.h +0 -41
  4379. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/cast_gather_reduce_infer.h +0 -31
  4380. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/control/tensor_array_infer.h +0 -31
  4381. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/control/tensor_array_read_infer.h +0 -31
  4382. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/control/tensor_array_write_infer.h +0 -31
  4383. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/control/tensorlist_fromtensor_infer.h +0 -31
  4384. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/control/tensorlist_getitem_infer.h +0 -32
  4385. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/control/tensorlist_reserve_infer.h +0 -31
  4386. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/control/tensorlist_setitem_infer.h +0 -31
  4387. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/control/tensorlist_stack_infer.h +0 -31
  4388. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/conv3d_infer.h +0 -32
  4389. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/custom_is_inf_infer.h +0 -31
  4390. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/custom_masked_fill_infer.h +0 -31
  4391. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/custom_tensor_scatter_max_infer.h +0 -31
  4392. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/format_transpose_infer.h +0 -31
  4393. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/gather_d_infer.h +0 -33
  4394. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/grid_sampler_infer.h +0 -32
  4395. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/group_norm_infer.h +0 -31
  4396. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/reduce_concat_infer.h +0 -31
  4397. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/sparse_fill_empty_rows_infer.h +0 -31
  4398. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/sparse_reshape_infer.h +0 -31
  4399. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/sparse_segment_sum_infer.h +0 -31
  4400. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/split_reduce_concat_infer.h +0 -31
  4401. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/string/custom_extract_features_infer.h +0 -31
  4402. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/string/custom_normalize_infer.h +0 -32
  4403. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/string/custom_predict_infer.h +0 -36
  4404. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/string/hashtable_lookup_infer.h +0 -31
  4405. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/string/lsh_projection_infer.h +0 -32
  4406. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/string/skip_gram_infer.h +0 -31
  4407. mindspore/include/mindspore/ops/kernel/cpu/nnacl/infer/triu_tril_infer.h +0 -32
  4408. mindspore/include/mindspore/ops/kernel/cpu/nnacl/instance_norm_parameter.h +0 -32
  4409. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/add_int8.h +0 -70
  4410. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/arg_min_max_int8.h +0 -41
  4411. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/arithmetic_int8.h +0 -51
  4412. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/arithmetic_self_int8.h +0 -59
  4413. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/batch_to_space_int8.h +0 -33
  4414. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/batchnorm_int8.h +0 -34
  4415. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/common_func_int8.h +0 -95
  4416. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/concat_int8.h +0 -33
  4417. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/conv1x1_int8.h +0 -46
  4418. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/conv3x3_int8.h +0 -48
  4419. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/conv_depthwise_int8.h +0 -49
  4420. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/conv_int8.h +0 -44
  4421. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/crop_int8.h +0 -31
  4422. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/deconv_int8.h +0 -46
  4423. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/depth_to_space_int8.h +0 -32
  4424. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/div_int8.h +0 -37
  4425. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/dynamic_gather_int8.h +0 -40
  4426. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/dynamic_matmul_int8.h +0 -74
  4427. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/dynamic_quant_int8.h +0 -34
  4428. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/gatherNd_int8.h +0 -32
  4429. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/gather_int8.h +0 -35
  4430. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/hswish_int8.h +0 -43
  4431. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/l2_norm_int8.h +0 -32
  4432. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/layer_norm_int8.h +0 -35
  4433. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/leaky_relu_int8.h +0 -31
  4434. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/matmul_int8.h +0 -93
  4435. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/mul_int8.h +0 -39
  4436. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/pack_int8.h +0 -56
  4437. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/pad_int8.h +0 -35
  4438. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/pooling_int8.h +0 -50
  4439. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/power_int8.h +0 -33
  4440. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/quant_dtype_cast_int8.h +0 -56
  4441. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/reduce_int8.h +0 -70
  4442. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/relux_int8.h +0 -43
  4443. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/reshape_int8.h +0 -32
  4444. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/resize_int8.h +0 -50
  4445. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/scale_int8.h +0 -35
  4446. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/sigmoid_int8.h +0 -32
  4447. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/slice_int8.h +0 -35
  4448. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/softmax_int8.h +0 -35
  4449. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/space_to_batch_int8.h +0 -32
  4450. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/split_int8.h +0 -33
  4451. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/squeeze_int8.h +0 -32
  4452. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/sub_int8.h +0 -32
  4453. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/tanh_int8.h +0 -43
  4454. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/topk_int8.h +0 -36
  4455. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/transpose_int8.h +0 -36
  4456. mindspore/include/mindspore/ops/kernel/cpu/nnacl/int8/unsqueeze_int8.h +0 -33
  4457. mindspore/include/mindspore/ops/kernel/cpu/nnacl/intrinsics/avx/common_utils.h +0 -157
  4458. mindspore/include/mindspore/ops/kernel/cpu/nnacl/intrinsics/sse/sse_common.h +0 -390
  4459. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/activation.h +0 -25
  4460. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/addn.h +0 -35
  4461. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/arg_min_max.h +0 -63
  4462. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/arithmetic_compare.h +0 -26
  4463. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/arithmetic_self.h +0 -48
  4464. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/batch_norm.h +0 -38
  4465. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/batch_to_space.h +0 -33
  4466. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/biasadd.h +0 -25
  4467. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/cast.h +0 -32
  4468. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/clip.h +0 -34
  4469. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/concat.h +0 -52
  4470. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_1x1.h +0 -42
  4471. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_base.h +0 -63
  4472. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_delegate.h +0 -39
  4473. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_depthwise.h +0 -36
  4474. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_depthwise_3x3.h +0 -37
  4475. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_depthwise_indirect.h +0 -39
  4476. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_depthwise_sw.h +0 -36
  4477. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_depthwise_sw_avx.h +0 -40
  4478. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_im2col.h +0 -28
  4479. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_im2col_arm32.h +0 -30
  4480. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_im2col_arm64.h +0 -29
  4481. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_im2col_avx.h +0 -29
  4482. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_im2col_avx512.h +0 -29
  4483. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_im2col_base.h +0 -52
  4484. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_im2col_sse.h +0 -29
  4485. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_slidewindow.h +0 -46
  4486. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_sw_1x1.h +0 -36
  4487. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_sw_arm64.h +0 -28
  4488. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_sw_avx.h +0 -28
  4489. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_winograd.h +0 -32
  4490. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_winograd_arm32.h +0 -30
  4491. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_winograd_arm64.h +0 -30
  4492. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_winograd_avx.h +0 -30
  4493. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_winograd_base.h +0 -65
  4494. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/convolution_winograd_sse.h +0 -30
  4495. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/crop.h +0 -31
  4496. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/crop_and_resize.h +0 -41
  4497. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/deconvolution.h +0 -39
  4498. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/deconvolution_depthwise.h +0 -34
  4499. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/deconvolution_winograd.h +0 -52
  4500. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/depth_to_space.h +0 -42
  4501. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/f16/arithmetic_compare_f16.h +0 -26
  4502. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/f16/arithmetic_f16.h +0 -42
  4503. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/f16/concat_f16.h +0 -25
  4504. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/f16/reduce_f16.h +0 -27
  4505. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/f16/stack_f16.h +0 -32
  4506. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/fill.h +0 -36
  4507. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/fullconnection.h +0 -25
  4508. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/fused_batch_norm.h +0 -37
  4509. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/gather.h +0 -46
  4510. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/gather_d.h +0 -25
  4511. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/gather_nd.h +0 -35
  4512. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/group_convolution.h +0 -49
  4513. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/group_norm.h +0 -31
  4514. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/init_vs_kernels.h +0 -20
  4515. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/layer_norm.h +0 -49
  4516. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/local_response_norm.h +0 -30
  4517. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/log_softmax.h +0 -31
  4518. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/matmul.h +0 -25
  4519. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/matmul_arm32.h +0 -28
  4520. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/matmul_arm64.h +0 -28
  4521. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/matmul_avx.h +0 -28
  4522. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/matmul_avx512.h +0 -27
  4523. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/matmul_base.h +0 -35
  4524. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/matmul_create.h +0 -24
  4525. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/matmul_sse.h +0 -27
  4526. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/non_max_suppression.h +0 -34
  4527. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/non_zero.h +0 -30
  4528. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/ones_like.h +0 -31
  4529. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/pad.h +0 -51
  4530. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/pow.h +0 -31
  4531. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/prelu.h +0 -34
  4532. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/prior_box.h +0 -36
  4533. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/range.h +0 -31
  4534. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/rank.h +0 -31
  4535. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/reduce.h +0 -72
  4536. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/reverse.h +0 -36
  4537. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/scale.h +0 -41
  4538. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/shape.h +0 -31
  4539. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/size.h +0 -30
  4540. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/softmax.h +0 -39
  4541. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/splice.h +0 -30
  4542. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/stack.h +0 -41
  4543. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/transpose.h +0 -49
  4544. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/tril.h +0 -32
  4545. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/triu.h +0 -32
  4546. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/unique.h +0 -32
  4547. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/where.h +0 -44
  4548. mindspore/include/mindspore/ops/kernel/cpu/nnacl/kernel/zeros_like.h +0 -31
  4549. mindspore/include/mindspore/ops/kernel/cpu/nnacl/l2_norm_parameter.h +0 -41
  4550. mindspore/include/mindspore/ops/kernel/cpu/nnacl/local_response_norm_parameter.h +0 -31
  4551. mindspore/include/mindspore/ops/kernel/cpu/nnacl/lsh_projection_parameter.h +0 -35
  4552. mindspore/include/mindspore/ops/kernel/cpu/nnacl/mul_parameter.h +0 -32
  4553. mindspore/include/mindspore/ops/kernel/cpu/nnacl/non_max_suppression_parameter.h +0 -28
  4554. mindspore/include/mindspore/ops/kernel/cpu/nnacl/pack.h +0 -23
  4555. mindspore/include/mindspore/ops/kernel/cpu/nnacl/partial_fusion_parameter.h +0 -29
  4556. mindspore/include/mindspore/ops/kernel/cpu/nnacl/predict_parameter.h +0 -32
  4557. mindspore/include/mindspore/ops/kernel/cpu/nnacl/prelu_parameter.h +0 -26
  4558. mindspore/include/mindspore/ops/kernel/cpu/nnacl/random_parameter.h +0 -34
  4559. mindspore/include/mindspore/ops/kernel/cpu/nnacl/reverse_parameter.h +0 -30
  4560. mindspore/include/mindspore/ops/kernel/cpu/nnacl/reverse_sequence_parameter.h +0 -45
  4561. mindspore/include/mindspore/ops/kernel/cpu/nnacl/scale_parameter.h +0 -39
  4562. mindspore/include/mindspore/ops/kernel/cpu/nnacl/scatter_elements_parameter.h +0 -25
  4563. mindspore/include/mindspore/ops/kernel/cpu/nnacl/scatter_nd_parameter.h +0 -29
  4564. mindspore/include/mindspore/ops/kernel/cpu/nnacl/sigmoid_parameter.h +0 -41
  4565. mindspore/include/mindspore/ops/kernel/cpu/nnacl/skip_gram_parameter.h +0 -30
  4566. mindspore/include/mindspore/ops/kernel/cpu/nnacl/sparse_to_dense_parameter.h +0 -32
  4567. mindspore/include/mindspore/ops/kernel/cpu/nnacl/tensor_array_parameter.h +0 -29
  4568. mindspore/include/mindspore/ops/kernel/cpu/nnacl/triu_tril_parameter.h +0 -31
  4569. mindspore/include/mindspore/ops/kernel/cpu/nnacl/upsample_parameter.h +0 -29
  4570. mindspore/include/mindspore/ops/kernel/cpu/nnacl/where_parameter.h +0 -25
  4571. mindspore/include/mindspore/ops/ops_utils/ms_extension.h +0 -39
  4572. mindspore/include/third_party/securec/src/secinput.h +0 -181
  4573. mindspore/include/third_party/securec/src/securecutil.h +0 -574
  4574. mindspore/include/third_party/securec/src/secureprintoutput.h +0 -153
  4575. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/config/ascend310/aic-ascend310-ops-info.json +0 -123
  4576. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/config/ascend310p/aic-ascend310p-ops-info.json +0 -152
  4577. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/config/ascend910/aic-ascend910-ops-info.json +0 -2048
  4578. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/config/ascend910_93/aic-ascend910_93-ops-info.json +0 -2048
  4579. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/config/ascend910b/aic-ascend910b-ops-info.json +0 -2048
  4580. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/custom_aicore_ops_impl/add_dsl.py +0 -46
  4581. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/custom_aicore_ops_impl/add_tik.py +0 -51
  4582. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/custom_aicore_ops_impl/build_tbe_kernel.py +0 -529
  4583. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/custom_aicore_ops_impl/compiler.py +0 -56
  4584. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/custom_aicore_ops_impl/custom.py +0 -1109
  4585. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/custom_aicore_ops_impl/get_file_path.py +0 -36
  4586. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/custom_aicore_ops_impl/kv_cache_mgr.py +0 -241
  4587. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/custom_aicore_ops_impl/matmul_tik.py +0 -212
  4588. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/ai_core/tbe/custom_aicore_ops_impl/tbe_topi.py +0 -556
  4589. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/vector_core/tbe/custom_aicore_ops_impl/add_dsl.py +0 -46
  4590. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/vector_core/tbe/custom_aicore_ops_impl/add_tik.py +0 -51
  4591. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/vector_core/tbe/custom_aicore_ops_impl/kv_cache_mgr.py +0 -241
  4592. mindspore/lib/plugin/ascend/custom_aicore_ops/op_impl/vector_core/tbe/custom_aicore_ops_impl/matmul_tik.py +0 -212
  4593. mindspore/lib/plugin/ascend/custom_aicore_ops/op_proto/libop_proto.so +0 -0
  4594. mindspore/lib/plugin/ascend/custom_ascendc_910/framework/plugin/npu_supported_ops.json +0 -10
  4595. mindspore/lib/plugin/ascend/custom_ascendc_910/op_api/include/aclnn_decoder_kv_cache.h +0 -59
  4596. mindspore/lib/plugin/ascend/custom_ascendc_910/op_api/include/aclnn_prompt_kv_cache.h +0 -59
  4597. mindspore/lib/plugin/ascend/custom_ascendc_910/op_api/lib/libcust_opapi.so +0 -0
  4598. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/config/ascend910/aic-ascend910-ops-info.json +0 -182
  4599. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/custom_ascendc_910_impl/dynamic/decoder_kv_cache.cpp +0 -192
  4600. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/custom_ascendc_910_impl/dynamic/decoder_kv_cache.py +0 -215
  4601. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/custom_ascendc_910_impl/dynamic/prompt_kv_cache.cpp +0 -274
  4602. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/custom_ascendc_910_impl/dynamic/prompt_kv_cache.py +0 -215
  4603. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_0d5520cc587ad44ce634bf3fbcffc272.json +0 -158
  4604. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_0d5520cc587ad44ce634bf3fbcffc272.o +0 -0
  4605. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_20390d30b3c4c0d23167ccca6c030c2b.json +0 -158
  4606. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_20390d30b3c4c0d23167ccca6c030c2b.o +0 -0
  4607. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_2d151f0b1d2db51faa2968d5b67544e2.json +0 -158
  4608. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_2d151f0b1d2db51faa2968d5b67544e2.o +0 -0
  4609. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_561690ec17cc1def3d2fcf68c1b07b56.json +0 -158
  4610. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_561690ec17cc1def3d2fcf68c1b07b56.o +0 -0
  4611. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_570f9aaa99e5e773b3dd0a33784363f4.json +0 -158
  4612. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_570f9aaa99e5e773b3dd0a33784363f4.o +0 -0
  4613. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_59668a0f0764afb98fda8ab9e84126f1.json +0 -158
  4614. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_59668a0f0764afb98fda8ab9e84126f1.o +0 -0
  4615. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_91d9833e4792b70b670e4e2b916abd86.json +0 -158
  4616. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_91d9833e4792b70b670e4e2b916abd86.o +0 -0
  4617. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_c74cdc5fef094383401856f8519504af.json +0 -158
  4618. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/decoder_kv_cache/DecoderKvCache_c74cdc5fef094383401856f8519504af.o +0 -0
  4619. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_0515c7b1a4cd614449e38c5e9a7e3f8d.json +0 -167
  4620. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_0515c7b1a4cd614449e38c5e9a7e3f8d.o +0 -0
  4621. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_09f22d898d6358c91e7c4fc48bac48e7.json +0 -167
  4622. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_09f22d898d6358c91e7c4fc48bac48e7.o +0 -0
  4623. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_0cb9a6f894b925250227136e5aab7061.json +0 -167
  4624. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_0cb9a6f894b925250227136e5aab7061.o +0 -0
  4625. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_2fa8702ffd7ca85e9e194f62644415d5.json +0 -167
  4626. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_2fa8702ffd7ca85e9e194f62644415d5.o +0 -0
  4627. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_570b62f187dfd439b64613d881deedb7.json +0 -167
  4628. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_570b62f187dfd439b64613d881deedb7.o +0 -0
  4629. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_585218c11411ff84709b9e725b66c435.json +0 -167
  4630. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_585218c11411ff84709b9e725b66c435.o +0 -0
  4631. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_5c9365ccde170b358c5b126d69dae13e.json +0 -167
  4632. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_5c9365ccde170b358c5b126d69dae13e.o +0 -0
  4633. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_6d97c45b7c43bc16fcff8baa5dacac4e.json +0 -167
  4634. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/ascend910/prompt_kv_cache/PromptKvCache_6d97c45b7c43bc16fcff8baa5dacac4e.o +0 -0
  4635. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/config/ascend910/binary_info_config.json +0 -302
  4636. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/config/ascend910/decoder_kv_cache.json +0 -892
  4637. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/kernel/config/ascend910/prompt_kv_cache.json +0 -892
  4638. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/lib/linux/x86_64/libcust_opmaster_rt2.0.so +0 -0
  4639. mindspore/lib/plugin/ascend/custom_ascendc_910/op_impl/ai_core/tbe/op_tiling/liboptiling.so +0 -0
  4640. mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/inc/op_proto.h +0 -33
  4641. mindspore/lib/plugin/ascend/custom_ascendc_910/op_proto/lib/linux/x86_64/libcust_opsproto_rt2.0.so +0 -0
  4642. mindspore/lib/plugin/ascend/custom_ascendc_910/version.info +0 -1
  4643. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_api/include/aclnn_decoder_kv_cache.h +0 -59
  4644. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_api/include/aclnn_prompt_kv_cache.h +0 -59
  4645. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/custom_ascendc_910b_impl/dynamic/decoder_kv_cache.cpp +0 -192
  4646. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/custom_ascendc_910b_impl/dynamic/decoder_kv_cache.py +0 -215
  4647. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/custom_ascendc_910b_impl/dynamic/prompt_kv_cache.cpp +0 -274
  4648. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/custom_ascendc_910b_impl/dynamic/prompt_kv_cache.py +0 -215
  4649. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_0d5520cc587ad44ce634bf3fbcffc272.json +0 -158
  4650. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_0d5520cc587ad44ce634bf3fbcffc272.o +0 -0
  4651. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_20390d30b3c4c0d23167ccca6c030c2b.json +0 -158
  4652. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_20390d30b3c4c0d23167ccca6c030c2b.o +0 -0
  4653. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_2d151f0b1d2db51faa2968d5b67544e2.json +0 -158
  4654. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_2d151f0b1d2db51faa2968d5b67544e2.o +0 -0
  4655. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_561690ec17cc1def3d2fcf68c1b07b56.json +0 -158
  4656. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_561690ec17cc1def3d2fcf68c1b07b56.o +0 -0
  4657. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_570f9aaa99e5e773b3dd0a33784363f4.json +0 -158
  4658. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_570f9aaa99e5e773b3dd0a33784363f4.o +0 -0
  4659. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_59668a0f0764afb98fda8ab9e84126f1.json +0 -158
  4660. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_59668a0f0764afb98fda8ab9e84126f1.o +0 -0
  4661. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_91d9833e4792b70b670e4e2b916abd86.json +0 -158
  4662. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_91d9833e4792b70b670e4e2b916abd86.o +0 -0
  4663. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_c74cdc5fef094383401856f8519504af.json +0 -158
  4664. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/decoder_kv_cache/DecoderKvCache_c74cdc5fef094383401856f8519504af.o +0 -0
  4665. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_0515c7b1a4cd614449e38c5e9a7e3f8d.json +0 -167
  4666. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_0515c7b1a4cd614449e38c5e9a7e3f8d.o +0 -0
  4667. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_09f22d898d6358c91e7c4fc48bac48e7.json +0 -167
  4668. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_09f22d898d6358c91e7c4fc48bac48e7.o +0 -0
  4669. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_0cb9a6f894b925250227136e5aab7061.json +0 -167
  4670. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_0cb9a6f894b925250227136e5aab7061.o +0 -0
  4671. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_2fa8702ffd7ca85e9e194f62644415d5.json +0 -167
  4672. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_2fa8702ffd7ca85e9e194f62644415d5.o +0 -0
  4673. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_570b62f187dfd439b64613d881deedb7.json +0 -167
  4674. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_570b62f187dfd439b64613d881deedb7.o +0 -0
  4675. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_585218c11411ff84709b9e725b66c435.json +0 -167
  4676. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_585218c11411ff84709b9e725b66c435.o +0 -0
  4677. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_5c9365ccde170b358c5b126d69dae13e.json +0 -167
  4678. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_5c9365ccde170b358c5b126d69dae13e.o +0 -0
  4679. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_6d97c45b7c43bc16fcff8baa5dacac4e.json +0 -167
  4680. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend310p/prompt_kv_cache/PromptKvCache_6d97c45b7c43bc16fcff8baa5dacac4e.o +0 -0
  4681. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_0d5520cc587ad44ce634bf3fbcffc272.json +0 -156
  4682. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_0d5520cc587ad44ce634bf3fbcffc272.o +0 -0
  4683. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_20390d30b3c4c0d23167ccca6c030c2b.json +0 -156
  4684. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_20390d30b3c4c0d23167ccca6c030c2b.o +0 -0
  4685. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_2d151f0b1d2db51faa2968d5b67544e2.json +0 -156
  4686. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_2d151f0b1d2db51faa2968d5b67544e2.o +0 -0
  4687. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_561690ec17cc1def3d2fcf68c1b07b56.json +0 -156
  4688. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_561690ec17cc1def3d2fcf68c1b07b56.o +0 -0
  4689. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_570f9aaa99e5e773b3dd0a33784363f4.json +0 -156
  4690. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_570f9aaa99e5e773b3dd0a33784363f4.o +0 -0
  4691. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_59668a0f0764afb98fda8ab9e84126f1.json +0 -156
  4692. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_59668a0f0764afb98fda8ab9e84126f1.o +0 -0
  4693. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_91d9833e4792b70b670e4e2b916abd86.json +0 -156
  4694. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_91d9833e4792b70b670e4e2b916abd86.o +0 -0
  4695. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_c74cdc5fef094383401856f8519504af.json +0 -156
  4696. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/decoder_kv_cache/DecoderKvCache_c74cdc5fef094383401856f8519504af.o +0 -0
  4697. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_0515c7b1a4cd614449e38c5e9a7e3f8d.json +0 -165
  4698. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_0515c7b1a4cd614449e38c5e9a7e3f8d.o +0 -0
  4699. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_09f22d898d6358c91e7c4fc48bac48e7.json +0 -165
  4700. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_09f22d898d6358c91e7c4fc48bac48e7.o +0 -0
  4701. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_0cb9a6f894b925250227136e5aab7061.json +0 -165
  4702. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_0cb9a6f894b925250227136e5aab7061.o +0 -0
  4703. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_2fa8702ffd7ca85e9e194f62644415d5.json +0 -165
  4704. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_2fa8702ffd7ca85e9e194f62644415d5.o +0 -0
  4705. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_570b62f187dfd439b64613d881deedb7.json +0 -165
  4706. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_570b62f187dfd439b64613d881deedb7.o +0 -0
  4707. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_585218c11411ff84709b9e725b66c435.json +0 -165
  4708. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_585218c11411ff84709b9e725b66c435.o +0 -0
  4709. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_5c9365ccde170b358c5b126d69dae13e.json +0 -165
  4710. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_5c9365ccde170b358c5b126d69dae13e.o +0 -0
  4711. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_6d97c45b7c43bc16fcff8baa5dacac4e.json +0 -165
  4712. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910_93/prompt_kv_cache/PromptKvCache_6d97c45b7c43bc16fcff8baa5dacac4e.o +0 -0
  4713. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_0d5520cc587ad44ce634bf3fbcffc272.json +0 -156
  4714. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_0d5520cc587ad44ce634bf3fbcffc272.o +0 -0
  4715. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_20390d30b3c4c0d23167ccca6c030c2b.json +0 -156
  4716. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_20390d30b3c4c0d23167ccca6c030c2b.o +0 -0
  4717. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_2d151f0b1d2db51faa2968d5b67544e2.json +0 -156
  4718. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_2d151f0b1d2db51faa2968d5b67544e2.o +0 -0
  4719. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_561690ec17cc1def3d2fcf68c1b07b56.json +0 -156
  4720. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_561690ec17cc1def3d2fcf68c1b07b56.o +0 -0
  4721. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_570f9aaa99e5e773b3dd0a33784363f4.json +0 -156
  4722. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_570f9aaa99e5e773b3dd0a33784363f4.o +0 -0
  4723. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_59668a0f0764afb98fda8ab9e84126f1.json +0 -156
  4724. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_59668a0f0764afb98fda8ab9e84126f1.o +0 -0
  4725. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_91d9833e4792b70b670e4e2b916abd86.json +0 -156
  4726. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_91d9833e4792b70b670e4e2b916abd86.o +0 -0
  4727. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_c74cdc5fef094383401856f8519504af.json +0 -156
  4728. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/decoder_kv_cache/DecoderKvCache_c74cdc5fef094383401856f8519504af.o +0 -0
  4729. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_0515c7b1a4cd614449e38c5e9a7e3f8d.json +0 -165
  4730. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_0515c7b1a4cd614449e38c5e9a7e3f8d.o +0 -0
  4731. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_09f22d898d6358c91e7c4fc48bac48e7.json +0 -165
  4732. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_09f22d898d6358c91e7c4fc48bac48e7.o +0 -0
  4733. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_0cb9a6f894b925250227136e5aab7061.json +0 -165
  4734. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_0cb9a6f894b925250227136e5aab7061.o +0 -0
  4735. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_2fa8702ffd7ca85e9e194f62644415d5.json +0 -165
  4736. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_2fa8702ffd7ca85e9e194f62644415d5.o +0 -0
  4737. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_570b62f187dfd439b64613d881deedb7.json +0 -165
  4738. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_570b62f187dfd439b64613d881deedb7.o +0 -0
  4739. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_585218c11411ff84709b9e725b66c435.json +0 -165
  4740. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_585218c11411ff84709b9e725b66c435.o +0 -0
  4741. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_5c9365ccde170b358c5b126d69dae13e.json +0 -165
  4742. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_5c9365ccde170b358c5b126d69dae13e.o +0 -0
  4743. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_6d97c45b7c43bc16fcff8baa5dacac4e.json +0 -165
  4744. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/ascend910b/prompt_kv_cache/PromptKvCache_6d97c45b7c43bc16fcff8baa5dacac4e.o +0 -0
  4745. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/config/ascend310p/decoder_kv_cache.json +0 -892
  4746. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/config/ascend310p/prompt_kv_cache.json +0 -892
  4747. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/config/ascend910_93/decoder_kv_cache.json +0 -892
  4748. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/config/ascend910_93/prompt_kv_cache.json +0 -892
  4749. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/config/ascend910b/decoder_kv_cache.json +0 -892
  4750. mindspore/lib/plugin/ascend/custom_ascendc_910b/op_impl/ai_core/tbe/kernel/config/ascend910b/prompt_kv_cache.json +0 -892
  4751. mindspore/lib/plugin/libmindspore_gpu_res_manager.so +0 -0
  4752. mindspore/profiler/common/validator/__init__.py +0 -14
  4753. mindspore/profiler/common/validator/validate_path.py +0 -84
  4754. mindspore/profiler/parser/__init__.py +0 -14
  4755. mindspore/profiler/parser/aicpu_data_parser.py +0 -272
  4756. mindspore/profiler/parser/ascend_analysis/__init__.py +0 -14
  4757. mindspore/profiler/parser/ascend_analysis/constant.py +0 -71
  4758. mindspore/profiler/parser/ascend_analysis/file_manager.py +0 -180
  4759. mindspore/profiler/parser/ascend_analysis/function_event.py +0 -185
  4760. mindspore/profiler/parser/ascend_analysis/fwk_cann_parser.py +0 -136
  4761. mindspore/profiler/parser/ascend_analysis/fwk_file_parser.py +0 -131
  4762. mindspore/profiler/parser/ascend_analysis/msprof_timeline_parser.py +0 -104
  4763. mindspore/profiler/parser/ascend_analysis/path_manager.py +0 -313
  4764. mindspore/profiler/parser/ascend_analysis/profiler_info_parser.py +0 -123
  4765. mindspore/profiler/parser/ascend_analysis/tlv_decoder.py +0 -86
  4766. mindspore/profiler/parser/ascend_analysis/trace_event_manager.py +0 -75
  4767. mindspore/profiler/parser/ascend_cluster_generator.py +0 -116
  4768. mindspore/profiler/parser/ascend_communicate_generator.py +0 -314
  4769. mindspore/profiler/parser/ascend_flops_generator.py +0 -116
  4770. mindspore/profiler/parser/ascend_fpbp_generator.py +0 -82
  4771. mindspore/profiler/parser/ascend_hccl_generator.py +0 -271
  4772. mindspore/profiler/parser/ascend_integrate_generator.py +0 -42
  4773. mindspore/profiler/parser/ascend_memory_generator.py +0 -185
  4774. mindspore/profiler/parser/ascend_msprof_exporter.py +0 -282
  4775. mindspore/profiler/parser/ascend_msprof_generator.py +0 -187
  4776. mindspore/profiler/parser/ascend_op_generator.py +0 -334
  4777. mindspore/profiler/parser/ascend_steptrace_generator.py +0 -94
  4778. mindspore/profiler/parser/ascend_timeline_generator.py +0 -545
  4779. mindspore/profiler/parser/base_timeline_generator.py +0 -483
  4780. mindspore/profiler/parser/container.py +0 -229
  4781. mindspore/profiler/parser/cpu_gpu_timeline_generator.py +0 -697
  4782. mindspore/profiler/parser/flops_parser.py +0 -531
  4783. mindspore/profiler/parser/framework_enum.py +0 -111
  4784. mindspore/profiler/parser/framework_parser.py +0 -464
  4785. mindspore/profiler/parser/framework_struct.py +0 -61
  4786. mindspore/profiler/parser/gpu_analysis/__init__.py +0 -14
  4787. mindspore/profiler/parser/gpu_analysis/function_event.py +0 -44
  4788. mindspore/profiler/parser/gpu_analysis/fwk_file_parser.py +0 -89
  4789. mindspore/profiler/parser/gpu_analysis/profiler_info_parser.py +0 -72
  4790. mindspore/profiler/parser/hccl_parser.py +0 -573
  4791. mindspore/profiler/parser/hwts_log_parser.py +0 -122
  4792. mindspore/profiler/parser/integrator.py +0 -526
  4793. mindspore/profiler/parser/memory_usage_parser.py +0 -277
  4794. mindspore/profiler/parser/minddata_analyzer.py +0 -800
  4795. mindspore/profiler/parser/minddata_parser.py +0 -186
  4796. mindspore/profiler/parser/minddata_pipeline_parser.py +0 -299
  4797. mindspore/profiler/parser/op_intermediate_parser.py +0 -149
  4798. mindspore/profiler/parser/optime_parser.py +0 -250
  4799. mindspore/profiler/parser/profiler_info.py +0 -213
  4800. mindspore/profiler/parser/step_trace_parser.py +0 -666
  4801. mindspore/utils/hooks.py +0 -81
  4802. mindspore-2.6.0.dist-info/METADATA +0 -367
  4803. mindspore-2.6.0.dist-info/RECORD +0 -12414
  4804. mindspore-2.6.0.dist-info/WHEEL +0 -5
  4805. /mindspore/common/{_auto_dynamic.py → dynamic_shape/_auto_dynamic.py} +0 -0
  4806. /mindspore/include/mindspore/ops/kernel/ascend/ascendc/{op_host → all_finite/op_host}/all_finite_tiling.h +0 -0
  4807. /mindspore/include/third_party/{securec/include → include}/securec.h +0 -0
  4808. /mindspore/include/third_party/{securec/include → include}/securectype.h +0 -0
  4809. {mindspore-2.6.0.dist-info → mindspore-2.7.0.dist-info}/entry_points.txt +0 -0
  4810. {mindspore-2.6.0.dist-info → mindspore-2.7.0.dist-info}/top_level.txt +0 -0
@@ -17,496 +17,362 @@ from mindspore.common import dtype as mstype
17
17
  from mindspore.ops.auto_generate.pyboost_inner_prim import *
18
18
 
19
19
 
20
- def trace(input):
20
+ def cummin(input, dim):
21
21
  r"""
22
- Returns a new tensor that is the sum of the `input` main trace.
22
+ Returns a tuple (values, indices) where `values` is the cumulative minimum value of input Tensor `input`
23
+ along the dimension `dim`, and `indices` is the index location of each minimum value.
24
+
25
+ .. math::
26
+ \begin{array}{ll} \\
27
+ y_{i} = \min(x_{1}, x_{2}, ... , x_{i})
28
+ \end{array}
29
+
30
+ .. note::
31
+ GE backend is not supported in Ascend.
23
32
 
24
33
  Args:
25
- input (Tensor): 2-D Tensor.
34
+ input (Tensor): The input Tensor, The dimension must be greater than 0.
35
+ dim (int): Operation dimension. The value of `dim` must be in the range `[-input.ndim, input.ndim - 1]`.
26
36
 
27
37
  Returns:
28
- Tensor, when the data type of `input` is integer or bool, its data type is int64, otherwise it is the same as `input`, and size equals to 1.
38
+ tuple [Tensor], tuple of 2 Tensors, containing the cumulative minimum of elements and the index.
39
+ The shape of each output tensor is the same as that of input `input`.
29
40
 
30
41
  Raises:
31
42
  TypeError: If `input` is not a Tensor.
32
- ValueError: If the dimension of `input` is not equal to 2.
33
- TypeError: If the dtype of `input` is not one of float16, float32, float64, bool, uint8, int8, int16, int32, int64, complex64, complex128, bfloat16.
43
+ TypeError: If `input` is a Tensor, but the type is complex or bool.
44
+ TypeError: If `dim` is not an int.
45
+ ValueError: If `dim` is out the range of `[-input.ndim, input.ndim - 1]`.
34
46
 
35
47
  Supported Platforms:
36
48
  ``Ascend``
37
49
 
38
50
  Examples:
39
- >>> import mindspore
40
- >>> import numpy as np
41
51
  >>> from mindspore import Tensor, ops
42
- >>> input = Tensor(np.array([[10, 11, 12], [13, 14, 15], [16, 17, 18]]), mindspore.float32)
43
- >>> output = ops.trace_ext(input)
44
- >>> print(output)
45
- 42.0
46
- >>> input = Tensor(np.arange(1, 13).reshape(3, 4), mindspore.float32)
47
- >>> output = ops.trace_ext(input)
48
- >>> print(output)
49
- 18.0
50
- >>> input = Tensor(np.arange(12, 0, -1).reshape(4, 3), mindspore.float32)
51
- >>> output = ops.trace_ext(input)
52
- >>> print(output)
53
- 24.0
52
+ >>> import mindspore
53
+ >>> a = Tensor([-0.2284, -0.6628, 0.0975, 0.2680, -1.3298, -0.4220], mindspore.float32)
54
+ >>> output = ops.cummin_ext(a, dim=0)
55
+ >>> print(output[0])
56
+ [-0.2284 -0.6628 -0.6628 -0.6628 -1.3298 -1.3298]
57
+ >>> print(output[1])
58
+ [0 1 1 1 4 4]
54
59
  """
55
- return trace_impl(input)
60
+ return cummin_impl(input, dim)
56
61
 
57
62
 
58
- def leaky_relu(input, negative_slope=0.01):
63
+ def selu(input):
59
64
  r"""
60
- leaky_relu activation function. The element of `input` less than 0 times `negative_slope` .
65
+ Activation function SELU (Scaled exponential Linear Unit).
61
66
 
62
67
  The activation function is defined as:
63
68
 
64
69
  .. math::
65
- \text{leaky_relu}(input) = \begin{cases}input, &\text{if } input \geq 0; \cr
66
- \text{negative_slope} * input, &\text{otherwise.}\end{cases}
70
+ E_{i} =
71
+ scale *
72
+ \begin{cases}
73
+ x_{i}, &\text{if } x_{i} \geq 0; \cr
74
+ \text{alpha} * (\exp(x_i) - 1), &\text{otherwise.}
75
+ \end{cases}
67
76
 
68
- where :math:`negative\_slope` represents the `negative_slope` parameter.
77
+ where :math:`alpha` and :math:`scale` are pre-defined constants(:math:`alpha=1.67326324`
78
+ and :math:`scale=1.05070098`).
69
79
 
70
- For more details, see `Rectifier Nonlinearities Improve Neural Network Acoustic Models
71
- <https://ai.stanford.edu/~amaas/papers/relu_hybrid_icml2013_final.pdf>`_.
80
+ See more details in `Self-Normalizing Neural Networks <https://arxiv.org/abs/1706.02515>`_.
72
81
 
73
- LeakyReLU Activation Function Graph:
82
+ SELU Activation Function Graph:
74
83
 
75
- .. image:: ../images/LeakyReLU.png
84
+ .. image:: ../images/SeLU.png
76
85
  :align: center
77
86
 
78
87
  Args:
79
- input (Tensor): The input of leaky_relu is a Tensor of any dimension.
80
- negative_slope (Union[int, float], optional): Slope of the activation function when the element of `input` is less than 0.
81
- Default: ``0.01`` .
88
+ input (Tensor): Tensor of any dimension.
89
+ The data type is float16, float32, bfloat16.
82
90
 
83
91
  Returns:
84
- Tensor, has the same type and shape as the `input`.
92
+ Tensor, with the same type and shape as the `input`.
85
93
 
86
94
  Raises:
87
- TypeError: If `input` is not a Tensor.
88
- TypeError: If `negative_slope` is not a float or an int.
95
+ TypeError: If dtype of `input` is not float16, float32, bfloat16.
89
96
 
90
97
  Supported Platforms:
91
98
  ``Ascend``
92
99
 
93
100
  Examples:
94
101
  >>> import mindspore
95
- >>> import numpy as np
96
102
  >>> from mindspore import Tensor, ops
97
- >>> input = Tensor(np.array([[-1.0, 4.0, -8.0], [2.0, -5.0, 9.0]]), mindspore.float32)
98
- >>> print(ops.extend.leaky_relu_ext(input, negative_slope=0.2))
99
- [[-0.2 4. -1.6]
100
- [ 2. -1. 9. ]]
101
- """
102
- return leaky_relu_impl(input, negative_slope)
103
-
104
-
105
- def prod(input, dim=None, keepdim=False, dtype=None):
106
- r"""
107
- Reduces a dimension of a tensor by multiplying all elements in the dimension, by default. And also can
108
- reduce a dimension of `input` along the `dim`. Determine whether the dimensions of the output and input are the
109
- same by controlling `keepdim`.
110
-
111
- Args:
112
- input (Tensor[Number]): The input tensor. The dtype of the tensor to be reduced is number.
113
- :math:`(N, *)` where :math:`*` means, any number of additional dimensions.
114
- dim (int): The dimensions to reduce. Default: ``None`` , reduce all dimensions.
115
- Only constant value is allowed. Assume the rank of `input` is r, and the value range is [-r,r).
116
- keepdim (bool): If ``True`` , keep these reduced dimensions and the length is 1.
117
- If ``False`` , don't keep these dimensions. Default: ``False`` .
118
- dtype (:class:`mindspore.dtype`): The desired data type of returned Tensor. Default: ``None`` .
119
-
120
- Returns:
121
- Tensor, has the same data type as input tensor.
122
-
123
- - If `dim` is ``None`` , and `keepdim` is ``False`` ,
124
- the output is a 0-D tensor representing the product of all elements in the input tensor.
125
- - If `dim` is int, set as 1, and `keepdim` is ``False`` ,
126
- the shape of output is :math:`(input_0, input_2, ..., input_R)`.
127
-
128
- Raises:
129
- TypeError: If `input` is not a Tensor.
130
- TypeError: If `dim` is not one of the following: int or None.
131
- TypeError: If `keepdim` is not a bool.
132
- ValueError: If `dim` is out of range.
133
-
134
- Supported Platforms:
135
- ``Ascend`` ``GPU`` ``CPU``
136
-
137
- Examples:
138
- >>> import mindspore
139
103
  >>> import numpy as np
140
- >>> from mindspore import Tensor, ops
141
- >>> x = Tensor(np.random.randn(3, 4, 5, 6).astype(np.float32))
142
- >>> output = ops.prod_ext(x, 1, keepdim=True)
143
- >>> result = output.shape
144
- >>> print(result)
145
- (3, 1, 5, 6)
146
- >>> # case 1: Reduces a dimension by multiplying all elements in the dimension.
147
- >>> x = Tensor(np.array([[[1, 1, 1, 1, 1, 1], [2, 2, 2, 2, 2, 2], [3, 3, 3, 3, 3, 3]],
148
- ... [[4, 4, 4, 4, 4, 4], [5, 5, 5, 5, 5, 5], [6, 6, 6, 6, 6, 6]],
149
- ... [[7, 7, 7, 7, 7, 7], [8, 8, 8, 8, 8, 8], [9, 9, 9, 9, 9, 9]]]), mindspore.float32)
150
- >>> output = ops.prod_ext(x)
151
- >>> print(output)
152
- 2.2833798e+33
153
- >>> print(output.shape)
154
- ()
155
- >>> # case 2: Reduces a dimension along dim 0.
156
- >>> output = ops.prod_ext(x, 0, True)
157
- >>> print(output)
158
- [[[ 28. 28. 28. 28. 28. 28.]
159
- [ 80. 80. 80. 80. 80. 80.]
160
- [162. 162. 162. 162. 162. 162.]]]
161
- >>> # case 3: Reduces a dimension along dim 1.
162
- >>> output = ops.prod_ext(x, 1, True)
163
- >>> print(output)
164
- [[[ 6. 6. 6. 6. 6. 6.]]
165
- [[120. 120. 120. 120. 120. 120.]]
166
- [[504. 504. 504. 504. 504. 504.]]]
167
- >>> # case 4: Reduces a dimension along dim 2.
168
- >>> output = ops.prod_ext(x, 2, True)
104
+ >>> input = Tensor(np.array([[-1.0, 4.0, -8.0], [2.0, -5.0, 9.0]]), mindspore.float32)
105
+ >>> output = ops.auto_generate.selu_ext(input)
169
106
  >>> print(output)
170
- [[[1.00000e+00]
171
- [6.40000e+01]
172
- [7.29000e+02]]
173
- [[4.09600e+03]
174
- [1.56250e+04]
175
- [4.66560e+04]]
176
- [[1.17649e+05]
177
- [2.62144e+05]
178
- [5.31441e+05]]]
107
+ [[-1.1113307 4.202804 -1.7575096]
108
+ [ 2.101402 -1.7462534 9.456309 ]]
179
109
  """
180
- return prod_impl(input, dim, keepdim, dtype)
110
+ return selu_impl(input)
181
111
 
182
112
 
183
- def matrix_inverse(input):
113
+ def elu(input, alpha=1.0):
184
114
  r"""
185
- Compute the inverse of the input matrix.
186
-
187
- Args:
188
- input (Tensor): A matrix to be calculated. Input `input` must be at least two dimensions, and the size of
189
- the last two dimensions must be the same size.
190
-
191
- Returns:
192
- Tensor, has the same type and shape as input`.
193
-
194
- Raises:
195
- TypeError: If `input` is not a Tensor.
196
- ValueError: If the size of the last two dimensions of `input` is not the same.
197
- ValueError: If the dimension of `input` is 1.
115
+ Exponential Linear Unit activation function.
198
116
 
199
- Supported Platforms:
200
- ``Ascend``
117
+ Applies the exponential linear unit function element-wise.
118
+ The activation function is defined as:
201
119
 
202
- Examples:
203
- >>> from mindspore import Tensor, ops
204
- >>> from mindspore import dtype as mstype
205
- >>> x = Tensor([[1., 2.], [3., 4.]], mstype.float32)
206
- >>> print(ops.matrix_inverse_ext(x))
207
- [[-2. 1. ]
208
- [ 1.5 -0.5]]
209
- """
210
- return matrix_inverse_impl(input)
211
-
212
-
213
- def softplus(input, beta=1, threshold=20):
214
- r"""
215
- Applies softplus function to `input` element-wise.
120
+ .. math::
216
121
 
217
- The softplus function is shown as follows, x is the element of `input` :
122
+ \text{ELU}(x)= \left\{
123
+ \begin{array}{align}
124
+ \alpha(e^{x} - 1) & \text{if } x \le 0\\
125
+ x & \text{if } x \gt 0\\
126
+ \end{array}\right.
218
127
 
219
- .. math::
128
+ Where :math:`x` is the element of input Tensor `input`, :math:`\alpha` is param `alpha`,
129
+ it determines the smoothness of ELU.
220
130
 
221
- \text{output} = \frac{1}{beta}\log(1 + \exp(\text{beta * x}))
131
+ ELU function graph:
222
132
 
223
- where :math:`input * beta > threshold`, the implementation converts to the linear function to ensure numerical stability.
133
+ .. image:: ../images/ELU.png
134
+ :align: center
224
135
 
225
136
  Args:
226
- input (Tensor): Tensor of any dimension. Supported dtypes:
227
-
228
- - Ascend: float16, float32, bfloat16.
229
- beta (number.Number, optional): Scaling parameters in the softplus function. Default: ``1`` .
230
- threshold (number.Number, optional): For numerical stability, the softplus function is converted
231
- to a threshold parameter of a linear function. Default: ``20`` .
137
+ input (Tensor): The input of ELU is a Tensor of any dimension.
138
+ alpha (float, optional): The alpha value of ELU, the data type is float.
139
+ Default: ``1.0`` .
232
140
 
233
141
  Returns:
234
- Tensor, with the same type and shape as the input.
142
+ Tensor, has the same shape and data type as `input`.
235
143
 
236
144
  Raises:
237
- TypeError: If `input` is not a Tensor.
238
- TypeError: If dtype of `input` is not float16, float32, bfloat16.
145
+ TypeError: If `alpha` is not a float.
239
146
 
240
147
  Supported Platforms:
241
- ``Ascend``
148
+ ``Ascend``
242
149
 
243
150
  Examples:
244
151
  >>> import mindspore
245
152
  >>> import numpy as np
246
153
  >>> from mindspore import Tensor, ops
247
- >>> input = Tensor(np.array([0.1, 0.2, 30, 25]), mindspore.float32)
248
- >>> output = ops.auto_generate.softplus_ext(input)
154
+ >>> x = Tensor(np.array([[-1.0, 4.0, -8.0], [2.0, -5.0, 9.0]]), mindspore.float32)
155
+ >>> output = ops.auto_generate.elu_ext(x)
249
156
  >>> print(output)
250
- [0.74439657 0.7981388 30. 25.]
157
+ [[-0.63212055 4. -0.99966455]
158
+ [ 2. -0.99326205 9. ]]
251
159
  """
252
- return softplus_impl(input, beta, threshold)
160
+ return elu_impl(input, alpha)
253
161
 
254
162
 
255
- def l1_loss(input, target, reduction='mean'):
163
+ def inplace_adds(input, other, alpha=1):
256
164
  r"""
257
- Calculate the mean absolute error between the `input` value and the `target` value.
258
-
259
- Assuming that the :math:`x` and :math:`y` are the predicted value and target value,
260
- both are one-dimensional tensors of length :math:`N`, length :math:`N`, `reduction` is set to ``'none'`` ,
261
- then calculate the loss of :math:`x` and :math:`y` without dimensionality reduction.
262
-
263
- The formula is as follows:
264
-
265
- .. math::
266
- \ell(x, y) = L = \{l_1,\dots,l_N\}^\top, \quad \text{with } l_n = \left| x_n - y_n \right|,
267
-
268
- where :math:`N` is the batch size.
269
-
270
- If `reduction` is ``'mean'`` or ``'sum'`` , then:
271
-
272
- .. math::
273
- \ell(x, y) =
274
- \begin{cases}
275
- \operatorname{mean}(L), & \text{if reduction} = \text{'mean';}\\
276
- \operatorname{sum}(L), & \text{if reduction} = \text{'sum'.}
277
- \end{cases}
278
-
279
- Args:
280
- input (Tensor): Predicted value, Tensor of any dimension.
281
- target (Tensor): Target value, usually has the same shape as the `input`.
282
- If `input` and `target` have different shapes, make sure they can broadcast to each other.
283
- reduction (str, optional): Apply specific reduction method to the output: ``'none'`` , ``'mean'`` ,
284
- ``'sum'`` . Default: ``'mean'`` .
285
-
286
- - ``'none'``: no reduction will be applied.
287
- - ``'mean'``: compute and return the mean of elements in the output. Notice: At least one of the input and target is float type when the reduction is ``'mean'`` .
288
- - ``'sum'``: the output elements will be summed.
289
-
290
- Returns:
291
- Tensor or Scalar, if `reduction` is ``'none'`` , return a Tensor with same shape and dtype as `input`.
292
- Otherwise, a scalar value will be returned.
293
-
294
- Raises:
295
- TypeError: If `input` is not a Tensor.
296
- TypeError: If `target` is not a Tensor.
297
- ValueError: If `reduction` is not one of ``'none'`` , ``'mean'`` or ``'sum'`` .
298
-
299
- Supported Platforms:
300
- ``Ascend``
301
-
302
- Examples:
303
- >>> from mindspore import Tensor, ops
304
- >>> from mindspore import dtype as mstype
305
- >>> x = Tensor([[1, 2, 3], [4, 5, 6]], mstype.float32)
306
- >>> target = Tensor([[6, 5, 4], [3, 2, 1]], mstype.float32)
307
- >>> output = ops.l1_loss_ext(x, target, reduction="mean")
308
- >>> print(output)
309
- 3.0
165
+ None
310
166
  """
311
- return l1_loss_impl(input, target, converted_reduction)
167
+ return inplace_adds_impl(input, other, alpha)
312
168
 
313
169
 
314
- def frac(input):
170
+ def index_select(input, dim, index):
315
171
  r"""
316
- Calculates the fractional part of each element in the input.
317
-
318
- .. math::
319
- out_i = input_i - \lfloor |input_i| \rfloor * sgn(input_i)
172
+ Generates a new Tensor that accesses the values of `input` along the specified `dim` dimension
173
+ using the indices specified in `index`. The new Tensor has the same number of dimensions as `input`,
174
+ with the size of the `dim` dimension being equal to the length of `index`, and the size of all other
175
+ dimensions will be unchanged from the original `input` Tensor.
320
176
 
321
- .. warning::
322
- This is an experimental API that is subject to change or deletion.
177
+ .. note::
178
+ The value of index must be in the range of `[0, input.shape[dim])`, the result is undefined out of range.
323
179
 
324
180
  Args:
325
181
  input (Tensor): The input Tensor.
182
+ dim (int): The dimension to be indexed.
183
+ index (Tensor): A 1-D Tensor with the indices.
326
184
 
327
185
  Returns:
328
- Tensor, has the same shape and type as input.
186
+ Tensor, has the same dtype as input Tensor.
329
187
 
330
188
  Raises:
331
- TypeError: If `input` is not a Tensor.
189
+ TypeError: If `input` or `index` is not a Tensor.
190
+ TypeError: If `dim` is not int number.
191
+ ValueError: If the value of `dim` is out the range of `[-input.ndim, input.ndim - 1]`.
192
+ ValueError: If the dimension of `index` is not equal to 1.
332
193
 
333
194
  Supported Platforms:
334
195
  ``Ascend``
335
196
 
336
197
  Examples:
337
198
  >>> import mindspore
338
- >>> import numpy as np
339
199
  >>> from mindspore import Tensor, ops
340
- >>> x = Tensor([2, 4.2, -2.5], mindspore.float16)
341
- >>> output = ops.frac_ext(x)
342
- >>> print(output)
343
- [ 0. 0.1992 -0.5 ]
200
+ >>> import numpy as np
201
+ >>> input = Tensor(np.arange(16).astype(np.float32).reshape(2, 2, 4))
202
+ >>> print(input)
203
+ [[[ 0. 1. 2. 3.]
204
+ [ 4. 5. 6. 7.]]
205
+ [[ 8. 9. 10. 11.]
206
+ [12. 13. 14. 15.]]]
207
+ >>> index = Tensor([0,], mindspore.int32)
208
+ >>> y = ops.auto_generate.index_select_ext(input, 1, index)
209
+ >>> print(y)
210
+ [[[ 0. 1. 2. 3.]]
211
+ [[ 8. 9. 10. 11.]]]
344
212
  """
345
- return frac_impl(input)
213
+ return index_select_impl(input, dim, index)
346
214
 
347
215
 
348
- def cummin(input, dim):
216
+ def unfold(input, kernel_size, dilation=1, padding=0, stride=1):
349
217
  r"""
350
- Returns a tuple (values, indices) where `values` is the cumulative minimum value of input Tensor `input`
351
- along the dimension `dim`, and `indices` is the index location of each minimum value.
218
+ Extracts sliding local blocks from a batched input tensor.
219
+
220
+ Consider a batched input tensor of shape :math:`(N, C, *)`,
221
+ where :math:`N` is the batch dimension, :math:`C` is the channel dimension,
222
+ and :math:`*` represent arbitrary spatial dimensions. This operation flattens
223
+ each sliding `Kernel_size`- sized block within the spatial dimensions
224
+ of `input` into a column (i.e., last dimension) of a 3-D output
225
+ tensor of shape :math:`(N, C \times \prod(\text{kernel_size}), L)`, where
226
+ :math:`C \times \prod(\text{kernel_size})` is the total number of values
227
+ within each block (a block has :math:`\prod(\text{kernel_size})` spatial
228
+ locations each containing a `C`-channeled vector), and :math:`L` is
229
+ the total number of such blocks:
352
230
 
353
231
  .. math::
354
- \begin{array}{ll} \\
355
- y_{i} = \min(x_{1}, x_{2}, ... , x_{i})
356
- \end{array}
232
+ L = \prod_d \left\lfloor\frac{\text{spatial_size}[d] + 2 \times \text{padding}[d] %
233
+ - \text{dilation}[d] \times (\text{kernel_size}[d] - 1) - 1}{\text{stride}[d]} + 1\right\rfloor,
357
234
 
358
- .. note::
359
- O2 mode is not supported in Ascend.
235
+ where :math:`\text{spatial_size}` is formed by the spatial dimensions
236
+ of `input` (:math:`*` above), and :math:`d` is over all spatial
237
+ dimensions.
238
+
239
+ Therefore, indexing `output` at the last dimension (column dimension)
240
+ gives all values within a certain block.
241
+
242
+ The `dilation`, `padding` and `stride` arguments specify
243
+ how the sliding blocks are retrieved.
244
+
245
+ .. warning::
246
+ - Currently, batched(4D) image-like tensors are supported.
247
+ - For Ascend, it is only supported on platforms above Atlas A2.
360
248
 
361
249
  Args:
362
- input (Tensor): The input Tensor, The dimension must be greater than 0.
363
- dim (int): Operation dimension. The value of `dim` must be in the range `[-input.ndim, input.ndim - 1]`.
250
+ input (Tensor): 4-D Tensor.
251
+ kernel_size (Union[int, tuple[int], list[int]]): The size of the kernel, should be two int
252
+ for height and width. If type is int, it means that height equal with width. Must be specified.
253
+ dilation (Union[int, tuple[int], list[int]], optional): The dilation of the window, should be two int
254
+ for height and width. If type is int, it means that height equal with width. Default: ``1`` .
255
+ padding (Union[int, tuple[int], list[int]], optional): The pad of the window, should be two int
256
+ for height and width. If type is int, it means that height equal with width. Default: ``0`` .
257
+ stride (Union[int, tuple[int], list[int]], optional): The stride of the window, should be two int
258
+ for height and width. If type is int, it means that height equal with width. Default: ``1`` .
364
259
 
365
260
  Returns:
366
- tuple [Tensor], tuple of 2 Tensors, containing the cumulative minimum of elements and the index.
367
- The shape of each output tensor is the same as that of input `input`.
261
+ A Tensor, with same type as `input` .
262
+
263
+ Shape:
264
+ - Input: :math:`(N, C, *)`
265
+ - Output: :math:`(N, C \times \prod(\text{kernel_size}), L)`
368
266
 
369
267
  Raises:
370
- TypeError: If `input` is not a Tensor.
371
- TypeError: If `input` is a Tensor, but the type is complex or bool.
372
- TypeError: If `dim` is not an int.
373
- ValueError: If `dim` is out the range of `[-input.ndim, input.ndim - 1]`.
268
+ TypeError: If any data type of `kernel_size`, `stride`, `dilation`, `padding` is not int, tuple or list.
269
+ ValueError: If `kernel_size`, `dilation`, `stride` value is not
270
+ greater than zero or elements number more than `2`.
271
+ ValueError: If `padding` value is less than zero.
374
272
 
375
273
  Supported Platforms:
376
274
  ``Ascend``
377
275
 
378
276
  Examples:
379
- >>> from mindspore import Tensor, ops
380
277
  >>> import mindspore
381
- >>> a = Tensor([-0.2284, -0.6628, 0.0975, 0.2680, -1.3298, -0.4220], mindspore.float32)
382
- >>> output = ops.cummin_ext(a, dim=0)
383
- >>> print(output[0])
384
- [-0.2284 -0.6628 -0.6628 -0.6628 -1.3298 -1.3298]
385
- >>> print(output[1])
386
- [0 1 1 1 4 4]
278
+ >>> import numpy as np
279
+ >>> from mindspore import Tensor, ops
280
+ >>> x = Tensor(np.random.rand(4, 4, 32, 32), mindspore.float32)
281
+ >>> output = ops.auto_generate.unfold_ext(x, kernel_size=3, dilation=1, stride=1)
282
+ >>> print(output.shape)
283
+ (4, 36, 900)
387
284
  """
388
- return cummin_impl(input, dim)
285
+ return unfold_impl(input, converted_kernel_size, converted_dilation, converted_padding, converted_stride)
389
286
 
390
287
 
391
- def diag(input, diagonal=0):
288
+ def stack(tensors, dim=0):
392
289
  r"""
393
- If input is a vector (1-D tensor), then returns a 2-D square tensor with the elements of input as the diagonal.
394
-
395
- If input is a matrix (2-D tensor), then returns a 1-D tensor with the diagonal elements of input.
396
-
397
- The argument diagonal controls which diagonal to consider:
398
-
399
- - If `diagonal` = 0, it is the main diagonal.
400
-
401
- - If `diagonal` > 0, it is above the main diagonal.
290
+ Stacks a list of tensors in specified dim.
402
291
 
403
- - If `diagonal` < 0, it is below the main diagonal.
292
+ Stacks the list of input tensors with the same rank `R`, output is a tensor of rank `(R+1)`.
404
293
 
405
- .. warning::
406
- This is an experimental API that is subject to change or deletion.
294
+ Given input tensors of shape :math:`(x_1, x_2, ..., x_R)`. Set the number of input tensors as `N`.
295
+ If :math:`dim \ge 0`, the shape of the output tensor is
296
+ :math:`(x_1, x_2, ..., x_{dim}, N, x_{dim+1}, ..., x_R)`.
407
297
 
408
298
  Args:
409
- input (Tensor): The input tensor.
410
- diagonal (int, optional): the diagonal to consider. Defaults: ``0``.
299
+ tensors (Union[tuple, list]): A Tuple or list of Tensor objects with the same shape and type.
300
+ dim (int, optional): Dimension to stack. The range is [-(R+1), R+1). Default: ``0`` .
411
301
 
412
302
  Returns:
413
- Tensor, has the same dtype as the `input`, its shape is up to `diagonal`.
414
-
415
- - If `input` shape is :math:`(x_0)` : then output shape is :math:`(x_0 + \left | diagonal \right | , x_0 + \left | diagonal \right | )` 2-D Tensor.
416
-
417
- - If `input` shape is :math:`(x_0, x_1)` : then output shape is main diagonal to move :math:`(\left | diagonal \right |)` elements remains elements' length 1-D Tensor.
303
+ Tensor. A stacked Tensor with the same type as `tensors`.
418
304
 
419
305
  Raises:
420
- TypeError: If `input` is not a Tensor.
421
- ValueError: If shape of `input` is not 1-D and 2-D.
306
+ TypeError: If the data types of elements in `tensors` are not the same.
307
+ ValueError: If `dim` is out of the range [-(R+1), R+1);
308
+ or if the shapes of elements in `tensors` are not the same.
422
309
 
423
310
  Supported Platforms:
424
311
  ``Ascend``
425
312
 
426
313
  Examples:
314
+ >>> import mindspore
427
315
  >>> from mindspore import Tensor, ops
428
- >>> input = Tensor([1, 2, 3, 4]).astype('int32')
429
- >>> output = ops.auto_generate.diag_ext(input)
316
+ >>> import numpy as np
317
+ >>> data1 = Tensor(np.array([0, 1]).astype(np.float32))
318
+ >>> data2 = Tensor(np.array([2, 3]).astype(np.float32))
319
+ >>> output = ops.auto_generate.stack_ext([data1, data2], 0)
430
320
  >>> print(output)
431
- [[1 0 0 0]
432
- [0 2 0 0]
433
- [0 0 3 0]
434
- [0 0 0 4]]
321
+ [[0. 1.]
322
+ [2. 3.]]
435
323
  """
436
- return diag_impl(input, diagonal)
324
+ return stack_impl(tensors, dim)
437
325
 
438
326
 
439
- def topk(input, k, dim=-1, largest=True, sorted=True):
327
+ def max_unpool2d(input, indices, kernel_size, stride=None, padding=0, output_size=None):
440
328
  r"""
441
- Finds values and indices of the `k` largest or smallest entries along a given dimension.
442
-
443
- .. warning::
444
- - If sorted is set to False, due to different memory layout and traversal methods on different platforms,
445
- the display order of calculation results may be inconsistent when `sorted` is False.
446
-
447
- If the `input` is a one-dimensional Tensor, finds the `k` largest or smallest entries in the Tensor,
448
- and outputs its value and index as a Tensor. values[`k`] is the `k` largest item in `input`,
449
- and its index is indices [`k`].
329
+ Computes the inverse of `max_pool2d`.
450
330
 
451
- For a multi-dimensional matrix,
452
- calculates the first or last `k` entries in a given dimension, therefore:
331
+ `max_unpool2d` keeps the maximal value and set all position of non-maximal values to zero. Typically the input is of shape :math:`(N, C, H_{in}, W_{in})` or :math:`(C, H_{in}, W_{in})`, and the output is of shape :math:`(N, C, H_{out}, W_{out})` or :math:`(C, H_{out}, W_{out})`. The operation is as follows.
453
332
 
454
333
  .. math::
334
+ \begin{array}{ll} \\
335
+ H_{out} = (H_{in} - 1) \times stride[0] - 2 \times padding[0] + kernel\_size[0] \\
336
+ W_{out} = (W_{in} - 1) \times stride[1] - 2 \times padding[1] + kernel\_size[1] \\
337
+ \end{array}
455
338
 
456
- values.shape = indices.shape
457
-
458
- If the two compared elements are the same, the one with the smaller index value is returned first.
339
+ .. warning::
340
+ This is an experimental API that is subject to change or deletion.
459
341
 
460
342
  Args:
461
- input (Tensor): Input to be computed.
462
- k (int): The number of top or bottom elements to be computed along the last dimension.
463
- dim (int, optional): The dimension to sort along. Default: ``-1`` .
464
- largest (bool, optional): If largest is ``False`` then the k smallest elements are returned.
465
- Default: ``True`` .
466
- sorted (bool, optional): If ``True`` , the obtained elements will be sorted by the values in descending
467
- order or ascending order according to `largest`. If ``False`` , the obtained elements will not be
468
- sorted. Default: ``True`` .
343
+ input (Tensor): The input Tensor to invert. Tensor of shape :math:`(N, C, H_{in}, W_{in})` or :math:`(C, H_{in}, W_{in})`.
344
+ indices (Tensor): Max values' index represented by the indices. Tensor of shape must be same with input 'input'. Values of indices must belong to :math:`[0, H_{in} \times W_{in} - 1]`. Data type must be in int32 or int64.
345
+ kernel_size (Union[int, tuple[int]]): The size of kernel used to take the maximum value, an int number that represents height and width of the kernel, or a tuple of two int numbers that represent height and width respectively.
346
+ stride (Union[int, tuple[int]], optional): The distance of kernel moving, an int number that represents the height and width of movement are both stride, or a tuple of two int numbers that represent height and width of movement respectively. Default: ``None`` , which indicates the moving step is `kernel_size` .
347
+ padding (Union[int, tuple[int]], optional): The pad value to be filled. Default: ``0`` . If `padding` is an integer, the paddings of height and width are the same, equal to padding. If `padding` is a tuple of two integers, the padding of height and width equal to padding[0] and padding[1] correspondingly.
348
+ output_size (tuple[int], optional): The target output size. Default: ``None`` . If output_size == (), then the shape of output computed by `kernel_size`, `stride` and `padding`. If output_size != (), then output_size must be :math:`(N, C, H, W)` , :math:`(C, H, W)` or :math:`(H, W)` and output_size must belong to :math:`[(N, C, H_{out} - stride[0], W_{out} - stride[1]), (N, C, H_{out} + stride[0], W_{out} + stride[1])]`.
469
349
 
470
350
  Returns:
471
- A tuple consisting of `values` and `indices`.
472
-
473
- - values (Tensor) - The `k` largest or smallest elements in each slice of the given dimension.
474
- - indices (Tensor) - The indices of values within the last dimension of input.
351
+ Tensor, with shape :math:`(N, C, H_{out}, W_{out})` or :math:`(C, H_{out}, W_{out})`, with the same data type with `input`.
475
352
 
476
353
  Raises:
477
- TypeError: If `sorted` is not a bool.
478
- TypeError: If `input` is not a Tensor.
479
- TypeError: If `k` is not an int.
354
+ TypeError: If data type of `input` or `indices` is not supported.
355
+ TypeError: If `kernel_size`, `stride` or `padding` is neither an int nor a tuple.
356
+ ValueError: If numbers in `stride`, `padding` or `kernel_size` are not positive.
357
+ ValueError: If the shapes of `input` and `indices` are different.
358
+ ValueError: If the length of `input` is not 3 or 4.
359
+ ValueError: If the type of `output_size` is not tuple.
360
+ ValueError: If `output_size` is not close to output size computed by attr `kernel_size`, `stride`, `padding`.
480
361
 
481
362
  Supported Platforms:
482
363
  ``Ascend``
483
364
 
484
365
  Examples:
485
- >>> import mindspore as ms
486
- >>> from mindspore import ops
487
- >>> x = ms.Tensor([[0.5368, 0.2447, 0.4302, 0.9673],
488
- ... [0.4388, 0.6525, 0.4685, 0.1868],
489
- ... [0.3563, 0.5152, 0.9675, 0.8230]], dtype=ms.float32)
490
- >>> output = ops.topk_ext(x, 2, dim=1)
491
- >>> print(output)
492
- (Tensor(shape=[3, 2], dtype=Float32, value=
493
- [[ 9.67299998e-01, 5.36800027e-01],
494
- [ 6.52499974e-01, 4.68499988e-01],
495
- [ 9.67499971e-01, 8.23000014e-01]]), Tensor(shape=[3, 2], dtype=Int64, value=
496
- [[3, 0],
497
- [1, 2],
498
- [2, 3]]))
499
- >>> output2 = ops.topk_ext(x, 2, dim=1, largest=False)
500
- >>> print(output2)
501
- (Tensor(shape=[3, 2], dtype=Float32, value=
502
- [[ 2.44700000e-01, 4.30200011e-01],
503
- [ 1.86800003e-01, 4.38800007e-01],
504
- [ 3.56299996e-01, 5.15200019e-01]]), Tensor(shape=[3, 2], dtype=Int64, value=
505
- [[1, 2],
506
- [3, 0],
507
- [0, 1]]))
366
+ >>> import numpy as np
367
+ >>> from mindspore import Tensor, ops
368
+ >>> input = Tensor(np.array([[[[0, 1], [8, 9]]]]).astype(np.float32))
369
+ >>> indices = Tensor(np.array([[[[0, 1], [2, 3]]]]).astype(np.int64))
370
+ >>> output = ops.max_unpool2d_ext(input, indices, 1, stride=1, padding=0)
371
+ >>> print(output.asnumpy())
372
+ [[[[0. 1.]
373
+ [8. 9.]]]]
508
374
  """
509
- return topk_impl(input, k, dim, largest, sorted)
375
+ return max_unpool2d_impl(input, indices, kernel_size, stride, padding, output_size)
510
376
 
511
377
 
512
378
  def avg_pool1d(input, kernel_size, stride=None, padding=0, ceil_mode=False, count_include_pad=True):
@@ -556,372 +422,262 @@ def avg_pool1d(input, kernel_size, stride=None, padding=0, ceil_mode=False, coun
556
422
  >>> print(output.shape)
557
423
  (1, 3, 1)
558
424
  """
559
- return avg_pool1d_impl(input, kernel_size, stride, padding, ceil_mode, count_include_pad)
560
-
561
-
562
- def fold(input, output_size, kernel_size, dilation=1, padding=0, stride=1):
563
- r"""
564
- Combines an array of sliding local blocks into a large containing tensor.
565
-
566
- Consider a batched input tensor of shape :math:`(N, C \times \prod(\text{kernel_size}), L)` ,
567
- where :math:`N` is the batch dimension, :math:`C \times \prod(\text{kernel_size})` is the
568
- total number of values within each block (a block has :math:`\prod(\text{kernel_size})` spatial
569
- locations each containing a `C`-channeled vector), and :math:`L` is the total number of such blocks:
570
-
571
- .. math::
572
- L = \prod_d \left\lfloor\frac{\text{output_size}[d] + 2 \times \text{padding}[d] %
573
- - \text{dilation}[d] \times (\text{kernel_size}[d] - 1) - 1}{\text{stride}[d]} + 1\right\rfloor,
574
-
575
- where :math:`d` is over all spatial dimensions.
576
-
577
- Therefore, `output_size` is the spatial shape of the large containing tensor of the sliding local blocks.
578
-
579
- The `dilation`, `padding` and `stride` arguments specify how the sliding blocks are retrieved.
580
-
581
- .. warning::
582
- Currently, only unbatched(3D) or batched(4D) image-like output tensors are supported.
583
-
584
- Args:
585
- input (Tensor): 2-D or 3-D Tensor.
586
- output_size (Union[int, tuple[int], list[int]]): The shape of the spatial dimensions of
587
- the output(i.e., output.shape[2:]).
588
- kernel_size (Union[int, tuple[int], list[int]]): The size of the kernel, should be two int
589
- for height and width. If type is int, it means that height equal with width. Must be specified.
590
- dilation (Union[int, tuple[int], list[int]], optional): The size of the dilation, should be two int
591
- for height and width. If type is int, it means that height equal with width. Default: ``1`` .
592
- padding (Union[int, tuple[int], list[int]], optional): The size of the padding, should be two int
593
- for height and width. If type is int, it means that height equal with width. Default: ``0`` .
594
- stride (Union[int, tuple[int], list[int]], optional): The size of the stride, should be two int
595
- for height and width. If type is int, it means that height equal with width. Default: ``1`` .
596
-
597
- Returns:
598
- A Tensor, with same type as `input` .
599
-
600
- Shape:
601
- - Input: :math:`(N, C \times \prod(\text{kernel_size}), L)` or
602
- :math:`(C \times \prod(\text{kernel_size}), L)`
603
- - Output: :math:`(N, C, output\_size[0], output\_size[1], ...)` or
604
- :math:`(C, output\_size[0], output\_size[1], ...)`
605
-
606
- Raises:
607
- TypeError: If `output_size`, `kernel_size`, `stride`, `dilation`, `padding` data type is not int, tuple or list.
608
- ValueError: If `output_size`, `kernel_size`, `dilation`, `stride` value is not
609
- greater than zero or elements number invalid.
610
- ValueError: If `padding` value is less than zero or elements number invalid.
611
- ValueError: If input.shape[-2] can't be divisible by the product of kernel_size.
612
- ValueError: If `input.shape[-1]` is not equal to the calculated number of sliding blocks `L`.
613
-
614
- Supported Platforms:
615
- ``Ascend``
616
-
617
- Examples:
618
- >>> import numpy as np
619
- >>> from mindspore import Tensor, ops
620
- >>> x = Tensor(np.random.rand(16, 64, 25).astype(np.float32))
621
- >>> output = ops.auto_generate.fold_ext(x, (8, 8), [2, 2], [2, 2], [2, 2], [2, 2])
622
- >>> print(output.shape)
623
- (16, 16, 8, 8)
624
- """
625
- return fold_impl(input, converted_output_size, converted_kernel_size, converted_dilation, converted_padding, converted_stride)
626
-
627
-
628
- def index_select(input, dim, index):
629
- r"""
630
- Generates a new Tensor that accesses the values of `input` along the specified `dim` dimension
631
- using the indices specified in `index`. The new Tensor has the same number of dimensions as `input`,
632
- with the size of the `dim` dimension being equal to the length of `index`, and the size of all other
633
- dimensions will be unchanged from the original `input` Tensor.
634
-
635
- .. note::
636
- The value of index must be in the range of `[0, input.shape[dim])`, the result is undefined out of range.
637
-
638
- Args:
639
- input (Tensor): The input Tensor.
640
- dim (int): The dimension to be indexed.
641
- index (Tensor): A 1-D Tensor with the indices.
642
-
643
- Returns:
644
- Tensor, has the same dtype as input Tensor.
645
-
646
- Raises:
647
- TypeError: If `input` or `index` is not a Tensor.
648
- TypeError: If `dim` is not int number.
649
- ValueError: If the value of `dim` is out the range of `[-input.ndim, input.ndim - 1]`.
650
- ValueError: If the dimension of `index` is not equal to 1.
651
-
652
- Supported Platforms:
653
- ``Ascend``
654
-
655
- Examples:
656
- >>> import mindspore
657
- >>> from mindspore import Tensor, ops
658
- >>> import numpy as np
659
- >>> input = Tensor(np.arange(16).astype(np.float32).reshape(2, 2, 4))
660
- >>> print(input)
661
- [[[ 0. 1. 2. 3.]
662
- [ 4. 5. 6. 7.]]
663
- [[ 8. 9. 10. 11.]
664
- [12. 13. 14. 15.]]]
665
- >>> index = Tensor([0,], mindspore.int32)
666
- >>> y = ops.auto_generate.index_select_ext(input, 1, index)
667
- >>> print(y)
668
- [[[ 0. 1. 2. 3.]]
669
- [[ 8. 9. 10. 11.]]]
670
- """
671
- return index_select_impl(input, dim, index)
672
-
673
-
674
- def inplace_add(input, other, alpha=1):
675
- r"""
676
- None
677
- """
678
- return inplace_add_impl(input, other, alpha)
425
+ return avg_pool1d_impl(input, kernel_size, stride, padding, ceil_mode, count_include_pad)
679
426
 
680
427
 
681
- def logsumexp(input, dim, keepdim=False):
428
+ def log2(input):
682
429
  r"""
683
- Computes the logarithm of the sum of exponentiations of all elements along the specified `dim` dimension of the `input` (with numerical stabilization), and retains the dimension based on the `keepdim` parameter.
430
+ Returns the logarithm to the base 2 of a tensor element-wise.
684
431
 
685
432
  .. math::
686
-
687
- logsumexp(input) = \log(\sum(e^{input-input_{max}})) + input_{max}
433
+ y_i = \log_2(x_i)
688
434
 
689
435
  .. warning::
690
- This is an experimental API that is subject to change or deletion.
436
+ - If the input value of operator Log2 is within the range (0, 0.01] or [0.95, 1.05], the output accuracy
437
+ may be affacted.
691
438
 
692
439
  Args:
693
- input (Tensor): Input Tensor.
694
- dim (Union[int, tuple(int), list(int)], optional): The dimension to be reduced (the value should be within `[0, len(input.shape) - 1]`), when the `dim` is `()`, all dimensions are reduced.
695
- keepdim (bool, optional): Whether the output tensor retains the dimension `dim`, default: `False`.
440
+ input (Tensor): Input Tensor of any dimension. The value must be greater than 0.
696
441
 
697
442
  Returns:
698
- Tensor, the dtype changes according to the `input.dtype`, and the shape changes according to the values of `dim` and `keepdim`.
699
-
700
- - If `input.dtype` is in [float16, float32, bfloat16], the output dtype is the same as the `input.dtype`.
701
- - If `input.dtype` is an integer or boolean type, the output dtype is float32.
702
- - If `dim` is (), and `keepdim` is False, the output is a 0-D tensor representing the logarithm of the sum of exponentiations of all elements in the `input` tensor.
703
- - If `dim` is `1`, and `keepdim` is False, the shape of output is :math:`(input.shape[0], input.shape[2], ..., input.shape[n])`.
704
- - If `dim` is `(1, 2)`, and `keepdim` is False, the shape of output is :math:`(input.shape[0], input.shape[3], ..., input.shape[n])`.
443
+ Tensor, has the same shape as the `input`. If `input.dtype` is of integer or boolean type, the output dtype
444
+ will be float32. Otherwise, the output dtype will be the same as `input.dtype`.
705
445
 
706
446
  Raises:
707
447
  TypeError: If `input` is not a Tensor.
708
- TypeError: If dtype of `input` is not one of: bool, int8, int16, int32, int64, uint8, float16, float32, bfloat16.
709
- TypeError: If `dim` is not an int or tuple(int) or list(list).
710
- TypeError: If `keepdim` is not a bool.
711
- ValueError: If the value of any elements of `dim` is not in the range `[0, len(input.shape) - 1]`.
712
- RuntimeError: If any element of `dim` is repeated.
713
448
 
714
449
  Supported Platforms:
715
450
  ``Ascend``
716
451
 
717
452
  Examples:
453
+ >>> import mindspore
718
454
  >>> import numpy as np
719
455
  >>> from mindspore import Tensor, ops
720
- >>> x = Tensor(np.random.randn(3, 4, 5, 6).astype(np.float32))
721
- >>> output = ops.auto_generate.logsumexp_ext(x, 1, keepdim=True)
722
- >>> print(output.shape)
723
- (3, 1, 5, 6)
456
+ >>> x = Tensor(np.array([3.0, 5.0, 7.0]), mindspore.float32)
457
+ >>> output = ops.auto_generate.log2_ext(x)
458
+ >>> print(output)
459
+ [1.5849625 2.321928 2.807355 ]
724
460
  """
725
- return logsumexp_impl(input, dim, keepdim)
461
+ return log2_impl(input)
726
462
 
727
463
 
728
- def atan(input):
464
+ def log_softmax(input, dim=None, dtype=None):
729
465
  r"""
730
- Computes the trigonometric inverse tangent of the input element-wise.
466
+ Applies the Log Softmax function to the input tensor on the specified axis.
467
+ Supposes a slice in the given axis, :math:`x` for each element :math:`x_i`,
468
+ the Log Softmax function is shown as follows:
731
469
 
732
470
  .. math::
471
+ \text{output}(x_i) = \log \left(\frac{\exp(x_i)} {\sum_{j = 0}^{N-1}\exp(x_j)}\right),
733
472
 
734
- out_i = \tan^{-1}(input_i)
473
+ where :math:`N` is the length of the Tensor.
735
474
 
736
475
  Args:
737
- input (Tensor): The shape of tensor is
738
- :math:`(N,*)` where :math:`*` means, any number of additional dimensions.
476
+ input (Tensor): The input Tensor.
477
+ dim (int, optional): The axis to perform the Log softmax operation. Default: ``None`` .
478
+
479
+ Keyword Args:
480
+ dtype (:class:`mindspore.dtype`, optional): The desired dtype of returned Tensor. If not set to None, the input
481
+ Tensor will be cast to `dtype` before the operation is performed. This is useful for preventing overflows.
482
+ If set to None, stay the same as original Tensor. Default: ``None`` . Supported data type is {float16, float32, double, bfloat16}.
739
483
 
740
484
  Returns:
741
- Tensor, has the same shape as `input`. The dtype of output is float32 when dtype of `input` is in [bool, int8, uint8, int16, int32, int64]. Otherwise output has the same dtype as `input`.
485
+ Tensor, with the same shape as the input.
742
486
 
743
487
  Raises:
744
- TypeError: If `input` is not a Tensor.
488
+ TypeError: If `dim` is not an int.
489
+ ValueError: If `dim` is not in range [-len(input.shape), len(input.shape)).
745
490
 
746
491
  Supported Platforms:
747
- ``Ascend`` ``GPU`` ``CPU``
492
+ ``Ascend``
748
493
 
749
494
  Examples:
750
495
  >>> import mindspore
751
496
  >>> import numpy as np
752
497
  >>> from mindspore import Tensor, ops
753
- >>> input = Tensor(np.array([1.0, 0.0]), mindspore.float32)
754
- >>> output = ops.atan_ext(input)
498
+ >>> logits = Tensor(np.array([1, 2, 3, 4, 5]), mindspore.float32)
499
+ >>> output = ops.auto_generate.log_softmax(logits, dim=-1)
755
500
  >>> print(output)
756
- [0.7853982 0. ]
501
+ [-4.4519143 -3.4519143 -2.4519143 -1.4519144 -0.4519144]
757
502
  """
758
- return atan_impl(input)
503
+ return log_softmax_impl(input, dim, dtype)
759
504
 
760
505
 
761
- def sum(input, dim=None, keepdim=False, dtype=None):
506
+ def sort(input, dim=-1, descending=False, stable=False):
762
507
  r"""
763
- Calculate sum of Tensor elements over a given dim.
508
+ None
509
+ """
510
+ return sort_impl(input, dim, descending, stable)
511
+
512
+
513
+ def fold(input, output_size, kernel_size, dilation=1, padding=0, stride=1):
514
+ r"""
515
+ Combines an array of sliding local blocks into a large containing tensor.
764
516
 
765
- Note:
766
- The `dim` with tensor type is only used for compatibility with older versions and is not recommended.
517
+ Consider a batched input tensor of shape :math:`(N, C \times \prod(\text{kernel_size}), L)` ,
518
+ where :math:`N` is the batch dimension, :math:`C \times \prod(\text{kernel_size})` is the
519
+ total number of values within each block (a block has :math:`\prod(\text{kernel_size})` spatial
520
+ locations each containing a `C`-channeled vector), and :math:`L` is the total number of such blocks:
521
+
522
+ .. math::
523
+ L = \prod_d \left\lfloor\frac{\text{output_size}[d] + 2 \times \text{padding}[d] %
524
+ - \text{dilation}[d] \times (\text{kernel_size}[d] - 1) - 1}{\text{stride}[d]} + 1\right\rfloor,
525
+
526
+ where :math:`d` is over all spatial dimensions.
527
+
528
+ Therefore, `output_size` is the spatial shape of the large containing tensor of the sliding local blocks.
529
+
530
+ The `dilation`, `padding` and `stride` arguments specify how the sliding blocks are retrieved.
531
+
532
+ .. warning::
533
+ Currently, only unbatched(3D) or batched(4D) image-like output tensors are supported.
767
534
 
768
535
  Args:
769
- input (Tensor): The input tensor.
770
- dim (Union[None, int, tuple(int), list(int), Tensor]): Dimensions along which a sum is performed.
771
- If ``None`` , sum all the elements of the input tensor.
772
- If the `dim` is a tuple or list of ints, a sum is performed on all the dimensions specified in the tuple.
773
- Must be in the range :math:`[-input.ndim, input.ndim)` . Default: ``None`` .
774
- keepdim (bool): Whether the output tensor has `dim` retained or not.
775
- If ``True`` , keep these reduced dimensions and the length is 1.
776
- If ``False`` , don't keep these dimensions. Default: ``False`` .
777
- dtype (:class:`mindspore.dtype`): The desired data type of returned Tensor. Default: ``None`` .
536
+ input (Tensor): 2-D or 3-D Tensor.
537
+ output_size (Union[int, tuple[int], list[int]]): The shape of the spatial dimensions of
538
+ the output(i.e., output.shape[2:]).
539
+ kernel_size (Union[int, tuple[int], list[int]]): The size of the kernel, should be two int
540
+ for height and width. If type is int, it means that height equal with width. Must be specified.
541
+ dilation (Union[int, tuple[int], list[int]], optional): The size of the dilation, should be two int
542
+ for height and width. If type is int, it means that height equal with width. Default: ``1`` .
543
+ padding (Union[int, tuple[int], list[int]], optional): The size of the padding, should be two int
544
+ for height and width. If type is int, it means that height equal with width. Default: ``0`` .
545
+ stride (Union[int, tuple[int], list[int]], optional): The size of the stride, should be two int
546
+ for height and width. If type is int, it means that height equal with width. Default: ``1`` .
778
547
 
779
548
  Returns:
780
- A Tensor, sum of elements over a given `dim` in `input`.
549
+ A Tensor, with same type as `input` .
550
+
551
+ Shape:
552
+ - Input: :math:`(N, C \times \prod(\text{kernel_size}), L)` or
553
+ :math:`(C \times \prod(\text{kernel_size}), L)`
554
+ - Output: :math:`(N, C, output\_size[0], output\_size[1], ...)` or
555
+ :math:`(C, output\_size[0], output\_size[1], ...)`
781
556
 
782
557
  Raises:
783
- TypeError: If `input` is not a Tensor.
784
- TypeError: If `dim` is not an int, tulpe(int), list(int), Tensor or None.
785
- ValueError: If `dim` is not in the range :math:`[-input.ndim, input.ndim)` .
786
- TypeError: If `keepdim` is not a bool.
558
+ TypeError: If `output_size`, `kernel_size`, `stride`, `dilation`, `padding` data type is not int, tuple or list.
559
+ ValueError: If `output_size`, `kernel_size`, `dilation`, `stride` value is not
560
+ greater than zero or elements number invalid.
561
+ ValueError: If `padding` value is less than zero or elements number invalid.
562
+ ValueError: If input.shape[-2] can't be divisible by the product of kernel_size.
563
+ ValueError: If `input.shape[-1]` is not equal to the calculated number of sliding blocks `L`.
787
564
 
788
565
  Supported Platforms:
789
- ``Ascend`` ``GPU`` ``CPU``
566
+ ``Ascend``
790
567
 
791
568
  Examples:
792
- >>> import mindspore
793
569
  >>> import numpy as np
794
570
  >>> from mindspore import Tensor, ops
795
- >>> from mindspore import dtype as mstype
796
- >>> x = Tensor(np.array([[[1, 1, 1, 1, 1, 1], [2, 2, 2, 2, 2, 2], [3, 3, 3, 3, 3, 3]],
797
- ... [[4, 4, 4, 4, 4, 4], [5, 5, 5, 5, 5, 5], [6, 6, 6, 6, 6, 6]],
798
- ... [[7, 7, 7, 7, 7, 7], [8, 8, 8, 8, 8, 8], [9, 9, 9, 9, 9, 9]]]), mstype.float32)
799
- >>> out = ops.sum_ext(x)
800
- >>> print(out)
801
- 270.0
802
- >>> out = ops.sum_ext(x, dim=2)
803
- >>> print(out)
804
- [[ 6. 12. 18.]
805
- [24. 30. 36.]
806
- [42. 48. 54.]]
807
- >>> out = ops.sum_ext(x, dim=2, keepdim=True)
808
- >>> print(out)
809
- [[[ 6.]
810
- [12.]
811
- [18.]]
812
- [[24.]
813
- [30.]
814
- [36.]]
815
- [[42.]
816
- [48.]
817
- [54.]]]
571
+ >>> x = Tensor(np.random.rand(16, 64, 25).astype(np.float32))
572
+ >>> output = ops.auto_generate.fold_ext(x, (8, 8), [2, 2], [2, 2], [2, 2], [2, 2])
573
+ >>> print(output.shape)
574
+ (16, 16, 8, 8)
818
575
  """
819
- return sum_impl(input, dim, keepdim, dtype)
576
+ return fold_impl(input, converted_output_size, converted_kernel_size, converted_dilation, converted_padding, converted_stride)
820
577
 
821
578
 
822
- def acosh(input):
579
+ def atan2(input, other):
823
580
  r"""
824
- Computes inverse hyperbolic cosine of the inputs element-wise.
825
-
826
- .. math::
581
+ Returns arctangent of input/other element-wise.
827
582
 
828
- out_i = \cosh^{-1}(input_i)
583
+ It returns :math:`\theta\ \in\ [-\pi, \pi]`
584
+ such that :math:`input = r*\sin(\theta), other = r*\cos(\theta)`, where :math:`r = \sqrt{input^2 + other^2}`.
829
585
 
830
- .. note::
831
- Given an input tensor input, the function computes inverse hyperbolic cosine of every element.
832
- Input range is [1, inf].
586
+ Note:
587
+ - Arg `input` and `other` comply with the implicit type conversion rules to make the data types consistent.
588
+ If they have different data types, the lower precision data type will be converted to relatively the
589
+ highest precision data type.
833
590
 
834
591
  Args:
835
- input (Tensor): The input tensor of inverse hyperbolic cosine function.
592
+ input (Tensor, Number.number): The input tensor or scalar.
593
+ other (Tensor, Number.number): The input tensor or scalar. It has the same shape with `input` or
594
+ its shape is able to broadcast with `input`.
836
595
 
837
596
  Returns:
838
- Tensor, has the same shape as `input`. The dtype of output is float32 when dtype of `input` is in [bool, int8, uint8, int16, int32, int64]. Otherwise output has the same dtype as `input`.
597
+ Tensor, the shape is the same as the one after broadcasting.
598
+ The dtype of output is float32 when dtype of `input` is in
599
+ [bool, int8, uint8, int16, int32, int64]. Otherwise output has the same dtype as `input`.
839
600
 
840
601
  Raises:
841
- TypeError: If `input` is not a Tensor.
602
+ TypeError: If `input` or `other` is not a Tensor or scalar.
603
+ RuntimeError: If the data type of `input` and `other` conversion of Parameter is required
604
+ when data type conversion of Parameter is not supported.
842
605
 
843
606
  Supported Platforms:
844
- ``Ascend`` ``GPU`` ``CPU``
607
+ ``Ascend``
845
608
 
846
609
  Examples:
847
610
  >>> import mindspore
848
611
  >>> import numpy as np
849
612
  >>> from mindspore import Tensor, ops
850
- >>> input = Tensor(np.array([1.0, 1.5, 3.0, 100.0]), mindspore.float32)
851
- >>> output = ops.acosh_ext(input)
613
+ >>> input = Tensor(np.array([0, 1]), mindspore.float32)
614
+ >>> other = Tensor(np.array([1, 1]), mindspore.float32)
615
+ >>> output = ops.auto_generate.atan2_ext(input, other)
852
616
  >>> print(output)
853
- [0. 0.9624236 1.7627472 5.298292 ]
854
- """
855
- return acosh_impl(input)
856
-
857
-
858
- def matmul(input, other):
859
- r"""
860
- None
617
+ [0. 0.7853982]
861
618
  """
862
- return matmul_impl(input, other)
619
+ return atan2_impl(input, other)
863
620
 
864
621
 
865
- def log_softmax(input, dim=None, dtype=None):
622
+ def logaddexp(input, other):
866
623
  r"""
867
- Applies the Log Softmax function to the input tensor on the specified axis.
868
- Supposes a slice in the given axis, :math:`x` for each element :math:`x_i`,
869
- the Log Softmax function is shown as follows:
624
+ Computes the logarithm of the sum of exponentiations of the inputs.
625
+ This function is useful in statistics where the calculated probabilities of events may be
626
+ so small as to exceed the range of normal floating point numbers.
870
627
 
871
628
  .. math::
872
- \text{output}(x_i) = \log \left(\frac{\exp(x_i)} {\sum_{j = 0}^{N-1}\exp(x_j)}\right),
873
629
 
874
- where :math:`N` is the length of the Tensor.
630
+ out_i = \log(exp(input_i) + \exp(other_i))
875
631
 
876
- Args:
877
- input (Tensor): The input Tensor.
878
- dim (int, optional): The axis to perform the Log softmax operation. Default: ``None`` .
632
+ .. warning::
633
+ This is an experimental API that is subject to change or deletion.
879
634
 
880
- Keyword Args:
881
- dtype (:class:`mindspore.dtype`, optional): The desired dtype of returned Tensor. If not set to None, the input
882
- Tensor will be cast to `dtype` before the operation is performed. This is useful for preventing overflows.
883
- If set to None, stay the same as original Tensor. Default: ``None`` . Supported data type is {float16, float32, double, bfloat16}.
635
+ Args:
636
+ input (Tensor): Input Tensor. The dtype of `input` must be float.
637
+ other (Tensor): Input Tensor. The dtype of `other` must be float.
638
+ If the shape of `input` is not equal to the shape of `other`,
639
+ they must be broadcastable to a common shape.
884
640
 
885
641
  Returns:
886
- Tensor, with the same shape as the input.
642
+ Tensor, with the same dtype as `input` and `other`.
887
643
 
888
644
  Raises:
889
- TypeError: If `dim` is not an int.
890
- ValueError: If `dim` is not in range [-len(input.shape), len(input.shape)).
645
+ TypeError: If `input` or `other` is not a Tensor.
646
+ TypeError: The dtype of `input` or `other` is not float.
891
647
 
892
648
  Supported Platforms:
893
649
  ``Ascend``
894
650
 
895
651
  Examples:
896
- >>> import mindspore
897
652
  >>> import numpy as np
898
653
  >>> from mindspore import Tensor, ops
899
- >>> logits = Tensor(np.array([1, 2, 3, 4, 5]), mindspore.float32)
900
- >>> output = ops.auto_generate.log_softmax(logits, dim=-1)
654
+ >>> x1 = Tensor(np.array([1, 2, 3]).astype(np.float16))
655
+ >>> x2 = Tensor(np.array(2).astype(np.float16))
656
+ >>> output = ops.logaddexp_ext(x1, x2)
901
657
  >>> print(output)
902
- [-4.4519143 -3.4519143 -2.4519143 -1.4519144 -0.4519144]
658
+ [2.312 2.693 3.312]
903
659
  """
904
- return log_softmax_impl(input, dim, dtype)
660
+ return logaddexp_impl(input, other)
905
661
 
906
662
 
907
- def adaptive_avg_pool3d(input, output_size):
663
+ def tril(input, diagonal=0):
908
664
  r"""
909
665
  None
910
666
  """
911
- return adaptive_avg_pool3d_impl(input, output_size)
667
+ return tril_impl(input, diagonal)
912
668
 
913
669
 
914
- def acos(input):
670
+ def atan(input):
915
671
  r"""
916
- Computes arccosine of input tensors element-wise.
672
+ Computes the trigonometric inverse tangent of the input element-wise.
917
673
 
918
674
  .. math::
919
675
 
920
- out_i = \cos^{-1}(input_i)
676
+ out_i = \tan^{-1}(input_i)
921
677
 
922
678
  Args:
923
679
  input (Tensor): The shape of tensor is
924
- :math:`(N,*)`, where :math:`*` means any number of additional dimensions.
680
+ :math:`(N,*)` where :math:`*` means, any number of additional dimensions.
925
681
 
926
682
  Returns:
927
683
  Tensor, has the same shape as `input`. The dtype of output is float32 when dtype of `input` is in [bool, int8, uint8, int16, int32, int64]. Otherwise output has the same dtype as `input`.
@@ -936,78 +692,114 @@ def acos(input):
936
692
  >>> import mindspore
937
693
  >>> import numpy as np
938
694
  >>> from mindspore import Tensor, ops
939
- >>> input = Tensor(np.array([0.74, 0.04, 0.30, 0.56]), mindspore.float32)
940
- >>> output = ops.acos_ext(input)
695
+ >>> input = Tensor(np.array([1.0, 0.0]), mindspore.float32)
696
+ >>> output = ops.atan_ext(input)
941
697
  >>> print(output)
942
- [0.7377037 1.5307857 1.2661037 0.9764114]
698
+ [0.7853982 0. ]
943
699
  """
944
- return acos_impl(input)
700
+ return atan_impl(input)
945
701
 
946
702
 
947
- def flatten(input, start_dim=0, end_dim=-1):
703
+ def leaky_relu(input, negative_slope=0.01):
948
704
  r"""
949
- Flatten a tensor along dimensions from `start_dim` to `end_dim`.
705
+ leaky_relu activation function. The element of `input` less than 0 times `negative_slope` .
706
+
707
+ The activation function is defined as:
708
+
709
+ .. math::
710
+ \text{leaky_relu}(input) = \begin{cases}input, &\text{if } input \geq 0; \cr
711
+ \text{negative_slope} * input, &\text{otherwise.}\end{cases}
712
+
713
+ where :math:`negative\_slope` represents the `negative_slope` parameter.
714
+
715
+ For more details, see `Rectifier Nonlinearities Improve Neural Network Acoustic Models
716
+ <https://ai.stanford.edu/~amaas/papers/relu_hybrid_icml2013_final.pdf>`_.
717
+
718
+ LeakyReLU Activation Function Graph:
719
+
720
+ .. image:: ../images/LeakyReLU.png
721
+ :align: center
950
722
 
951
723
  Args:
952
- input (Tensor): The input Tensor.
953
- start_dim (int, optional): The first dimension to flatten. Default: ``0`` .
954
- end_dim (int, optional): The last dimension to flatten. Default: ``-1`` .
724
+ input (Tensor): The input of leaky_relu is a Tensor of any dimension.
725
+ negative_slope (Union[int, float], optional): Slope of the activation function when the element of `input` is less than 0.
726
+ Default: ``0.01`` .
955
727
 
956
728
  Returns:
957
- Tensor. If no dimensions are flattened, returns the original `input`, otherwise return the flattened Tensor.
958
- If `input` is a 0-dimensional Tensor, a 1-dimensional Tensor will be returned.
729
+ Tensor, has the same type and shape as the `input`.
959
730
 
960
731
  Raises:
961
732
  TypeError: If `input` is not a Tensor.
962
- TypeError: If `start_dim` or `end_dim` is not int.
963
- ValueError: If `start_dim` is greater than `end_dim` after canonicalized.
964
- ValueError: If `start_dim` or `end_dim` is not in range of [-input.dim, input.dim-1].
733
+ TypeError: If `negative_slope` is not a float or an int.
965
734
 
966
735
  Supported Platforms:
967
- ``Ascend`` ``GPU`` ``CPU``
736
+ ``Ascend``
968
737
 
969
738
  Examples:
970
739
  >>> import mindspore
971
740
  >>> import numpy as np
972
741
  >>> from mindspore import Tensor, ops
973
- >>> input_x = Tensor(np.ones(shape=[1, 2, 3, 4]), mindspore.float32)
974
- >>> output = ops.auto_generate.flatten_ext(input_x)
975
- >>> print(output.shape)
976
- (24,)
742
+ >>> input = Tensor(np.array([[-1.0, 4.0, -8.0], [2.0, -5.0, 9.0]]), mindspore.float32)
743
+ >>> print(ops.extend.leaky_relu_ext(input, negative_slope=0.2))
744
+ [[-0.2 4. -1.6]
745
+ [ 2. -1. 9. ]]
977
746
  """
978
- return flatten_impl(input, start_dim, end_dim)
747
+ return leaky_relu_impl(input, negative_slope)
979
748
 
980
749
 
981
- def sub_tensor_(input, other, alpha=1):
750
+ def acosh(input):
982
751
  r"""
983
- None
752
+ Computes inverse hyperbolic cosine of the inputs element-wise.
753
+
754
+ .. math::
755
+
756
+ out_i = \cosh^{-1}(input_i)
757
+
758
+ .. note::
759
+ Given an input tensor input, the function computes inverse hyperbolic cosine of every element.
760
+ Input range is [1, inf].
761
+
762
+ Args:
763
+ input (Tensor): The input tensor of inverse hyperbolic cosine function.
764
+
765
+ Returns:
766
+ Tensor, has the same shape as `input`. The dtype of output is float32 when dtype of `input` is in [bool, int8, uint8, int16, int32, int64]. Otherwise output has the same dtype as `input`.
767
+
768
+ Raises:
769
+ TypeError: If `input` is not a Tensor.
770
+
771
+ Supported Platforms:
772
+ ``Ascend`` ``GPU`` ``CPU``
773
+
774
+ Examples:
775
+ >>> import mindspore
776
+ >>> import numpy as np
777
+ >>> from mindspore import Tensor, ops
778
+ >>> input = Tensor(np.array([1.0, 1.5, 3.0, 100.0]), mindspore.float32)
779
+ >>> output = ops.acosh_ext(input)
780
+ >>> print(output)
781
+ [0. 0.9624236 1.7627472 5.298292 ]
984
782
  """
985
- return sub_tensor_impl(input, other, alpha)
783
+ return acosh_impl(input)
986
784
 
987
785
 
988
- def log10(input):
786
+ def t(input):
989
787
  r"""
990
- Returns the logarithm to the base 10 of a tensor element-wise.
991
-
992
- .. math::
993
- y_i = \log_{10}(x_i)
788
+ Transpose the input tensor.
994
789
 
995
790
  .. warning::
996
- - This is an experimental API that is subject to change or deletion.
997
- - If the input value of operator Log10 is within the range (0, 0.01] or [0.95, 1.05], the output accuracy
998
- may be affacted.
791
+ This is an experimental API that is subject to change or deletion.
999
792
 
1000
793
  Args:
1001
- input (Tensor): Input Tensor of any dimension. The value must be greater than 0.
794
+ input (Tensor): The input tensor.
1002
795
 
1003
796
  Returns:
1004
- Tensor, has the same shape as the `input`, and the dtype changes according to the `input.dtype`.
1005
-
1006
- - if `input.dtype` is in [float16, float32, float64, bfloat16], the output dtype is the same as the `input.dtype`.
1007
- - if `input.dtype` is integer or boolean type, the output dtype is float32.
797
+ Tensor, transpose 2D tensor, return 1D tensor as it is.
1008
798
 
1009
799
  Raises:
1010
- TypeError: If `input` is not a Tensor.
800
+ ValueError: If the dimension of `input` is greater than 2.
801
+ ValueError: If `input` is empty.
802
+ TypeError: If `input` is not a tensor.
1011
803
 
1012
804
  Supported Platforms:
1013
805
  ``Ascend``
@@ -1016,12 +808,14 @@ def log10(input):
1016
808
  >>> import mindspore
1017
809
  >>> import numpy as np
1018
810
  >>> from mindspore import Tensor, ops
1019
- >>> x = Tensor(np.array([3.0, 5.0, 7.0]), mindspore.float32)
1020
- >>> output = ops.auto_generate.log10_ext(x)
811
+ >>> input = Tensor(np.array([[1, 2, 3], [4, 5, 6]]), mindspore.float32)
812
+ >>> output = ops.t_ext(input)
1021
813
  >>> print(output)
1022
- [0.47712136 0.69897 0.845098 ]
814
+ [[ 1. 4.]
815
+ [ 2. 5.]
816
+ [ 3. 6.]]
1023
817
  """
1024
- return log10_impl(input)
818
+ return t_impl(input)
1025
819
 
1026
820
 
1027
821
  def mean(input, dim=None, keepdim=False, dtype=None):
@@ -1111,347 +905,430 @@ def mean(input, dim=None, keepdim=False, dtype=None):
1111
905
  return mean_impl(input, dim, keepdim, dtype)
1112
906
 
1113
907
 
1114
- def sort(input, dim=-1, descending=False, stable=False):
908
+ def cumsum(input, dim, dtype=None):
1115
909
  r"""
1116
- None
910
+ Computes the cumulative sum of input Tensor along `dim`.
911
+
912
+ .. math::
913
+
914
+ y_i = x_1 + x_2 + x_3 + ... + x_i
915
+
916
+ Args:
917
+ input (Tensor): The input Tensor.
918
+ dim (int): Dim along which the cumulative sum is computed.
919
+ dtype (:class:`mindspore.dtype`, optional): The desired dtype of returned Tensor. If specified,
920
+ the input Tensor will be cast to `dtype` before the computation. This is useful for preventing overflows.
921
+ If not specified, stay the same as original Tensor. Default: ``None`` .
922
+
923
+ Returns:
924
+ Tensor, the shape of the output Tensor is consistent with the input Tensor's.
925
+
926
+ Raises:
927
+ TypeError: If `input` is not a Tensor.
928
+ ValueError: If the `dim` is out of range.
929
+
930
+ Supported Platforms:
931
+ ``Ascend``
932
+
933
+ Examples:
934
+ >>> import numpy as np
935
+ >>> from mindspore import Tensor
936
+ >>> import mindspore.ops as ops
937
+ >>> x = Tensor(np.array([[3, 4, 6, 10], [1, 6, 7, 9], [4, 3, 8, 7], [1, 3, 7, 9]]).astype(np.float32))
938
+ >>> # case 1: along the dim 0
939
+ >>> y = ops.auto_generate.cumsum_ext(x, 0)
940
+ >>> print(y)
941
+ [[ 3. 4. 6. 10.]
942
+ [ 4. 10. 13. 19.]
943
+ [ 8. 13. 21. 26.]
944
+ [ 9. 16. 28. 35.]]
945
+ >>> # case 2: along the dim 1
946
+ >>> y = ops.auto_generate.cumsum_ext(x, 1)
947
+ >>> print(y)
948
+ [[ 3. 7. 13. 23.]
949
+ [ 1. 7. 14. 23.]
950
+ [ 4. 7. 15. 22.]
951
+ [ 1. 4. 11. 20.]]
1117
952
  """
1118
- return sort_impl(input, dim, descending, stable)
953
+ return cumsum_impl(input, dim, dtype)
1119
954
 
1120
955
 
1121
- def unfold(input, kernel_size, dilation=1, padding=0, stride=1):
956
+ def logsumexp(input, dim, keepdim=False):
1122
957
  r"""
1123
- Extracts sliding local blocks from a batched input tensor.
1124
-
1125
- Consider a batched input tensor of shape :math:`(N, C, *)`,
1126
- where :math:`N` is the batch dimension, :math:`C` is the channel dimension,
1127
- and :math:`*` represent arbitrary spatial dimensions. This operation flattens
1128
- each sliding `Kernel_size`- sized block within the spatial dimensions
1129
- of `input` into a column (i.e., last dimension) of a 3-D output
1130
- tensor of shape :math:`(N, C \times \prod(\text{kernel_size}), L)`, where
1131
- :math:`C \times \prod(\text{kernel_size})` is the total number of values
1132
- within each block (a block has :math:`\prod(\text{kernel_size})` spatial
1133
- locations each containing a `C`-channeled vector), and :math:`L` is
1134
- the total number of such blocks:
958
+ Computes the logarithm of the sum of exponentiations of all elements along the specified `dim` dimension of the `input` (with numerical stabilization), and retains the dimension based on the `keepdim` parameter.
1135
959
 
1136
960
  .. math::
1137
- L = \prod_d \left\lfloor\frac{\text{spatial_size}[d] + 2 \times \text{padding}[d] %
1138
- - \text{dilation}[d] \times (\text{kernel_size}[d] - 1) - 1}{\text{stride}[d]} + 1\right\rfloor,
1139
961
 
1140
- where :math:`\text{spatial_size}` is formed by the spatial dimensions
1141
- of `input` (:math:`*` above), and :math:`d` is over all spatial
1142
- dimensions.
1143
-
1144
- Therefore, indexing `output` at the last dimension (column dimension)
1145
- gives all values within a certain block.
1146
-
1147
- The `dilation`, `padding` and `stride` arguments specify
1148
- how the sliding blocks are retrieved.
962
+ logsumexp(input) = \log(\sum(e^{input-input_{max}})) + input_{max}
1149
963
 
1150
964
  .. warning::
1151
- - Currently, batched(4D) image-like tensors are supported.
1152
- - For Ascend, it is only supported on platforms above Atlas A2.
965
+ This is an experimental API that is subject to change or deletion.
1153
966
 
1154
967
  Args:
1155
- input (Tensor): 4-D Tensor.
1156
- kernel_size (Union[int, tuple[int], list[int]]): The size of the kernel, should be two int
1157
- for height and width. If type is int, it means that height equal with width. Must be specified.
1158
- dilation (Union[int, tuple[int], list[int]], optional): The dilation of the window, should be two int
1159
- for height and width. If type is int, it means that height equal with width. Default: ``1`` .
1160
- padding (Union[int, tuple[int], list[int]], optional): The pad of the window, should be two int
1161
- for height and width. If type is int, it means that height equal with width. Default: ``0`` .
1162
- stride (Union[int, tuple[int], list[int]], optional): The stride of the window, should be two int
1163
- for height and width. If type is int, it means that height equal with width. Default: ``1`` .
968
+ input (Tensor): Input Tensor.
969
+ dim (Union[int, tuple(int), list(int)], optional): The dimension to be reduced (the value should be within `[0, len(input.shape) - 1]`), when the `dim` is `()`, all dimensions are reduced.
970
+ keepdim (bool, optional): Whether the output tensor retains the dimension `dim`, default: `False`.
1164
971
 
1165
972
  Returns:
1166
- A Tensor, with same type as `input` .
973
+ Tensor, the dtype changes according to the `input.dtype`, and the shape changes according to the values of `dim` and `keepdim`.
1167
974
 
1168
- Shape:
1169
- - Input: :math:`(N, C, *)`
1170
- - Output: :math:`(N, C \times \prod(\text{kernel_size}), L)`
975
+ - If `input.dtype` is in [float16, float32, bfloat16], the output dtype is the same as the `input.dtype`.
976
+ - If `input.dtype` is an integer or boolean type, the output dtype is float32.
977
+ - If `dim` is (), and `keepdim` is False, the output is a 0-D tensor representing the logarithm of the sum of exponentiations of all elements in the `input` tensor.
978
+ - If `dim` is `1`, and `keepdim` is False, the shape of output is :math:`(input.shape[0], input.shape[2], ..., input.shape[n])`.
979
+ - If `dim` is `(1, 2)`, and `keepdim` is False, the shape of output is :math:`(input.shape[0], input.shape[3], ..., input.shape[n])`.
1171
980
 
1172
981
  Raises:
1173
- TypeError: If any data type of `kernel_size`, `stride`, `dilation`, `padding` is not int, tuple or list.
1174
- ValueError: If `kernel_size`, `dilation`, `stride` value is not
1175
- greater than zero or elements number more than `2`.
1176
- ValueError: If `padding` value is less than zero.
982
+ TypeError: If `input` is not a Tensor.
983
+ TypeError: If dtype of `input` is not one of: bool, int8, int16, int32, int64, uint8, float16, float32, bfloat16.
984
+ TypeError: If `dim` is not an int or tuple(int) or list(list).
985
+ TypeError: If `keepdim` is not a bool.
986
+ ValueError: If the value of any elements of `dim` is not in the range `[0, len(input.shape) - 1]`.
987
+ RuntimeError: If any element of `dim` is repeated.
1177
988
 
1178
989
  Supported Platforms:
1179
990
  ``Ascend``
1180
991
 
1181
992
  Examples:
1182
- >>> import mindspore
1183
993
  >>> import numpy as np
1184
994
  >>> from mindspore import Tensor, ops
1185
- >>> x = Tensor(np.random.rand(4, 4, 32, 32), mindspore.float32)
1186
- >>> output = ops.auto_generate.unfold_ext(x, kernel_size=3, dilation=1, stride=1)
995
+ >>> x = Tensor(np.random.randn(3, 4, 5, 6).astype(np.float32))
996
+ >>> output = ops.auto_generate.logsumexp_ext(x, 1, keepdim=True)
1187
997
  >>> print(output.shape)
1188
- (4, 36, 900)
998
+ (3, 1, 5, 6)
1189
999
  """
1190
- return unfold_impl(input, converted_kernel_size, converted_dilation, converted_padding, converted_stride)
1000
+ return logsumexp_impl(input, dim, keepdim)
1191
1001
 
1192
1002
 
1193
- def outer(input, vec2):
1003
+ def softplus(input, beta=1, threshold=20):
1194
1004
  r"""
1195
- Return outer product of `input` and `vec2`. If `input` is a vector of size :math:`n`
1196
- and `vec2` is a vector of size :math:`m` , then output must be a matrix of shape :math:`(n, m)` .
1005
+ Applies softplus function to `input` element-wise.
1197
1006
 
1198
- .. warning::
1199
- This is an experimental API that is subject to change or deletion.
1007
+ The softplus function is shown as follows, x is the element of `input` :
1200
1008
 
1201
- .. note::
1202
- This function does not broadcast.
1009
+ .. math::
1010
+
1011
+ \text{output} = \frac{1}{beta}\log(1 + \exp(\text{beta * x}))
1012
+
1013
+ where :math:`input * beta > threshold`, the implementation converts to the linear function to ensure numerical stability.
1203
1014
 
1204
1015
  Args:
1205
- input (Tensor): 1-D input vector.
1206
- vec2 (Tensor): 1-D input vector.
1016
+ input (Tensor): Tensor of any dimension. Supported dtypes:
1017
+
1018
+ - Ascend: float16, float32, bfloat16.
1019
+ beta (number.Number, optional): Scaling parameters in the softplus function. Default: ``1`` .
1020
+ threshold (number.Number, optional): For numerical stability, the softplus function is converted
1021
+ to a threshold parameter of a linear function. Default: ``20`` .
1207
1022
 
1208
1023
  Returns:
1209
- out, 2-D matrix, the outer product of two vectors.
1024
+ Tensor, with the same type and shape as the input.
1210
1025
 
1211
1026
  Raises:
1212
- TypeError: If `input` or `vec2` is not a Tensor.
1213
- TypeError: The implicitly converted data types of `input` and `vec2` are not one of float16, float32, float64, bool, uint8, int8, int16, int32, int64, complex64, complex128, bfloat16
1214
- ValueError: If the dimension of `input` or `vec2` is not equal to 1.
1027
+ TypeError: If `input` is not a Tensor.
1028
+ TypeError: If dtype of `input` is not float16, float32, bfloat16.
1215
1029
 
1216
1030
  Supported Platforms:
1217
- ``Ascend``
1031
+ ``Ascend``
1218
1032
 
1219
1033
  Examples:
1220
1034
  >>> import mindspore
1221
1035
  >>> import numpy as np
1222
- >>> from mindspore import Tensor
1223
- >>> from mindspore import ops
1224
- >>> input = Tensor(np.array([7, 8, 9]), mindspore.int32)
1225
- >>> vec2 = Tensor(np.array([7, 10, 11]), mindspore.int32)
1226
- >>> out = ops.outer(input, vec2)
1227
- >>> print(out)
1228
- [[49 70 77]
1229
- [56 80 88]
1230
- [63 90 99]]
1036
+ >>> from mindspore import Tensor, ops
1037
+ >>> input = Tensor(np.array([0.1, 0.2, 30, 25]), mindspore.float32)
1038
+ >>> output = ops.auto_generate.softplus_ext(input)
1039
+ >>> print(output)
1040
+ [0.74439657 0.7981388 30. 25.]
1231
1041
  """
1232
- return outer_impl(input, vec2)
1042
+ return softplus_impl(input, beta, threshold)
1233
1043
 
1234
1044
 
1235
- def histc(input, bins=100, min=0, max=0):
1045
+ def diag(input, diagonal=0):
1236
1046
  r"""
1237
- Computes the histogram of a tensor.
1047
+ If input is a vector (1-D tensor), then returns a 2-D square tensor with the elements of input as the diagonal.
1238
1048
 
1239
- The elements are sorted into equal width bins between `min` and `max`.
1240
- If `min` and `max` are both zero, the minimum and maximum values of the data are used.
1049
+ If input is a matrix (2-D tensor), then returns a 1-D tensor with the diagonal elements of input.
1241
1050
 
1242
- Elements lower than min or higher than max are ignored.
1051
+ The argument diagonal controls which diagonal to consider:
1052
+
1053
+ - If `diagonal` = 0, it is the main diagonal.
1054
+
1055
+ - If `diagonal` > 0, it is above the main diagonal.
1056
+
1057
+ - If `diagonal` < 0, it is below the main diagonal.
1243
1058
 
1244
1059
  .. warning::
1245
1060
  This is an experimental API that is subject to change or deletion.
1246
- If input is int64, valid values fit within int32; exceeding this may cause precision errors.
1247
1061
 
1248
1062
  Args:
1249
- input (Tensor): the input tensor.
1250
- bins (int, optional): Number of histogram bins, optional. If specified, must be positive. Default: ``100`` .
1251
- min (int, float, optional): the lower end of the range (inclusive), optional. Default: ``0`` .
1252
- max (int, float, optional): the upper end of the range (inclusive), optional. Default: ``0`` .
1063
+ input (Tensor): The input tensor.
1064
+ diagonal (int, optional): the diagonal to consider. Defaults: ``0``.
1253
1065
 
1254
1066
  Returns:
1255
- A 1-D Tensor, has the same type as `input` with the shape :math:`(bins, )`.
1067
+ Tensor, has the same dtype as the `input`, its shape is up to `diagonal`.
1068
+
1069
+ - If `input` shape is :math:`(x_0)` : then output shape is :math:`(x_0 + \left | diagonal \right | , x_0 + \left | diagonal \right | )` 2-D Tensor.
1070
+
1071
+ - If `input` shape is :math:`(x_0, x_1)` : then output shape is main diagonal to move :math:`(\left | diagonal \right |)` elements remains elements' length 1-D Tensor.
1256
1072
 
1257
1073
  Raises:
1258
1074
  TypeError: If `input` is not a Tensor.
1259
- TypeError: If `input` datatype is not in support list.
1260
- TypeError: If attr `min` or `max` is not float or int.
1261
- TypeError: If attr `bins` is not int.
1262
- ValueError: If attr value `min` > `max`.
1263
- ValueError: If attr `bins` <= 0.
1075
+ ValueError: If shape of `input` is not 1-D and 2-D.
1264
1076
 
1265
1077
  Supported Platforms:
1266
1078
  ``Ascend``
1267
1079
 
1268
1080
  Examples:
1269
1081
  >>> from mindspore import Tensor, ops
1270
- >>> x = Tensor([1., 2, 1])
1271
- >>> y = ops.histc_ext(x, bins=4, min=0, max=3)
1272
- >>> print(y)
1273
- [0 2 1 0]
1082
+ >>> input = Tensor([1, 2, 3, 4]).astype('int32')
1083
+ >>> output = ops.auto_generate.diag_ext(input)
1084
+ >>> print(output)
1085
+ [[1 0 0 0]
1086
+ [0 2 0 0]
1087
+ [0 0 3 0]
1088
+ [0 0 0 4]]
1274
1089
  """
1275
- return histc_impl(input, bins, min, max)
1090
+ return diag_impl(input, diagonal)
1276
1091
 
1277
1092
 
1278
- def asinh(input):
1093
+ def argmax(input, dim=None, keepdim=False):
1279
1094
  r"""
1280
- Computes inverse hyperbolic sine of the input element-wise.
1095
+ argmax(input) -> Tensor
1281
1096
 
1282
- .. math::
1097
+ Return the indices of the maximum values of a tensor.
1283
1098
 
1284
- out_i = \sinh^{-1}(input_i)
1099
+ Args:
1100
+ input (Tensor): Input tensor.
1101
+
1102
+ Returns:
1103
+ Tensor.
1104
+
1105
+ Supported Platforms:
1106
+ ``Ascend``
1107
+
1108
+ Examples:
1109
+ >>> import numpy as np
1110
+ >>> from mindspore import Tensor
1111
+ >>> from mindspore import ops
1112
+ >>> x = Tensor(np.array([[1, 20, 5], [67, 8, 9], [130, 24, 15]]).astype(np.float32))
1113
+ >>> output = ops.auto_generate.argmax_ext(x)
1114
+ >>> print(output)
1115
+ 6
1116
+
1117
+ .. function:: argmax(input, dim, keepdim=False) -> Tensor
1118
+ :noindex:
1119
+
1120
+ Return the indices of the maximum values of a tensor across a dimension.
1285
1121
 
1286
1122
  Args:
1287
- input (Tensor): The input tensor of inverse hyperbolic sine function.
1123
+ input (Tensor): Input tensor.
1124
+ dim (int): The dimension to reduce.
1125
+ keepdim (bool, optional): Whether the output tensor retains the specified
1126
+ dimension. Default: ``False`` .
1288
1127
 
1289
1128
  Returns:
1290
- Tensor, has the same shape as `input`. The dtype of output is float32 when dtype of `input` is in [bool, int8, uint8, int16, int32, int64]. Otherwise output has the same dtype as `input`.
1129
+ Tensor, indices of the maximum values across a dimension.
1291
1130
 
1292
1131
  Raises:
1293
- TypeError: If `input` is not a Tensor.
1132
+ TypeError: If `keepdim` is not bool.
1133
+ ValueError: If `dim` is out of range.
1294
1134
 
1295
1135
  Supported Platforms:
1296
- ``Ascend`` ``GPU`` ``CPU``
1136
+ ``Ascend``
1297
1137
 
1298
1138
  Examples:
1299
- >>> import mindspore
1300
1139
  >>> import numpy as np
1301
- >>> from mindspore import Tensor, ops
1302
- >>> input = Tensor(np.array([-5.0, 1.5, 3.0, 100.0]), mindspore.float32)
1303
- >>> output = ops.asinh_ext(input)
1140
+ >>> from mindspore import Tensor
1141
+ >>> from mindspore import ops
1142
+ >>> x = Tensor(np.array([[1, 20, 5], [67, 8, 9], [130, 24, 15]]).astype(np.float32))
1143
+ >>> output = ops.auto_generate.argmax_ext(x, dim=-1)
1304
1144
  >>> print(output)
1305
- [-2.3124385 1.1947632 1.8184465 5.298342 ]
1145
+ [1 0 0]
1306
1146
  """
1307
- return asinh_impl(input)
1147
+ return argmax_impl(input, dim, keepdim)
1308
1148
 
1309
1149
 
1310
- def cumsum(input, dim, dtype=None):
1150
+ def add(input, other, alpha=1):
1311
1151
  r"""
1312
- Computes the cumulative sum of input Tensor along `dim`.
1152
+ Adds scaled other value to input Tensor.
1313
1153
 
1314
1154
  .. math::
1315
1155
 
1316
- y_i = x_1 + x_2 + x_3 + ... + x_i
1156
+ out_{i} = input_{i} + alpha \times other_{i}
1157
+
1158
+ Note:
1159
+ - When the two inputs have different shapes,
1160
+ they must be able to broadcast to a common shape.
1161
+ - The two inputs and alpha comply with the implicit type conversion rules to make the data types
1162
+ consistent.
1317
1163
 
1318
1164
  Args:
1319
- input (Tensor): The input Tensor.
1320
- dim (int): Dim along which the cumulative sum is computed.
1321
- dtype (:class:`mindspore.dtype`, optional): The desired dtype of returned Tensor. If specified,
1322
- the input Tensor will be cast to `dtype` before the computation. This is useful for preventing overflows.
1323
- If not specified, stay the same as original Tensor. Default: ``None`` .
1165
+ input (Union[Tensor, number.Number, bool]): The first input is a number.Number or
1166
+ a bool or a tensor whose data type is
1167
+ `number <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_ or
1168
+ `bool <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_.
1169
+ other (Union[Tensor, number.Number, bool]): The second input, is a number.Number or
1170
+ a bool or a tensor whose data type is
1171
+ `number <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_ or
1172
+ `bool <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_.
1173
+ alpha (number.Number): A scaling factor applied to `other`, default 1.
1324
1174
 
1325
1175
  Returns:
1326
- Tensor, the shape of the output Tensor is consistent with the input Tensor's.
1176
+ Tensor with a shape that is the same as the broadcasted shape of the input `input` and `other`,
1177
+ and the data type is the one with higher precision or higher digits among the two inputs and alpha.
1327
1178
 
1328
1179
  Raises:
1329
- TypeError: If `input` is not a Tensor.
1330
- ValueError: If the `dim` is out of range.
1180
+ TypeError: If the type of `input`, `other`, or `alpha` is not one of the following: Tensor, number.Number, bool.
1181
+ TypeError: If `alpha` is of type float but `input` and `other` are not of type float.
1182
+ TypeError: If `alpha` is of type bool but `input` and `other` are not of type bool.
1331
1183
 
1332
1184
  Supported Platforms:
1333
- ``Ascend``
1185
+ ``Ascend`` ``GPU`` ``CPU``
1334
1186
 
1335
1187
  Examples:
1336
1188
  >>> import numpy as np
1189
+ >>> import mindspore
1337
1190
  >>> from mindspore import Tensor
1338
- >>> import mindspore.ops as ops
1339
- >>> x = Tensor(np.array([[3, 4, 6, 10], [1, 6, 7, 9], [4, 3, 8, 7], [1, 3, 7, 9]]).astype(np.float32))
1340
- >>> # case 1: along the dim 0
1341
- >>> y = ops.auto_generate.cumsum_ext(x, 0)
1342
- >>> print(y)
1343
- [[ 3. 4. 6. 10.]
1344
- [ 4. 10. 13. 19.]
1345
- [ 8. 13. 21. 26.]
1346
- [ 9. 16. 28. 35.]]
1347
- >>> # case 2: along the dim 1
1348
- >>> y = ops.auto_generate.cumsum_ext(x, 1)
1349
- >>> print(y)
1350
- [[ 3. 7. 13. 23.]
1351
- [ 1. 7. 14. 23.]
1352
- [ 4. 7. 15. 22.]
1353
- [ 1. 4. 11. 20.]]
1191
+ >>> from mindspore import ops
1192
+ >>> x = Tensor(1, mindspore.int32)
1193
+ >>> y = Tensor(np.array([4, 5, 6]).astype(np.float32))
1194
+ >>> alpha = 0.5
1195
+ >>> output = ops.auto_generate.add_ext(x, y, alpha)
1196
+ >>> print(output)
1197
+ [3. 3.5 4.]
1198
+ >>> # the data type of x is int32, the data type of y is float32,
1199
+ >>> # alpha is a float, and the output is the data format of higher precision float32.
1200
+ >>> print(output.dtype)
1201
+ Float32
1354
1202
  """
1355
- return cumsum_impl(input, dim, dtype)
1203
+ return add_impl(input, other, alpha)
1356
1204
 
1357
1205
 
1358
- def mm(input, mat2):
1206
+ def flatten(input, start_dim=0, end_dim=-1):
1359
1207
  r"""
1360
- Returns the matrix product of two arrays.
1361
- If `input` is a :math:`(n \times m)` Tensor, `mat2` is a
1362
- :math:`(m \times p)` Tensor, `out` will be a :math:`(n \times p)` Tensor.
1363
-
1364
- Note:
1365
- This function cannot support broadcasting.
1366
- Refer to :func:`mindspore.ops.matmul` instead if you need a broadcastable function.
1367
-
1368
- .. warning::
1369
- This is an experimental API that is subject to change or deletion.
1208
+ Flatten a tensor along dimensions from `start_dim` to `end_dim`.
1370
1209
 
1371
1210
  Args:
1372
- input (Tensor): The first matrix of matrix multiplication.
1373
- The last dimension of `input` must be the same size as the first dimension of `mat2`.
1374
- mat2 (Tensor): The second matrix of matrix multiplication.
1375
- The last dimension of `input` must be the same size as the first dimension of `mat2`.
1211
+ input (Tensor): The input Tensor.
1212
+ start_dim (int, optional): The first dimension to flatten. Default: ``0`` .
1213
+ end_dim (int, optional): The last dimension to flatten. Default: ``-1`` .
1376
1214
 
1377
1215
  Returns:
1378
- Tensor, the matrix product of the inputs.
1216
+ Tensor. If no dimensions are flattened, returns the original `input`, otherwise return the flattened Tensor.
1217
+ If `input` is a 0-dimensional Tensor, a 1-dimensional Tensor will be returned.
1379
1218
 
1380
1219
  Raises:
1381
- ValueError: If the last dimension of `input` is not the same size as the
1382
- second-to-last dimension of `mat2`.
1383
- TypeError: If `input` or `mat2` is not a Tensor.
1384
- TypeError: If dtype of `input` or `mat2` is not float16, float32 or bfloat16.
1220
+ TypeError: If `input` is not a Tensor.
1221
+ TypeError: If `start_dim` or `end_dim` is not int.
1222
+ ValueError: If `start_dim` is greater than `end_dim` after canonicalized.
1223
+ ValueError: If `start_dim` or `end_dim` is not in range of [-input.dim, input.dim-1].
1385
1224
 
1386
1225
  Supported Platforms:
1387
- ``Ascend``
1226
+ ``Ascend`` ``GPU`` ``CPU``
1388
1227
 
1389
1228
  Examples:
1390
- >>> import mindspore as ms
1391
- >>> from mindspore import ops
1229
+ >>> import mindspore
1392
1230
  >>> import numpy as np
1393
- >>> x1 = ms.Tensor(np.random.rand(2, 3), ms.float32)
1394
- >>> x2 = ms.Tensor(np.random.rand(3, 4), ms.float32)
1395
- >>> out = ops.mm_ext(x1, x2)
1396
- >>> print(out.shape)
1397
- (2, 4)
1231
+ >>> from mindspore import Tensor, ops
1232
+ >>> input_x = Tensor(np.ones(shape=[1, 2, 3, 4]), mindspore.float32)
1233
+ >>> output = ops.auto_generate.flatten_ext(input_x)
1234
+ >>> print(output.shape)
1235
+ (24,)
1398
1236
  """
1399
- return mm_impl(input, mat2)
1237
+ return flatten_impl(input, start_dim, end_dim)
1400
1238
 
1401
1239
 
1402
- def t(input):
1240
+ def l1_loss(input, target, reduction='mean'):
1403
1241
  r"""
1404
- Transpose the input tensor.
1242
+ Calculate the mean absolute error between the `input` value and the `target` value.
1405
1243
 
1406
- .. warning::
1407
- This is an experimental API that is subject to change or deletion.
1244
+ Assuming that the :math:`x` and :math:`y` are the predicted value and target value,
1245
+ both are one-dimensional tensors of length :math:`N`, length :math:`N`, `reduction` is set to ``'none'`` ,
1246
+ then calculate the loss of :math:`x` and :math:`y` without dimensionality reduction.
1247
+
1248
+ The formula is as follows:
1249
+
1250
+ .. math::
1251
+ \ell(x, y) = L = \{l_1,\dots,l_N\}^\top, \quad \text{with } l_n = \left| x_n - y_n \right|,
1252
+
1253
+ where :math:`N` is the batch size.
1254
+
1255
+ If `reduction` is ``'mean'`` or ``'sum'`` , then:
1256
+
1257
+ .. math::
1258
+ \ell(x, y) =
1259
+ \begin{cases}
1260
+ \operatorname{mean}(L), & \text{if reduction} = \text{'mean';}\\
1261
+ \operatorname{sum}(L), & \text{if reduction} = \text{'sum'.}
1262
+ \end{cases}
1408
1263
 
1409
1264
  Args:
1410
- input (Tensor): The input tensor.
1265
+ input (Tensor): Predicted value, Tensor of any dimension.
1266
+ target (Tensor): Target value, usually has the same shape as the `input`.
1267
+ If `input` and `target` have different shapes, make sure they can broadcast to each other.
1268
+ reduction (str, optional): Apply specific reduction method to the output: ``'none'`` , ``'mean'`` ,
1269
+ ``'sum'`` . Default: ``'mean'`` .
1270
+
1271
+ - ``'none'``: no reduction will be applied.
1272
+ - ``'mean'``: compute and return the mean of elements in the output. Notice: At least one of the input and target is float type when the reduction is ``'mean'`` .
1273
+ - ``'sum'``: the output elements will be summed.
1411
1274
 
1412
1275
  Returns:
1413
- Tensor, transpose 2D tensor, return 1D tensor as it is.
1276
+ Tensor or Scalar, if `reduction` is ``'none'`` , return a Tensor with same shape and dtype as `input`.
1277
+ Otherwise, a scalar value will be returned.
1414
1278
 
1415
1279
  Raises:
1416
- ValueError: If the dimension of `input` is greater than 2.
1417
- ValueError: If `input` is empty.
1418
- TypeError: If `input` is not a tensor.
1280
+ TypeError: If `input` is not a Tensor.
1281
+ TypeError: If `target` is not a Tensor.
1282
+ ValueError: If `reduction` is not one of ``'none'`` , ``'mean'`` or ``'sum'`` .
1419
1283
 
1420
1284
  Supported Platforms:
1421
1285
  ``Ascend``
1422
1286
 
1423
1287
  Examples:
1424
- >>> import mindspore
1425
- >>> import numpy as np
1426
1288
  >>> from mindspore import Tensor, ops
1427
- >>> input = Tensor(np.array([[1, 2, 3], [4, 5, 6]]), mindspore.float32)
1428
- >>> output = ops.t_ext(input)
1289
+ >>> from mindspore import dtype as mstype
1290
+ >>> x = Tensor([[1, 2, 3], [4, 5, 6]], mstype.float32)
1291
+ >>> target = Tensor([[6, 5, 4], [3, 2, 1]], mstype.float32)
1292
+ >>> output = ops.l1_loss_ext(x, target, reduction="mean")
1429
1293
  >>> print(output)
1430
- [[ 1. 4.]
1431
- [ 2. 5.]
1432
- [ 3. 6.]]
1294
+ 3.0
1433
1295
  """
1434
- return t_impl(input)
1296
+ return l1_loss_impl(input, target, converted_reduction)
1435
1297
 
1436
1298
 
1437
- def bmm(input, mat2):
1299
+ def sub_tensor_(input, other, alpha=1):
1438
1300
  r"""
1439
- Performs batch matrix-matrix multiplication of two three-dimensional tensors.
1301
+ None
1302
+ """
1303
+ return sub_tensor_impl(input, other, alpha)
1304
+
1305
+
1306
+ def sum(input, dim=None, keepdim=False, dtype=None):
1307
+ r"""
1308
+ Calculate sum of Tensor elements over a given dim.
1440
1309
 
1441
- .. math::
1442
- \text{output}= \text{input} @ \text{mat2}
1310
+ Note:
1311
+ The `dim` with tensor type is only used for compatibility with older versions and is not recommended.
1443
1312
 
1444
1313
  Args:
1445
- input (Tensor): The first batch of matrices to be multiplied. Must be a three-dimensional tensor of shape `(b, n, m)`.
1446
- mat2 (Tensor): The second batch of matrices to be multiplied. Must be a three-dimensional tensor of shape `(b, m, p)`.
1314
+ input (Tensor): The input tensor.
1315
+ dim (Union[None, int, tuple(int), list(int), Tensor]): Dimensions along which a sum is performed.
1316
+ If ``None`` , sum all the elements of the input tensor.
1317
+ If the `dim` is a tuple or list of ints, a sum is performed on all the dimensions specified in the tuple.
1318
+ Must be in the range :math:`[-input.ndim, input.ndim)` . Default: ``None`` .
1319
+ keepdim (bool): Whether the output tensor has `dim` retained or not.
1320
+ If ``True`` , keep these reduced dimensions and the length is 1.
1321
+ If ``False`` , don't keep these dimensions. Default: ``False`` .
1322
+ dtype (:class:`mindspore.dtype`): The desired data type of returned Tensor. Default: ``None`` .
1447
1323
 
1448
1324
  Returns:
1449
- Tensor, the output tensor of shape `(b, n, p)`, where each matrix is the product of the corresponding matrices in the input batches.
1325
+ A Tensor, sum of elements over a given `dim` in `input`.
1450
1326
 
1451
1327
  Raises:
1452
- ValueError: If `input` or `mat2` is not three-dimensional tensors.
1453
- ValueError: If the length of the third dimension of `input` is not equal to the length of the second dimension of `mat2`.
1454
- ValueError: If the batch size of the inputs is not equal to the batch size of the mat2.
1328
+ TypeError: If `input` is not a Tensor.
1329
+ TypeError: If `dim` is not an int, tulpe(int), list(int), Tensor or None.
1330
+ ValueError: If `dim` is not in the range :math:`[-input.ndim, input.ndim)` .
1331
+ TypeError: If `keepdim` is not a bool.
1455
1332
 
1456
1333
  Supported Platforms:
1457
1334
  ``Ascend`` ``GPU`` ``CPU``
@@ -1459,59 +1336,65 @@ def bmm(input, mat2):
1459
1336
  Examples:
1460
1337
  >>> import mindspore
1461
1338
  >>> import numpy as np
1462
- >>> from mindspore import Tensor
1463
- >>> from mindspore import ops
1464
- >>> a = Tensor(np.ones(shape=[2, 3, 4]), mindspore.float32)
1465
- >>> b = Tensor(np.ones(shape=[2, 4, 5]), mindspore.float32)
1466
- >>> output = ops.auto_generate.bmm_ext(a, b)
1467
- >>> print(output)
1468
- [[[4. 4. 4. 4. 4.]
1469
- [4. 4. 4. 4. 4.]
1470
- [4. 4. 4. 4. 4.]]
1471
- [[4. 4. 4. 4. 4.]
1472
- [4. 4. 4. 4. 4.]
1473
- [4. 4. 4. 4. 4.]]]
1339
+ >>> from mindspore import Tensor, ops
1340
+ >>> from mindspore import dtype as mstype
1341
+ >>> x = Tensor(np.array([[[1, 1, 1, 1, 1, 1], [2, 2, 2, 2, 2, 2], [3, 3, 3, 3, 3, 3]],
1342
+ ... [[4, 4, 4, 4, 4, 4], [5, 5, 5, 5, 5, 5], [6, 6, 6, 6, 6, 6]],
1343
+ ... [[7, 7, 7, 7, 7, 7], [8, 8, 8, 8, 8, 8], [9, 9, 9, 9, 9, 9]]]), mstype.float32)
1344
+ >>> out = ops.sum_ext(x)
1345
+ >>> print(out)
1346
+ 270.0
1347
+ >>> out = ops.sum_ext(x, dim=2)
1348
+ >>> print(out)
1349
+ [[ 6. 12. 18.]
1350
+ [24. 30. 36.]
1351
+ [42. 48. 54.]]
1352
+ >>> out = ops.sum_ext(x, dim=2, keepdim=True)
1353
+ >>> print(out)
1354
+ [[[ 6.]
1355
+ [12.]
1356
+ [18.]]
1357
+ [[24.]
1358
+ [30.]
1359
+ [36.]]
1360
+ [[42.]
1361
+ [48.]
1362
+ [54.]]]
1474
1363
  """
1475
- return bmm_impl(input, mat2)
1364
+ return sum_impl(input, dim, keepdim, dtype)
1476
1365
 
1477
1366
 
1478
- def stack(tensors, dim=0):
1367
+ def asin(input):
1479
1368
  r"""
1480
- Stacks a list of tensors in specified dim.
1369
+ Computes arcsine of input tensors element-wise.
1481
1370
 
1482
- Stacks the list of input tensors with the same rank `R`, output is a tensor of rank `(R+1)`.
1371
+ .. math::
1483
1372
 
1484
- Given input tensors of shape :math:`(x_1, x_2, ..., x_R)`. Set the number of input tensors as `N`.
1485
- If :math:`dim \ge 0`, the shape of the output tensor is
1486
- :math:`(x_1, x_2, ..., x_{dim}, N, x_{dim+1}, ..., x_R)`.
1373
+ out_i = \sin^{-1}(input_i)
1487
1374
 
1488
1375
  Args:
1489
- tensors (Union[tuple, list]): A Tuple or list of Tensor objects with the same shape and type.
1490
- dim (int, optional): Dimension to stack. The range is [-(R+1), R+1). Default: ``0`` .
1376
+ input (Tensor): The shape of tensor is
1377
+ :math:`(N,*)`, where :math:`*` means any number of additional dimensions.
1491
1378
 
1492
1379
  Returns:
1493
- Tensor. A stacked Tensor with the same type as `tensors`.
1380
+ Tensor, has the same shape as `input`. The dtype of output is float32 when dtype of `input` is in [bool, int8, uint8, int16, int32, int64]. Otherwise output has the same dtype as `input`.
1494
1381
 
1495
1382
  Raises:
1496
- TypeError: If the data types of elements in `tensors` are not the same.
1497
- ValueError: If `dim` is out of the range [-(R+1), R+1);
1498
- or if the shapes of elements in `tensors` are not the same.
1383
+ TypeError: If `input` is not a Tensor.
1499
1384
 
1500
1385
  Supported Platforms:
1501
- ``Ascend``
1386
+ ``Ascend`` ``GPU`` ``CPU``
1502
1387
 
1503
1388
  Examples:
1504
1389
  >>> import mindspore
1505
- >>> from mindspore import Tensor, ops
1506
1390
  >>> import numpy as np
1507
- >>> data1 = Tensor(np.array([0, 1]).astype(np.float32))
1508
- >>> data2 = Tensor(np.array([2, 3]).astype(np.float32))
1509
- >>> output = ops.auto_generate.stack_ext([data1, data2], 0)
1391
+ >>> from mindspore import Tensor, ops
1392
+ >>> input = Tensor(np.array([0.74, 0.04, 0.30, 0.56]), mindspore.float32)
1393
+ >>> output = ops.asin_ext(input)
1510
1394
  >>> print(output)
1511
- [[0. 1.]
1512
- [2. 3.]]
1395
+ [0.8330927 0.04001068 0.30469266 0.59438497 ]
1513
1396
  """
1514
- return stack_impl(tensors, dim)
1397
+ return asin_impl(input)
1515
1398
 
1516
1399
 
1517
1400
  def mish(input):
@@ -1560,59 +1443,53 @@ def mish(input):
1560
1443
  return mish_impl(input)
1561
1444
 
1562
1445
 
1563
- def isneginf(input):
1446
+ def acos(input):
1564
1447
  r"""
1565
- Determines which elements are -inf for each position.
1448
+ Computes arccosine of input tensors element-wise.
1566
1449
 
1567
- .. warning::
1568
- - This API can be used only on the Atlas A2 training series.
1450
+ .. math::
1451
+
1452
+ out_i = \cos^{-1}(input_i)
1569
1453
 
1570
1454
  Args:
1571
- input (Tensor): Input Tensor.
1455
+ input (Tensor): The shape of tensor is
1456
+ :math:`(N,*)`, where :math:`*` means any number of additional dimensions.
1572
1457
 
1573
1458
  Returns:
1574
- Tensor with the same shape as the input, where elements are `True` if the corresponding element in the `input` is negative infinity, and `False` otherwise.
1459
+ Tensor, has the same shape as `input`. The dtype of output is float32 when dtype of `input` is in [bool, int8, uint8, int16, int32, int64]. Otherwise output has the same dtype as `input`.
1575
1460
 
1576
1461
  Raises:
1577
- TypeError: If the input is not a tensor.
1462
+ TypeError: If `input` is not a Tensor.
1578
1463
 
1579
1464
  Supported Platforms:
1580
1465
  ``Ascend`` ``GPU`` ``CPU``
1581
1466
 
1582
1467
  Examples:
1583
- >>> from mindspore import ops, Tensor
1584
- >>> from mindspore import dtype as mstype
1585
- >>> output = ops.isneginf(Tensor([[-float("inf"), float("inf")], [1, -float("inf")]], mstype.float32))
1468
+ >>> import mindspore
1469
+ >>> import numpy as np
1470
+ >>> from mindspore import Tensor, ops
1471
+ >>> input = Tensor(np.array([0.74, 0.04, 0.30, 0.56]), mindspore.float32)
1472
+ >>> output = ops.acos_ext(input)
1586
1473
  >>> print(output)
1587
- [[ True False]
1588
- [False True]]
1474
+ [0.7377037 1.5307857 1.2661037 0.9764114]
1589
1475
  """
1590
- return isneginf_impl(input)
1476
+ return acos_impl(input)
1591
1477
 
1592
1478
 
1593
- def argsort(input, dim=-1, descending=False, stable=False):
1479
+ def trace(input):
1594
1480
  r"""
1595
- Sorts the input tensor along the given dimension in specified order and return the sorted indices.
1596
-
1597
- .. warning::
1598
- This is an experimental optimizer API that is subject to change.
1481
+ Returns a new tensor that is the sum of the `input` main trace.
1599
1482
 
1600
1483
  Args:
1601
- input(Tensor): The input tensor to sort.
1602
- dim (int, optional): The dim to sort along. Default: ``-1`` , means the last dimension.
1603
- The Ascend backend only supports sorting the last dimension.
1604
- descending (bool, optional): The sort order. If `descending` is ``True`` then the elements
1605
- are sorted in descending order by value. Otherwise sort in ascending order. Default: ``False`` .
1606
- stable (bool, optional): Whether to use stable sorting algorithm. Default: ``False``.
1484
+ input (Tensor): 2-D Tensor.
1607
1485
 
1608
1486
  Returns:
1609
- Tensor, the indices of sorted input tensor. Data type is int64.
1487
+ Tensor, when the data type of `input` is integer or bool, its data type is int64, otherwise it is the same as `input`, and size equals to 1.
1610
1488
 
1611
1489
  Raises:
1612
- ValueError: If `dim` is out of range.
1613
- TypeError: If dtype of `dim` is not int32.
1614
- TypeError: If dtype of `descending` is not bool.
1615
- TypeError: If dtype of `stable` is not bool.
1490
+ TypeError: If `input` is not a Tensor.
1491
+ ValueError: If the dimension of `input` is not equal to 2.
1492
+ TypeError: If the dtype of `input` is not one of float16, float32, float64, bool, uint8, int8, int16, int32, int64, complex64, complex128, bfloat16.
1616
1493
 
1617
1494
  Supported Platforms:
1618
1495
  ``Ascend``
@@ -1621,343 +1498,321 @@ def argsort(input, dim=-1, descending=False, stable=False):
1621
1498
  >>> import mindspore
1622
1499
  >>> import numpy as np
1623
1500
  >>> from mindspore import Tensor, ops
1624
- >>> x = Tensor(np.array([[8, 2, 1], [5, 9, 3], [4, 6, 7]]), mindspore.float16)
1625
- >>> sort = ops.auto_generate.argsort_ext(x)
1626
- >>> print(sort)
1627
- [[2 1 0]
1628
- [2 0 1]
1629
- [0 1 2]]
1501
+ >>> input = Tensor(np.array([[10, 11, 12], [13, 14, 15], [16, 17, 18]]), mindspore.float32)
1502
+ >>> output = ops.trace_ext(input)
1503
+ >>> print(output)
1504
+ 42.0
1505
+ >>> input = Tensor(np.arange(1, 13).reshape(3, 4), mindspore.float32)
1506
+ >>> output = ops.trace_ext(input)
1507
+ >>> print(output)
1508
+ 18.0
1509
+ >>> input = Tensor(np.arange(12, 0, -1).reshape(4, 3), mindspore.float32)
1510
+ >>> output = ops.trace_ext(input)
1511
+ >>> print(output)
1512
+ 24.0
1630
1513
  """
1631
- return argsort_impl(input, dim, descending, stable)
1514
+ return trace_impl(input)
1632
1515
 
1633
1516
 
1634
- def argmin(input, dim=None, keepdim=False):
1517
+ def inplace_add(input, other, alpha=1):
1635
1518
  r"""
1636
- Return the indices of the minimum values of a tensor across a dimension.
1519
+ None
1520
+ """
1521
+ return inplace_add_impl(input, other, alpha)
1522
+
1523
+
1524
+ def frac(input):
1525
+ r"""
1526
+ Calculates the fractional part of each element in the input.
1527
+
1528
+ .. math::
1529
+ out_i = input_i - \lfloor |input_i| \rfloor * sgn(input_i)
1530
+
1531
+ .. warning::
1532
+ This is an experimental API that is subject to change or deletion.
1637
1533
 
1638
1534
  Args:
1639
- input (Tensor): Input tensor.
1640
- dim (Union[int, None], optional): Specify the axis for calculation. If `dim` is ``None`` , the indices of the minimum
1641
- value within the flattened input will be returned. Default: ``None`` .
1642
- keepdim (bool, optional): Whether the output tensor retains the specified
1643
- dimension. Ignored if `dim` is None. Default: ``False`` .
1535
+ input (Tensor): The input Tensor.
1644
1536
 
1645
1537
  Returns:
1646
- Tensor, indices of the minimum values of the input tensor across a dimension.
1538
+ Tensor, has the same shape and type as input.
1647
1539
 
1648
1540
  Raises:
1649
- TypeError: If `keepdim` is not bool.
1650
- ValueError: If `dim` is out of range.
1541
+ TypeError: If `input` is not a Tensor.
1651
1542
 
1652
1543
  Supported Platforms:
1653
1544
  ``Ascend``
1654
1545
 
1655
1546
  Examples:
1547
+ >>> import mindspore
1656
1548
  >>> import numpy as np
1657
- >>> from mindspore import Tensor
1658
- >>> from mindspore import ops
1659
- >>> x = Tensor(np.array([[1, 20, 5], [67, 8, 9], [130, 24, 15]]).astype(np.float32))
1660
- >>> output = ops.auto_generate.argmin_ext(x, dim=-1)
1549
+ >>> from mindspore import Tensor, ops
1550
+ >>> x = Tensor([2, 4.2, -2.5], mindspore.float16)
1551
+ >>> output = ops.frac_ext(x)
1661
1552
  >>> print(output)
1662
- [0 1 2]
1553
+ [ 0. 0.1992 -0.5 ]
1663
1554
  """
1664
- return argmin_impl(input, dim, keepdim)
1555
+ return frac_impl(input)
1665
1556
 
1666
1557
 
1667
- def sub(input, other, alpha=1):
1558
+ def bmm(input, mat2):
1668
1559
  r"""
1669
- Subtracts scaled other value from input Tensor.
1560
+ Performs batch matrix-matrix multiplication of two three-dimensional tensors.
1670
1561
 
1671
1562
  .. math::
1672
-
1673
- out_{i} = input_{i} - alpha \times other_{i}
1674
-
1675
- Note:
1676
- - When the two inputs have different shapes,
1677
- they must be able to broadcast to a common shape.
1678
- - The two inputs and alpha comply with the implicit type conversion rules to make the data types
1679
- consistent.
1563
+ \text{output}= \text{input} @ \text{mat2}
1680
1564
 
1681
1565
  Args:
1682
- input (Union[Tensor, number.Number, bool]): The first input is a number.Number or
1683
- a bool or a tensor whose data type is
1684
- `number <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_ or
1685
- `bool_ <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_.
1686
- other (Union[Tensor, number.Number, bool]): The second input, is a number.Number or
1687
- a bool or a tensor whose data type is
1688
- `number <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_ or
1689
- `bool_ <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_.
1690
- alpha (number.Number): A scaling factor applied to `other`, default 1.
1566
+ input (Tensor): The first batch of matrices to be multiplied. Must be a three-dimensional tensor of shape `(b, n, m)`.
1567
+ mat2 (Tensor): The second batch of matrices to be multiplied. Must be a three-dimensional tensor of shape `(b, m, p)`.
1691
1568
 
1692
1569
  Returns:
1693
- Tensor with a shape that is the same as the broadcasted shape of the input `input` and `other`,
1694
- and the data type is the one with higher precision or higher digits among the two inputs and alpha.
1570
+ Tensor, the output tensor of shape `(b, n, p)`, where each matrix is the product of the corresponding matrices in the input batches.
1695
1571
 
1696
1572
  Raises:
1697
- TypeError: If the type of `input`, `other`, or `alpha` is not one of the following: Tensor, number.Number, bool.
1698
- TypeError: If `alpha` is of type float but `input` and `other` are not of type float.
1699
- TypeError: If `alpha` is of type bool but `input` and `other` are not of type bool.
1573
+ ValueError: If `input` or `mat2` is not three-dimensional tensors.
1574
+ ValueError: If the length of the third dimension of `input` is not equal to the length of the second dimension of `mat2`.
1575
+ ValueError: If the batch size of the inputs is not equal to the batch size of the mat2.
1700
1576
 
1701
1577
  Supported Platforms:
1702
1578
  ``Ascend`` ``GPU`` ``CPU``
1703
1579
 
1704
1580
  Examples:
1705
- >>> import numpy as np
1706
1581
  >>> import mindspore
1582
+ >>> import numpy as np
1707
1583
  >>> from mindspore import Tensor
1708
1584
  >>> from mindspore import ops
1709
- >>> x = Tensor(np.array([4, 5, 6]).astype(np.float32))
1710
- >>> y = Tensor(1, mindspore.int32)
1711
- >>> alpha = 0.5
1712
- >>> output = ops.auto_generate.sub_ext(x, y, alpha)
1585
+ >>> a = Tensor(np.ones(shape=[2, 3, 4]), mindspore.float32)
1586
+ >>> b = Tensor(np.ones(shape=[2, 4, 5]), mindspore.float32)
1587
+ >>> output = ops.auto_generate.bmm_ext(a, b)
1713
1588
  >>> print(output)
1714
- [3.5 4.5 5.5]
1715
- >>> # the data type of x is float32, the data type of y is int32,
1716
- >>> # alpha is a float, and the output is the data format of higher precision float32.
1717
- >>> print(output.dtype)
1718
- Float32
1589
+ [[[4. 4. 4. 4. 4.]
1590
+ [4. 4. 4. 4. 4.]
1591
+ [4. 4. 4. 4. 4.]]
1592
+ [[4. 4. 4. 4. 4.]
1593
+ [4. 4. 4. 4. 4.]
1594
+ [4. 4. 4. 4. 4.]]]
1719
1595
  """
1720
- return sub_impl(input, other, alpha)
1596
+ return bmm_impl(input, mat2)
1721
1597
 
1722
1598
 
1723
- def index_add(input, dim, index, source, alpha=1):
1599
+ def matrix_inverse(input):
1724
1600
  r"""
1725
- Accumulate the elements of `alpha` times `source` into the `input` by adding to the index in the order given in `index`. For example, if ``dim == 0`` , ``index[i] == j`` , and ``alpha = -1`` , then the `i` th row of `source` is subtracted from the `j` th row of `input` . The `dim` th dimension of `source` must have the same size as the length of `index` , and all other dimensions must match `input`, or an error will be raised. For a 3-D tensor, the output is defined as follows:
1601
+ Compute the inverse of the input matrix.
1726
1602
 
1727
- .. math::
1728
- \begin{array}{ll}
1729
- input[index[i],\ :,\ :]\ +=\ alpha * source[i,\ :,\ :] \qquad \#if\ dim == 0 \\
1730
- input[:,\ \ index[i],\ :]\ +=\ alpha * source[:,\ \ i,\ :] \qquad \#if\ dim == 1 \\
1731
- input[:,\ :,\ \ index[i]]\ +=\ alpha * source[:,\ :,\ \ i] \qquad\#if\ dim == 2 \\
1732
- \end{array}
1733
-
1734
- .. warning::
1735
- This is an experimental API that is subject to change or deletion.
1736
-
1737
1603
  Args:
1738
- input (Tensor): The input Tensor.
1739
- dim (int): The dimension along which to index.
1740
- index (Tensor): Add the value of "input Tensor" and `source` along the dimension of the `dim` according to the specified index value, with data type int32. The `index` must be 1D with the same size as the size of `source` in the `dim` dimension. The values of `index` should be in [0, b), where the b is the size of "input Tensor" in the `dim` dimension.
1741
- source (Tensor): The input tensor with the value to add. Must have same data type as "input Tensor". The shape must be the same as "input Tensor" except the `dim` th dimension.
1742
- alpha (number, optional): The scalar multiplier for source. Default: ``1``.
1743
-
1604
+ input (Tensor): A matrix to be calculated. Input `input` must be at least two dimensions, and the size of
1605
+ the last two dimensions must be the same size.
1606
+
1744
1607
  Returns:
1745
- Tensor, has the same shape and dtype as `input`.
1608
+ Tensor, has the same type and shape as input`.
1746
1609
 
1747
1610
  Raises:
1748
- TypeError: If neither `index` nor `source` is a Tensor.
1749
- ValueError: If the value of `dim` is out of the dimension range of `source` shape.
1750
- ValueError: If `index` rank is not the same as `source` rank.
1751
- ValueError: If shape of `index` is not 1D or size of `index` is not equal to dimension of source[dim].
1752
- ValueError: If the shape of `source` is not the same as that of `input` except the `dim` axis.
1611
+ TypeError: If `input` is not a Tensor.
1612
+ ValueError: If the size of the last two dimensions of `input` is not the same.
1613
+ ValueError: If the dimension of `input` is 1.
1753
1614
 
1754
1615
  Supported Platforms:
1755
1616
  ``Ascend``
1756
1617
 
1757
1618
  Examples:
1758
- >>> import numpy as np
1759
- >>> import mindspore
1760
1619
  >>> from mindspore import Tensor, ops
1761
- >>> x = Tensor(np.array([[1, 2, 3], [4, 5, 6], [7, 8, 9]]), mindspore.float32)
1762
- >>> index = Tensor(np.array([0, 2]), mindspore.int32)
1763
- >>> y = Tensor(np.array([[0.5, 1.0], [1.0, 1.5], [2.0, 2.5]]), mindspore.float32)
1764
- >>> output = ops.auto_generate.index_add_ext(x, 1, index, y, alpha=1)
1765
- >>> print(output)
1766
- [[ 1.5 2. 4. ]
1767
- [ 5. 5. 7.5]
1768
- [ 9. 8. 11.5]]
1620
+ >>> from mindspore import dtype as mstype
1621
+ >>> x = Tensor([[1., 2.], [3., 4.]], mstype.float32)
1622
+ >>> print(ops.matrix_inverse_ext(x))
1623
+ [[-2. 1. ]
1624
+ [ 1.5 -0.5]]
1769
1625
  """
1770
- return index_add_impl(input, dim, index, source, alpha)
1626
+ return matrix_inverse_impl(input)
1771
1627
 
1772
1628
 
1773
- def max_unpool2d(input, indices, kernel_size, stride=None, padding=0, output_size=None):
1629
+ def adaptive_avg_pool2d_grad(grad_output, x):
1774
1630
  r"""
1775
- Computes the inverse of `max_pool2d`.
1631
+ None
1632
+ """
1633
+ return adaptive_avg_pool2d_grad_impl(grad_output, x)
1634
+
1635
+
1636
+ def histc(input, bins=100, min=0, max=0):
1637
+ r"""
1638
+ Computes the histogram of a tensor.
1776
1639
 
1777
- `max_unpool2d` keeps the maximal value and set all position of non-maximal values to zero. Typically the input is of shape :math:`(N, C, H_{in}, W_{in})` or :math:`(C, H_{in}, W_{in})`, and the output is of shape :math:`(N, C, H_{out}, W_{out})` or :math:`(C, H_{out}, W_{out})`. The operation is as follows.
1640
+ The elements are sorted into equal width bins between `min` and `max`.
1641
+ If `min` and `max` are both zero, the minimum and maximum values of the data are used.
1778
1642
 
1779
- .. math::
1780
- \begin{array}{ll} \\
1781
- H_{out} = (H_{in} - 1) \times stride[0] - 2 \times padding[0] + kernel\_size[0] \\
1782
- W_{out} = (W_{in} - 1) \times stride[1] - 2 \times padding[1] + kernel\_size[1] \\
1783
- \end{array}
1643
+ Elements lower than min or higher than max are ignored.
1784
1644
 
1785
1645
  .. warning::
1786
1646
  This is an experimental API that is subject to change or deletion.
1647
+ If input is int64, valid values fit within int32; exceeding this may cause precision errors.
1787
1648
 
1788
1649
  Args:
1789
- input (Tensor): The input Tensor to invert. Tensor of shape :math:`(N, C, H_{in}, W_{in})` or :math:`(C, H_{in}, W_{in})`.
1790
- indices (Tensor): Max values' index represented by the indices. Tensor of shape must be same with input 'input'. Values of indices must belong to :math:`[0, H_{in} \times W_{in} - 1]`. Data type must be in int32 or int64.
1791
- kernel_size (Union[int, tuple[int]]): The size of kernel used to take the maximum value, an int number that represents height and width of the kernel, or a tuple of two int numbers that represent height and width respectively.
1792
- stride (Union[int, tuple[int]], optional): The distance of kernel moving, an int number that represents the height and width of movement are both stride, or a tuple of two int numbers that represent height and width of movement respectively. Default: ``None`` , which indicates the moving step is `kernel_size` .
1793
- padding (Union[int, tuple[int]], optional): The pad value to be filled. Default: ``0`` . If `padding` is an integer, the paddings of height and width are the same, equal to padding. If `padding` is a tuple of two integers, the padding of height and width equal to padding[0] and padding[1] correspondingly.
1794
- output_size (tuple[int], optional): The target output size. Default: ``None`` . If output_size == (), then the shape of output computed by `kernel_size`, `stride` and `padding`. If output_size != (), then output_size must be :math:`(N, C, H, W)` , :math:`(C, H, W)` or :math:`(H, W)` and output_size must belong to :math:`[(N, C, H_{out} - stride[0], W_{out} - stride[1]), (N, C, H_{out} + stride[0], W_{out} + stride[1])]`.
1650
+ input (Tensor): the input tensor.
1651
+ bins (int, optional): Number of histogram bins, optional. If specified, must be positive. Default: ``100`` .
1652
+ min (int, float, optional): the lower end of the range (inclusive), optional. Default: ``0`` .
1653
+ max (int, float, optional): the upper end of the range (inclusive), optional. Default: ``0`` .
1795
1654
 
1796
1655
  Returns:
1797
- Tensor, with shape :math:`(N, C, H_{out}, W_{out})` or :math:`(C, H_{out}, W_{out})`, with the same data type with `input`.
1656
+ A 1-D Tensor, has the same type as `input` with the shape :math:`(bins, )`.
1798
1657
 
1799
1658
  Raises:
1800
- TypeError: If data type of `input` or `indices` is not supported.
1801
- TypeError: If `kernel_size`, `stride` or `padding` is neither an int nor a tuple.
1802
- ValueError: If numbers in `stride`, `padding` or `kernel_size` are not positive.
1803
- ValueError: If the shapes of `input` and `indices` are different.
1804
- ValueError: If the length of `input` is not 3 or 4.
1805
- ValueError: If the type of `output_size` is not tuple.
1806
- ValueError: If `output_size` is not close to output size computed by attr `kernel_size`, `stride`, `padding`.
1659
+ TypeError: If `input` is not a Tensor.
1660
+ TypeError: If `input` datatype is not in support list.
1661
+ TypeError: If attr `min` or `max` is not float or int.
1662
+ TypeError: If attr `bins` is not int.
1663
+ ValueError: If attr value `min` > `max`.
1664
+ ValueError: If attr `bins` <= 0.
1807
1665
 
1808
1666
  Supported Platforms:
1809
1667
  ``Ascend``
1810
1668
 
1811
1669
  Examples:
1812
- >>> import numpy as np
1813
1670
  >>> from mindspore import Tensor, ops
1814
- >>> input = Tensor(np.array([[[[0, 1], [8, 9]]]]).astype(np.float32))
1815
- >>> indices = Tensor(np.array([[[[0, 1], [2, 3]]]]).astype(np.int64))
1816
- >>> output = ops.max_unpool2d_ext(input, indices, 1, stride=1, padding=0)
1817
- >>> print(output.asnumpy())
1818
- [[[[0. 1.]
1819
- [8. 9.]]]]
1671
+ >>> x = Tensor([1., 2, 1])
1672
+ >>> y = ops.histc_ext(x, bins=4, min=0, max=3)
1673
+ >>> print(y)
1674
+ [0 2 1 0]
1820
1675
  """
1821
- return max_unpool2d_impl(input, indices, kernel_size, stride, padding, output_size)
1676
+ return histc_impl(input, bins, min, max)
1822
1677
 
1823
1678
 
1824
- def add(input, other, alpha=1):
1679
+ def ffn(x, weight1, weight2, expertTokens=None, bias1=None, bias2=None, scale=None, offset=None, deqScale1=None, deqScale2=None, antiquant_scale1=None, antiquant_scale2=None, antiquant_offset1=None, antiquant_offset2=None, activation='fastgelu', inner_precise=0):
1825
1680
  r"""
1826
- Adds scaled other value to input Tensor.
1681
+ None
1682
+ """
1683
+ return ffn_impl(x, weight1, weight2, expertTokens, bias1, bias2, scale, offset, deqScale1, deqScale2, antiquant_scale1, antiquant_scale2, antiquant_offset1, antiquant_offset2, converted_activation, inner_precise)
1684
+
1685
+
1686
+ def log10(input):
1687
+ r"""
1688
+ Returns the logarithm to the base 10 of a tensor element-wise.
1827
1689
 
1828
1690
  .. math::
1691
+ y_i = \log_{10}(x_i)
1829
1692
 
1830
- out_{i} = input_{i} + alpha \times other_{i}
1831
-
1832
- Note:
1833
- - When the two inputs have different shapes,
1834
- they must be able to broadcast to a common shape.
1835
- - The two inputs and alpha comply with the implicit type conversion rules to make the data types
1836
- consistent.
1693
+ .. warning::
1694
+ - This is an experimental API that is subject to change or deletion.
1695
+ - If the input value of operator Log10 is within the range (0, 0.01] or [0.95, 1.05], the output accuracy
1696
+ may be affacted.
1837
1697
 
1838
1698
  Args:
1839
- input (Union[Tensor, number.Number, bool]): The first input is a number.Number or
1840
- a bool or a tensor whose data type is
1841
- `number <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_ or
1842
- `bool_ <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_.
1843
- other (Union[Tensor, number.Number, bool]): The second input, is a number.Number or
1844
- a bool or a tensor whose data type is
1845
- `number <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_ or
1846
- `bool_ <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_.
1847
- alpha (number.Number): A scaling factor applied to `other`, default 1.
1699
+ input (Tensor): Input Tensor of any dimension. The value must be greater than 0.
1848
1700
 
1849
1701
  Returns:
1850
- Tensor with a shape that is the same as the broadcasted shape of the input `input` and `other`,
1851
- and the data type is the one with higher precision or higher digits among the two inputs and alpha.
1702
+ Tensor, has the same shape as the `input`, and the dtype changes according to the `input.dtype`.
1703
+
1704
+ - if `input.dtype` is in [float16, float32, float64, bfloat16], the output dtype is the same as the `input.dtype`.
1705
+ - if `input.dtype` is integer or boolean type, the output dtype is float32.
1852
1706
 
1853
1707
  Raises:
1854
- TypeError: If the type of `input`, `other`, or `alpha` is not one of the following: Tensor, number.Number, bool.
1855
- TypeError: If `alpha` is of type float but `input` and `other` are not of type float.
1856
- TypeError: If `alpha` is of type bool but `input` and `other` are not of type bool.
1708
+ TypeError: If `input` is not a Tensor.
1857
1709
 
1858
1710
  Supported Platforms:
1859
- ``Ascend`` ``GPU`` ``CPU``
1711
+ ``Ascend``
1860
1712
 
1861
1713
  Examples:
1862
- >>> import numpy as np
1863
1714
  >>> import mindspore
1864
- >>> from mindspore import Tensor
1865
- >>> from mindspore import ops
1866
- >>> x = Tensor(1, mindspore.int32)
1867
- >>> y = Tensor(np.array([4, 5, 6]).astype(np.float32))
1868
- >>> alpha = 0.5
1869
- >>> output = ops.auto_generate.add_ext(x, y, alpha)
1715
+ >>> import numpy as np
1716
+ >>> from mindspore import Tensor, ops
1717
+ >>> x = Tensor(np.array([3.0, 5.0, 7.0]), mindspore.float32)
1718
+ >>> output = ops.auto_generate.log10_ext(x)
1870
1719
  >>> print(output)
1871
- [3. 3.5 4.]
1872
- >>> # the data type of x is int32, the data type of y is float32,
1873
- >>> # alpha is a float, and the output is the data format of higher precision float32.
1874
- >>> print(output.dtype)
1875
- Float32
1720
+ [0.47712136 0.69897 0.845098 ]
1876
1721
  """
1877
- return add_impl(input, other, alpha)
1722
+ return log10_impl(input)
1878
1723
 
1879
1724
 
1880
- def mse_loss(input, target, reduction='mean'):
1725
+ def prod(input, dim=None, keepdim=False, dtype=None):
1881
1726
  r"""
1882
- Calculates the mean squared error between the predicted value and the label value.
1883
-
1884
- For detailed information, please refer to :class:`mindspore.nn.MSELoss`.
1727
+ Reduces a dimension of a tensor by multiplying all elements in the dimension, by default. And also can
1728
+ reduce a dimension of `input` along the `dim`. Determine whether the dimensions of the output and input are the
1729
+ same by controlling `keepdim`.
1885
1730
 
1886
1731
  Args:
1887
- input (Tensor): Tensor of any dimension. The data type needs to be consistent with the `target`.
1888
- It should also be broadcastable with the `target`.
1889
- target (Tensor): The input label. Tensor of any dimension. The data type needs to be consistent with the `input`.
1890
- It should also be broadcastable with the `input`.
1891
- reduction (str, optional): Apply specific reduction method to the output: ``'mean'`` , ``'none'`` ,
1892
- ``'sum'`` . Default: ``'mean'`` .
1893
-
1894
- - ``'none'``: no reduction will be applied.
1895
- - ``'mean'``: compute and return the mean of elements in the output.
1896
- - ``'sum'``: the output elements will be summed.
1732
+ input (Tensor[Number]): The input tensor. The dtype of the tensor to be reduced is number.
1733
+ :math:`(N, *)` where :math:`*` means, any number of additional dimensions.
1734
+ dim (int): The dimensions to reduce. Default: ``None`` , reduce all dimensions.
1735
+ Only constant value is allowed. Assume the rank of `input` is r, and the value range is [-r,r).
1736
+ keepdim (bool): If ``True`` , keep these reduced dimensions and the length is 1.
1737
+ If ``False`` , don't keep these dimensions. Default: ``False`` .
1738
+ dtype (:class:`mindspore.dtype`): The desired data type of returned Tensor. Default: ``None`` .
1897
1739
 
1898
1740
  Returns:
1899
- - Tensor. If `reduction` is ``'mean'`` or ``'sum'``, the shape of output is `Tensor Scalar`.
1900
- - If reduction is ``'none'``, the shape of output is the broadcasted shape of **input** and **target** .
1741
+ Tensor, has the same data type as input tensor.
1742
+
1743
+ - If `dim` is ``None`` , and `keepdim` is ``False`` ,
1744
+ the output is a 0-D tensor representing the product of all elements in the input tensor.
1745
+ - If `dim` is int, set as 1, and `keepdim` is ``False`` ,
1746
+ the shape of output is :math:`(input_0, input_2, ..., input_R)`.
1901
1747
 
1902
1748
  Raises:
1903
- ValueError: If `reduction` is not one of ``'mean'`` , ``'sum'`` or ``'none'``.
1904
- ValueError: If `input` and `target` are not broadcastable.
1905
- TypeError: If `input` and `target` are in different data type.
1749
+ TypeError: If `input` is not a Tensor.
1750
+ TypeError: If `dim` is not one of the following: int or None.
1751
+ TypeError: If `keepdim` is not a bool.
1752
+ ValueError: If `dim` is out of range.
1906
1753
 
1907
1754
  Supported Platforms:
1908
- ``Ascend``
1755
+ ``Ascend`` ``GPU`` ``CPU``
1909
1756
 
1910
1757
  Examples:
1911
1758
  >>> import mindspore
1912
1759
  >>> import numpy as np
1913
1760
  >>> from mindspore import Tensor, ops
1914
- >>> logits = Tensor(np.array([1, 2, 3]), mindspore.float32)
1915
- >>> labels = Tensor(np.array([[1, 1, 1], [1, 2, 2]]), mindspore.float32)
1916
- >>> output = ops.mse_loss_ext(logits, labels, reduction='none')
1761
+ >>> x = Tensor(np.random.randn(3, 4, 5, 6).astype(np.float32))
1762
+ >>> output = ops.prod_ext(x, 1, keepdim=True)
1763
+ >>> result = output.shape
1764
+ >>> print(result)
1765
+ (3, 1, 5, 6)
1766
+ >>> # case 1: Reduces a dimension by multiplying all elements in the dimension.
1767
+ >>> x = Tensor(np.array([[[1, 1, 1, 1, 1, 1], [2, 2, 2, 2, 2, 2], [3, 3, 3, 3, 3, 3]],
1768
+ ... [[4, 4, 4, 4, 4, 4], [5, 5, 5, 5, 5, 5], [6, 6, 6, 6, 6, 6]],
1769
+ ... [[7, 7, 7, 7, 7, 7], [8, 8, 8, 8, 8, 8], [9, 9, 9, 9, 9, 9]]]), mindspore.float32)
1770
+ >>> output = ops.prod_ext(x)
1917
1771
  >>> print(output)
1918
- [[0. 1. 4.]
1919
- [0. 0. 1.]]
1772
+ 2.2833798e+33
1773
+ >>> print(output.shape)
1774
+ ()
1775
+ >>> # case 2: Reduces a dimension along dim 0.
1776
+ >>> output = ops.prod_ext(x, 0, True)
1777
+ >>> print(output)
1778
+ [[[ 28. 28. 28. 28. 28. 28.]
1779
+ [ 80. 80. 80. 80. 80. 80.]
1780
+ [162. 162. 162. 162. 162. 162.]]]
1781
+ >>> # case 3: Reduces a dimension along dim 1.
1782
+ >>> output = ops.prod_ext(x, 1, True)
1783
+ >>> print(output)
1784
+ [[[ 6. 6. 6. 6. 6. 6.]]
1785
+ [[120. 120. 120. 120. 120. 120.]]
1786
+ [[504. 504. 504. 504. 504. 504.]]]
1787
+ >>> # case 4: Reduces a dimension along dim 2.
1788
+ >>> output = ops.prod_ext(x, 2, True)
1789
+ >>> print(output)
1790
+ [[[1.00000e+00]
1791
+ [6.40000e+01]
1792
+ [7.29000e+02]]
1793
+ [[4.09600e+03]
1794
+ [1.56250e+04]
1795
+ [4.66560e+04]]
1796
+ [[1.17649e+05]
1797
+ [2.62144e+05]
1798
+ [5.31441e+05]]]
1920
1799
  """
1921
- return mse_loss_impl(input, target, converted_reduction)
1800
+ return prod_impl(input, dim, keepdim, dtype)
1922
1801
 
1923
1802
 
1924
- def argmax(input, dim=None, keepdim=False):
1803
+ def argmin(input, dim=None, keepdim=False):
1925
1804
  r"""
1926
- argmax(input) -> Tensor
1927
-
1928
- Return the indices of the maximum values of a tensor.
1929
-
1930
- Args:
1931
- input (Tensor): Input tensor.
1932
-
1933
- Returns:
1934
- Tensor.
1935
-
1936
- Supported Platforms:
1937
- ``Ascend``
1938
-
1939
- Examples:
1940
- >>> import numpy as np
1941
- >>> from mindspore import Tensor
1942
- >>> from mindspore import ops
1943
- >>> x = Tensor(np.array([[1, 20, 5], [67, 8, 9], [130, 24, 15]]).astype(np.float32))
1944
- >>> output = ops.auto_generate.argmax_ext(x)
1945
- >>> print(output)
1946
- 6
1947
-
1948
- .. function:: argmax(input, dim, keepdim=False) -> Tensor
1949
- :noindex:
1950
-
1951
- Return the indices of the maximum values of a tensor across a dimension.
1805
+ Return the indices of the minimum values of a tensor across a dimension.
1952
1806
 
1953
1807
  Args:
1954
1808
  input (Tensor): Input tensor.
1955
- dim (int): The dimension to reduce.
1809
+ dim (Union[int, None], optional): Specify the axis for calculation. If `dim` is ``None`` , the indices of the minimum
1810
+ value within the flattened input will be returned. Default: ``None`` .
1956
1811
  keepdim (bool, optional): Whether the output tensor retains the specified
1957
- dimension. Default: ``False`` .
1812
+ dimension. Ignored if `dim` is None. Default: ``False`` .
1958
1813
 
1959
1814
  Returns:
1960
- Tensor, indices of the maximum values across a dimension.
1815
+ Tensor, indices of the minimum values of the input tensor across a dimension.
1961
1816
 
1962
1817
  Raises:
1963
1818
  TypeError: If `keepdim` is not bool.
@@ -1971,47 +1826,35 @@ def argmax(input, dim=None, keepdim=False):
1971
1826
  >>> from mindspore import Tensor
1972
1827
  >>> from mindspore import ops
1973
1828
  >>> x = Tensor(np.array([[1, 20, 5], [67, 8, 9], [130, 24, 15]]).astype(np.float32))
1974
- >>> output = ops.auto_generate.argmax_ext(x, dim=-1)
1829
+ >>> output = ops.auto_generate.argmin_ext(x, dim=-1)
1975
1830
  >>> print(output)
1976
- [1 0 0]
1977
- """
1978
- return argmax_impl(input, dim, keepdim)
1979
-
1980
-
1981
- def adaptive_avg_pool2d_grad(grad_output, x):
1982
- r"""
1983
- None
1984
- """
1985
- return adaptive_avg_pool2d_grad_impl(grad_output, x)
1986
-
1987
-
1988
- def ffn(x, weight1, weight2, expertTokens=None, bias1=None, bias2=None, scale=None, offset=None, deqScale1=None, deqScale2=None, antiquant_scale1=None, antiquant_scale2=None, antiquant_offset1=None, antiquant_offset2=None, activation='fastgelu', inner_precise=0):
1989
- r"""
1990
- None
1831
+ [0 1 2]
1991
1832
  """
1992
- return ffn_impl(x, weight1, weight2, expertTokens, bias1, bias2, scale, offset, deqScale1, deqScale2, antiquant_scale1, antiquant_scale2, antiquant_offset1, antiquant_offset2, converted_activation, inner_precise)
1833
+ return argmin_impl(input, dim, keepdim)
1993
1834
 
1994
1835
 
1995
- def log2(input):
1836
+ def outer(input, vec2):
1996
1837
  r"""
1997
- Returns the logarithm to the base 2 of a tensor element-wise.
1998
-
1999
- .. math::
2000
- y_i = \log_2(x_i)
1838
+ Return outer product of `input` and `vec2`. If `input` is a vector of size :math:`n`
1839
+ and `vec2` is a vector of size :math:`m` , then output must be a matrix of shape :math:`(n, m)` .
2001
1840
 
2002
1841
  .. warning::
2003
- - If the input value of operator Log2 is within the range (0, 0.01] or [0.95, 1.05], the output accuracy
2004
- may be affacted.
1842
+ This is an experimental API that is subject to change or deletion.
1843
+
1844
+ .. note::
1845
+ This function does not broadcast.
2005
1846
 
2006
1847
  Args:
2007
- input (Tensor): Input Tensor of any dimension. The value must be greater than 0.
1848
+ input (Tensor): 1-D input vector.
1849
+ vec2 (Tensor): 1-D input vector.
2008
1850
 
2009
1851
  Returns:
2010
- Tensor, has the same shape as the `input`. If `input.dtype` is of integer or boolean type, the output dtype
2011
- will be float32. Otherwise, the output dtype will be the same as `input.dtype`.
1852
+ out, 2-D matrix, the outer product of two vectors.
2012
1853
 
2013
1854
  Raises:
2014
- TypeError: If `input` is not a Tensor.
1855
+ TypeError: If `input` or `vec2` is not a Tensor.
1856
+ TypeError: The implicitly converted data types of `input` and `vec2` are not one of float16, float32, float64, bool, uint8, int8, int16, int32, int64, complex64, complex128, bfloat16
1857
+ ValueError: If the dimension of `input` or `vec2` is not equal to 1.
2015
1858
 
2016
1859
  Supported Platforms:
2017
1860
  ``Ascend``
@@ -2019,13 +1862,17 @@ def log2(input):
2019
1862
  Examples:
2020
1863
  >>> import mindspore
2021
1864
  >>> import numpy as np
2022
- >>> from mindspore import Tensor, ops
2023
- >>> x = Tensor(np.array([3.0, 5.0, 7.0]), mindspore.float32)
2024
- >>> output = ops.auto_generate.log2_ext(x)
2025
- >>> print(output)
2026
- [1.5849625 2.321928 2.807355 ]
1865
+ >>> from mindspore import Tensor
1866
+ >>> from mindspore import ops
1867
+ >>> input = Tensor(np.array([7, 8, 9]), mindspore.int32)
1868
+ >>> vec2 = Tensor(np.array([7, 10, 11]), mindspore.int32)
1869
+ >>> out = ops.outer(input, vec2)
1870
+ >>> print(out)
1871
+ [[49 70 77]
1872
+ [56 80 88]
1873
+ [63 90 99]]
2027
1874
  """
2028
- return log2_impl(input)
1875
+ return outer_impl(input, vec2)
2029
1876
 
2030
1877
 
2031
1878
  def bincount(input, weights=None, minlength=0):
@@ -2074,233 +1921,336 @@ def bincount(input, weights=None, minlength=0):
2074
1921
  return bincount_impl(input, weights, minlength)
2075
1922
 
2076
1923
 
2077
- def selu(input):
1924
+ def isneginf(input):
2078
1925
  r"""
2079
- Activation function SELU (Scaled exponential Linear Unit).
1926
+ Determines which elements are -inf for each position.
2080
1927
 
2081
- The activation function is defined as:
1928
+ .. warning::
1929
+ - This API can be used only on the Atlas A2 training series.
2082
1930
 
2083
- .. math::
2084
- E_{i} =
2085
- scale *
2086
- \begin{cases}
2087
- x_{i}, &\text{if } x_{i} \geq 0; \cr
2088
- \text{alpha} * (\exp(x_i) - 1), &\text{otherwise.}
2089
- \end{cases}
1931
+ Args:
1932
+ input (Tensor): Input Tensor.
2090
1933
 
2091
- where :math:`alpha` and :math:`scale` are pre-defined constants(:math:`alpha=1.67326324`
2092
- and :math:`scale=1.05070098`).
1934
+ Returns:
1935
+ Tensor with the same shape as the input, where elements are `True` if the corresponding element in the `input` is negative infinity, and `False` otherwise.
2093
1936
 
2094
- See more details in `Self-Normalizing Neural Networks <https://arxiv.org/abs/1706.02515>`_.
1937
+ Raises:
1938
+ TypeError: If the input is not a tensor.
2095
1939
 
2096
- SELU Activation Function Graph:
1940
+ Supported Platforms:
1941
+ ``Ascend`` ``GPU`` ``CPU``
2097
1942
 
2098
- .. image:: ../images/SeLU.png
2099
- :align: center
1943
+ Examples:
1944
+ >>> from mindspore import ops, Tensor
1945
+ >>> from mindspore import dtype as mstype
1946
+ >>> output = ops.isneginf(Tensor([[-float("inf"), float("inf")], [1, -float("inf")]], mstype.float32))
1947
+ >>> print(output)
1948
+ [[ True False]
1949
+ [False True]]
1950
+ """
1951
+ return isneginf_impl(input)
1952
+
1953
+
1954
+ def adaptive_avg_pool3d(input, output_size):
1955
+ r"""
1956
+ None
1957
+ """
1958
+ return adaptive_avg_pool3d_impl(input, output_size)
1959
+
1960
+
1961
+ def argsort(input, dim=-1, descending=False, stable=False):
1962
+ r"""
1963
+ Sorts the input tensor along the given dimension in specified order and return the sorted indices.
1964
+
1965
+ .. warning::
1966
+ This is an experimental optimizer API that is subject to change.
1967
+
1968
+ Args:
1969
+ input(Tensor): The input tensor to sort.
1970
+ dim (int, optional): The dim to sort along. Default: ``-1`` , means the last dimension.
1971
+ The Ascend backend only supports sorting the last dimension.
1972
+ descending (bool, optional): The sort order. If `descending` is ``True`` then the elements
1973
+ are sorted in descending order by value. Otherwise sort in ascending order. Default: ``False`` .
1974
+ stable (bool, optional): Whether to use stable sorting algorithm. Default: ``False``.
1975
+
1976
+ Returns:
1977
+ Tensor, the indices of sorted input tensor. Data type is int64.
1978
+
1979
+ Raises:
1980
+ ValueError: If `dim` is out of range.
1981
+ TypeError: If dtype of `dim` is not int32.
1982
+ TypeError: If dtype of `descending` is not bool.
1983
+ TypeError: If dtype of `stable` is not bool.
1984
+
1985
+ Supported Platforms:
1986
+ ``Ascend``
1987
+
1988
+ Examples:
1989
+ >>> import mindspore
1990
+ >>> import numpy as np
1991
+ >>> from mindspore import Tensor, ops
1992
+ >>> x = Tensor(np.array([[8, 2, 1], [5, 9, 3], [4, 6, 7]]), mindspore.float16)
1993
+ >>> sort = ops.auto_generate.argsort_ext(x)
1994
+ >>> print(sort)
1995
+ [[2 1 0]
1996
+ [2 0 1]
1997
+ [0 1 2]]
1998
+ """
1999
+ return argsort_impl(input, dim, descending, stable)
2000
+
2001
+
2002
+ def matmul(input, other):
2003
+ r"""
2004
+ None
2005
+ """
2006
+ return matmul_impl(input, other)
2007
+
2008
+
2009
+ def mse_loss(input, target, reduction='mean'):
2010
+ r"""
2011
+ Calculates the mean squared error between the predicted value and the label value.
2012
+
2013
+ For detailed information, please refer to :class:`mindspore.nn.MSELoss`.
2014
+
2015
+ Args:
2016
+ input (Tensor): Tensor of any dimension. The data type needs to be consistent with the `target`.
2017
+ It should also be broadcastable with the `target`.
2018
+ target (Tensor): The input label. Tensor of any dimension. The data type needs to be consistent with the `input`.
2019
+ It should also be broadcastable with the `input`.
2020
+ reduction (str, optional): Apply specific reduction method to the output: ``'mean'`` , ``'none'`` ,
2021
+ ``'sum'`` . Default: ``'mean'`` .
2100
2022
 
2101
- Args:
2102
- input (Tensor): Tensor of any dimension.
2103
- The data type is float16, float32, bfloat16.
2023
+ - ``'none'``: no reduction will be applied.
2024
+ - ``'mean'``: compute and return the mean of elements in the output.
2025
+ - ``'sum'``: the output elements will be summed.
2104
2026
 
2105
2027
  Returns:
2106
- Tensor, with the same type and shape as the `input`.
2028
+ - Tensor. If `reduction` is ``'mean'`` or ``'sum'``, the shape of output is `Tensor Scalar`.
2029
+ - If reduction is ``'none'``, the shape of output is the broadcasted shape of **input** and **target** .
2107
2030
 
2108
2031
  Raises:
2109
- TypeError: If dtype of `input` is not float16, float32, bfloat16.
2032
+ ValueError: If `reduction` is not one of ``'mean'`` , ``'sum'`` or ``'none'``.
2033
+ ValueError: If `input` and `target` are not broadcastable.
2034
+ TypeError: If `input` and `target` are in different data type.
2110
2035
 
2111
2036
  Supported Platforms:
2112
2037
  ``Ascend``
2113
2038
 
2114
2039
  Examples:
2115
2040
  >>> import mindspore
2116
- >>> from mindspore import Tensor, ops
2117
2041
  >>> import numpy as np
2118
- >>> input = Tensor(np.array([[-1.0, 4.0, -8.0], [2.0, -5.0, 9.0]]), mindspore.float32)
2119
- >>> output = ops.auto_generate.selu_ext(input)
2042
+ >>> from mindspore import Tensor, ops
2043
+ >>> logits = Tensor(np.array([1, 2, 3]), mindspore.float32)
2044
+ >>> labels = Tensor(np.array([[1, 1, 1], [1, 2, 2]]), mindspore.float32)
2045
+ >>> output = ops.mse_loss_ext(logits, labels, reduction='none')
2120
2046
  >>> print(output)
2121
- [[-1.1113307 4.202804 -1.7575096]
2122
- [ 2.101402 -1.7462534 9.456309 ]]
2123
- """
2124
- return selu_impl(input)
2125
-
2126
-
2127
- def tril(input, diagonal=0):
2128
- r"""
2129
- None
2047
+ [[0. 1. 4.]
2048
+ [0. 0. 1.]]
2130
2049
  """
2131
- return tril_impl(input, diagonal)
2050
+ return mse_loss_impl(input, target, converted_reduction)
2132
2051
 
2133
2052
 
2134
- def logaddexp(input, other):
2053
+ def sub(input, other, alpha=1):
2135
2054
  r"""
2136
- Computes the logarithm of the sum of exponentiations of the inputs.
2137
- This function is useful in statistics where the calculated probabilities of events may be
2138
- so small as to exceed the range of normal floating point numbers.
2055
+ Subtracts scaled other value from input Tensor.
2139
2056
 
2140
2057
  .. math::
2141
2058
 
2142
- out_i = \log(exp(input_i) + \exp(other_i))
2059
+ out_{i} = input_{i} - alpha \times other_{i}
2143
2060
 
2144
- .. warning::
2145
- This is an experimental API that is subject to change or deletion.
2061
+ Note:
2062
+ - When the two inputs have different shapes,
2063
+ they must be able to broadcast to a common shape.
2064
+ - The two inputs and alpha comply with the implicit type conversion rules to make the data types
2065
+ consistent.
2146
2066
 
2147
2067
  Args:
2148
- input (Tensor): Input Tensor. The dtype of `input` must be float.
2149
- other (Tensor): Input Tensor. The dtype of `other` must be float.
2150
- If the shape of `input` is not equal to the shape of `other`,
2151
- they must be broadcastable to a common shape.
2068
+ input (Union[Tensor, number.Number, bool]): The first input is a number.Number or
2069
+ a bool or a tensor whose data type is
2070
+ `number <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_ or
2071
+ `bool <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_.
2072
+ other (Union[Tensor, number.Number, bool]): The second input, is a number.Number or
2073
+ a bool or a tensor whose data type is
2074
+ `number <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_ or
2075
+ `bool <https://www.mindspore.cn/docs/en/master/api_python/mindspore/mindspore.dtype.html>`_.
2076
+ alpha (number.Number): A scaling factor applied to `other`, default 1.
2152
2077
 
2153
2078
  Returns:
2154
- Tensor, with the same dtype as `input` and `other`.
2079
+ Tensor with a shape that is the same as the broadcasted shape of the input `input` and `other`,
2080
+ and the data type is the one with higher precision or higher digits among the two inputs and alpha.
2155
2081
 
2156
2082
  Raises:
2157
- TypeError: If `input` or `other` is not a Tensor.
2158
- TypeError: The dtype of `input` or `other` is not float.
2083
+ TypeError: If the type of `input`, `other`, or `alpha` is not one of the following: Tensor, number.Number, bool.
2084
+ TypeError: If `alpha` is of type float but `input` and `other` are not of type float.
2085
+ TypeError: If `alpha` is of type bool but `input` and `other` are not of type bool.
2159
2086
 
2160
2087
  Supported Platforms:
2161
- ``Ascend``
2088
+ ``Ascend`` ``GPU`` ``CPU``
2162
2089
 
2163
2090
  Examples:
2164
2091
  >>> import numpy as np
2165
- >>> from mindspore import Tensor, ops
2166
- >>> x1 = Tensor(np.array([1, 2, 3]).astype(np.float16))
2167
- >>> x2 = Tensor(np.array(2).astype(np.float16))
2168
- >>> output = ops.logaddexp_ext(x1, x2)
2092
+ >>> import mindspore
2093
+ >>> from mindspore import Tensor
2094
+ >>> from mindspore import ops
2095
+ >>> x = Tensor(np.array([4, 5, 6]).astype(np.float32))
2096
+ >>> y = Tensor(1, mindspore.int32)
2097
+ >>> alpha = 0.5
2098
+ >>> output = ops.auto_generate.sub_ext(x, y, alpha)
2169
2099
  >>> print(output)
2170
- [2.312 2.693 3.312]
2100
+ [3.5 4.5 5.5]
2101
+ >>> # the data type of x is float32, the data type of y is int32,
2102
+ >>> # alpha is a float, and the output is the data format of higher precision float32.
2103
+ >>> print(output.dtype)
2104
+ Float32
2171
2105
  """
2172
- return logaddexp_impl(input, other)
2106
+ return sub_impl(input, other, alpha)
2173
2107
 
2174
2108
 
2175
- def elu(input, alpha=1.0):
2109
+ def mm(input, mat2):
2176
2110
  r"""
2177
- Exponential Linear Unit activation function.
2178
-
2179
- Applies the exponential linear unit function element-wise.
2180
- The activation function is defined as:
2181
-
2182
- .. math::
2183
-
2184
- \text{ELU}(x)= \left\{
2185
- \begin{array}{align}
2186
- \alpha(e^{x} - 1) & \text{if } x \le 0\\
2187
- x & \text{if } x \gt 0\\
2188
- \end{array}\right.
2189
-
2190
- Where :math:`x` is the element of input Tensor `input`, :math:`\alpha` is param `alpha`,
2191
- it determines the smoothness of ELU.
2111
+ Returns the matrix product of two arrays.
2112
+ If `input` is a :math:`(n \times m)` Tensor, `mat2` is a
2113
+ :math:`(m \times p)` Tensor, `out` will be a :math:`(n \times p)` Tensor.
2192
2114
 
2193
- ELU function graph:
2115
+ Note:
2116
+ This function cannot support broadcasting.
2117
+ Refer to :func:`mindspore.ops.matmul` instead if you need a broadcastable function.
2194
2118
 
2195
- .. image:: ../images/ELU.png
2196
- :align: center
2119
+ .. warning::
2120
+ This is an experimental API that is subject to change or deletion.
2197
2121
 
2198
2122
  Args:
2199
- input (Tensor): The input of ELU is a Tensor of any dimension.
2200
- alpha (float, optional): The alpha value of ELU, the data type is float.
2201
- Default: ``1.0`` .
2123
+ input (Tensor): The first matrix of matrix multiplication.
2124
+ The last dimension of `input` must be the same size as the first dimension of `mat2`.
2125
+ mat2 (Tensor): The second matrix of matrix multiplication.
2126
+ The last dimension of `input` must be the same size as the first dimension of `mat2`.
2202
2127
 
2203
2128
  Returns:
2204
- Tensor, has the same shape and data type as `input`.
2129
+ Tensor, the matrix product of the inputs.
2205
2130
 
2206
2131
  Raises:
2207
- TypeError: If `alpha` is not a float.
2132
+ ValueError: If the last dimension of `input` is not the same size as the
2133
+ second-to-last dimension of `mat2`.
2134
+ TypeError: If `input` or `mat2` is not a Tensor.
2135
+ TypeError: If dtype of `input` or `mat2` is not float16, float32 or bfloat16.
2208
2136
 
2209
2137
  Supported Platforms:
2210
2138
  ``Ascend``
2211
2139
 
2212
2140
  Examples:
2213
- >>> import mindspore
2141
+ >>> import mindspore as ms
2142
+ >>> from mindspore import ops
2214
2143
  >>> import numpy as np
2215
- >>> from mindspore import Tensor, ops
2216
- >>> x = Tensor(np.array([[-1.0, 4.0, -8.0], [2.0, -5.0, 9.0]]), mindspore.float32)
2217
- >>> output = ops.auto_generate.elu_ext(x)
2218
- >>> print(output)
2219
- [[-0.63212055 4. -0.99966455]
2220
- [ 2. -0.99326205 9. ]]
2221
- """
2222
- return elu_impl(input, alpha)
2223
-
2224
-
2225
- def inplace_adds(input, other, alpha=1):
2226
- r"""
2227
- None
2144
+ >>> x1 = ms.Tensor(np.random.rand(2, 3), ms.float32)
2145
+ >>> x2 = ms.Tensor(np.random.rand(3, 4), ms.float32)
2146
+ >>> out = ops.mm_ext(x1, x2)
2147
+ >>> print(out.shape)
2148
+ (2, 4)
2228
2149
  """
2229
- return inplace_adds_impl(input, other, alpha)
2150
+ return mm_impl(input, mat2)
2230
2151
 
2231
2152
 
2232
- def asin(input):
2153
+ def topk(input, k, dim=-1, largest=True, sorted=True):
2233
2154
  r"""
2234
- Computes arcsine of input tensors element-wise.
2155
+ Finds values and indices of the `k` largest or smallest entries along a given dimension.
2156
+
2157
+ .. warning::
2158
+ - If sorted is set to False, due to different memory layout and traversal methods on different platforms,
2159
+ the display order of calculation results may be inconsistent when `sorted` is False.
2160
+
2161
+ If the `input` is a one-dimensional Tensor, finds the `k` largest or smallest entries in the Tensor,
2162
+ and outputs its value and index as a Tensor. values[`k`] is the `k` largest item in `input`,
2163
+ and its index is indices [`k`].
2164
+
2165
+ For a multi-dimensional matrix,
2166
+ calculates the first or last `k` entries in a given dimension, therefore:
2235
2167
 
2236
2168
  .. math::
2237
2169
 
2238
- out_i = \sin^{-1}(input_i)
2170
+ values.shape = indices.shape
2171
+
2172
+ If the two compared elements are the same, the one with the smaller index value is returned first.
2239
2173
 
2240
2174
  Args:
2241
- input (Tensor): The shape of tensor is
2242
- :math:`(N,*)`, where :math:`*` means any number of additional dimensions.
2175
+ input (Tensor): Input to be computed.
2176
+ k (int): The number of top or bottom elements to be computed along the last dimension.
2177
+ dim (int, optional): The dimension to sort along. Default: ``-1`` .
2178
+ largest (bool, optional): If largest is ``False`` then the k smallest elements are returned.
2179
+ Default: ``True`` .
2180
+ sorted (bool, optional): If ``True`` , the obtained elements will be sorted by the values in descending
2181
+ order or ascending order according to `largest`. If ``False`` , the obtained elements will not be
2182
+ sorted. Default: ``True`` .
2243
2183
 
2244
2184
  Returns:
2245
- Tensor, has the same shape as `input`. The dtype of output is float32 when dtype of `input` is in [bool, int8, uint8, int16, int32, int64]. Otherwise output has the same dtype as `input`.
2185
+ A tuple consisting of `values` and `indices`.
2186
+
2187
+ - values (Tensor) - The `k` largest or smallest elements in each slice of the given dimension.
2188
+ - indices (Tensor) - The indices of values within the last dimension of input.
2246
2189
 
2247
2190
  Raises:
2191
+ TypeError: If `sorted` is not a bool.
2248
2192
  TypeError: If `input` is not a Tensor.
2193
+ TypeError: If `k` is not an int.
2249
2194
 
2250
2195
  Supported Platforms:
2251
- ``Ascend`` ``GPU`` ``CPU``
2196
+ ``Ascend``
2252
2197
 
2253
2198
  Examples:
2254
- >>> import mindspore
2255
- >>> import numpy as np
2256
- >>> from mindspore import Tensor, ops
2257
- >>> input = Tensor(np.array([0.74, 0.04, 0.30, 0.56]), mindspore.float32)
2258
- >>> output = ops.asin_ext(input)
2199
+ >>> import mindspore as ms
2200
+ >>> from mindspore import ops
2201
+ >>> x = ms.Tensor([[0.5368, 0.2447, 0.4302, 0.9673],
2202
+ ... [0.4388, 0.6525, 0.4685, 0.1868],
2203
+ ... [0.3563, 0.5152, 0.9675, 0.8230]], dtype=ms.float32)
2204
+ >>> output = ops.topk_ext(x, 2, dim=1)
2259
2205
  >>> print(output)
2260
- [0.8330927 0.04001068 0.30469266 0.59438497 ]
2206
+ (Tensor(shape=[3, 2], dtype=Float32, value=
2207
+ [[ 9.67299998e-01, 5.36800027e-01],
2208
+ [ 6.52499974e-01, 4.68499988e-01],
2209
+ [ 9.67499971e-01, 8.23000014e-01]]), Tensor(shape=[3, 2], dtype=Int64, value=
2210
+ [[3, 0],
2211
+ [1, 2],
2212
+ [2, 3]]))
2213
+ >>> output2 = ops.topk_ext(x, 2, dim=1, largest=False)
2214
+ >>> print(output2)
2215
+ (Tensor(shape=[3, 2], dtype=Float32, value=
2216
+ [[ 2.44700000e-01, 4.30200011e-01],
2217
+ [ 1.86800003e-01, 4.38800007e-01],
2218
+ [ 3.56299996e-01, 5.15200019e-01]]), Tensor(shape=[3, 2], dtype=Int64, value=
2219
+ [[1, 2],
2220
+ [3, 0],
2221
+ [0, 1]]))
2261
2222
  """
2262
- return asin_impl(input)
2223
+ return topk_impl(input, k, dim, largest, sorted)
2263
2224
 
2264
2225
 
2265
- def atan2(input, other):
2226
+ def asinh(input):
2266
2227
  r"""
2267
- Returns arctangent of input/other element-wise.
2228
+ Computes inverse hyperbolic sine of the input element-wise.
2268
2229
 
2269
- It returns :math:`\theta\ \in\ [-\pi, \pi]`
2270
- such that :math:`input = r*\sin(\theta), other = r*\cos(\theta)`, where :math:`r = \sqrt{input^2 + other^2}`.
2230
+ .. math::
2271
2231
 
2272
- Note:
2273
- - Arg `input` and `other` comply with the implicit type conversion rules to make the data types consistent.
2274
- If they have different data types, the lower precision data type will be converted to relatively the
2275
- highest precision data type.
2232
+ out_i = \sinh^{-1}(input_i)
2276
2233
 
2277
2234
  Args:
2278
- input (Tensor, Number.number): The input tensor or scalar.
2279
- other (Tensor, Number.number): The input tensor or scalar. It has the same shape with `input` or
2280
- its shape is able to broadcast with `input`.
2235
+ input (Tensor): The input tensor of inverse hyperbolic sine function.
2281
2236
 
2282
2237
  Returns:
2283
- Tensor, the shape is the same as the one after broadcasting.
2284
- The dtype of output is float32 when dtype of `input` is in
2285
- [bool, int8, uint8, int16, int32, int64]. Otherwise output has the same dtype as `input`.
2238
+ Tensor, has the same shape as `input`. The dtype of output is float32 when dtype of `input` is in [bool, int8, uint8, int16, int32, int64]. Otherwise output has the same dtype as `input`.
2286
2239
 
2287
2240
  Raises:
2288
- TypeError: If `input` or `other` is not a Tensor or scalar.
2289
- RuntimeError: If the data type of `input` and `other` conversion of Parameter is required
2290
- when data type conversion of Parameter is not supported.
2241
+ TypeError: If `input` is not a Tensor.
2291
2242
 
2292
2243
  Supported Platforms:
2293
- ``Ascend``
2244
+ ``Ascend`` ``GPU`` ``CPU``
2294
2245
 
2295
2246
  Examples:
2296
2247
  >>> import mindspore
2297
2248
  >>> import numpy as np
2298
2249
  >>> from mindspore import Tensor, ops
2299
- >>> input = Tensor(np.array([0, 1]), mindspore.float32)
2300
- >>> other = Tensor(np.array([1, 1]), mindspore.float32)
2301
- >>> output = ops.auto_generate.atan2_ext(input, other)
2250
+ >>> input = Tensor(np.array([-5.0, 1.5, 3.0, 100.0]), mindspore.float32)
2251
+ >>> output = ops.asinh_ext(input)
2302
2252
  >>> print(output)
2303
- [0. 0.7853982]
2253
+ [-2.3124385 1.1947632 1.8184465 5.298342 ]
2304
2254
  """
2305
- return atan2_impl(input, other)
2255
+ return asinh_impl(input)
2306
2256