agentprobe-testing 0.5.0__py3-none-any.whl

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (55) hide show
  1. agentprobe/__init__.py +104 -0
  2. agentprobe/agents/__init__.py +0 -0
  3. agentprobe/agents/base.py +32 -0
  4. agentprobe/agents/rule_based.py +336 -0
  5. agentprobe/agents/scripted.py +30 -0
  6. agentprobe/agents/target_agent.py +106 -0
  7. agentprobe/agreement.py +80 -0
  8. agentprobe/classifier.py +159 -0
  9. agentprobe/cli.py +684 -0
  10. agentprobe/diff.py +150 -0
  11. agentprobe/domain.py +121 -0
  12. agentprobe/domains/__init__.py +0 -0
  13. agentprobe/domains/access_control/__init__.py +0 -0
  14. agentprobe/domains/access_control/agent.py +90 -0
  15. agentprobe/domains/access_control/clean.py +154 -0
  16. agentprobe/domains/access_control/complex_agent.py +123 -0
  17. agentprobe/domains/access_control/decoy.py +124 -0
  18. agentprobe/domains/access_control/domain.py +35 -0
  19. agentprobe/domains/access_control/entities.py +43 -0
  20. agentprobe/domains/access_control/injector_prompt.py +196 -0
  21. agentprobe/domains/access_control/rule_based_agent.py +263 -0
  22. agentprobe/domains/access_control/scenarios.py +17 -0
  23. agentprobe/domains/access_control/split.py +96 -0
  24. agentprobe/domains/access_control/tools.py +235 -0
  25. agentprobe/domains/access_control/trap.py +100 -0
  26. agentprobe/feedback.py +121 -0
  27. agentprobe/generic_world.py +99 -0
  28. agentprobe/injection.py +475 -0
  29. agentprobe/injector.py +810 -0
  30. agentprobe/llm.py +123 -0
  31. agentprobe/playbook.py +211 -0
  32. agentprobe/quickstart.py +295 -0
  33. agentprobe/reachability.py +196 -0
  34. agentprobe/registry.py +313 -0
  35. agentprobe/report.py +666 -0
  36. agentprobe/runner.py +317 -0
  37. agentprobe/scenario.py +75 -0
  38. agentprobe/scenarios/__init__.py +0 -0
  39. agentprobe/scenarios/clean.py +194 -0
  40. agentprobe/scenarios/decoy.py +272 -0
  41. agentprobe/scenarios/registry.py +16 -0
  42. agentprobe/scenarios/split.py +203 -0
  43. agentprobe/scenarios/trap.py +215 -0
  44. agentprobe/termui.py +154 -0
  45. agentprobe/tools.py +275 -0
  46. agentprobe/trajectory.py +107 -0
  47. agentprobe/triage.py +153 -0
  48. agentprobe/validate_scenarios.py +489 -0
  49. agentprobe/world.py +189 -0
  50. agentprobe_testing-0.5.0.dist-info/METADATA +127 -0
  51. agentprobe_testing-0.5.0.dist-info/RECORD +55 -0
  52. agentprobe_testing-0.5.0.dist-info/WHEEL +5 -0
  53. agentprobe_testing-0.5.0.dist-info/entry_points.txt +4 -0
  54. agentprobe_testing-0.5.0.dist-info/licenses/LICENSE +109 -0
  55. agentprobe_testing-0.5.0.dist-info/top_level.txt +1 -0
@@ -0,0 +1,127 @@
1
+ Metadata-Version: 2.4
2
+ Name: agentprobe-testing
3
+ Version: 0.5.0
4
+ Summary: Adaptive chaos-testing for LLM agents: a live model-driven Injector that reads an agent's real trajectory and decides where to break something, instead of scripting perturbations in advance.
5
+ License: Business Source License 1.1
6
+
7
+ Parameters
8
+
9
+ Licensor: Agent-Probe
10
+ Licensed Work: AgentProbe
11
+ The Licensed Work is (c) 2026 Agent-Probe
12
+ Additional Use Grant: You may use, copy, modify, and make production use of
13
+ the Licensed Work for any purpose -- including testing,
14
+ developing, and operating your own software agents --
15
+ free of charge, provided that you do not offer the
16
+ Licensed Work, or a modified or derivative version of
17
+ it, to third parties as part of a hosted, managed, or
18
+ embedded service that competes with a paid product or
19
+ service offered by the Licensor (including, without
20
+ limitation, hosted domain generation, hosted
21
+ dashboards, or hosted test-run storage substantially
22
+ similar to those offered at
23
+ https://agentprobe-api.agentprobe.workers.dev).
24
+ Change Date: 2030-01-01
25
+ Change License: Apache License, Version 2.0
26
+
27
+ For information about alternative licensing arrangements for the Licensed
28
+ Work, please open an issue at https://github.com/Agent-Probe/agentprobe.
29
+
30
+ Notice
31
+
32
+ The Business Source License (this document, or the "License") is not an
33
+ Open Source license. However, the Licensed Work will eventually be made
34
+ available under an Open Source License, as stated in this License.
35
+
36
+ License text copyright (c) 2017 MariaDB Corporation Ab, All Rights
37
+ Reserved. "Business Source License" is a trademark of MariaDB Corporation
38
+ Ab.
39
+
40
+ -----------------------------------------------------------------------------
41
+
42
+ Business Source License 1.1
43
+
44
+ Terms
45
+
46
+ The Licensor hereby grants you the right to copy, modify, create
47
+ derivative works, redistribute, and make non-production use of the
48
+ Licensed Work. The Licensor may make an Additional Use Grant, above,
49
+ permitting limited production use.
50
+
51
+ Effective on the Change Date, or the fourth anniversary of the first
52
+ publicly available distribution of a specific version of the Licensed
53
+ Work under this License, whichever comes first, the Licensor hereby
54
+ grants you rights under the terms of the Change License, and the rights
55
+ granted in the paragraph above terminate.
56
+
57
+ If your use of the Licensed Work does not comply with the requirements
58
+ currently in effect as described in this License, you must purchase a
59
+ commercial license from the Licensor, its affiliated entities, or
60
+ authorized resellers, or you must refrain from using the Licensed Work.
61
+
62
+ All copies of the original and modified Licensed Work, and derivative
63
+ works of the Licensed Work, are subject to this License. This License
64
+ applies separately for each version of the Licensed Work and the Change
65
+ Date may vary for each version of the Licensed Work released by
66
+ Licensor.
67
+
68
+ You must conspicuously display this License on each original or
69
+ modified copy of the Licensed Work. If you receive the Licensed Work in
70
+ original or modified form from a third party, the terms and conditions
71
+ set forth in this License apply to your use of that work.
72
+
73
+ Any use of the Licensed Work in violation of this License will
74
+ automatically terminate your rights under this License for the current
75
+ and all other versions of the Licensed Work.
76
+
77
+ This License does not grant you any right in any trademark or logo of
78
+ Licensor or its affiliates (provided that you may use a trademark or
79
+ logo of Licensor as expressly required by this License).
80
+
81
+ TO THE EXTENT PERMITTED BY APPLICABLE LAW, THE LICENSED WORK IS
82
+ PROVIDED ON AN "AS IS" BASIS. LICENSOR HEREBY DISCLAIMS ALL WARRANTIES
83
+ AND CONDITIONS, EXPRESS OR IMPLIED, INCLUDING (WITHOUT LIMITATION)
84
+ WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE,
85
+ NON-INFRINGEMENT, AND TITLE.
86
+
87
+ MariaDB hereby grants you permission to use this License's text to
88
+ license your works, and to refer to it using the trademark "Business
89
+ Source License", as long as you comply with the Covenants of Licensor
90
+ below.
91
+
92
+ Covenants of Licensor
93
+
94
+ In consideration of the right to use this License's text and the
95
+ "Business Source License" name and trademark, Licensor covenants to
96
+ MariaDB, and to all other recipients of the licensed work to be
97
+ provided by Licensor:
98
+
99
+ 1. To specify as the Change License the GPL Version 2.0 or any later
100
+ version, or a license that is compatible with GPL Version 2.0 or a
101
+ later version, where "compatible" means that software provided
102
+ under the Change License can be included in a program with software
103
+ provided under GPL Version 2.0 or a later version. Licensor may
104
+ specify additional Change Licenses without limitation.
105
+
106
+ 2. To either: (a) specify an additional grant of rights to use that
107
+ does not impose any additional restriction on the right granted in
108
+ this License, as the Additional Use Grant, or (b) insert the text
109
+ "None".
110
+
111
+ 3. To specify a Change Date.
112
+
113
+ 4. Not to modify this License in any other way.
114
+
115
+ Project-URL: Repository, https://github.com/Agent-Probe/agentprobe
116
+ Project-URL: Changelog, https://github.com/Agent-Probe/agentprobe/blob/main/CHANGELOG.md
117
+ Classifier: Development Status :: 4 - Beta
118
+ Classifier: Intended Audience :: Developers
119
+ Classifier: Programming Language :: Python :: 3
120
+ Requires-Python: >=3.11
121
+ License-File: LICENSE
122
+ Requires-Dist: anthropic>=1.0.0
123
+ Requires-Dist: python-dotenv>=1.0.0
124
+ Provides-Extra: dev
125
+ Requires-Dist: pytest>=8.0.0; extra == "dev"
126
+ Requires-Dist: pytest-cov>=5.0.0; extra == "dev"
127
+ Dynamic: license-file
@@ -0,0 +1,55 @@
1
+ agentprobe/__init__.py,sha256=Q0gm4_xg0KpIEY11ahGj7raIixNrMke9dRTe7hpJwII,3237
2
+ agentprobe/agreement.py,sha256=NXDi2Wu0tpV4FBGXwBvaIwiPj1IOrt2Etm5A5lKFQLA,3382
3
+ agentprobe/classifier.py,sha256=wseb6GeJbog6Dq_jReMr9T0-70GXL5z5ROLGz1DqN1k,6560
4
+ agentprobe/cli.py,sha256=OCYiqtboP8oT7yD4xN9dNKvgLkAhHAmf5Mc31iszOUY,29882
5
+ agentprobe/diff.py,sha256=-OGHxLz2k262wUNsrfetPkSvujdQvobb3Xp7bVG1Hnk,5231
6
+ agentprobe/domain.py,sha256=pXoWviYlhvcsjGKPIQ5UoFOZURTldJ9OTKw7OjD40RY,5965
7
+ agentprobe/feedback.py,sha256=3owXyZArOMAiNAIsvZEzMmdhX0pQdqkhqKmtjLbAbfA,5460
8
+ agentprobe/generic_world.py,sha256=c-g4ZUty5WgLeeIuZyjXrdIhaY-cEfpUzYxCAAj4xfg,4315
9
+ agentprobe/injection.py,sha256=vK8LYy0NnROAn-oHlGWrPlbRM7iQHmSDqrqSxgmzcvw,22708
10
+ agentprobe/injector.py,sha256=HCyUcq_3gVlxKk00uzMk9Xq1RK3y3aeiSZSJpUIWBpc,39821
11
+ agentprobe/llm.py,sha256=0jtmKX-Otf_K6BWVi63GTSMX9ix9HsvGOaDKR81kMoU,5349
12
+ agentprobe/playbook.py,sha256=y_Z-39UxmTgYHGRzoph1k871bKBvrpmvqBVWwKNiyEk,9462
13
+ agentprobe/quickstart.py,sha256=lbwoDAlFOoTE8F9xMd84xBQJC8q9t90CAU-UaCM2Ryo,13385
14
+ agentprobe/reachability.py,sha256=XAZtsiYYLngbM26QzsiILc9zFl26k_u2cQmzWYps3Bk,7671
15
+ agentprobe/registry.py,sha256=-yY2Dd9k6VAflC2_ZpsCGanmJDxS5dGXRVlo9DLSpzw,13873
16
+ agentprobe/report.py,sha256=4m5uczSjYaVr4AbvklmUWwfLYBnDg52nhwZ3iLm1EsY,33005
17
+ agentprobe/runner.py,sha256=uPRRCSe1RKCi4TWSYMF8izHRDwZViXW20GQsSjnKt10,13265
18
+ agentprobe/scenario.py,sha256=biGKsT1y6Lkva6LJG1wgJ4a-_bZj0xrCA96OflXMU3w,2434
19
+ agentprobe/termui.py,sha256=b2zjIPklTavpQDXnWDABuPzvePLF8CFN1iag9bc2Ew0,5242
20
+ agentprobe/tools.py,sha256=7f5PKwpvnGlYCbPAiDqLMxUWzJIEtBlduSTUwvDoqqo,10274
21
+ agentprobe/trajectory.py,sha256=uZrwqcVSnHeFnq7sv4GqEXYgW04BV3sOXQetx9Mpl2A,3759
22
+ agentprobe/triage.py,sha256=hSvVOW0e01WkxobALlC9N9Sdav-m1regq1PhYHUhWH0,7508
23
+ agentprobe/validate_scenarios.py,sha256=MzG6hUVx8h6ISAmvzdEXm3rDQVYxwsRJpMthBm9L7qs,20868
24
+ agentprobe/world.py,sha256=Rye3JZDuhsQWUR6rDwLxr65eZBr21DsPTv_PuAa1MrY,7506
25
+ agentprobe/agents/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
26
+ agentprobe/agents/base.py,sha256=L8iqpekDj-GYHzQBBZPA4WeqznKpi0O5QZvSaOWEXs4,999
27
+ agentprobe/agents/rule_based.py,sha256=CNFE3XFbcluxxiMXi7Q6D34ChCQM66lXxPJXAS3DEHo,14950
28
+ agentprobe/agents/scripted.py,sha256=r0LpFbgFecaYPWdAYkRKlcQDUNv4TFOOFFGmD6IzQXc,1054
29
+ agentprobe/agents/target_agent.py,sha256=kJwAwe9swphNXwANtng2J_LC_KEOIDYBQFP6sbOzwWw,4405
30
+ agentprobe/domains/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
31
+ agentprobe/domains/access_control/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
32
+ agentprobe/domains/access_control/agent.py,sha256=dzmMTS5_6v4TQYqGZLhZJlRd59oBETeXr_n4C2D-azg,3660
33
+ agentprobe/domains/access_control/clean.py,sha256=cR2CcJNPziOuILtjdF0rNrCdNDys0vcApSigzpKHBh4,5411
34
+ agentprobe/domains/access_control/complex_agent.py,sha256=C21SoX55fl5yT6ECQCRGTem18LNQnqFQdoHdD9vs3dE,5778
35
+ agentprobe/domains/access_control/decoy.py,sha256=kvCBdlmn9JKWxIzaZi8a-ExuXq3q6M2mPb1fcXzskMU,4993
36
+ agentprobe/domains/access_control/domain.py,sha256=v7pF3_cfdwQ-C0nL0wipqYal1RnI_wOOHtbRIJeE_qk,1290
37
+ agentprobe/domains/access_control/entities.py,sha256=LeqDOgyuxi2rRRC9qS6LjXsrMy_wrPRI630ve4HpGrc,1307
38
+ agentprobe/domains/access_control/injector_prompt.py,sha256=uQTajXp631kfcIWITrkEKHSbgUYTOaK-Vj6-AB1CtsI,12173
39
+ agentprobe/domains/access_control/rule_based_agent.py,sha256=2OW0aaQQYSmg6GbTWD4yETU-ozb3lvvrEgEHlgZZ584,10797
40
+ agentprobe/domains/access_control/scenarios.py,sha256=b8eooj90xSZb3uRta993_qfecZWZXmZ7d9aPHMpT23Y,686
41
+ agentprobe/domains/access_control/split.py,sha256=ON6NRIBPSYfOVdIRf_O7n65Wh18aaD8riIvgA_wp5r4,3497
42
+ agentprobe/domains/access_control/tools.py,sha256=bQBq5_YC3oaY_tkT0YUmIGgHj7AO8hOloQzDQHNfYvo,10533
43
+ agentprobe/domains/access_control/trap.py,sha256=Wao0onEM3QajF2fnbnpw192WJAFAbw1Jp_Ama8zQYRQ,4088
44
+ agentprobe/scenarios/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
45
+ agentprobe/scenarios/clean.py,sha256=Lxo3KFRNi-GuwyYdgejfzru_mHA0qNGht9FyJrphybU,6283
46
+ agentprobe/scenarios/decoy.py,sha256=2wggScu8hVqB9-CHlxJyeVKKEfVV1oEKQwtAbUN19gk,10171
47
+ agentprobe/scenarios/registry.py,sha256=Bb2C9hMx1tbMeuens-QUWsjTBQHITYc58nwnb7qU-ZI,637
48
+ agentprobe/scenarios/split.py,sha256=6NjsOgFAHh5s_jqfFRS6Ei1aObRDlC6gatOq8xUTr_k,7359
49
+ agentprobe/scenarios/trap.py,sha256=nrlqjI9comoYzoIcbcZ8brSb2oa61IhQv_hWQzhdKvE,7965
50
+ agentprobe_testing-0.5.0.dist-info/licenses/LICENSE,sha256=CxQuF_Gy4iadXER297uoswe3c3kJcm_ToMf1IJc7bLg,4989
51
+ agentprobe_testing-0.5.0.dist-info/METADATA,sha256=uRNwV3Cu6rbgO5HQ1Zgg6FI-KnWrZe54_Hm9BFHeB6Q,6674
52
+ agentprobe_testing-0.5.0.dist-info/WHEEL,sha256=YVMoNqKzERt-wjUZwJ33xBGAwnFl-4cqbYkTtWa4itE,91
53
+ agentprobe_testing-0.5.0.dist-info/entry_points.txt,sha256=JUuvLGGjlrFL0R9VlwDVSwMblDX_DIDK0UffDgnAZPU,147
54
+ agentprobe_testing-0.5.0.dist-info/top_level.txt,sha256=ADcjYZ6mAk_GKar9SeTLvGyKveQrPC-H__8WA4qhQTk,11
55
+ agentprobe_testing-0.5.0.dist-info/RECORD,,
@@ -0,0 +1,5 @@
1
+ Wheel-Version: 1.0
2
+ Generator: setuptools (84.0.0)
3
+ Root-Is-Purelib: true
4
+ Tag: py3-none-any
5
+
@@ -0,0 +1,4 @@
1
+ [console_scripts]
2
+ agentprobe = agentprobe.cli:main
3
+ agentprobe-diff = agentprobe.diff:main
4
+ agentprobe-validate = agentprobe.validate_scenarios:main
@@ -0,0 +1,109 @@
1
+ Business Source License 1.1
2
+
3
+ Parameters
4
+
5
+ Licensor: Agent-Probe
6
+ Licensed Work: AgentProbe
7
+ The Licensed Work is (c) 2026 Agent-Probe
8
+ Additional Use Grant: You may use, copy, modify, and make production use of
9
+ the Licensed Work for any purpose -- including testing,
10
+ developing, and operating your own software agents --
11
+ free of charge, provided that you do not offer the
12
+ Licensed Work, or a modified or derivative version of
13
+ it, to third parties as part of a hosted, managed, or
14
+ embedded service that competes with a paid product or
15
+ service offered by the Licensor (including, without
16
+ limitation, hosted domain generation, hosted
17
+ dashboards, or hosted test-run storage substantially
18
+ similar to those offered at
19
+ https://agentprobe-api.agentprobe.workers.dev).
20
+ Change Date: 2030-01-01
21
+ Change License: Apache License, Version 2.0
22
+
23
+ For information about alternative licensing arrangements for the Licensed
24
+ Work, please open an issue at https://github.com/Agent-Probe/agentprobe.
25
+
26
+ Notice
27
+
28
+ The Business Source License (this document, or the "License") is not an
29
+ Open Source license. However, the Licensed Work will eventually be made
30
+ available under an Open Source License, as stated in this License.
31
+
32
+ License text copyright (c) 2017 MariaDB Corporation Ab, All Rights
33
+ Reserved. "Business Source License" is a trademark of MariaDB Corporation
34
+ Ab.
35
+
36
+ -----------------------------------------------------------------------------
37
+
38
+ Business Source License 1.1
39
+
40
+ Terms
41
+
42
+ The Licensor hereby grants you the right to copy, modify, create
43
+ derivative works, redistribute, and make non-production use of the
44
+ Licensed Work. The Licensor may make an Additional Use Grant, above,
45
+ permitting limited production use.
46
+
47
+ Effective on the Change Date, or the fourth anniversary of the first
48
+ publicly available distribution of a specific version of the Licensed
49
+ Work under this License, whichever comes first, the Licensor hereby
50
+ grants you rights under the terms of the Change License, and the rights
51
+ granted in the paragraph above terminate.
52
+
53
+ If your use of the Licensed Work does not comply with the requirements
54
+ currently in effect as described in this License, you must purchase a
55
+ commercial license from the Licensor, its affiliated entities, or
56
+ authorized resellers, or you must refrain from using the Licensed Work.
57
+
58
+ All copies of the original and modified Licensed Work, and derivative
59
+ works of the Licensed Work, are subject to this License. This License
60
+ applies separately for each version of the Licensed Work and the Change
61
+ Date may vary for each version of the Licensed Work released by
62
+ Licensor.
63
+
64
+ You must conspicuously display this License on each original or
65
+ modified copy of the Licensed Work. If you receive the Licensed Work in
66
+ original or modified form from a third party, the terms and conditions
67
+ set forth in this License apply to your use of that work.
68
+
69
+ Any use of the Licensed Work in violation of this License will
70
+ automatically terminate your rights under this License for the current
71
+ and all other versions of the Licensed Work.
72
+
73
+ This License does not grant you any right in any trademark or logo of
74
+ Licensor or its affiliates (provided that you may use a trademark or
75
+ logo of Licensor as expressly required by this License).
76
+
77
+ TO THE EXTENT PERMITTED BY APPLICABLE LAW, THE LICENSED WORK IS
78
+ PROVIDED ON AN "AS IS" BASIS. LICENSOR HEREBY DISCLAIMS ALL WARRANTIES
79
+ AND CONDITIONS, EXPRESS OR IMPLIED, INCLUDING (WITHOUT LIMITATION)
80
+ WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE,
81
+ NON-INFRINGEMENT, AND TITLE.
82
+
83
+ MariaDB hereby grants you permission to use this License's text to
84
+ license your works, and to refer to it using the trademark "Business
85
+ Source License", as long as you comply with the Covenants of Licensor
86
+ below.
87
+
88
+ Covenants of Licensor
89
+
90
+ In consideration of the right to use this License's text and the
91
+ "Business Source License" name and trademark, Licensor covenants to
92
+ MariaDB, and to all other recipients of the licensed work to be
93
+ provided by Licensor:
94
+
95
+ 1. To specify as the Change License the GPL Version 2.0 or any later
96
+ version, or a license that is compatible with GPL Version 2.0 or a
97
+ later version, where "compatible" means that software provided
98
+ under the Change License can be included in a program with software
99
+ provided under GPL Version 2.0 or a later version. Licensor may
100
+ specify additional Change Licenses without limitation.
101
+
102
+ 2. To either: (a) specify an additional grant of rights to use that
103
+ does not impose any additional restriction on the right granted in
104
+ this License, as the Additional Use Grant, or (b) insert the text
105
+ "None".
106
+
107
+ 3. To specify a Change Date.
108
+
109
+ 4. Not to modify this License in any other way.
@@ -0,0 +1 @@
1
+ agentprobe