@omniaibot/win-x64 0.3.11 → 1.1.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/bin/omnibot-windows-x64/VERSION +1 -0
- package/bin/omnibot-windows-x64/omnibot/skills/omnibot/SKILL.md +173 -0
- package/bin/omnibot-windows-x64/omnibot/skills/omnibot/references/anti-patterns.md +29 -0
- package/bin/omnibot-windows-x64/omnibot/skills/omnibot/references/command-reference.md +579 -0
- package/bin/omnibot-windows-x64/omnibot/skills/omnibot/references/debugging-and-evidence.md +95 -0
- package/bin/omnibot-windows-x64/omnibot/skills/omnibot/references/fallback-operations.md +157 -0
- package/bin/omnibot-windows-x64/omnibot/skills/omnibot/references/operation-patterns.md +369 -0
- package/bin/omnibot-windows-x64/omnibot/skills/omnibot/references/runtime-and-status.md +89 -0
- package/bin/omnibot-windows-x64/omnibot/skills/omnibot/references/session-and-tabs.md +148 -0
- package/bin/{omnibot-win-x64 → omnibot-windows-x64}/omnibot-windows-x64.exe +0 -0
- package/package.json +5 -2
- package/bin/omnibot-win-x64/VERSION +0 -1
- package/bin/omnibot-win-x64/omnibot/skills/omnibot/SKILL.md +0 -159
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/81d243bd2c585b0f4821__mypyc.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/_asyncio.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/_bz2.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/_cffi_backend.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/_ctypes.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/_decimal.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/_hashlib.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/_lzma.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/_multiprocessing.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/_overlapped.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/_queue.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/_socket.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/_ssl.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/_uuid.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/_wmi.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/certifi/cacert.pem +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/charset_normalizer/cd.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/charset_normalizer/md.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/cryptography/hazmat/bindings/_rust.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/ffi.dll +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/libbz2.dll +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/libcrypto-3-x64.dll +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/libexpat.dll +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/liblzma.dll +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/libmpdec-4.dll +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/libssl-3-x64.dll +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/omnibot/sop/tmwebdriver_sop.md +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/omnibot/sop/vue3_component_sop.md +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/pyexpat.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/python3.dll +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/python313.dll +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/select.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/unicodedata.pyd +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/vcruntime140.dll +0 -0
- /package/bin/{omnibot-win-x64 → omnibot-windows-x64}/zlib.dll +0 -0
|
@@ -0,0 +1,579 @@
|
|
|
1
|
+
# Omnibot Command Reference
|
|
2
|
+
|
|
3
|
+
This is a lookup table, not a behavior guide. Choose behavior from `operation-patterns.md`, use `session-and-tabs.md` for targeting, and use `fallback-operations.md` before dropping to lower tiers.
|
|
4
|
+
|
|
5
|
+
## Runtime & Status
|
|
6
|
+
|
|
7
|
+
### doctor
|
|
8
|
+
|
|
9
|
+
Purpose: Check daemon and browser extension health.
|
|
10
|
+
|
|
11
|
+
```bash
|
|
12
|
+
omnibot doctor
|
|
13
|
+
```
|
|
14
|
+
|
|
15
|
+
Preferred pattern: See `runtime-and-status.md#startup-check`.
|
|
16
|
+
Fallback relation: Not a fallback command.
|
|
17
|
+
|
|
18
|
+
### tabs
|
|
19
|
+
|
|
20
|
+
Purpose: List connected browser tabs and discover tab ids.
|
|
21
|
+
|
|
22
|
+
```bash
|
|
23
|
+
omnibot tabs
|
|
24
|
+
```
|
|
25
|
+
|
|
26
|
+
Preferred pattern: See `session-and-tabs.md#tab-explicit`.
|
|
27
|
+
Fallback relation: Not a fallback command.
|
|
28
|
+
|
|
29
|
+
### license status
|
|
30
|
+
|
|
31
|
+
Purpose: Check license state.
|
|
32
|
+
|
|
33
|
+
```bash
|
|
34
|
+
omnibot license status
|
|
35
|
+
```
|
|
36
|
+
|
|
37
|
+
Preferred pattern: See `runtime-and-status.md#startup-check`.
|
|
38
|
+
Fallback relation: Not a fallback command.
|
|
39
|
+
|
|
40
|
+
## Reading
|
|
41
|
+
|
|
42
|
+
### scan
|
|
43
|
+
|
|
44
|
+
Purpose: Read current rendered viewport, optionally as JSON.
|
|
45
|
+
|
|
46
|
+
```bash
|
|
47
|
+
OMNIBOT_SESSION_TOKEN=research omnibot scan --json --tab-id <TAB_ID>
|
|
48
|
+
OMNIBOT_SESSION_TOKEN=research omnibot scan --text-only --tab-id <TAB_ID>
|
|
49
|
+
```
|
|
50
|
+
|
|
51
|
+
Preferred pattern: See `operation-patterns.md#read` and `operation-patterns.md#extraction`.
|
|
52
|
+
Fallback relation: Before `full-scan`, `dom visible`, or `execute-js`.
|
|
53
|
+
|
|
54
|
+
### full-scan
|
|
55
|
+
|
|
56
|
+
Purpose: Scroll and read more page content, including lazy-loaded content.
|
|
57
|
+
|
|
58
|
+
```bash
|
|
59
|
+
OMNIBOT_SESSION_TOKEN=research omnibot full-scan --duration 5 --text-only --tab-id <TAB_ID>
|
|
60
|
+
```
|
|
61
|
+
|
|
62
|
+
Preferred pattern: See `operation-patterns.md#read` and `operation-patterns.md#extraction`.
|
|
63
|
+
Fallback relation: Use after targeted `get`, `is`, or `scan` are insufficient.
|
|
64
|
+
|
|
65
|
+
### snapshot -i
|
|
66
|
+
|
|
67
|
+
Purpose: Read accessibility tree and produce actionable `@eN` refs.
|
|
68
|
+
|
|
69
|
+
```bash
|
|
70
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot snapshot -i --tab-id <TAB_ID>
|
|
71
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot snapshot -i -c -d 4 --tab-id <TAB_ID>
|
|
72
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot snapshot -i -s "#main" -u --tab-id <TAB_ID>
|
|
73
|
+
```
|
|
74
|
+
|
|
75
|
+
Preferred pattern: See `operation-patterns.md#click`, `operation-patterns.md#fill`, and `session-and-tabs.md#ref-scope`.
|
|
76
|
+
Fallback relation: Tier 2 after semantic find.
|
|
77
|
+
|
|
78
|
+
### get
|
|
79
|
+
|
|
80
|
+
Purpose: Read one value or element state without dumping the page.
|
|
81
|
+
|
|
82
|
+
```bash
|
|
83
|
+
OMNIBOT_SESSION_TOKEN=research omnibot get title --tab-id <TAB_ID>
|
|
84
|
+
OMNIBOT_SESSION_TOKEN=research omnibot get url --tab-id <TAB_ID>
|
|
85
|
+
OMNIBOT_SESSION_TOKEN=research omnibot get text "#main" --tab-id <TAB_ID>
|
|
86
|
+
OMNIBOT_SESSION_TOKEN=research omnibot get html "#main" --tab-id <TAB_ID>
|
|
87
|
+
OMNIBOT_SESSION_TOKEN=research omnibot get value "input[name=email]" --tab-id <TAB_ID>
|
|
88
|
+
OMNIBOT_SESSION_TOKEN=research omnibot get attr "a.login" href --tab-id <TAB_ID>
|
|
89
|
+
OMNIBOT_SESSION_TOKEN=research omnibot get count ".item" --tab-id <TAB_ID>
|
|
90
|
+
OMNIBOT_SESSION_TOKEN=research omnibot get box "#submit" --tab-id <TAB_ID>
|
|
91
|
+
OMNIBOT_SESSION_TOKEN=research omnibot get styles "#submit" --tab-id <TAB_ID>
|
|
92
|
+
```
|
|
93
|
+
|
|
94
|
+
Preferred pattern: See `operation-patterns.md#read` and `operation-patterns.md#extraction`.
|
|
95
|
+
Fallback relation: Selector tier for reading; escalate only if unavailable.
|
|
96
|
+
|
|
97
|
+
### is
|
|
98
|
+
|
|
99
|
+
Purpose: Check element state.
|
|
100
|
+
|
|
101
|
+
```bash
|
|
102
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot is visible "#submit" --tab-id <TAB_ID>
|
|
103
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot is enabled "#submit" --tab-id <TAB_ID>
|
|
104
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot is checked "#agree" --tab-id <TAB_ID>
|
|
105
|
+
```
|
|
106
|
+
|
|
107
|
+
Preferred pattern: See `operation-patterns.md#read` and `operation-patterns.md#select--check`.
|
|
108
|
+
Fallback relation: Prefer before visual or JavaScript checks.
|
|
109
|
+
|
|
110
|
+
## Actions
|
|
111
|
+
|
|
112
|
+
### click
|
|
113
|
+
|
|
114
|
+
Purpose: Click an element by `@eN` ref or selector.
|
|
115
|
+
|
|
116
|
+
```bash
|
|
117
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot click --tab-id <TAB_ID> @e4
|
|
118
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot click --tab-id <TAB_ID> @e4 --new-tab
|
|
119
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot click "button[type=submit]" --tab-id <TAB_ID>
|
|
120
|
+
```
|
|
121
|
+
|
|
122
|
+
Preferred pattern: See `operation-patterns.md#click`.
|
|
123
|
+
Fallback relation: Tier 2 with refs, Tier 3 with selector.
|
|
124
|
+
|
|
125
|
+
### dblclick
|
|
126
|
+
|
|
127
|
+
Purpose: Double-click an element by `@eN` ref or selector.
|
|
128
|
+
|
|
129
|
+
```bash
|
|
130
|
+
OMNIBOT_SESSION_TOKEN=editor omnibot dblclick --tab-id <TAB_ID> @e7
|
|
131
|
+
```
|
|
132
|
+
|
|
133
|
+
Preferred pattern: See `operation-patterns.md#click`.
|
|
134
|
+
Fallback relation: Prefer semantic or snapshot first; then selector.
|
|
135
|
+
|
|
136
|
+
### fill
|
|
137
|
+
|
|
138
|
+
Purpose: Replace an input value.
|
|
139
|
+
|
|
140
|
+
```bash
|
|
141
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot fill --tab-id <TAB_ID> @e2 "a@b.com"
|
|
142
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot fill "input[name=email]" "a@b.com" --tab-id <TAB_ID>
|
|
143
|
+
```
|
|
144
|
+
|
|
145
|
+
Preferred pattern: See `operation-patterns.md#fill`.
|
|
146
|
+
Fallback relation: Tier 2 with refs, Tier 3 with selector.
|
|
147
|
+
|
|
148
|
+
### type
|
|
149
|
+
|
|
150
|
+
Purpose: Type text into an element.
|
|
151
|
+
|
|
152
|
+
```bash
|
|
153
|
+
OMNIBOT_SESSION_TOKEN=search omnibot type --tab-id <TAB_ID> @e3 "omnibot"
|
|
154
|
+
```
|
|
155
|
+
|
|
156
|
+
Preferred pattern: See `operation-patterns.md#fill`.
|
|
157
|
+
Fallback relation: Use after fill is not appropriate or focus is needed.
|
|
158
|
+
|
|
159
|
+
### press
|
|
160
|
+
|
|
161
|
+
Purpose: Press a key in the target tab.
|
|
162
|
+
|
|
163
|
+
```bash
|
|
164
|
+
OMNIBOT_SESSION_TOKEN=search omnibot press Enter --tab-id <TAB_ID>
|
|
165
|
+
```
|
|
166
|
+
|
|
167
|
+
Preferred pattern: See `operation-patterns.md#fill` and `operation-patterns.md#wait`.
|
|
168
|
+
Fallback relation: Not a fallback by itself; verify after pressing.
|
|
169
|
+
|
|
170
|
+
### hover
|
|
171
|
+
|
|
172
|
+
Purpose: Hover an element by ref or selector.
|
|
173
|
+
|
|
174
|
+
```bash
|
|
175
|
+
OMNIBOT_SESSION_TOKEN=menu omnibot hover --tab-id <TAB_ID> @e5
|
|
176
|
+
```
|
|
177
|
+
|
|
178
|
+
Preferred pattern: Observe menu state, hover, then verify visible options.
|
|
179
|
+
Fallback relation: Use mouse move only if hover fails.
|
|
180
|
+
|
|
181
|
+
### focus
|
|
182
|
+
|
|
183
|
+
Purpose: Focus an element by selector.
|
|
184
|
+
|
|
185
|
+
```bash
|
|
186
|
+
OMNIBOT_SESSION_TOKEN=form omnibot focus "input[name=email]" --tab-id <TAB_ID>
|
|
187
|
+
```
|
|
188
|
+
|
|
189
|
+
Preferred pattern: See `operation-patterns.md#fill`.
|
|
190
|
+
Fallback relation: Selector tier before keyboard/type fallback.
|
|
191
|
+
|
|
192
|
+
### select
|
|
193
|
+
|
|
194
|
+
Purpose: Select an option in a dropdown.
|
|
195
|
+
|
|
196
|
+
```bash
|
|
197
|
+
OMNIBOT_SESSION_TOKEN=form omnibot select @e5 "US" --tab-id <TAB_ID>
|
|
198
|
+
```
|
|
199
|
+
|
|
200
|
+
Preferred pattern: See `operation-patterns.md#select--check`.
|
|
201
|
+
Fallback relation: Prefer refs/selectors before JavaScript value changes.
|
|
202
|
+
|
|
203
|
+
### check / uncheck
|
|
204
|
+
|
|
205
|
+
Purpose: Set checkbox state.
|
|
206
|
+
|
|
207
|
+
```bash
|
|
208
|
+
OMNIBOT_SESSION_TOKEN=form omnibot check @e6 --tab-id <TAB_ID>
|
|
209
|
+
OMNIBOT_SESSION_TOKEN=form omnibot uncheck @e6 --tab-id <TAB_ID>
|
|
210
|
+
```
|
|
211
|
+
|
|
212
|
+
Preferred pattern: See `operation-patterns.md#select--check`.
|
|
213
|
+
Fallback relation: Verify with `is checked` before and after.
|
|
214
|
+
|
|
215
|
+
### scroll / scrollintoview
|
|
216
|
+
|
|
217
|
+
Purpose: Scroll page or element.
|
|
218
|
+
|
|
219
|
+
```bash
|
|
220
|
+
OMNIBOT_SESSION_TOKEN=read omnibot scroll down 500 --tab-id <TAB_ID>
|
|
221
|
+
OMNIBOT_SESSION_TOKEN=read omnibot scroll down 500 --selector "#list" --tab-id <TAB_ID>
|
|
222
|
+
OMNIBOT_SESSION_TOKEN=read omnibot scrollintoview @e7 --tab-id <TAB_ID>
|
|
223
|
+
```
|
|
224
|
+
|
|
225
|
+
Preferred pattern: See `operation-patterns.md#read` and `operation-patterns.md#extraction`.
|
|
226
|
+
Fallback relation: DOM or mouse scroll only after standard scroll fails.
|
|
227
|
+
|
|
228
|
+
### drag
|
|
229
|
+
|
|
230
|
+
Purpose: Drag from one element to another.
|
|
231
|
+
|
|
232
|
+
```bash
|
|
233
|
+
OMNIBOT_SESSION_TOKEN=board omnibot drag @e8 @e9 --tab-id <TAB_ID>
|
|
234
|
+
```
|
|
235
|
+
|
|
236
|
+
Preferred pattern: Observe source and target, drag, verify position/state.
|
|
237
|
+
Fallback relation: Mouse drag is Tier 5 if element drag fails.
|
|
238
|
+
|
|
239
|
+
### upload
|
|
240
|
+
|
|
241
|
+
Purpose: Upload a local file through a file input.
|
|
242
|
+
|
|
243
|
+
```bash
|
|
244
|
+
OMNIBOT_SESSION_TOKEN=form omnibot upload "input[type=file]" /path/to/file.png --tab-id <TAB_ID>
|
|
245
|
+
```
|
|
246
|
+
|
|
247
|
+
Preferred pattern: See `operation-patterns.md#upload`.
|
|
248
|
+
Fallback relation: Use JavaScript only if native upload cannot reach the input.
|
|
249
|
+
|
|
250
|
+
## Semantic Find
|
|
251
|
+
|
|
252
|
+
Semantic find is Tier 1 for operating by meaning.
|
|
253
|
+
|
|
254
|
+
```bash
|
|
255
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot find role button --name "Submit" --action click --tab-id <TAB_ID>
|
|
256
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot find text "Sign in" --action click --tab-id <TAB_ID>
|
|
257
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot find label "Email" --action fill --action-value "a@b.com" --tab-id <TAB_ID>
|
|
258
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot find placeholder "Search" --action type --action-value "omnibot" --tab-id <TAB_ID>
|
|
259
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot find testid submit-button --action click --tab-id <TAB_ID>
|
|
260
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot find nth ".card" 2 --action click --tab-id <TAB_ID>
|
|
261
|
+
```
|
|
262
|
+
|
|
263
|
+
Preferred pattern: See `operation-patterns.md#click` and `operation-patterns.md#fill`.
|
|
264
|
+
Fallback relation: Tier 1. Explain failure before using refs, selectors, DOM, mouse, JavaScript, or CDP.
|
|
265
|
+
|
|
266
|
+
## Fallback Actions
|
|
267
|
+
|
|
268
|
+
### mouse
|
|
269
|
+
|
|
270
|
+
Purpose: Coordinate-based mouse operations.
|
|
271
|
+
Usage tier: Tier 5 fallback only.
|
|
272
|
+
|
|
273
|
+
```bash
|
|
274
|
+
OMNIBOT_SESSION_TOKEN=repair omnibot mouse click --x 100 --y 200 --tab-id <TAB_ID>
|
|
275
|
+
OMNIBOT_SESSION_TOKEN=repair omnibot mouse click --x 100 --y 200 --click-count 2 --tab-id <TAB_ID>
|
|
276
|
+
OMNIBOT_SESSION_TOKEN=repair omnibot mouse move --x 50 --y 60 --tab-id <TAB_ID>
|
|
277
|
+
OMNIBOT_SESSION_TOKEN=repair omnibot mouse scroll --x 100 --y 200 --dy 500 --tab-id <TAB_ID>
|
|
278
|
+
OMNIBOT_SESSION_TOKEN=repair omnibot mouse drag --from-x 10 --from-y 20 --to-x 100 --to-y 200 --tab-id <TAB_ID>
|
|
279
|
+
```
|
|
280
|
+
|
|
281
|
+
Preferred pattern: See `fallback-operations.md#mouse-fallback`.
|
|
282
|
+
Fallback relation: After semantic, refs, selector, and DOM fail.
|
|
283
|
+
|
|
284
|
+
### dom
|
|
285
|
+
|
|
286
|
+
Purpose: Interact with visible DOM node ids returned by `dom visible`.
|
|
287
|
+
Usage tier: Tier 4 fallback only.
|
|
288
|
+
|
|
289
|
+
```bash
|
|
290
|
+
OMNIBOT_SESSION_TOKEN=repair omnibot dom visible --tab-id <TAB_ID>
|
|
291
|
+
OMNIBOT_SESSION_TOKEN=repair omnibot dom click n1 --tab-id <TAB_ID>
|
|
292
|
+
OMNIBOT_SESSION_TOKEN=repair omnibot dom dblclick n1 --tab-id <TAB_ID>
|
|
293
|
+
OMNIBOT_SESSION_TOKEN=repair omnibot dom scroll n1 --dy 800 --tab-id <TAB_ID>
|
|
294
|
+
```
|
|
295
|
+
|
|
296
|
+
Preferred pattern: See `fallback-operations.md#dom-fallback`.
|
|
297
|
+
Fallback relation: After selector failure and before mouse fallback.
|
|
298
|
+
|
|
299
|
+
### execute-js
|
|
300
|
+
|
|
301
|
+
Purpose: Run arbitrary JavaScript in the page.
|
|
302
|
+
Usage tier: Tier 6 fallback only. Do not use first.
|
|
303
|
+
|
|
304
|
+
```bash
|
|
305
|
+
OMNIBOT_SESSION_TOKEN=repair omnibot execute-js "return location.href" --tab-id <TAB_ID>
|
|
306
|
+
OMNIBOT_SESSION_TOKEN=repair omnibot execute-js --file /tmp/repair.js --tab-id <TAB_ID>
|
|
307
|
+
```
|
|
308
|
+
|
|
309
|
+
Preferred pattern: See `fallback-operations.md#javascript-fallback`.
|
|
310
|
+
Fallback relation: After semantic, refs, selector, DOM, and mouse are insufficient.
|
|
311
|
+
|
|
312
|
+
### cdp
|
|
313
|
+
|
|
314
|
+
Purpose: Send raw Chrome DevTools Protocol commands.
|
|
315
|
+
Usage tier: Tier 7 fallback and inspection only.
|
|
316
|
+
|
|
317
|
+
```bash
|
|
318
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot cdp Runtime.evaluate '{"expression":"document.title"}' --tab-id <TAB_ID>
|
|
319
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot cdp DOM.getDocument '{"depth":1}' --tab-id <TAB_ID>
|
|
320
|
+
```
|
|
321
|
+
|
|
322
|
+
Preferred pattern: See `fallback-operations.md#raw-cdp-fallback` and `debugging-and-evidence.md#cdp-inspection`.
|
|
323
|
+
Fallback relation: Last resort.
|
|
324
|
+
|
|
325
|
+
## Navigation & Tabs
|
|
326
|
+
|
|
327
|
+
### navigate / open / goto
|
|
328
|
+
|
|
329
|
+
Purpose: Navigate or open pages. These commands create or use CLI target state; record the resulting tab id and use `--tab-id` afterward.
|
|
330
|
+
|
|
331
|
+
```bash
|
|
332
|
+
OMNIBOT_SESSION_TOKEN=research omnibot navigate https://example.com
|
|
333
|
+
OMNIBOT_SESSION_TOKEN=research omnibot navigate --same-tab https://example.com
|
|
334
|
+
OMNIBOT_SESSION_TOKEN=research omnibot open https://example.com
|
|
335
|
+
OMNIBOT_SESSION_TOKEN=research omnibot goto https://example.com
|
|
336
|
+
```
|
|
337
|
+
|
|
338
|
+
Preferred pattern: See `operation-patterns.md#navigation` and `session-and-tabs.md#tab-explicit`.
|
|
339
|
+
Fallback relation: Verify with `get url --tab-id <TAB_ID>` before continuing.
|
|
340
|
+
|
|
341
|
+
### close / back / forward / reload / pushstate
|
|
342
|
+
|
|
343
|
+
Purpose: Change tab lifecycle or history state.
|
|
344
|
+
|
|
345
|
+
```bash
|
|
346
|
+
OMNIBOT_SESSION_TOKEN=research omnibot close <TAB_ID>
|
|
347
|
+
OMNIBOT_SESSION_TOKEN=research omnibot back --tab-id <TAB_ID>
|
|
348
|
+
OMNIBOT_SESSION_TOKEN=research omnibot forward --tab-id <TAB_ID>
|
|
349
|
+
OMNIBOT_SESSION_TOKEN=research omnibot reload --tab-id <TAB_ID>
|
|
350
|
+
OMNIBOT_SESSION_TOKEN=research omnibot pushstate /dashboard --tab-id <TAB_ID>
|
|
351
|
+
```
|
|
352
|
+
|
|
353
|
+
Preferred pattern: See `operation-patterns.md#navigation`.
|
|
354
|
+
Fallback relation: Verify URL or page state after the action.
|
|
355
|
+
|
|
356
|
+
### tab
|
|
357
|
+
|
|
358
|
+
Purpose: Manage browser tabs.
|
|
359
|
+
|
|
360
|
+
```bash
|
|
361
|
+
OMNIBOT_SESSION_TOKEN=research omnibot tab list
|
|
362
|
+
OMNIBOT_SESSION_TOKEN=research omnibot tab new https://docs.example.com --label docs
|
|
363
|
+
OMNIBOT_SESSION_TOKEN=research omnibot tab switch docs
|
|
364
|
+
OMNIBOT_SESSION_TOKEN=research omnibot tab close docs
|
|
365
|
+
```
|
|
366
|
+
|
|
367
|
+
Preferred pattern: See `session-and-tabs.md#tab-explicit`.
|
|
368
|
+
Fallback relation: `tab switch` is casual only; do not use it as workflow state.
|
|
369
|
+
|
|
370
|
+
### window / frame / switch-tab / focus-tab
|
|
371
|
+
|
|
372
|
+
Purpose: Manage windows, frames, and visible browser focus.
|
|
373
|
+
|
|
374
|
+
```bash
|
|
375
|
+
OMNIBOT_SESSION_TOKEN=research omnibot window new
|
|
376
|
+
OMNIBOT_SESSION_TOKEN=research omnibot frame main
|
|
377
|
+
OMNIBOT_SESSION_TOKEN=research omnibot switch-tab 123
|
|
378
|
+
OMNIBOT_SESSION_TOKEN=research omnibot focus-tab 123
|
|
379
|
+
```
|
|
380
|
+
|
|
381
|
+
Preferred pattern: See `session-and-tabs.md#switch-tab` and `session-and-tabs.md#focus-tab`.
|
|
382
|
+
Fallback relation: `focus-tab` is for user-visible UI, not targeting reliability.
|
|
383
|
+
|
|
384
|
+
## Waiting & Batch
|
|
385
|
+
|
|
386
|
+
### wait
|
|
387
|
+
|
|
388
|
+
Purpose: Wait for time, selector, text, URL, load state, or JavaScript condition.
|
|
389
|
+
|
|
390
|
+
```bash
|
|
391
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot wait 500 --tab-id <TAB_ID>
|
|
392
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot wait "#ready" --tab-id <TAB_ID>
|
|
393
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot wait "#spinner" --state hidden --tab-id <TAB_ID>
|
|
394
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot wait --text "Welcome" --tab-id <TAB_ID>
|
|
395
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot wait --url "/dashboard" --tab-id <TAB_ID>
|
|
396
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot wait --load domcontentloaded --tab-id <TAB_ID>
|
|
397
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot wait --load networkidle --tab-id <TAB_ID>
|
|
398
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot wait --fn "window.appReady === true" --tab-id <TAB_ID>
|
|
399
|
+
```
|
|
400
|
+
|
|
401
|
+
Preferred pattern: See `operation-patterns.md#wait`.
|
|
402
|
+
Fallback relation: Prefer over shell sleep.
|
|
403
|
+
|
|
404
|
+
### batch
|
|
405
|
+
|
|
406
|
+
Purpose: Send short command arrays as JSON or from a file.
|
|
407
|
+
|
|
408
|
+
```bash
|
|
409
|
+
OMNIBOT_SESSION_TOKEN=research omnibot batch '[{"cmd":"scan"},{"cmd":"snapshot","interactive":true}]' --tab-id <TAB_ID>
|
|
410
|
+
OMNIBOT_SESSION_TOKEN=research omnibot batch --file /tmp/omnibot-batch.json --tab-id <TAB_ID>
|
|
411
|
+
```
|
|
412
|
+
|
|
413
|
+
Preferred pattern: See `operation-patterns.md#batch`.
|
|
414
|
+
Fallback relation: Not a substitute for verification.
|
|
415
|
+
|
|
416
|
+
## Debugging
|
|
417
|
+
|
|
418
|
+
### screenshot
|
|
419
|
+
|
|
420
|
+
Purpose: Capture visual evidence from a browser tab.
|
|
421
|
+
|
|
422
|
+
```bash
|
|
423
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot screenshot --tab-id <TAB_ID> -o /tmp/omni-shot.png
|
|
424
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot screenshot --annotate --tab-id <TAB_ID> -o /tmp/omni-annotated.png
|
|
425
|
+
```
|
|
426
|
+
|
|
427
|
+
Preferred pattern: See `debugging-and-evidence.md#screenshot`.
|
|
428
|
+
Fallback relation: Evidence collection, not operation fallback.
|
|
429
|
+
|
|
430
|
+
### console
|
|
431
|
+
|
|
432
|
+
Purpose: Read or clear browser console evidence.
|
|
433
|
+
|
|
434
|
+
```bash
|
|
435
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot console logs --tab-id <TAB_ID>
|
|
436
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot console errors --tab-id <TAB_ID>
|
|
437
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot console clear --tab-id <TAB_ID>
|
|
438
|
+
```
|
|
439
|
+
|
|
440
|
+
Preferred pattern: See `debugging-and-evidence.md#console`.
|
|
441
|
+
Fallback relation: Evidence collection, not operation fallback.
|
|
442
|
+
|
|
443
|
+
### network
|
|
444
|
+
|
|
445
|
+
Purpose: Read browser network evidence.
|
|
446
|
+
|
|
447
|
+
```bash
|
|
448
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot network logs --tab-id <TAB_ID>
|
|
449
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot network summary --tab-id <TAB_ID>
|
|
450
|
+
```
|
|
451
|
+
|
|
452
|
+
Preferred pattern: See `debugging-and-evidence.md#network`.
|
|
453
|
+
Fallback relation: Evidence collection, not operation fallback.
|
|
454
|
+
|
|
455
|
+
## Browser Capabilities
|
|
456
|
+
|
|
457
|
+
### clipboard
|
|
458
|
+
|
|
459
|
+
Purpose: Read or write browser clipboard.
|
|
460
|
+
|
|
461
|
+
```bash
|
|
462
|
+
OMNIBOT_SESSION_TOKEN=research omnibot clipboard read --tab-id <TAB_ID>
|
|
463
|
+
OMNIBOT_SESSION_TOKEN=research omnibot clipboard write "text" --tab-id <TAB_ID>
|
|
464
|
+
```
|
|
465
|
+
|
|
466
|
+
Preferred pattern: See `operation-patterns.md#extraction`.
|
|
467
|
+
Fallback relation: Use only when clipboard is part of the browser task.
|
|
468
|
+
|
|
469
|
+
### viewport
|
|
470
|
+
|
|
471
|
+
Purpose: Read or set viewport size.
|
|
472
|
+
|
|
473
|
+
```bash
|
|
474
|
+
OMNIBOT_SESSION_TOKEN=visual omnibot viewport get --tab-id <TAB_ID>
|
|
475
|
+
OMNIBOT_SESSION_TOKEN=visual omnibot viewport set 1280 720 --tab-id <TAB_ID>
|
|
476
|
+
```
|
|
477
|
+
|
|
478
|
+
Preferred pattern: Set explicit viewport before visual verification if layout matters.
|
|
479
|
+
Fallback relation: Not a fallback command.
|
|
480
|
+
|
|
481
|
+
### assets
|
|
482
|
+
|
|
483
|
+
Purpose: List or export page resources.
|
|
484
|
+
|
|
485
|
+
```bash
|
|
486
|
+
OMNIBOT_SESSION_TOKEN=extract omnibot assets list --tab-id <TAB_ID>
|
|
487
|
+
OMNIBOT_SESSION_TOKEN=extract omnibot assets export -o /tmp/assets.zip --tab-id <TAB_ID>
|
|
488
|
+
```
|
|
489
|
+
|
|
490
|
+
Preferred pattern: See `operation-patterns.md#extraction`.
|
|
491
|
+
Fallback relation: Use after page content indicates assets are needed.
|
|
492
|
+
|
|
493
|
+
## Visibility & Sessions
|
|
494
|
+
|
|
495
|
+
### visibility
|
|
496
|
+
|
|
497
|
+
Purpose: Inspect, set, or launch automation browser visibility mode.
|
|
498
|
+
|
|
499
|
+
```bash
|
|
500
|
+
omnibot visibility status
|
|
501
|
+
omnibot visibility set background
|
|
502
|
+
omnibot visibility set visible
|
|
503
|
+
omnibot visibility set headless --user-data-dir /tmp/omnibot-headless
|
|
504
|
+
omnibot visibility launch headless --user-data-dir /tmp/omnibot-headless
|
|
505
|
+
```
|
|
506
|
+
|
|
507
|
+
Preferred pattern: See `session-and-tabs.md#visibility`.
|
|
508
|
+
Fallback relation: Headless does not inherit existing user login state.
|
|
509
|
+
|
|
510
|
+
### browser
|
|
511
|
+
|
|
512
|
+
Purpose: Manage browser runtime ownership.
|
|
513
|
+
|
|
514
|
+
```bash
|
|
515
|
+
OMNIBOT_SESSION_TOKEN=research omnibot browser list
|
|
516
|
+
OMNIBOT_SESSION_TOKEN=research omnibot browser current
|
|
517
|
+
OMNIBOT_SESSION_TOKEN=research omnibot browser claim 123
|
|
518
|
+
OMNIBOT_SESSION_TOKEN=research omnibot browser release 123
|
|
519
|
+
```
|
|
520
|
+
|
|
521
|
+
Preferred pattern: See `session-and-tabs.md#browser-claimrelease`.
|
|
522
|
+
Fallback relation: Use in multi-browser or multi-runtime scenarios.
|
|
523
|
+
|
|
524
|
+
### session
|
|
525
|
+
|
|
526
|
+
Purpose: Name or list sessions.
|
|
527
|
+
|
|
528
|
+
```bash
|
|
529
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot session name "checkout"
|
|
530
|
+
OMNIBOT_SESSION_TOKEN=checkout omnibot session list
|
|
531
|
+
```
|
|
532
|
+
|
|
533
|
+
Preferred pattern: See `session-and-tabs.md#session-first`.
|
|
534
|
+
Fallback relation: Not a fallback command.
|
|
535
|
+
|
|
536
|
+
## Recording & Trace
|
|
537
|
+
|
|
538
|
+
### record / replay / trace
|
|
539
|
+
|
|
540
|
+
Purpose: Capture, replay, or trace workflows for evidence.
|
|
541
|
+
|
|
542
|
+
```bash
|
|
543
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot record start
|
|
544
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot record stop -o flow.json
|
|
545
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot replay flow.json
|
|
546
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot trace start
|
|
547
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot trace stop -o trace.zip
|
|
548
|
+
```
|
|
549
|
+
|
|
550
|
+
Preferred pattern: See `debugging-and-evidence.md#record-and-replay` and `debugging-and-evidence.md#trace`.
|
|
551
|
+
Fallback relation: Evidence collection, not operation fallback.
|
|
552
|
+
|
|
553
|
+
## Skills & License
|
|
554
|
+
|
|
555
|
+
### skills install / skills path
|
|
556
|
+
|
|
557
|
+
Purpose: Install packaged omnibot skills or show the packaged skills path.
|
|
558
|
+
|
|
559
|
+
```bash
|
|
560
|
+
omnibot skills install --agent hermes --profile nuwa
|
|
561
|
+
omnibot skills install --agent opencode
|
|
562
|
+
omnibot skills install --agent claude
|
|
563
|
+
omnibot skills install --agent codex
|
|
564
|
+
omnibot skills path
|
|
565
|
+
```
|
|
566
|
+
|
|
567
|
+
Preferred pattern: See `runtime-and-status.md#skills-path`.
|
|
568
|
+
Fallback relation: Not a fallback command.
|
|
569
|
+
|
|
570
|
+
### license status
|
|
571
|
+
|
|
572
|
+
Purpose: Inspect license status.
|
|
573
|
+
|
|
574
|
+
```bash
|
|
575
|
+
omnibot license status
|
|
576
|
+
```
|
|
577
|
+
|
|
578
|
+
Preferred pattern: See `runtime-and-status.md#startup-check`.
|
|
579
|
+
Fallback relation: Not a fallback command.
|
|
@@ -0,0 +1,95 @@
|
|
|
1
|
+
# Debugging and Evidence
|
|
2
|
+
|
|
3
|
+
Debugging is for evidence. Fallback is for completing operations.
|
|
4
|
+
|
|
5
|
+
Use this file when you need to prove browser state, explain a failure, or collect artifacts for review. Do not use `execute-js` as the first debug tool.
|
|
6
|
+
|
|
7
|
+
## Screenshot
|
|
8
|
+
|
|
9
|
+
Use screenshots when visual layout, canvas, dialogs, or visual regressions matter.
|
|
10
|
+
|
|
11
|
+
```bash
|
|
12
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot screenshot --tab-id <TAB_ID> -o /tmp/omni-shot.png
|
|
13
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot screenshot --annotate --tab-id <TAB_ID> -o /tmp/omni-annotated.png
|
|
14
|
+
```
|
|
15
|
+
|
|
16
|
+
Prefer text extraction when text is enough. Screenshot is evidence, not extraction.
|
|
17
|
+
|
|
18
|
+
## Console
|
|
19
|
+
|
|
20
|
+
Use console logs for runtime JavaScript errors, frontend warnings, or app-level diagnostics.
|
|
21
|
+
|
|
22
|
+
```bash
|
|
23
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot console errors --tab-id <TAB_ID>
|
|
24
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot console logs --tab-id <TAB_ID>
|
|
25
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot console clear --tab-id <TAB_ID>
|
|
26
|
+
```
|
|
27
|
+
|
|
28
|
+
Collect console errors before and after the action when debugging regressions.
|
|
29
|
+
|
|
30
|
+
## Network
|
|
31
|
+
|
|
32
|
+
Use network logs for failed requests, redirects, blocked assets, API errors, or loading stalls.
|
|
33
|
+
|
|
34
|
+
```bash
|
|
35
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot network summary --tab-id <TAB_ID>
|
|
36
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot network logs --tab-id <TAB_ID>
|
|
37
|
+
```
|
|
38
|
+
|
|
39
|
+
Pair network evidence with page verification:
|
|
40
|
+
|
|
41
|
+
```bash
|
|
42
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot get text "#main" --tab-id <TAB_ID>
|
|
43
|
+
```
|
|
44
|
+
|
|
45
|
+
## Trace
|
|
46
|
+
|
|
47
|
+
Use trace for a reproducible artifact around a failing workflow.
|
|
48
|
+
|
|
49
|
+
```bash
|
|
50
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot trace start
|
|
51
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot click --tab-id <TAB_ID> @e4
|
|
52
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot snapshot -i --tab-id <TAB_ID>
|
|
53
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot trace stop -o trace.zip
|
|
54
|
+
```
|
|
55
|
+
|
|
56
|
+
Trace is evidence. It does not replace operation verification.
|
|
57
|
+
|
|
58
|
+
## Record and Replay
|
|
59
|
+
|
|
60
|
+
Use record/replay when a flow must be captured or reproduced.
|
|
61
|
+
|
|
62
|
+
```bash
|
|
63
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot record start
|
|
64
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot click --tab-id <TAB_ID> @e4
|
|
65
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot snapshot -i --tab-id <TAB_ID>
|
|
66
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot record stop -o flow.json
|
|
67
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot replay flow.json
|
|
68
|
+
```
|
|
69
|
+
|
|
70
|
+
After replay, verify final state:
|
|
71
|
+
|
|
72
|
+
```bash
|
|
73
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot get url --tab-id <TAB_ID>
|
|
74
|
+
```
|
|
75
|
+
|
|
76
|
+
## CDP Inspection
|
|
77
|
+
|
|
78
|
+
Use CDP for low-level inspection when normal evidence is insufficient.
|
|
79
|
+
|
|
80
|
+
```bash
|
|
81
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot cdp Runtime.evaluate '{"expression":"document.title"}' --tab-id <TAB_ID>
|
|
82
|
+
OMNIBOT_SESSION_TOKEN=debug omnibot cdp DOM.getDocument '{"depth":1}' --tab-id <TAB_ID>
|
|
83
|
+
```
|
|
84
|
+
|
|
85
|
+
CDP inspection is not a first-choice operation path. If CDP changes state, it becomes Tier 7 fallback and must follow `fallback-operations.md#raw-cdp-fallback`.
|
|
86
|
+
|
|
87
|
+
## Evidence Checklist
|
|
88
|
+
|
|
89
|
+
Before reporting a browser issue, collect the smallest evidence set that explains it:
|
|
90
|
+
|
|
91
|
+
- Runtime: `doctor`, `tabs`, `visibility status`.
|
|
92
|
+
- Page state: `get`, `is`, `scan`, or `snapshot`.
|
|
93
|
+
- Visual proof: `screenshot --annotate` only if visual state matters.
|
|
94
|
+
- Browser diagnostics: `console errors` and `network summary`.
|
|
95
|
+
- Reproduction artifact: `trace` or `record` when the flow is unstable.
|