@uipath/skills 1.201.0-preview.621 → 1.202.0-preview.635
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.claude-plugin/marketplace.json +1 -1
- package/.claude-plugin/plugin.json +1 -1
- package/.cursor-plugin/plugin.json +1 -1
- package/CODEOWNERS +41 -29
- package/README.md +1 -0
- package/assets/skill-status.json +13 -2
- package/assets/uip-catalog-snapshot.json +95 -46
- package/package.json +2 -1
- package/skills/uipath-admin/SKILL.md +107 -197
- package/skills/uipath-admin/references/audit-commands.md +69 -120
- package/skills/uipath-admin/references/audit-workflow-guide.md +101 -152
- package/skills/uipath-admin/references/authorization/authorization-commands.md +121 -210
- package/skills/uipath-admin/references/authorization/check-access.md +39 -63
- package/skills/uipath-admin/references/authorization/grant-permissions.md +38 -49
- package/skills/uipath-admin/references/authorization/permission-catalog.md +32 -34
- package/skills/uipath-admin/references/authorization/role-assignment-management.md +96 -99
- package/skills/uipath-admin/references/authorization/role-management.md +113 -142
- package/skills/uipath-admin/references/diagnose/CAPABILITY.md +13 -14
- package/skills/uipath-admin/references/diagnose/{references/failure-modes.md → failure-modes.md} +90 -46
- package/skills/uipath-admin/references/diagnose/{references/troubleshooting-guide.md → troubleshooting-guide.md} +21 -14
- package/skills/uipath-admin/references/external-app-management.md +42 -39
- package/skills/uipath-admin/references/identity-commands.md +72 -625
- package/skills/uipath-admin/references/identity-troubleshoot-guide.md +73 -95
- package/skills/uipath-admin/references/ip-restriction/bypass-rule-management.md +25 -54
- package/skills/uipath-admin/references/ip-restriction/enforcement-management.md +19 -31
- package/skills/uipath-admin/references/ip-restriction/ip-range-management.md +48 -45
- package/skills/uipath-admin/references/ip-restriction/ip-restriction-commands.md +89 -146
- package/skills/uipath-admin/references/key-concepts.md +24 -0
- package/skills/uipath-admin/references/organization-management.md +49 -70
- package/skills/uipath-admin/references/organizations-commands.md +39 -74
- package/skills/uipath-admin/references/pat-management.md +25 -38
- package/skills/uipath-admin/references/robot-account-management.md +16 -14
- package/skills/uipath-admin/references/smtp-management.md +19 -14
- package/skills/uipath-admin/references/tenant-management.md +1 -1
- package/skills/uipath-admin/references/tenants-commands.md +82 -148
- package/skills/uipath-admin/references/user-management.md +70 -56
- package/skills/uipath-agents/SKILL.md +4 -3
- package/skills/uipath-agents/references/authentication.md +4 -3
- package/skills/uipath-agents/references/coded/capabilities/datafabric.md +465 -0
- package/skills/uipath-agents/references/coded/capabilities/guardrails/guardrails-recommend.md +5 -0
- package/skills/uipath-agents/references/coded/capabilities/guardrails/guardrails.md +2 -0
- package/skills/uipath-agents/references/coded/capabilities/human-in-the-loop.md +12 -6
- package/skills/uipath-agents/references/coded/flow-integration.md +2 -2
- package/skills/uipath-agents/references/coded/frameworks/langgraph-integration.md +48 -16
- package/skills/uipath-agents/references/coded/frameworks/openai-agents-integration.md +1 -1
- package/skills/uipath-agents/references/coded/lifecycle/deployment.md +11 -1
- package/skills/uipath-agents/references/coded/quickstart.md +11 -8
- package/skills/uipath-agents/references/lowcode/capabilities/inline-in-flow/inline-in-flow.md +3 -3
- package/skills/uipath-agents/references/lowcode/capabilities/memory/memory.md +19 -2
- package/skills/uipath-agents/references/lowcode/evaluations/evaluate.md +2 -2
- package/skills/uipath-agents/references/lowcode/evaluations/orchestrator-eval-run.md +409 -155
- package/skills/uipath-agents/references/lowcode/evaluations/running-evaluations.md +2 -2
- package/skills/uipath-agents/references/lowcode/prompting/autonomous-agent-prompting-guide.md +1 -1
- package/skills/uipath-aops/SKILL.md +313 -0
- package/skills/uipath-aops/assets/templates/pipeline-dto-template.json +15 -0
- package/skills/uipath-aops/references/discovery-flow.md +312 -0
- package/skills/uipath-aops/references/migration-guide.md +146 -0
- package/skills/uipath-aops/references/pipeline-dto-guide.md +276 -0
- package/skills/uipath-aops/references/save-and-run-guide.md +156 -0
- package/skills/uipath-api-workflow/SKILL.md +48 -6
- package/skills/uipath-api-workflow/assets/templates/file-base64-roundtrip-example.json +154 -0
- package/skills/uipath-api-workflow/assets/templates/nested-control-flow-example.json +0 -1
- package/skills/uipath-api-workflow/references/cli-reference.md +20 -1
- package/skills/uipath-api-workflow/references/expressions-and-context.md +19 -0
- package/skills/uipath-api-workflow/references/files-and-base64.md +153 -0
- package/skills/uipath-api-workflow/references/operating-published-workflows.md +3 -2
- package/skills/uipath-api-workflow/references/task-types.md +89 -3
- package/skills/uipath-api-workflow/references/testing-and-evals.md +224 -0
- package/skills/uipath-api-workflow/references/troubleshooting.md +124 -4
- package/skills/uipath-coded-apps/SKILL.md +4 -2
- package/skills/uipath-coded-apps/assets/scripts/dashboards/build-dashboard.mjs +1 -1
- package/skills/uipath-coded-apps/references/dashboards/CAPABILITY.md +11 -1
- package/skills/uipath-coded-apps/references/dashboards/plugins/build/impl.md +5 -3
- package/skills/uipath-coded-apps/references/dashboards/plugins/deploy/impl.md +1 -0
- package/skills/uipath-coded-apps/references/oauth-client-setup.md +2 -0
- package/skills/uipath-coded-apps/references/pack-publish-deploy.md +18 -0
- package/skills/uipath-coded-apps/references/sdk/orchestrator.md +4 -0
- package/skills/uipath-connector-builder/SKILL.md +7 -5
- package/skills/uipath-connector-builder/references/debugging.md +5 -1
- package/skills/uipath-connector-builder/references/element-json.md +3 -1
- package/skills/uipath-connector-builder/references/standard-resources.md +37 -6
- package/skills/uipath-functions/SKILL.md +134 -222
- package/skills/uipath-functions/references/js/authoring-guide.md +141 -0
- package/skills/uipath-functions/references/js/bindings-guide.md +120 -0
- package/skills/uipath-functions/references/js/calling-uipath-apis-guide.md +112 -0
- package/skills/uipath-functions/references/js/coded-app-wiring-guide.md +103 -0
- package/skills/uipath-functions/references/js/deployment-guide.md +109 -0
- package/skills/uipath-functions/references/js/http-semantics-guide.md +80 -0
- package/skills/uipath-functions/references/js/job-mode-guide.md +114 -0
- package/skills/uipath-functions/references/js/local-dev-guide.md +107 -0
- package/skills/uipath-functions/references/python/workflow-guide.md +224 -0
- package/skills/uipath-governance/SKILL.md +9 -8
- package/skills/uipath-governance/references/compliance-pack/catalog/impl.md +36 -8
- package/skills/uipath-governance/references/compliance-pack/coverage/impl.md +14 -12
- package/skills/uipath-governance/references/compliance-pack/disable/impl.md +5 -3
- package/skills/uipath-governance/references/compliance-pack/full-apply/impl.md +7 -5
- package/skills/uipath-governance/references/compliance-pack/partial-apply/impl.md +14 -7
- package/skills/uipath-governance/references/compliance-pack/partial-apply/planning.md +3 -1
- package/skills/uipath-governance/references/compliance-pack/preview-gate.md +1 -1
- package/skills/uipath-governance/references/compliance-pack/query/impl.md +4 -2
- package/skills/uipath-governance/references/diagnose/CAPABILITY.md +12 -12
- package/skills/uipath-governance/references/diagnose/{references/failure-modes.md → failure-modes.md} +5 -5
- package/skills/uipath-governance/references/diagnose/{references/troubleshooting-guide.md → troubleshooting-guide.md} +2 -2
- package/skills/uipath-governance/references/disambiguation-guide.md +15 -7
- package/skills/uipath-human-in-the-loop/SKILL.md +107 -9
- package/skills/uipath-human-in-the-loop/references/hitl-casetask-action.md +413 -0
- package/skills/uipath-insights/SKILL.md +21 -14
- package/skills/uipath-insights/references/alerts-reads-guide.md +242 -0
- package/skills/uipath-insights/references/filter-discovery-guide.md +1 -1
- package/skills/uipath-insights/references/jobs-commands-guide.md +2 -2
- package/skills/uipath-ixp/references/cli-reference.md +1 -1
- package/skills/uipath-ixp/references/improve-prompts-guide.md +5 -6
- package/skills/uipath-maestro-bpmn/SKILL.md +87 -15
- package/skills/uipath-maestro-bpmn/references/diagnose/CAPABILITY.md +10 -10
- package/skills/uipath-maestro-bpmn/references/diagnose/{references/troubleshooting-guide.md → troubleshooting-guide.md} +1 -1
- package/skills/uipath-maestro-bpmn/references/expression-authoring.md +12 -2
- package/skills/uipath-maestro-bpmn/references/operate/CAPABILITY.md +12 -12
- package/skills/uipath-maestro-bpmn/references/operate/{references/run.md → run.md} +2 -2
- package/skills/uipath-maestro-bpmn/references/operate/{references/ship.md → ship.md} +3 -3
- package/skills/uipath-maestro-bpmn/references/patterns/ai-decision-review-guide.md +138 -0
- package/skills/uipath-maestro-bpmn/references/patterns/approval-chain-guide.md +136 -0
- package/skills/uipath-maestro-bpmn/references/patterns/composing-guide.md +113 -0
- package/skills/uipath-maestro-bpmn/references/patterns/external-wait-guide.md +145 -0
- package/skills/uipath-maestro-bpmn/references/patterns/failure-escalation-guide.md +103 -0
- package/skills/uipath-maestro-bpmn/references/patterns/high-volume-batch-guide.md +107 -0
- package/skills/uipath-maestro-bpmn/references/patterns/queue-distribution-guide.md +129 -0
- package/skills/uipath-maestro-bpmn/references/patterns/smart-triage-guide.md +129 -0
- package/skills/uipath-maestro-bpmn/references/registry-workflow.md +15 -0
- package/skills/uipath-maestro-bpmn/references/shared/local-metadata-regeneration-guide.md +67 -36
- package/skills/uipath-maestro-bpmn/references/shared/project-layout.md +6 -5
- package/skills/uipath-maestro-bpmn/references/structural-bpmn.md +23 -5
- package/skills/uipath-maestro-bpmn/validator/bpmn-spec.json +101 -53
- package/skills/uipath-maestro-case/SKILL.md +23 -24
- package/skills/uipath-maestro-case/references/bindings-and-expressions.md +30 -17
- package/skills/uipath-maestro-case/references/bindings-v2-sync.md +5 -5
- package/skills/uipath-maestro-case/references/brownfield.md +3 -3
- package/skills/uipath-maestro-case/references/case-commands.md +8 -4
- package/skills/uipath-maestro-case/references/case-editing-operations.md +19 -19
- package/skills/uipath-maestro-case/references/case-schema.md +17 -3
- package/skills/uipath-maestro-case/references/connector-integration.md +25 -16
- package/skills/uipath-maestro-case/references/connector-trigger-impl.md +15 -15
- package/skills/uipath-maestro-case/references/connector-trigger-planning.md +32 -29
- package/skills/uipath-maestro-case/references/entry-points-sync.md +2 -1
- package/skills/uipath-maestro-case/references/evals/evals.json +11 -11
- package/skills/uipath-maestro-case/references/implementation.md +74 -44
- package/skills/uipath-maestro-case/references/phased-execution.md +23 -21
- package/skills/uipath-maestro-case/references/placeholder-tasks.md +28 -23
- package/skills/uipath-maestro-case/references/planning.md +37 -252
- package/skills/uipath-maestro-case/references/plugins/case/impl-json.md +3 -3
- package/skills/uipath-maestro-case/references/plugins/case/planning.md +8 -6
- package/skills/uipath-maestro-case/references/plugins/conditions/case-exit-conditions/impl-json.md +3 -3
- package/skills/uipath-maestro-case/references/plugins/conditions/case-exit-conditions/planning.md +11 -10
- package/skills/uipath-maestro-case/references/plugins/conditions/stage-entry-conditions/impl-json.md +6 -6
- package/skills/uipath-maestro-case/references/plugins/conditions/stage-entry-conditions/planning.md +12 -12
- package/skills/uipath-maestro-case/references/plugins/conditions/stage-exit-conditions/impl-json.md +4 -4
- package/skills/uipath-maestro-case/references/plugins/conditions/stage-exit-conditions/planning.md +10 -9
- package/skills/uipath-maestro-case/references/plugins/conditions/task-entry-conditions/impl-json.md +5 -5
- package/skills/uipath-maestro-case/references/plugins/conditions/task-entry-conditions/planning.md +16 -14
- package/skills/uipath-maestro-case/references/plugins/logging/impl-json.md +3 -3
- package/skills/uipath-maestro-case/references/plugins/sla/impl-json.md +15 -15
- package/skills/uipath-maestro-case/references/plugins/sla/planning.md +20 -21
- package/skills/uipath-maestro-case/references/plugins/stages/impl-json.md +6 -6
- package/skills/uipath-maestro-case/references/plugins/stages/planning.md +9 -9
- package/skills/uipath-maestro-case/references/plugins/tasks/action/impl-json.md +9 -9
- package/skills/uipath-maestro-case/references/plugins/tasks/action/planning.md +38 -38
- package/skills/uipath-maestro-case/references/plugins/tasks/agent/impl-json.md +3 -3
- package/skills/uipath-maestro-case/references/plugins/tasks/agent/planning.md +24 -20
- package/skills/uipath-maestro-case/references/plugins/tasks/api-workflow/impl-json.md +3 -3
- package/skills/uipath-maestro-case/references/plugins/tasks/api-workflow/planning.md +24 -20
- package/skills/uipath-maestro-case/references/plugins/tasks/case-management/impl-json.md +4 -4
- package/skills/uipath-maestro-case/references/plugins/tasks/case-management/planning.md +25 -21
- package/skills/uipath-maestro-case/references/plugins/tasks/connector-activity/impl-json.md +30 -22
- package/skills/uipath-maestro-case/references/plugins/tasks/connector-activity/planning.md +44 -28
- package/skills/uipath-maestro-case/references/plugins/tasks/connector-trigger/impl-json.md +10 -10
- package/skills/uipath-maestro-case/references/plugins/tasks/connector-trigger/planning.md +27 -23
- package/skills/uipath-maestro-case/references/plugins/tasks/create-inline-common.md +3 -3
- package/skills/uipath-maestro-case/references/plugins/tasks/process/impl-json.md +3 -3
- package/skills/uipath-maestro-case/references/plugins/tasks/process/planning.md +25 -22
- package/skills/uipath-maestro-case/references/plugins/tasks/rpa/impl-json.md +3 -3
- package/skills/uipath-maestro-case/references/plugins/tasks/rpa/planning.md +25 -21
- package/skills/uipath-maestro-case/references/plugins/tasks/wait-for-timer/impl-json.md +4 -4
- package/skills/uipath-maestro-case/references/plugins/tasks/wait-for-timer/planning.md +5 -4
- package/skills/uipath-maestro-case/references/plugins/triggers/event/impl-json.md +9 -9
- package/skills/uipath-maestro-case/references/plugins/triggers/event/planning.md +30 -19
- package/skills/uipath-maestro-case/references/plugins/triggers/manual/impl-json.md +4 -4
- package/skills/uipath-maestro-case/references/plugins/triggers/manual/planning.md +8 -7
- package/skills/uipath-maestro-case/references/plugins/triggers/timer/impl-json.md +3 -3
- package/skills/uipath-maestro-case/references/plugins/triggers/timer/planning.md +5 -4
- package/skills/uipath-maestro-case/references/plugins/variables/bindings/impl-json.md +5 -5
- package/skills/uipath-maestro-case/references/plugins/variables/global-vars/impl-json.md +7 -7
- package/skills/uipath-maestro-case/references/plugins/variables/global-vars/planning.md +21 -17
- package/skills/uipath-maestro-case/references/plugins/variables/io-binding/impl-json.md +29 -21
- package/skills/uipath-maestro-case/references/plugins/variables/io-binding/planning.md +23 -21
- package/skills/uipath-maestro-case/references/registry-discovery.md +5 -5
- package/skills/uipath-maestro-flow/.maintenance/README.md +35 -28
- package/skills/uipath-maestro-flow/.maintenance/check-anchors.sh +19 -1
- package/skills/uipath-maestro-flow/.maintenance/check-links.sh +3 -0
- package/skills/uipath-maestro-flow/.maintenance/check-plugin-pairs.sh +2 -2
- package/skills/uipath-maestro-flow/SKILL.md +66 -76
- package/skills/uipath-maestro-flow/references/author/CAPABILITY.md +75 -72
- package/skills/uipath-maestro-flow/references/author/brownfield.md +90 -0
- package/skills/uipath-maestro-flow/references/author/{references/editing-operations-cli.md → editing-operations-cli.md} +9 -4
- package/skills/uipath-maestro-flow/references/author/editing-operations-json.md +373 -0
- package/skills/uipath-maestro-flow/references/author/editing-operations.md +103 -0
- package/skills/uipath-maestro-flow/references/author/{references/greenfield.md → greenfield.md} +32 -20
- package/skills/uipath-maestro-flow/references/author/planning-arch.md +342 -0
- package/skills/uipath-maestro-flow/references/author/planning-impl.md +283 -0
- package/skills/uipath-maestro-flow/references/author/plugins/agent/impl.md +227 -0
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/agent/planning.md +2 -2
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/agentic-process/impl.md +2 -2
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/agentic-process/planning.md +1 -1
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/api-workflow/impl.md +2 -2
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/api-workflow/planning.md +1 -1
- package/skills/uipath-maestro-flow/references/author/plugins/batch-transform/impl.md +171 -0
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/batch-transform/planning.md +1 -1
- package/skills/uipath-maestro-flow/references/author/plugins/connector/impl.md +449 -0
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/connector/planning.md +3 -3
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/connector-trigger/impl.md +20 -18
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/connector-trigger/planning.md +2 -2
- package/skills/uipath-maestro-flow/references/author/plugins/data-fabric/impl.md +427 -0
- package/skills/uipath-maestro-flow/references/author/plugins/data-fabric/planning.md +185 -0
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/decision/impl.md +5 -0
- package/skills/uipath-maestro-flow/references/author/plugins/delay/impl.md +38 -0
- package/skills/uipath-maestro-flow/references/author/plugins/end/impl.md +56 -0
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/flow/impl.md +2 -2
- package/skills/uipath-maestro-flow/references/author/plugins/hitl/impl.md +178 -0
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/hitl/planning.md +14 -1
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/http/impl-connector.md +4 -4
- package/skills/uipath-maestro-flow/references/author/plugins/http/impl-manual.md +68 -0
- package/skills/uipath-maestro-flow/references/author/plugins/http/impl.md +173 -0
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/http/planning.md +3 -3
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/inline-agent/impl.md +6 -6
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/inline-agent/planning.md +1 -1
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/inline-voice-agent/impl.md +4 -4
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/inline-voice-agent/planning.md +1 -1
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/ixp/impl.md +8 -8
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/loop/impl.md +1 -1
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/loop/planning.md +1 -1
- package/skills/uipath-maestro-flow/references/author/plugins/merge/impl.md +43 -0
- package/skills/uipath-maestro-flow/references/author/plugins/merge/planning.md +24 -0
- package/skills/uipath-maestro-flow/references/author/plugins/rpa/impl.md +117 -0
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/rpa/planning.md +1 -1
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/scheduled-trigger/impl.md +6 -8
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/script/impl.md +5 -5
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/script/planning.md +1 -1
- package/skills/uipath-maestro-flow/references/author/plugins/subflow/impl.md +164 -0
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/subflow/planning.md +1 -1
- package/skills/uipath-maestro-flow/references/author/plugins/summarize/impl.md +189 -0
- package/skills/uipath-maestro-flow/references/author/plugins/summarize/planning.md +66 -0
- package/skills/uipath-maestro-flow/references/author/plugins/switch/planning.md +34 -0
- package/skills/uipath-maestro-flow/references/author/plugins/terminate/impl.md +48 -0
- package/skills/uipath-maestro-flow/references/author/plugins/transform/impl.md +241 -0
- package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/transform/planning.md +1 -1
- package/skills/uipath-maestro-flow/references/diagnose/CAPABILITY.md +39 -37
- package/skills/uipath-maestro-flow/references/diagnose/{references/failure-modes.md → failure-modes.md} +22 -22
- package/skills/uipath-maestro-flow/references/diagnose/{references/troubleshooting-guide.md → troubleshooting-guide.md} +60 -1
- package/skills/uipath-maestro-flow/references/evaluate/CAPABILITY.md +27 -25
- package/skills/uipath-maestro-flow/references/evaluate/{references/commands-reference.md → commands-reference.md} +58 -7
- package/skills/uipath-maestro-flow/references/evaluate/eval-sets-guide.md +227 -0
- package/skills/uipath-maestro-flow/references/evaluate/upload-safety.md +94 -0
- package/skills/uipath-maestro-flow/references/operate/CAPABILITY.md +21 -21
- package/skills/uipath-maestro-flow/references/operate/{references/manage.md → manage.md} +4 -4
- package/skills/uipath-maestro-flow/references/operate/run.md +121 -0
- package/skills/uipath-maestro-flow/references/operate/{references/ship.md → ship.md} +5 -5
- package/skills/uipath-maestro-flow/references/shared/action-nodes.md +30 -22
- package/skills/uipath-maestro-flow/references/shared/cli-commands.md +76 -184
- package/skills/uipath-maestro-flow/references/shared/cli-conventions.md +49 -60
- package/skills/uipath-maestro-flow/references/shared/file-format.md +32 -11
- package/skills/uipath-maestro-flow/references/shared/node-output-wiring.md +49 -104
- package/skills/uipath-maestro-flow/references/shared/ux-narration-and-todos.md +66 -103
- package/skills/uipath-maestro-flow/references/shared/variables-and-expressions.md +4 -4
- package/skills/uipath-planner/SKILL.md +1 -1
- package/skills/uipath-planner/assets/templates/case/case-sdd-template.md +5 -3
- package/skills/uipath-planner/references/case/case-design-lane-guide.md +1 -1
- package/skills/uipath-planner/references/case/case-design-layers-guide.md +2 -2
- package/skills/uipath-planner/references/non-pdd-lane-guide.md +2 -1
- package/skills/uipath-planner/references/pdd-driven-lane-guide.md +3 -2
- package/skills/uipath-planner/references/sdd-generation-guide.md +1 -0
- package/skills/uipath-planner/scripts/case/audit_sdd.py +77 -1
- package/skills/uipath-platform/SKILL.md +6 -4
- package/skills/uipath-platform/references/integration-service/activities.md +7 -4
- package/skills/uipath-platform/references/integration-service/reference-resolution.md +28 -0
- package/skills/uipath-platform/references/integration-service/resources.md +11 -0
- package/skills/uipath-platform/references/integration-service/triggers.md +2 -2
- package/skills/uipath-platform/references/licensing/diagnose/CAPABILITY.md +80 -0
- package/skills/uipath-platform/references/licensing/diagnose/references/failure-modes.md +147 -0
- package/skills/uipath-platform/references/licensing/diagnose/references/troubleshooting-guide.md +125 -0
- package/skills/uipath-platform/references/licensing/licensing.md +3 -0
- package/skills/uipath-platform/references/licensing/user-licenses-allocations.md +5 -0
- package/skills/uipath-platform/references/orchestrator/run-jobs.md +11 -2
- package/skills/uipath-platform/references/traces/feedback.md +4 -4
- package/skills/uipath-platform/references/traces/traces.md +1 -1
- package/skills/uipath-process-mining/SKILL.md +6 -6
- package/skills/uipath-process-mining/references/lifecycle-and-rbac.md +10 -8
- package/skills/uipath-process-mining/references/model-editing.md +1 -1
- package/skills/uipath-process-mining/references/querying.md +4 -3
- package/skills/uipath-review/SKILL.md +171 -541
- package/skills/uipath-review/references/agents/agents-lowcode-rules.md +73 -92
- package/skills/uipath-review/references/agents/guardrails/coded-guardrails-review.md +4 -0
- package/skills/uipath-review/references/agents/guardrails/guardrails-review.md +73 -180
- package/skills/uipath-review/references/architecture-assessment-guide.md +93 -105
- package/skills/uipath-review/references/review-workflow-guide.md +1 -1
- package/skills/uipath-review/references/rpa/modern-studio-issues.md +44 -44
- package/skills/uipath-review/references/rpa/rpa-common-issues.md +251 -321
- package/skills/uipath-review/references/rpa/rpa-review-checklist.md +1 -1
- package/skills/uipath-review/references/rule-catalog-workflow.md +25 -45
- package/skills/uipath-review/references/rule-format.md +21 -21
- package/skills/uipath-rpa/.maintenance/pattern-card-maintenance.md +1 -1
- package/skills/uipath-rpa/CLAUDE.md +4 -5
- package/skills/uipath-rpa/SKILL.md +40 -246
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/FindText.md +2 -10
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/GetColorAtPosition.md +2 -10
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/GetCursorPosition.md +2 -10
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/GetField.md +13 -13
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/GetFieldAtPosition.md +2 -10
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/GetScreenArea.md +27 -8
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/GetText.md +2 -14
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/GetTextAtPosition.md +2 -10
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/MoveCursor.md +3 -11
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/MoveCursorToText.md +2 -10
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/SendControlKey.md +2 -8
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/SendKeys.md +2 -10
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/SendKeysSecure.md +2 -10
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/SetField.md +14 -13
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/SetFieldAtPosition.md +4 -7
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/TerminalSession/_common-options.md +29 -0
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/TerminalSession/authoring-paths.md +58 -0
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/TerminalSession.md +197 -11
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/WaitFieldText.md +2 -10
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/WaitScreenReady.md +9 -10
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/WaitScreenText.md +2 -14
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities/WaitTextAtPosition.md +2 -10
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/activities.json +271 -0
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/coded/coded-api.md +61 -3
- package/skills/uipath-rpa/references/activity-docs/UiPath.Terminal.Activities/2.10/overview.md +76 -0
- package/skills/uipath-rpa/references/cli-reference.md +63 -29
- package/skills/uipath-rpa/references/coded/codedworkflow-reference.md +59 -1
- package/skills/uipath-rpa/references/coded/operations-guide.md +2 -1
- package/skills/uipath-rpa/references/debugging.md +29 -12
- package/skills/uipath-rpa/references/environment-setup.md +54 -1
- package/skills/uipath-rpa/references/execution-maps-guide.md +10 -9
- package/skills/uipath-rpa/references/legacy/activity-docs/_INVOKE-CODE.md +1 -1
- package/skills/uipath-rpa/references/uia-starter-guide.md +46 -8
- package/skills/uipath-rpa/references/xaml/common-pitfalls.md +3 -4
- package/skills/uipath-rpa/references/xaml/csharp-activity-binding-guide.md +7 -8
- package/skills/uipath-rpa/references/xaml/xaml-basics-and-rules.md +132 -42
- package/skills/uipath-solution/SKILL.md +9 -6
- package/skills/uipath-solution/references/activate-and-manage.md +11 -6
- package/skills/uipath-solution/references/develop-solution.md +39 -28
- package/skills/uipath-solution/references/pack-and-deploy.md +49 -1
- package/skills/uipath-solution/references/scenarios/failure-modes.md +1 -1
- package/skills/uipath-solution/references/scenarios/intra-solution-references.md +3 -3
- package/skills/uipath-solution/references/scenarios/manual-edits.md +1 -1
- package/skills/uipath-solution/references/scenarios.md +2 -2
- package/skills/uipath-solution/references/solution-overview.md +15 -6
- package/skills/uipath-tasks/SKILL.md +11 -6
- package/skills/uipath-tasks/references/task-assignment.md +5 -0
- package/skills/uipath-tasks/references/task-catalogs.md +7 -4
- package/skills/uipath-tasks/references/task-completion.md +3 -1
- package/skills/uipath-tasks/references/task-data.md +3 -3
- package/skills/uipath-tasks/references/task-lifecycle.md +11 -0
- package/skills/uipath-tasks/references/task-metadata.md +4 -3
- package/skills/uipath-test/SKILL.md +13 -28
- package/skills/uipath-test/references/failure-triage-guide.md +90 -0
- package/skills/uipath-test/references/playwright-first-mile-guide.md +2 -2
- package/skills/uipath-test/references/publish-and-link-guide.md +0 -1
- package/skills/uipath-test/references/test-result-report-guide.md +1 -2
- package/skills/uipath-troubleshoot/references/activity-packages/ui-automation/interpretations/healing-agent-data.md +1 -1
- package/skills/uipath-troubleshoot/references/presenting.md +1 -1
- package/skills/uipath-troubleshoot/references/products/maestro/playbooks/folder-not-accessible.md +1 -1
- package/skills/uipath-troubleshoot/references/products/maestro/playbooks/generic-error-400.md +4 -4
- package/skills/uipath-troubleshoot/references/products/maestro/playbooks/integration-service-400.md +2 -2
- package/skills/uipath-troubleshoot/references/products/maestro/playbooks/job-operation-timeout.md +1 -1
- package/skills/uipath-troubleshoot/references/products/maestro/playbooks/no-suitable-runtime-machine.md +1 -1
- package/version-manifest.json +2 -2
- package/skills/uipath-maestro-case/scripts/audit_plan.py +0 -231
- package/skills/uipath-maestro-flow/references/author/references/brownfield.md +0 -93
- package/skills/uipath-maestro-flow/references/author/references/editing-operations-json.md +0 -545
- package/skills/uipath-maestro-flow/references/author/references/editing-operations.md +0 -131
- package/skills/uipath-maestro-flow/references/author/references/planning-arch.md +0 -638
- package/skills/uipath-maestro-flow/references/author/references/planning-impl.md +0 -306
- package/skills/uipath-maestro-flow/references/author/references/plugins/agent/impl.md +0 -229
- package/skills/uipath-maestro-flow/references/author/references/plugins/batch-transform/impl.md +0 -174
- package/skills/uipath-maestro-flow/references/author/references/plugins/connector/impl.md +0 -741
- package/skills/uipath-maestro-flow/references/author/references/plugins/delay/impl.md +0 -75
- package/skills/uipath-maestro-flow/references/author/references/plugins/end/impl.md +0 -65
- package/skills/uipath-maestro-flow/references/author/references/plugins/hitl/impl.md +0 -204
- package/skills/uipath-maestro-flow/references/author/references/plugins/http/impl-manual.md +0 -65
- package/skills/uipath-maestro-flow/references/author/references/plugins/http/impl.md +0 -201
- package/skills/uipath-maestro-flow/references/author/references/plugins/merge/impl.md +0 -43
- package/skills/uipath-maestro-flow/references/author/references/plugins/merge/planning.md +0 -29
- package/skills/uipath-maestro-flow/references/author/references/plugins/rpa/impl.md +0 -121
- package/skills/uipath-maestro-flow/references/author/references/plugins/subflow/impl.md +0 -230
- package/skills/uipath-maestro-flow/references/author/references/plugins/summarize/impl.md +0 -198
- package/skills/uipath-maestro-flow/references/author/references/plugins/summarize/planning.md +0 -71
- package/skills/uipath-maestro-flow/references/author/references/plugins/switch/planning.md +0 -38
- package/skills/uipath-maestro-flow/references/author/references/plugins/terminate/impl.md +0 -48
- package/skills/uipath-maestro-flow/references/author/references/plugins/transform/impl.md +0 -287
- package/skills/uipath-maestro-flow/references/evaluate/references/eval-sets-guide.md +0 -226
- package/skills/uipath-maestro-flow/references/evaluate/references/upload-safety.md +0 -82
- package/skills/uipath-maestro-flow/references/operate/references/run.md +0 -99
- /package/skills/uipath-maestro-bpmn/references/diagnose/{references/failure-modes.md → failure-modes.md} +0 -0
- /package/skills/uipath-maestro-bpmn/references/operate/{references/manage.md → manage.md} +0 -0
- /package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/decision/planning.md +0 -0
- /package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/delay/planning.md +0 -0
- /package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/end/planning.md +0 -0
- /package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/flow/planning.md +0 -0
- /package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/ixp/planning.md +0 -0
- /package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/queue/impl.md +0 -0
- /package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/queue/planning.md +0 -0
- /package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/scheduled-trigger/planning.md +0 -0
- /package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/switch/impl.md +0 -0
- /package/skills/uipath-maestro-flow/references/author/{references/plugins → plugins}/terminate/planning.md +0 -0
- /package/skills/uipath-maestro-flow/references/evaluate/{references/evaluators-guide.md → evaluators-guide.md} +0 -0
- /package/skills/uipath-maestro-flow/references/evaluate/{references/running-guide.md → running-guide.md} +0 -0
|
@@ -1,38 +0,0 @@
|
|
|
1
|
-
# Switch Node — Planning
|
|
2
|
-
|
|
3
|
-
## Node Type
|
|
4
|
-
|
|
5
|
-
`core.logic.switch`
|
|
6
|
-
|
|
7
|
-
## When to Use
|
|
8
|
-
|
|
9
|
-
Use a Switch node for multi-way branching (3+ paths) based on ordered case expressions. Cases are evaluated in order; the first `true` case is taken.
|
|
10
|
-
|
|
11
|
-
### Selection Heuristics
|
|
12
|
-
|
|
13
|
-
| Situation | Use Switch? |
|
|
14
|
-
| --- | --- |
|
|
15
|
-
| Three or more paths based on different conditions | Yes |
|
|
16
|
-
| Simple true/false branch | No — use [Decision](../decision/planning.md) |
|
|
17
|
-
| Branch on HTTP response status codes | No — use [HTTP](../http/planning.md) built-in branches |
|
|
18
|
-
| Branch requires reasoning on ambiguous input | No — use [Agent](../agent/planning.md) |
|
|
19
|
-
|
|
20
|
-
## Ports
|
|
21
|
-
|
|
22
|
-
| Input Port | Output Port(s) |
|
|
23
|
-
| --- | --- |
|
|
24
|
-
| `input` | `case-{id}` (dynamic per case), `default` |
|
|
25
|
-
|
|
26
|
-
## Key Inputs
|
|
27
|
-
|
|
28
|
-
| Input | Required | Description |
|
|
29
|
-
| --- | --- | --- |
|
|
30
|
-
| `cases` | Yes | Array of `{ id, label, expression }` (min 1 item) |
|
|
31
|
-
|
|
32
|
-
Each case creates a dynamic output port: `case-{item.id}`. An optional `default` port handles unmatched cases.
|
|
33
|
-
|
|
34
|
-
## Wiring Rules
|
|
35
|
-
|
|
36
|
-
- Switch nodes produce one outgoing edge per case + optionally one from `default`
|
|
37
|
-
- Each case edge uses `sourcePort: "case-{id}"` where `{id}` matches the case's `id` field
|
|
38
|
-
- Every case branch must lead to a downstream node
|
|
@@ -1,48 +0,0 @@
|
|
|
1
|
-
# Terminate Node — Implementation
|
|
2
|
-
|
|
3
|
-
## Node Type
|
|
4
|
-
|
|
5
|
-
`core.logic.terminate`
|
|
6
|
-
|
|
7
|
-
## Registry Validation
|
|
8
|
-
|
|
9
|
-
```bash
|
|
10
|
-
uip maestro flow registry get core.logic.terminate --output json
|
|
11
|
-
```
|
|
12
|
-
|
|
13
|
-
Confirm: input port `input`, no output ports. Set the node instance `typeVersion` to the `version` field from this response — do not hardcode it.
|
|
14
|
-
|
|
15
|
-
## JSON Structure
|
|
16
|
-
|
|
17
|
-
```json
|
|
18
|
-
{
|
|
19
|
-
"id": "abortOnError",
|
|
20
|
-
"type": "core.logic.terminate",
|
|
21
|
-
"typeVersion": "<DEFINITION_VERSION>",
|
|
22
|
-
"display": { "label": "Abort" },
|
|
23
|
-
"inputs": {}
|
|
24
|
-
}
|
|
25
|
-
```
|
|
26
|
-
|
|
27
|
-
## Adding / Editing
|
|
28
|
-
|
|
29
|
-
For step-by-step add, delete, and wiring procedures, see [editing-operations.md](../../editing-operations.md). Use the JSON structure above for the node-specific `inputs`.
|
|
30
|
-
|
|
31
|
-
## Common Pattern — Error Handler
|
|
32
|
-
|
|
33
|
-
```text
|
|
34
|
-
HTTP Request
|
|
35
|
-
|-- default -> Process -> End
|
|
36
|
-
|-- error -> Log Error (Script) -> Terminate
|
|
37
|
-
```
|
|
38
|
-
|
|
39
|
-
Wire the action node's implicit `error` source port straight to the handler; the Script logs `$vars.httpCall.error`, then Terminate aborts the flow. Do **not** put a Decision downstream to test for an error — a failing node has already faulted the flow before execution reaches it.
|
|
40
|
-
|
|
41
|
-
Add this pattern only when the requirements state what a failure should do. With no error edge the failure faults the flow on its own, which is the correct default — and never set `inputs.errorHandlingEnabled: true` without the edge. See [file-format.md — Implicit error port on action nodes](../../../../shared/file-format.md#implicit-error-port-on-action-nodes).
|
|
42
|
-
|
|
43
|
-
## Debug
|
|
44
|
-
|
|
45
|
-
| Error | Cause | Fix |
|
|
46
|
-
| --- | --- | --- |
|
|
47
|
-
| Terminate has outgoing edges | Wired an edge from Terminate to another node | Remove — Terminate has no output ports |
|
|
48
|
-
| Workflow outputs missing | Expected outputs but hit Terminate | Terminate does not produce outputs — use End for paths that need output mapping |
|
|
@@ -1,287 +0,0 @@
|
|
|
1
|
-
# Transform Node — Implementation
|
|
2
|
-
|
|
3
|
-
## Node Types
|
|
4
|
-
|
|
5
|
-
- `core.action.transform` — generic (chains multiple operations)
|
|
6
|
-
- `core.action.transform.filter` — filter only
|
|
7
|
-
- `core.action.transform.map` — map only
|
|
8
|
-
- `core.action.transform.group-by` — group-by only
|
|
9
|
-
|
|
10
|
-
## Registry Validation
|
|
11
|
-
|
|
12
|
-
```bash
|
|
13
|
-
uip maestro flow registry get core.action.transform --output json
|
|
14
|
-
uip maestro flow registry get core.action.transform.filter --output json
|
|
15
|
-
uip maestro flow registry get core.action.transform.map --output json
|
|
16
|
-
uip maestro flow registry get core.action.transform.group-by --output json
|
|
17
|
-
```
|
|
18
|
-
|
|
19
|
-
Confirm: input port `input`, output ports `output` and `error`, required inputs `collection` and `operations`. Set each node instance's `typeVersion` to the `version` field from the matching response — do not hardcode it.
|
|
20
|
-
|
|
21
|
-
## Adding / Editing
|
|
22
|
-
|
|
23
|
-
For step-by-step add, delete, and wiring procedures, see [editing-operations.md](../../editing-operations.md). Use the JSON structures below for the node-specific `inputs` and `model` fields.
|
|
24
|
-
|
|
25
|
-
## Collection Input Contract
|
|
26
|
-
|
|
27
|
-
`inputs.collection` is a transform-specific path field, not a general `=js:` value field. Set it to the variable path that contains the array:
|
|
28
|
-
|
|
29
|
-
```json
|
|
30
|
-
"collection": "$vars.orders.output.items"
|
|
31
|
-
```
|
|
32
|
-
|
|
33
|
-
**NEVER** wrap transform `collection` in `=js:`. **NEVER** set it to an inline array literal. Both forms below are wrong:
|
|
34
|
-
|
|
35
|
-
```json
|
|
36
|
-
"collection": "=js:$vars.orders.output.items"
|
|
37
|
-
```
|
|
38
|
-
|
|
39
|
-
```json
|
|
40
|
-
"collection": "=js:[{\"title\":\"Example\"}]"
|
|
41
|
-
```
|
|
42
|
-
|
|
43
|
-
The transform runtime turns the path string into a lookup such as `vars.orders.output.items`. If the string starts with `=js:` or contains an inline JSON/JS literal, that lookup resolves to an empty collection.
|
|
44
|
-
|
|
45
|
-
For static data, store the array in a workflow variable `defaultValue` or emit it from an upstream static-data/script node, then point `collection` at that variable or node output. Filtering, mapping, and grouping still belong in transform nodes.
|
|
46
|
-
|
|
47
|
-
## Output Shape
|
|
48
|
-
|
|
49
|
-
`$vars.<transformNode>.output` is a **bare array** — no `.items`, `.body`, `.response`. filter → surviving elements; map → mapped elements; group-by → group objects (`{<groupByField>, <alias>…}`).
|
|
50
|
-
|
|
51
|
-
Chain transforms off the bare array. `.output.items` on a transform → `undefined` → empty, silently (no fault). `.items`/`.body.items` in the examples below is HTTP-body/variable shape, never a transform's own output.
|
|
52
|
-
|
|
53
|
-
```json
|
|
54
|
-
"collection": "$vars.filterHighViewDays.output"
|
|
55
|
-
```
|
|
56
|
-
|
|
57
|
-
Read an element field in a Script node: `$vars.groupByNode.output[0].totalViews`.
|
|
58
|
-
|
|
59
|
-
---
|
|
60
|
-
|
|
61
|
-
## Generic Transform (`core.action.transform`)
|
|
62
|
-
|
|
63
|
-
Chains multiple operations (filter -> map -> groupBy) in a single node. Operations execute in order; each feeds into the next.
|
|
64
|
-
|
|
65
|
-
```json
|
|
66
|
-
{
|
|
67
|
-
"id": "transformChain",
|
|
68
|
-
"type": "core.action.transform",
|
|
69
|
-
"typeVersion": "<DEFINITION_VERSION>",
|
|
70
|
-
"display": { "label": "Process Employees" },
|
|
71
|
-
"inputs": {
|
|
72
|
-
"collection": "$vars.fetchData.output.body.employees",
|
|
73
|
-
"operations": [
|
|
74
|
-
{
|
|
75
|
-
"id": "op1",
|
|
76
|
-
"type": "filter",
|
|
77
|
-
"config": {
|
|
78
|
-
"operation": "and",
|
|
79
|
-
"filters": [
|
|
80
|
-
{ "id": "f1", "field": "active", "condition": "equals", "value": true }
|
|
81
|
-
]
|
|
82
|
-
}
|
|
83
|
-
},
|
|
84
|
-
{
|
|
85
|
-
"id": "op2",
|
|
86
|
-
"type": "map",
|
|
87
|
-
"config": {
|
|
88
|
-
"keepOriginalFields": false,
|
|
89
|
-
"mappings": [
|
|
90
|
-
{ "id": "m1", "field": "name", "transformation": "uppercase", "renameTo": "fullName" },
|
|
91
|
-
{ "id": "m2", "field": "salary", "transformation": "copy", "renameTo": "" }
|
|
92
|
-
]
|
|
93
|
-
}
|
|
94
|
-
}
|
|
95
|
-
]
|
|
96
|
-
},
|
|
97
|
-
"outputs": {
|
|
98
|
-
"output": {
|
|
99
|
-
"type": "object",
|
|
100
|
-
"description": "The return value of the transform",
|
|
101
|
-
"source": "=result.response",
|
|
102
|
-
"var": "output"
|
|
103
|
-
},
|
|
104
|
-
"error": {
|
|
105
|
-
"type": "object",
|
|
106
|
-
"description": "Error information if the transform fails",
|
|
107
|
-
"source": "=Error",
|
|
108
|
-
"var": "error"
|
|
109
|
-
}
|
|
110
|
-
}
|
|
111
|
-
}
|
|
112
|
-
```
|
|
113
|
-
|
|
114
|
-
---
|
|
115
|
-
|
|
116
|
-
## Filter (`core.action.transform.filter`)
|
|
117
|
-
|
|
118
|
-
```json
|
|
119
|
-
{
|
|
120
|
-
"id": "filterActive",
|
|
121
|
-
"type": "core.action.transform.filter",
|
|
122
|
-
"typeVersion": "<DEFINITION_VERSION>",
|
|
123
|
-
"display": { "label": "Filter Active Orders" },
|
|
124
|
-
"inputs": {
|
|
125
|
-
"collection": "$vars.orders.output.items",
|
|
126
|
-
"operations": [
|
|
127
|
-
{
|
|
128
|
-
"id": "op1",
|
|
129
|
-
"type": "filter",
|
|
130
|
-
"config": {
|
|
131
|
-
"operation": "and",
|
|
132
|
-
"filters": [
|
|
133
|
-
{ "id": "f1", "field": "status", "condition": "equals", "value": "active" },
|
|
134
|
-
{ "id": "f2", "field": "amount", "condition": "greater_equal", "value": 100 }
|
|
135
|
-
]
|
|
136
|
-
}
|
|
137
|
-
}
|
|
138
|
-
]
|
|
139
|
-
},
|
|
140
|
-
"outputs": {
|
|
141
|
-
"output": {
|
|
142
|
-
"type": "object",
|
|
143
|
-
"description": "The return value of the transform",
|
|
144
|
-
"source": "=result.response",
|
|
145
|
-
"var": "output"
|
|
146
|
-
},
|
|
147
|
-
"error": {
|
|
148
|
-
"type": "object",
|
|
149
|
-
"description": "Error information if the transform fails",
|
|
150
|
-
"source": "=Error",
|
|
151
|
-
"var": "error"
|
|
152
|
-
}
|
|
153
|
-
}
|
|
154
|
-
}
|
|
155
|
-
```
|
|
156
|
-
|
|
157
|
-
**Filter conditions:** `equals`, `not_equals`, `greater_than`, `less_than`, `greater_equal`, `less_equal`, `contains`, `starts_with`, `ends_with`, `is_null`, `is_not_null`
|
|
158
|
-
|
|
159
|
-
**Filter operations:** `and` (all conditions must match), `or` (any condition matches)
|
|
160
|
-
|
|
161
|
-
> **Filter `value` is literal-only — no `$vars`, no `=js:`, no brace-templates.** The Transform runtime reads `value` as-is and does not evaluate expressions. Setting `"value": "$vars.threshold"`, `"value": "=js:$vars.threshold"`, or `"value": "{$vars.threshold}"` silently produces an empty filtered array — the filter is comparing each item's field against the literal string `$vars.threshold` (or `=js:...`), never against the intended number. Only literal scalars work: `"value": 500`, `"value": "active"`, `"value": true`. If you need a dynamic threshold, compute the filter inside a [Script](../script/impl.md) node instead, or hoist the literal into the flow design and keep the Transform filter for demo-time thresholds.
|
|
162
|
-
|
|
163
|
-
**`field` accepts dot-paths** for nested object fields (e.g., `"field": "order.amount"`). Applies to `collection` elements.
|
|
164
|
-
|
|
165
|
-
---
|
|
166
|
-
|
|
167
|
-
## Map (`core.action.transform.map`)
|
|
168
|
-
|
|
169
|
-
```json
|
|
170
|
-
{
|
|
171
|
-
"id": "mapFields",
|
|
172
|
-
"type": "core.action.transform.map",
|
|
173
|
-
"typeVersion": "<DEFINITION_VERSION>",
|
|
174
|
-
"display": { "label": "Normalize Names" },
|
|
175
|
-
"inputs": {
|
|
176
|
-
"collection": "$vars.rawData.output.items",
|
|
177
|
-
"operations": [
|
|
178
|
-
{
|
|
179
|
-
"id": "op1",
|
|
180
|
-
"type": "map",
|
|
181
|
-
"config": {
|
|
182
|
-
"keepOriginalFields": false,
|
|
183
|
-
"mappings": [
|
|
184
|
-
{ "id": "m1", "field": "firstName", "transformation": "uppercase", "renameTo": "name" },
|
|
185
|
-
{ "id": "m2", "field": "email", "transformation": "lowercase", "renameTo": "" },
|
|
186
|
-
{ "id": "m3", "field": "dept", "transformation": "copy", "renameTo": "department" }
|
|
187
|
-
]
|
|
188
|
-
}
|
|
189
|
-
}
|
|
190
|
-
]
|
|
191
|
-
},
|
|
192
|
-
"outputs": {
|
|
193
|
-
"output": {
|
|
194
|
-
"type": "object",
|
|
195
|
-
"description": "The return value of the transform",
|
|
196
|
-
"source": "=result.response",
|
|
197
|
-
"var": "output"
|
|
198
|
-
},
|
|
199
|
-
"error": {
|
|
200
|
-
"type": "object",
|
|
201
|
-
"description": "Error information if the transform fails",
|
|
202
|
-
"source": "=Error",
|
|
203
|
-
"var": "error"
|
|
204
|
-
}
|
|
205
|
-
}
|
|
206
|
-
}
|
|
207
|
-
```
|
|
208
|
-
|
|
209
|
-
**Transformations:** `copy` (no change), `uppercase`, `lowercase`, `trim` (remove leading/trailing whitespace).
|
|
210
|
-
|
|
211
|
-
**`keepOriginalFields`:** When `false`, only mapped fields appear in output. When `true`, unmapped fields pass through.
|
|
212
|
-
|
|
213
|
-
**`renameTo`:** New field name. Empty string (`""`) keeps the original name.
|
|
214
|
-
|
|
215
|
-
---
|
|
216
|
-
|
|
217
|
-
## Group By (`core.action.transform.group-by`)
|
|
218
|
-
|
|
219
|
-
```json
|
|
220
|
-
{
|
|
221
|
-
"id": "groupByDept",
|
|
222
|
-
"type": "core.action.transform.group-by",
|
|
223
|
-
"typeVersion": "<DEFINITION_VERSION>",
|
|
224
|
-
"display": { "label": "Group by Department" },
|
|
225
|
-
"inputs": {
|
|
226
|
-
"collection": "$vars.employees.output.items",
|
|
227
|
-
"operations": [
|
|
228
|
-
{
|
|
229
|
-
"id": "op1",
|
|
230
|
-
"type": "groupBy",
|
|
231
|
-
"config": {
|
|
232
|
-
"groupByField": "department",
|
|
233
|
-
"aggregations": [
|
|
234
|
-
{ "id": "a1", "field": "", "operation": "count", "alias": "headcount" },
|
|
235
|
-
{ "id": "a2", "field": "salary", "operation": "sum", "alias": "totalSalary" },
|
|
236
|
-
{ "id": "a3", "field": "salary", "operation": "average", "alias": "avgSalary" },
|
|
237
|
-
{ "id": "a4", "field": "salary", "operation": "min", "alias": "minSalary" },
|
|
238
|
-
{ "id": "a5", "field": "salary", "operation": "max", "alias": "maxSalary" },
|
|
239
|
-
{ "id": "a6", "field": "name", "operation": "collect", "alias": "names" },
|
|
240
|
-
{ "id": "a7", "field": "name", "operation": "first", "alias": "firstHire" }
|
|
241
|
-
]
|
|
242
|
-
}
|
|
243
|
-
}
|
|
244
|
-
]
|
|
245
|
-
},
|
|
246
|
-
"outputs": {
|
|
247
|
-
"output": {
|
|
248
|
-
"type": "object",
|
|
249
|
-
"description": "The return value of the transform",
|
|
250
|
-
"source": "=result.response",
|
|
251
|
-
"var": "output"
|
|
252
|
-
},
|
|
253
|
-
"error": {
|
|
254
|
-
"type": "object",
|
|
255
|
-
"description": "Error information if the transform fails",
|
|
256
|
-
"source": "=Error",
|
|
257
|
-
"var": "error"
|
|
258
|
-
}
|
|
259
|
-
}
|
|
260
|
-
}
|
|
261
|
-
```
|
|
262
|
-
|
|
263
|
-
**Aggregation operations:**
|
|
264
|
-
|
|
265
|
-
| Operation | Description | `field` required |
|
|
266
|
-
| --- | --- | --- |
|
|
267
|
-
| `count` | Number of items in group | No |
|
|
268
|
-
| `sum` | Sum of numeric field | Yes |
|
|
269
|
-
| `average` | Average of numeric field | Yes |
|
|
270
|
-
| `min` | Minimum value | Yes |
|
|
271
|
-
| `max` | Maximum value | Yes |
|
|
272
|
-
| `collect` | Array of all field values | Yes |
|
|
273
|
-
| `first` | First item's field value | Yes |
|
|
274
|
-
| `last` | Last item's field value | Yes |
|
|
275
|
-
|
|
276
|
-
---
|
|
277
|
-
|
|
278
|
-
## Debug
|
|
279
|
-
|
|
280
|
-
| Error | Cause | Fix |
|
|
281
|
-
| --- | --- | --- |
|
|
282
|
-
| Filter passes all items through | Wrong condition name (e.g. `greater` instead of `greater_than`) | Use exact names: `equals`, `not_equals`, `greater_than`, `less_than`, `greater_equal`, `less_equal`, `contains`, `starts_with`, `ends_with`, `is_null`, `is_not_null` |
|
|
283
|
-
| Filter silently returns empty array | Filter `value` holds an unresolved expression (`"$vars.x"`, `"=js:..."`, `"{$vars.x}"`) — Transform compares each item against that string literal | Replace with a literal scalar (`"value": 500`); expressions are not evaluated in filter `value`. If the threshold must be dynamic, do the filter in a Script node |
|
|
284
|
-
| Collection is null/empty | `collection` was wrapped in `=js:` or set to an inline array literal instead of a plain variable path | Use a path such as `"$vars.loadCatalog.output.catalog"` or `"$vars.catalog"`; keep static arrays in a variable default or upstream node |
|
|
285
|
-
| Map output missing fields | `keepOriginalFields: false` and field not in mappings | Add the field to mappings or set `keepOriginalFields: true` |
|
|
286
|
-
| GroupBy produces empty groups | No items match the group field | Check `groupByField` matches actual field names in the data |
|
|
287
|
-
| Chained transform gets empty input, upstream had rows | `collection` used `$vars.<transform>.output.items`; transform output is a bare array (`.items` → `undefined`) | Use `$vars.<transform>.output` — see [Output Shape](#output-shape) |
|
|
@@ -1,226 +0,0 @@
|
|
|
1
|
-
# Eval Sets and Data Points
|
|
2
|
-
|
|
3
|
-
An eval set is a JSON file that bundles test cases (data points) with the evaluators that score them. Each Flow project can have multiple eval sets — typically one per scenario (smoke, regression, edge cases).
|
|
4
|
-
|
|
5
|
-
## Eval Set Lifecycle
|
|
6
|
-
|
|
7
|
-
```bash
|
|
8
|
-
# Create
|
|
9
|
-
uip maestro flow eval set add "<set_name>" \
|
|
10
|
-
[--evaluators <ref1>,<ref2>] \
|
|
11
|
-
[--entry-point <node_id>] \
|
|
12
|
-
--path <flow_project> --output json
|
|
13
|
-
|
|
14
|
-
# List
|
|
15
|
-
uip maestro flow eval set list --path <flow_project> --output json
|
|
16
|
-
|
|
17
|
-
# Remove
|
|
18
|
-
uip maestro flow eval set remove "<id_or_name>" --path <flow_project> --output json
|
|
19
|
-
```
|
|
20
|
-
|
|
21
|
-
### `--evaluators`
|
|
22
|
-
|
|
23
|
-
Comma-separated list of evaluator IDs or generated file base names. When omitted, the new eval set links to **all evaluators** present in the project at creation time and writes the generated evaluator file refs (for example, `greeting-match-62c0793a.json`). Prefer omission when the eval set should use every current evaluator.
|
|
24
|
-
|
|
25
|
-
Do **not** pass an evaluator display name such as `greeting-match` to `--evaluators`; that writes the display name into `evaluatorRefs`, and Studio Web eval runs will not resolve it. If you need an explicit list, get the generated id/file ref from `uip maestro flow eval evaluator add/list --output json` and pass that value instead.
|
|
26
|
-
|
|
27
|
-
Subsequent evaluators added to the project do NOT auto-attach — link them by re-running `set add` with explicit generated refs, or carefully repair the eval set's `evaluatorRefs` array using the evaluator file refs the CLI created.
|
|
28
|
-
|
|
29
|
-
### `--entry-point`
|
|
30
|
-
|
|
31
|
-
Stored as `selectedEntrypoint` on the eval set. Accepts either:
|
|
32
|
-
|
|
33
|
-
- A flow path: `/Main.bpmn#start`
|
|
34
|
-
- A start node ID: `start_a1b2c3d4`
|
|
35
|
-
|
|
36
|
-
The eval set's entry point is used by `eval run start` unless `--entry-point` is overridden at run time. Pin one explicitly when the flow has multiple entry points; otherwise the first start node found is used and may not be the one you intend.
|
|
37
|
-
|
|
38
|
-
## Data Point Lifecycle
|
|
39
|
-
|
|
40
|
-
Data points (test cases) live **inline** inside the eval set JSON, not as separate files. CRUD via `uip maestro flow eval add/list/remove`:
|
|
41
|
-
|
|
42
|
-
```bash
|
|
43
|
-
# Add a data point
|
|
44
|
-
uip maestro flow eval add "<data_point_name>" \
|
|
45
|
-
--set "<set_name>" \
|
|
46
|
-
--inputs '{"...":"..."}' \
|
|
47
|
-
[--expected '{"...":"..."}'] \
|
|
48
|
-
[--criteria '{"<evaluator_id>": {...}}'] \
|
|
49
|
-
[--input-file <key>=<path>] \
|
|
50
|
-
[--search-text "<text>"] \
|
|
51
|
-
--path <flow_project> --output json
|
|
52
|
-
|
|
53
|
-
# List
|
|
54
|
-
uip maestro flow eval list --set "<set_name>" --path <flow_project> --output json
|
|
55
|
-
|
|
56
|
-
# Remove
|
|
57
|
-
uip maestro flow eval remove "<id_or_name>" --set "<set_name>" --path <flow_project> --output json
|
|
58
|
-
```
|
|
59
|
-
|
|
60
|
-
### `--inputs`
|
|
61
|
-
|
|
62
|
-
JSON object whose keys must match the flow's declared input variables for the chosen entry point. `eval add` validates these keys and fails fast when an input key is not declared in the `.flow` file. Add missing variables first, or change the data point input JSON to match the Flow schema.
|
|
63
|
-
|
|
64
|
-
For a simple string input named `name`:
|
|
65
|
-
|
|
66
|
-
```bash
|
|
67
|
-
uip maestro flow variable add ./MySolution/MyFlow/MyFlow.flow name \
|
|
68
|
-
--direction in --type string --output json
|
|
69
|
-
```
|
|
70
|
-
|
|
71
|
-
### `--expected`
|
|
72
|
-
|
|
73
|
-
JSON object representing the expected output. How it is consumed depends on the evaluator type:
|
|
74
|
-
|
|
75
|
-
| Evaluator type | Reads `--expected` how |
|
|
76
|
-
|----------------|-----------------------|
|
|
77
|
-
| `exact-match` | Compares the output against `expected` verbatim (or `expected[targetKey]` if `--target-key` is set on the evaluator) |
|
|
78
|
-
| `json-similarity` | Tree-compared with tolerance |
|
|
79
|
-
| `contains` | Not used directly — see `--search-text` |
|
|
80
|
-
| `llm-judge-output` | Substituted into `{{ExpectedOutput}}` |
|
|
81
|
-
| `llm-judge-strict-json` | Substituted per-key into `{{ExpectedOutput}}` |
|
|
82
|
-
| `llm-judge-trajectory` | Used along with `--expected-agent-behavior` (set via `--criteria`) |
|
|
83
|
-
| `llm-judge-trajectory-simulation` | Same as `trajectory` plus simulation context |
|
|
84
|
-
|
|
85
|
-
### `--criteria`
|
|
86
|
-
|
|
87
|
-
Per-evaluator overrides keyed by evaluator ID. Use this when one eval set contains multiple evaluators and you want each to score against different criteria for the same data point. Most common shape:
|
|
88
|
-
|
|
89
|
-
```json
|
|
90
|
-
{
|
|
91
|
-
"<evaluator_ref_for_trajectory>": {
|
|
92
|
-
"expectedAgentBehavior": "Agent calls the weather tool with the user's location, then returns a one-sentence summary."
|
|
93
|
-
},
|
|
94
|
-
"<evaluator_ref_for_output>": {
|
|
95
|
-
"expectedOutput": {"summary": "Sunny in NYC, 72°F"}
|
|
96
|
-
}
|
|
97
|
-
}
|
|
98
|
-
```
|
|
99
|
-
|
|
100
|
-
If `--criteria` is omitted, evaluators fall back to `--expected` (for output evaluators) and to defaults (for trajectory evaluators). Always pass an explicit `expectedAgentBehavior` for trajectory evaluators — the LLM's score against an empty `{{ExpectedAgentBehavior}}` is meaningless.
|
|
101
|
-
|
|
102
|
-
### `--input-file <key>=<path>`
|
|
103
|
-
|
|
104
|
-
Repeatable. Attach a file as input under the given key. The CLI stages the file alongside the eval set so the runtime can read it during evaluation. Useful when the flow accepts file inputs (PDFs, CSVs, images) rather than JSON only.
|
|
105
|
-
|
|
106
|
-
```bash
|
|
107
|
-
uip maestro flow eval add invoice-test \
|
|
108
|
-
--set "Smoke Tests" \
|
|
109
|
-
--inputs '{"orderId":"ORD-123"}' \
|
|
110
|
-
--input-file invoice=./fixtures/invoice-123.pdf \
|
|
111
|
-
--input-file receipt=./fixtures/receipt-123.png \
|
|
112
|
-
--expected '{"total": 142.50}' \
|
|
113
|
-
--path ./MySolution/MyFlow --output json
|
|
114
|
-
```
|
|
115
|
-
|
|
116
|
-
The file content is referenced from the eval set; do not delete the source file before the run completes.
|
|
117
|
-
|
|
118
|
-
### `--search-text`
|
|
119
|
-
|
|
120
|
-
Convenience flag for `contains` evaluators only. Attaches the search string to the data point so the contains evaluator knows what substring to test for. Equivalent to writing `criteria` for the contains evaluator.
|
|
121
|
-
|
|
122
|
-
```bash
|
|
123
|
-
uip maestro flow eval add success-keyword \
|
|
124
|
-
--set "Smoke Tests" \
|
|
125
|
-
--inputs '{"task":"deploy"}' \
|
|
126
|
-
--search-text "deployment succeeded" \
|
|
127
|
-
--path ./MySolution/MyFlow --output json
|
|
128
|
-
```
|
|
129
|
-
|
|
130
|
-
## Eval Set JSON Shape
|
|
131
|
-
|
|
132
|
-
A typical eval set JSON file (created by `set add`):
|
|
133
|
-
|
|
134
|
-
```json
|
|
135
|
-
{
|
|
136
|
-
"id": "<uuid>",
|
|
137
|
-
"name": "Smoke Tests",
|
|
138
|
-
"version": "1.0",
|
|
139
|
-
"evaluatorRefs": ["<evaluator-file-ref-1>.json", "<evaluator-file-ref-2>.json"],
|
|
140
|
-
"selectedEntrypoint": "/Main.bpmn#start",
|
|
141
|
-
"evaluations": [
|
|
142
|
-
{
|
|
143
|
-
"id": "<uuid>",
|
|
144
|
-
"name": "hello-test",
|
|
145
|
-
"inputs": {"message": "hello"},
|
|
146
|
-
"expectedOutput": {"reply": "Hello! How can I help you?"},
|
|
147
|
-
"evaluationCriterias": {
|
|
148
|
-
"<evaluator-ref-2>": {
|
|
149
|
-
"expectedAgentBehavior": "Agent responds with a friendly greeting."
|
|
150
|
-
}
|
|
151
|
-
}
|
|
152
|
-
}
|
|
153
|
-
]
|
|
154
|
-
}
|
|
155
|
-
```
|
|
156
|
-
|
|
157
|
-
Key fields:
|
|
158
|
-
|
|
159
|
-
- `version: "1.0"` distinguishes the new eval format from any legacy variants. Keep this. <!-- version-check-skip --> (eval-set file schema version, CLI-emitted by `eval set add` — not a `.flow` version)
|
|
160
|
-
- `evaluatorRefs` references evaluator files generated by the CLI. Prefer CLI commands over hand-editing these refs.
|
|
161
|
-
- `selectedEntrypoint` is the eval set's pinned entry point. Override per-run with `eval run start --entry-point`.
|
|
162
|
-
- `evaluations[]` is the inline list of data points. Order is informational, not significant.
|
|
163
|
-
- `evaluationCriterias` (note plural) is the per-data-point per-evaluator override map.
|
|
164
|
-
|
|
165
|
-
## Aligning Inputs with the Flow Schema
|
|
166
|
-
|
|
167
|
-
The data point's `inputs` JSON must match the flow's input schema at the chosen entry point. Mismatches produce `eval add` errors such as `Input "name" is not declared as an input variable in the flow`. Two ways to verify before adding data points:
|
|
168
|
-
|
|
169
|
-
1. Inspect `<flow>.flow` in the project for `variables` entries with `direction: "in"`.
|
|
170
|
-
2. Run `uip maestro flow variable list <flow_file> --output json`.
|
|
171
|
-
|
|
172
|
-
## Simulations on Data Points
|
|
173
|
-
|
|
174
|
-
Simulations replace selected nodes during an eval run with controlled outputs, so the flow is evaluated without calling real external services. Each simulation targets one component by its node `id` from the `.flow` file.
|
|
175
|
-
|
|
176
|
-
```bash
|
|
177
|
-
# Add an LLM simulation (non-deterministic, prompt-guided)
|
|
178
|
-
uip maestro flow eval simulation add <component-id> \
|
|
179
|
-
--set "<set_name>" \
|
|
180
|
-
--data-point "<data_point_name>" \
|
|
181
|
-
--strategy Llm \
|
|
182
|
-
--component-type connector \
|
|
183
|
-
--simulation-instructions "Pretend to send the email and return success." \
|
|
184
|
-
--output-schema '{"type":"object","properties":{"status":{"type":"string"},"messageId":{"type":"string"}}}' \
|
|
185
|
-
--path <flow_project> --output json
|
|
186
|
-
|
|
187
|
-
# Add a Static simulation (fixed JSON output)
|
|
188
|
-
uip maestro flow eval simulation add <component-id> \
|
|
189
|
-
--set "<set_name>" \
|
|
190
|
-
--data-point "<data_point_name>" \
|
|
191
|
-
--strategy Static \
|
|
192
|
-
--component-type agent \
|
|
193
|
-
--mock-value '{"status":"ok"}' \
|
|
194
|
-
--path <flow_project> --output json
|
|
195
|
-
|
|
196
|
-
# List simulations on a data point
|
|
197
|
-
uip maestro flow eval simulation list \
|
|
198
|
-
--set "<set_name>" \
|
|
199
|
-
--data-point "<data_point_name>" \
|
|
200
|
-
--path <flow_project> --output json
|
|
201
|
-
|
|
202
|
-
# Remove a simulation
|
|
203
|
-
uip maestro flow eval simulation remove <component-id> \
|
|
204
|
-
--set "<set_name>" \
|
|
205
|
-
--data-point "<data_point_name>" \
|
|
206
|
-
--path <flow_project> --output json
|
|
207
|
-
```
|
|
208
|
-
|
|
209
|
-
**Strategy selection:**
|
|
210
|
-
|
|
211
|
-
| Strategy | Use when | Key flags |
|
|
212
|
-
|----------|----------|-----------|
|
|
213
|
-
| `Llm` | Output should be plausible but non-deterministic | `--simulation-instructions`, `--output-schema` (auto-resolved) |
|
|
214
|
-
| `Static` | Output must be identical every run | `--mock-value <json>` |
|
|
215
|
-
|
|
216
|
-
For `Llm` simulations, `--output-schema` is **auto-resolved from the `.flow` file** — the CLI reads the node's output definition (connector `outputJsonSchema`, agent `agentOutputVariables`, or `node.outputs`) and injects it automatically. Pass `--output-schema` explicitly only when you need to override the derived schema or the node has no declared outputs.
|
|
217
|
-
|
|
218
|
-
Simulations are stored inline in the data point's `simulations` array within the eval set JSON. Running `simulation add` twice for the same `<component-id>` on the same data point replaces the existing simulation.
|
|
219
|
-
|
|
220
|
-
## Anti-patterns
|
|
221
|
-
|
|
222
|
-
- **Don't hand-write `id` UUIDs on data points.** Use `uip maestro flow eval add` so the CLI generates fresh UUIDs and keeps `evalSetId` consistent with the parent set.
|
|
223
|
-
- **Don't pass `--inputs` keys that aren't in the flow's input schema.** The CLI rejects unknown keys before writing the data point.
|
|
224
|
-
- **Don't set `--expected '{}'` and skip `--criteria` for trajectory evaluators.** Both placeholders end up empty; scoring is meaningless.
|
|
225
|
-
- **Don't delete attached input files before the run completes.** The CLI references them by path until upload to Studio Web finishes.
|
|
226
|
-
- **Don't expect `--evaluators` on `set add` to auto-update.** Adding new evaluators later does not retroactively link them to existing eval sets.
|