graph-agents-cli 0.3.1__py3-none-any.whl

graph_agents_cli/scaffold/agents/langgraph/{{cookiecutter.agent_guidance_filename}}

@@ -0,0 +1,129 @@
+process: {{ cookiecutter.process if cookiecutter.process else 'null' }}
+
+# Coding Agent Guide for {{cookiecutter.project_name}}
+
+This is a LangGraph project scaffolded by graph-agents-cli. `{{cookiecutter.agent_directory}}/agent.py`
+exports `graph`, a compiled LangGraph agent with no checkpointer bound;
+`{{cookiecutter.agent_directory}}/fast_api_app.py` exports `app`, the FastAPI application that serves
+`POST /chat` (SSE), `GET /threads`, `GET /threads/{id}/messages`, `DELETE /threads/{id}`,
+the approvals of gated API calls (`GET /threads/{id}/approvals`, `GET /approvals`,
+`POST /threads/{id}/approvals/{approval_id}`), `GET /health` (liveness), `GET /ready` (readiness),
+`GET /metrics`, `GET /playground` (dev only) and the A2A protocol under `/a2a/{{cookiecutter.agent_directory}}`.
+Runtime: `{{cookiecutter.runtime}}`. Model provider: `{{cookiecutter.model_provider}}` (`MODEL_PROVIDER` in `.env`).
+Auth policy: `{{cookiecutter.auth_policy}}` (`AUTH_POLICY`). Every setting and its default is in
+`.env.example`; `README.md` explains the API, the auth policies and the deploy rules.
+
+## Governing process
+
+The `process:` line at the top of this file names the process document that
+governs this project. When it is not `null`, follow that process's gates and
+approvals instead of the generic spec-before-code gate of the
+`graph-agents-cli-workflow` skill, and treat the generic gate as satisfied only
+by that process's approvals. When it is `null`, the generic gate applies:
+write `.graph-agents-cli-spec.md` and get it approved before writing code.
+
+## The loop
+
+1. Build in `{{cookiecutter.agent_directory}}/`. Tools live in `{{cookiecutter.agent_directory}}/tools/`; every tool module
+   (subpackages included) declares `API_CALLS` as one literal list (empty when it calls no
+   external API) and reaches an external API only through `get_client("<api>")` of
+   `{{cookiecutter.agent_directory}}/app_utils/api_client.py`, which enforces `api-policy.yaml` and fails closed.
+   Keep `graph` unbound (no checkpointer) and keep its `recursion_limit` config and its
+   middleware (`SurfaceApiErrors`, `AnswerInvalidToolCalls`, which answers tool calls whose
+   arguments are not valid JSON, and `UntrustedToolResults`, which fences tool results as
+   untrusted data).
+2. Try it: `cp .env.example .env` and `graph-agents-cli login --write-env` once, then
+   `graph-agents-cli playground` (the app with `/playground`), or `graph-agents-cli run "prompt"`. `graph-agents-cli playground --graph` opens
+   LangGraph Studio against the graph directly (bypasses the auth policy).
+{%- if cookiecutter.auth_policy == 'jwt' %}
+   This project's policy is `jwt`: before `run` or `eval run`, put a local token in the variable
+   they send, `export GRAPH_AGENTS_CLI_API_KEY="$(graph-agents-cli auth dev-token --sub <user> --roles <roles>)"`
+   (dev key, `APP_ENV=dev` only). Never put a token on the command line (`--header`).
+{%- endif %}
+3. Write eval cases by hand in `tests/eval/datasets/`, then `graph-agents-cli eval run`
+   until the gate passes. `eval compare` shows regressions; `eval analyze` clusters failures.
+4. `uv run pytest` and `graph-agents-cli lint` before deploying.
+{%- if cookiecutter.deployment_target != 'kubernetes' %}
+5. No deployment target yet: `graph-agents-cli scaffold enhance --deployment-target kubernetes`
+   adds the chart and the deploy commands, only when the user asks for it.
+{%- else %}
+5. `graph-agents-cli deploy --env dev` **only after the user approves it.**
+{%- endif %}
+{%- if cookiecutter.deployment_target != 'kubernetes' %}
+{%- elif cookiecutter.cd == 'skip' %}
+   With `cd: skip` staging and production are direct deploys too (`deploy --env staging|prod`):
+   the kube context must be recorded in the manifest or passed with `--context`, and secrets come
+   from `.env.<env>`, never `.env`.
+{%- else %}
+   Staging and production go through the CI/CD path recorded in the manifest (`cd: {{cookiecutter.cd}}`);
+   outside `dev` the kube context must be recorded in the manifest or passed with `--context`, and
+   secrets come from `.env.<env>`, never `.env`.
+{%- endif %}
+
+## Commands
+
+| Command | Purpose |
+|---|---|
+| `graph-agents-cli playground` | Run the app with reload and open the dev chat page |
+| `graph-agents-cli run "prompt"` | One-shot chat (`--mode a2a` for the A2A path, `--url` for a deployed agent) |
+| `uv run pytest` | Unit and integration tests (fake model, in-memory checkpointer; they read neither `.env` nor your tools) |
+{%- if cookiecutter.auth_policy == 'jwt' %}
+| `graph-agents-cli auth dev-token --sub <user>` | A JWT for local runs, printed for `GRAPH_AGENTS_CLI_API_KEY` |
+{%- endif %}
+| `graph-agents-cli eval run` | Generate traces and grade them against the gate |
+| `graph-agents-cli lint` | ruff plus the API-policy check of every tool |
+| `graph-agents-cli api show` / `api check` | The outbound API policy and each tool's declared calls / the policy check alone |
+| `graph-agents-cli approvals list` | Gated API calls waiting for a person's approval (deciding one is the user's, not yours) |
+| `graph-agents-cli build` | Build the container image from the runtime's Dockerfile |
+| `graph-agents-cli deploy --env <env>` | Deploy (direct modes) or open the desired-state PR (argocd) |
+| `graph-agents-cli secrets apply --env <env>` | Create or update the environment's app Secret from `.env.<env>` |
+| `graph-agents-cli secrets status --env <env>` | Which keys the Secret holds (never values); exit 1 on a missing required key |
+| `graph-agents-cli infra check --env <env>` | Read-only report of cluster and GitHub prerequisites |
+
+## Rules
+
+- **Spec before code** unless the governing process says otherwise (see above).
+- **Change only what was asked.** Preserve surrounding code, comments, config values and formatting.
+- **Never change the model** (`MODEL_PROVIDER`, `MODEL_NAME`) unless explicitly asked.
+  A model 404 means the name is wrong for the provider or the endpoint; fix the
+  configuration in `.env`, not `{{cookiecutter.agent_directory}}/agent.py`.
+- **Human approval before deploy.** Never run `graph-agents-cli deploy` without the user's explicit go-ahead,
+  and never pass `--yes` (accepting the kubeconfig's current context) or `--rotate-api-key` on your own.
+- **Run Python through uv**: `uv run python script.py`, after `uv sync`.
+- **Three strikes.** The same error three times means fix the cause, not retry.
+- **The example tool is yours to replace.** `tools/weather.py` (and its eval case) only show the
+  pattern; the tests under `tests/` use their own test tool, so removing it breaks no test.
+- **Tools declare their API calls.** Add an `API_CALLS` entry (`api`, `method`,
+  `operation_id` and/or `path`) for every external API call a tool makes;
+  `graph-agents-cli lint` refuses undeclared or disallowed calls. Use the
+  `operation_id` the API's spec gives the call, the same in `API_CALLS` and on the
+  call; never relabel a call to get it past `lint` (a denial holds on the path
+  anyway). Never bypass `api_client.py` with a raw HTTP client.
+- **Change `api-policy.yaml` only when the user asks**, with `graph-agents-cli api`
+  (`add`, `access`, `allow`, `deny`, `revoke`, `limits`, `approval`, `remove`; show the
+  user the printed diff, use `--dry-run` first). The policy is a security boundary: never
+  widen access (more methods or operations, a lifted denial, a raised limit, a removed
+  or loosened `approval` gate, `requester` added to a four-eyes gate) on your own. When
+  a tool needs a call the policy refuses, `lint` prints the command that would allow it:
+  propose it, do not run it unasked. Widening goes through a pull request reviewed by the
+  code owners. Proposing an `approval` gate for write calls is welcome; adding one is
+  still the user's decision.
+- **Gated calls pause for a person.** A call the policy's `approval` gates waits for an
+  approver: never approve or reject one yourself (the approvals routes,
+  `graph-agents-cli approvals`), unless the user explicitly tells you to decide that one.
+  A tool makes at most one gated call per tool call, and code before it runs again on
+  resume, so keep other side effects after it; pass `redact=[...]` for fields an approver
+  need not read. Tests of gated tools run inside a graph (see `tests/unit/test_approval_ledger.py`).
+- **A response schema is a contract.** When `{{cookiecutter.agent_directory}}/response_schema.json`
+  exists, clients read the agent's final answer as that JSON (`message.end`
+  `structured_response`): change it only when the user asks, keep `response_format=` and
+  `StructuredAnswer()` (last) in `agent.py`, and run `graph-agents-cli lint` after an edit.
+- **Never edit `graph-agents-cli-manifest.yaml` or `values-prod.yaml`** unless the
+  user asks: production desired state changes only through a pull request reviewed
+  by the code owners.
+- **Do not export prompts or user data** to a hosted tracing destination unless
+  the user has decided so (`TRACING_ENABLED`, `TRACE_CAPTURE=full`).
+- **Never log credentials, prompts or tool arguments**, and keep secrets out of
+  `Principal.attributes` except under `attributes["credentials"]`.
+- **Respect the guardrails** (`RUN_TIMEOUT_S`, `RECURSION_LIMIT`, the one-run-per-thread 409):
+  fix a tool or graph that hits them instead of raising the limits, unless the user asks.

graph_agents_cli/scaffold/base_templates/_shared/graph-agents-cli-manifest.yaml

@@ -0,0 +1,36 @@
+# Project manifest written by `graph-agents-cli create`.
+# Authoritative for `info`, `upgrade`, `deploy` and `secrets`; edit deliberately.
+name: '{{cookiecutter.project_name}}'
+cli_version: '{{cookiecutter.package_version}}'
+agent_directory: '{{cookiecutter.agent_directory}}'
+base_template: '{{cookiecutter.recorded_base_template}}'
+generated_at: '{{cookiecutter.generated_at}}'
+language: '{{cookiecutter.language or "python"}}'
+create_params:
+  deployment_target: '{{cookiecutter.deployment_target}}'
+  runtime: '{{cookiecutter.runtime}}'
+  model_provider: '{{cookiecutter.model_provider}}'
+  model: '{{cookiecutter.model}}'
+  checkpointer: '{{cookiecutter.checkpointer}}'
+  registry: '{{cookiecutter.registry}}'
+  cd: '{{cookiecutter.cd}}'
+  auth_policy: '{{cookiecutter.auth_policy}}'
+  # false while the custom auth policy stub is in place; deploy --env staging|prod refuses until true
+  auth_policy_implemented: {{ 'false' if cookiecutter.auth_policy == 'custom' else 'true' }}
+  agent_guidance_filename: '{{cookiecutter.agent_guidance_filename}}'
+{%- if cookiecutter.deployment_target == 'kubernetes' %}
+environments:
+  dev: { context: "", namespace: {{cookiecutter.project_name}}-dev }
+  staging: { context: "", namespace: {{cookiecutter.project_name}}-staging }
+  prod: { context: "", namespace: {{cookiecutter.project_name}}-prod }
+{%- endif %}
+secrets:
+  # Only these keys are exported from an env file into the environment's Secret.
+  keys: [{{ cookiecutter.secret_keys | join(', ') }}]
+  # Team or role responsible for provisioning and rotating the Secret (free text).
+  owner: ""
+{%- if cookiecutter.has_api_policy %}
+api_policy:
+  policy_file: api-policy.yaml
+{%- endif %}
+process: {{ cookiecutter.process if cookiecutter.process else 'null' }}

graph_agents_cli/scaffold/base_templates/python/.dockerignore

@@ -0,0 +1,32 @@
+# Build context exclusions for `graph-agents-cli build` / `deploy` (context `.`).
+# Docker does not read .gitignore: without this file the image (and the
+# registry it is pushed to) would carry .env with the API keys, the virtualenv,
+# .git (with a CI checkout token), artifacts and the local run state.
+.git
+.github
+.env
+.env.*
+!.env.example
+.venv
+.venv*
+.graph-agents-cli/
+.langgraph_api/
+artifacts/
+deployment/
+tests/
+docs/
+__pycache__/
+*.py[cod]
+.pytest_cache/
+.ruff_cache/
+.mypy_cache/
+.saved_chats
+.locust_env
+.persist_vector_store
+*.pem
+*-key.json
+credentials*.json
+.vscode/
+.idea/
+Dockerfile*
+.dockerignore

graph_agents_cli/scaffold/base_templates/python/.github/CODEOWNERS

@@ -0,0 +1,30 @@
+# Everything that decides what runs in production, or what the CI gate checks,
+# changes only through a pull request reviewed by these owners (the production
+# gate). Replace the placeholder with the team or users who approve production
+# changes (GitHub ignores an owner that does not exist, which silently removes
+# the gate; `graph-agents-cli infra check` reports a leftover placeholder).
+# Branch protection on main must require code-owner review, dismiss stale
+# approvals and prevent self-approval.
+#
+{%- if cookiecutter.deployment_target == 'kubernetes' %}
+# Deployment: the chart, the shared and prod values and the Argo CD Applications.
+/deployment/ @CHANGE-ME/production-approvers
+# ...except the dev and staging values: the staging workflow's image-tag PR
+# merges automatically once pr_checks passes (a line without owners leaves
+# the file unowned, so ordinary review applies).
+/deployment/helm/*/values-dev.yaml
+/deployment/helm/*/values-staging.yaml
+{%- endif %}
+# CI/CD: the workflows, their settings (.github/agent.env) and this file.
+/.github/ @CHANGE-ME/production-approvers
+# The outbound API access policy the running agent enforces.
+/api-policy.yaml @CHANGE-ME/production-approvers
+# The eval gate's datasets and thresholds.
+/tests/eval/ @CHANGE-ME/production-approvers
+# Project extensions, which can replace CLI commands (including lint and eval),
+# and the CLI's local state directory (gitignored; covered should it be committed).
+/graph-agents-cli-extensions.yaml @CHANGE-ME/production-approvers
+/extensions/ @CHANGE-ME/production-approvers
+/.graph-agents-cli/ @CHANGE-ME/production-approvers
+# Project settings the CLI reads for every command (runtime, CD mode, Secret keys).
+/graph-agents-cli-manifest.yaml @CHANGE-ME/production-approvers

graph_agents_cli/scaffold/base_templates/python/.github/agent.env

@@ -0,0 +1,7 @@
+# Project settings for the GitHub workflows (which are copied verbatim, not
+# rendered). Read as data, never sourced by a shell: one NAME=VALUE per line,
+# no quoting needed even when a value contains spaces; lines starting with #
+# are comments. Only known settings are accepted (the workflows refuse any
+# other name, so this file cannot change how their steps run).
+# Where the workflows install graph-agents-cli from (uvx --from "$GRAPH_AGENTS_CLI_SPEC").
+GRAPH_AGENTS_CLI_SPEC={{cookiecutter.cli_install_spec}}

graph_agents_cli/scaffold/base_templates/python/.github/workflows/pr_checks.yaml

@@ -0,0 +1,214 @@
+# Copyright 2026 Google LLC
+# Modifications Copyright 2026 graph-agents-cli contributors
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+# CI for every pull request (make it a required status check on main): lint,
+# unit and integration tests, the API-policy check, and the eval gate when a
+# dataset exists. This file is copied verbatim (not rendered); project settings,
+# including where graph-agents-cli is installed from (GRAPH_AGENTS_CLI_SPEC),
+# come from .github/agent.env.
+#
+# Models: the tests always run against the deterministic fake model. The eval
+# gate uses the project's real provider (create_params in
+# graph-agents-cli-manifest.yaml) when that provider's key is a repository
+# secret, or the MODEL_PROVIDER / MODEL_NAME repository variables when set;
+# JUDGE_MODEL_PROVIDER / JUDGE_MODEL_NAME / JUDGE_BASE_URL variables and a
+# JUDGE_API_KEY secret pick a separate judge. On the fake model the gate only
+# checks the plumbing, and the run says so with a warning.
+#
+# The gate steps run the CLI's own `lint` and `eval run`: extensions (project
+# or user scope) cannot override them here (GRAPH_AGENTS_CLI_DISABLE_OVERRIDES=1
+# for the whole job).
+
+name: pr_checks
+
+on:
+  pull_request:
+    branches:
+      - main
+
+jobs:
+  checks:
+    runs-on: ubuntu-latest
+    permissions:
+      contents: read
+    env:
+      MODEL_PROVIDER: fake
+      MODEL_NAME: fake
+      CHECKPOINTER: memory
+      AUTH_POLICY: shared-bearer
+      API_KEY: ci-test-key
+      GRAPH_AGENTS_CLI_API_KEY: ci-test-key
+      APP_ENV: ci
+      TRACING_ENABLED: "false"
+      GRAPH_AGENTS_CLI_NO_UPDATE_CHECK: "1"
+      # Every graph-agents-cli command of this job is the CLI's own: a project
+      # (or runner-wide) extension cannot replace the gate's lint or eval.
+      GRAPH_AGENTS_CLI_DISABLE_OVERRIDES: "1"
+    steps:
+      - name: Checkout code
+        uses: actions/checkout@v4
+
+      - name: Load project settings
+        run: |
+          # .github/agent.env is data and is never sourced: each NAME=VALUE line is
+          # checked and copied to GITHUB_ENV, so a value may hold spaces or shell
+          # metacharacters (a PEP 508 install spec, for example). Only the settings
+          # listed in `known` are accepted: any other name (BASH_ENV, SHELLOPTS, PS4,
+          # PATH, PYTHONPATH, ...) could change how later steps run. To add a setting,
+          # extend `known` in all three workflows. Comment and blank lines are skipped;
+          # blanks around the value, one pair of quotes around it and a trailing
+          # " # comment" are dropped (no escapes, no expansion). Nothing reaches
+          # GITHUB_ENV unless the whole file is valid.
+          file=.github/agent.env
+          known="IMAGE_REPOSITORY RELEASE_NAME CHART_PATH RUNTIME CD GRAPH_AGENTS_CLI_SPEC"
+          if [ ! -f "$file" ]; then
+            echo "::error file=$file::$file is missing: it holds the project settings these workflows read." >&2
+            exit 1
+          fi
+          lineno=0
+          seen=" "
+          settings=()
+          while IFS= read -r line || [ -n "$line" ]; do
+            lineno=$((lineno + 1))
+            line="${line%$'\r'}"
+            if [ "$lineno" -eq 1 ]; then
+              line="${line#$'\xef\xbb\xbf'}"
+            fi
+            if [[ "$line" =~ ^[[:space:]]*(#|$) ]]; then
+              continue
+            fi
+            if ! [[ "$line" =~ ^[[:space:]]*([A-Za-z_][A-Za-z0-9_]*)[[:space:]]*=(.*)$ ]]; then
+              echo "::error file=$file,line=$lineno::expected NAME=VALUE, got: $line" >&2
+              exit 1
+            fi
+            name="${BASH_REMATCH[1]}"
+            value="${BASH_REMATCH[2]}"
+            case " $known " in
+              *" $name "*) ;;
+              *)
+                hint=""
+                if [ "$name" = CLI_VERSION_PIN ]; then
+                  hint=" (replaced by GRAPH_AGENTS_CLI_SPEC=<install spec>)"
+                fi
+                echo "::error file=$file,line=$lineno::$name is not a setting these workflows read${hint}; known: $known." >&2
+                exit 1
+                ;;
+            esac
+            case "$seen" in
+              *" $name "*)
+                echo "::error file=$file,line=$lineno::$name is set twice." >&2
+                exit 1
+                ;;
+            esac
+            seen="$seen$name "
+            value="${value#"${value%%[![:space:]]*}"}"
+            quote="${value:0:1}"
+            if [ "$quote" = '"' ] || [ "$quote" = "'" ]; then
+              rest="${value:1}"
+              if [[ "$rest" != *"$quote"* ]]; then
+                echo "::error file=$file,line=$lineno::$name: unterminated $quote quote." >&2
+                exit 1
+              fi
+              value="${rest%%"$quote"*}"
+            else
+              value="${value%%[[:space:]]#*}"
+              value="${value%"${value##*[![:space:]]}"}"
+            fi
+            if [[ "$value" == *[[:cntrl:]]* ]]; then
+              echo "::error file=$file,line=$lineno::$name: control characters are not allowed in a value." >&2
+              exit 1
+            fi
+            settings+=("$name=$value")
+          done < "$file"
+          if [ "${#settings[@]}" -gt 0 ]; then
+            printf '%s\n' "${settings[@]}" >> "$GITHUB_ENV"
+          fi
+
+      - name: Install uv
+        uses: astral-sh/setup-uv@v6
+        with:
+          python-version: "3.12"
+
+      - name: Install dependencies
+        run: uv sync --locked
+
+      - name: Lint (ruff)
+        run: uv run ruff check .
+
+      - name: Unit and integration tests
+        run: uv run pytest tests/unit tests/integration -q
+
+      - name: graph-agents-cli lint (code and API-policy check)
+        run: |
+          : "${GRAPH_AGENTS_CLI_SPEC:?GRAPH_AGENTS_CLI_SPEC is not set in .github/agent.env}"
+          uvx --from "$GRAPH_AGENTS_CLI_SPEC" graph-agents-cli lint
+
+      - name: Eval gate
+        env:
+          REPO_MODEL_PROVIDER: ${{ vars.MODEL_PROVIDER }}
+          REPO_MODEL_NAME: ${{ vars.MODEL_NAME }}
+          OPENAI_BASE_URL: ${{ vars.OPENAI_BASE_URL }}
+          OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
+          ANTHROPIC_API_KEY: ${{ secrets.ANTHROPIC_API_KEY }}
+          GOOGLE_API_KEY: ${{ secrets.GOOGLE_API_KEY }}
+          MODEL_API_KEY: ${{ secrets.MODEL_API_KEY }}
+          JUDGE_MODEL_PROVIDER: ${{ vars.JUDGE_MODEL_PROVIDER }}
+          JUDGE_MODEL_NAME: ${{ vars.JUDGE_MODEL_NAME }}
+          JUDGE_BASE_URL: ${{ vars.JUDGE_BASE_URL }}
+          JUDGE_API_KEY: ${{ secrets.JUDGE_API_KEY }}
+        run: |
+          : "${GRAPH_AGENTS_CLI_SPEC:?GRAPH_AGENTS_CLI_SPEC is not set in .github/agent.env}"
+          if ! ls tests/eval/datasets/*.json >/dev/null 2>&1; then
+            echo "No dataset under tests/eval/datasets; skipping the eval gate."
+            exit 0
+          fi
+          manifest=graph-agents-cli-manifest.yaml
+          project_provider="$(yq -r '.create_params.model_provider // ""' "$manifest")"
+          project_model="$(yq -r '.create_params.model // ""' "$manifest")"
+          provider="${REPO_MODEL_PROVIDER:-$project_provider}"
+          model="$REPO_MODEL_NAME"
+          if [ -z "$model" ] && [ "$provider" = "$project_provider" ]; then
+            model="$project_model"
+          fi
+          case "$provider" in
+            openai) key_var=OPENAI_API_KEY ;;
+            anthropic) key_var=ANTHROPIC_API_KEY ;;
+            gemini) key_var=GOOGLE_API_KEY ;;
+            openai-compatible) key_var=MODEL_API_KEY ;;
+            *) key_var="" ;;
+          esac
+          # A provider named by the repository variable is used as is (a local
+          # openai-compatible server may need no key); the project's own
+          # provider only when its key secret is present.
+          if [ "$provider" != fake ] && { [ -n "$REPO_MODEL_PROVIDER" ] || { [ -n "$key_var" ] && [ -n "${!key_var:-}" ]; }; }; then
+            if [ -z "$model" ]; then
+              echo "::error::Set the MODEL_NAME repository variable: MODEL_PROVIDER=$provider differs from the project's provider ($project_provider)." >&2
+              exit 1
+            fi
+            export MODEL_PROVIDER="$provider" MODEL_NAME="$model"
+          fi
+          judge="$(yq -r '.judge.provider // ""' tests/eval/eval_config.yaml 2>/dev/null || true)"
+          judge="${judge:-${JUDGE_MODEL_PROVIDER:-$MODEL_PROVIDER}}"
+          echo "Eval gate: agent model ${MODEL_PROVIDER}/${MODEL_NAME}, judge provider ${judge}."
+          if [ "$MODEL_PROVIDER" = fake ] || [ "$judge" = fake ]; then
+            message="The eval gate ran on the fake model (agent: ${MODEL_PROVIDER}, judge: ${judge}): it checks the plumbing, not answer quality. Add the ${key_var:-provider key} repository secret (or set the MODEL_PROVIDER / JUDGE_MODEL_PROVIDER variables) for a real quality gate."
+            echo "::warning title=Eval gate is not a quality signal::${message}"
+            {
+              echo "### :warning: Eval gate is not a quality signal"
+              echo
+              echo "$message"
+            } >> "$GITHUB_STEP_SUMMARY"
+          fi
+          uvx --from "$GRAPH_AGENTS_CLI_SPEC" graph-agents-cli eval run

graph_agents_cli/scaffold/base_templates/python/.gitignore

@@ -0,0 +1,209 @@
+# Byte-compiled / optimized / DLL files
+__pycache__/
+*.py[cod]
+*.pyc
+*$py.class
+**/dist
+/tmp
+/out-tsc
+/bazel-out
+
+# C extensions
+*.so
+
+# Distribution / packaging
+.Python
+build/
+develop-eggs/
+dist/
+downloads/
+eggs/
+.eggs/
+lib/
+lib64/
+parts/
+sdist/
+var/
+wheels/
+pip-wheel-metadata/
+share/python-wheels/
+*.egg-info/
+.installed.cfg
+*.egg
+MANIFEST
+
+# PyInstaller
+#  Usually these files are written by a python script from a template
+#  before PyInstaller builds the exe, so as to inject date/other infos into it.
+*.manifest
+*.spec
+
+# Installer logs
+pip-log.txt
+pip-delete-this-directory.txt
+
+# Unit test / coverage reports
+htmlcov/
+.tox/
+.nox/
+.coverage
+.coverage.*
+.cache
+nosetests.xml
+coverage.xml
+*.cover
+*.py,cover
+.hypothesis/
+.pytest_cache/
+
+# Translations
+*.mo
+*.pot
+
+# Django stuff:
+*.log
+local_settings.py
+db.sqlite3
+db.sqlite3-journal
+
+# Flask stuff:
+instance/
+.webassets-cache
+
+# Scrapy stuff:
+.scrapy
+
+# Sphinx documentation
+docs/_build/
+
+# PyBuilder
+target/
+
+# IPython
+profile_default/
+ipython_config.py
+
+# pyenv
+.python-version
+
+# pipenv
+#   According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
+#   However, in case of collaboration, if having platform-specific dependencies or dependencies
+#   having no cross-platform support, pipenv may install dependencies that don't work, or not
+#   install all needed dependencies.
+Pipfile.lock
+Pipfile
+
+# PEP 582; used by e.g. github.com/David-OConnor/pyflow
+__pypackages__/
+
+# Celery stuff
+celerybeat-schedule
+celerybeat.pid
+
+# SageMath parsed files
+*.sage.py
+
+# Environments
+.env
+!.env.example
+.venv
+.venv*
+env/
+venv/
+ENV/
+env.bak/
+venv.bak/
+
+# Spyder project settings
+.spyderproject
+.spyproject
+
+# Rope project settings
+.ropeproject
+
+# mkdocs documentation
+/site
+
+# mypy (legacy, kept for compatibility)
+.mypy_cache/
+.dmypy.json
+dmypy.json
+
+# ty (Astral's type checker)
+.ty/
+
+# Pyre type checker
+.pyre/
+
+# macOS
+.DS_Store
+
+# PyCharm
+.idea
+
+tmp*
+.graph-agents-cli-scripts/
+
+# Node
+**/node_modules
+npm-debug.log
+yarn-error.log
+
+# IDEs and editors
+.idea/
+.project
+.classpath
+.c9/
+*.launch
+.settings/
+*.sublime-workspace
+
+# Visual Studio Code
+.vscode/*
+!.vscode/settings.json
+!.vscode/tasks.json
+!.vscode/launch.json
+!.vscode/extensions.json
+.history/*
+
+# Miscellaneous
+**/.angular/*
+/.angular/cache
+.sass-cache/
+/connect.lock
+/coverage
+/libpeerconnection.log
+testem.log
+/typings
+
+# System files
+.DS_Store
+Thumbs.db
+*.vscode*
+# graph-agents-cli specific
+artifacts/
+.persist_vector_store
+tests/load_test/.results/*.html
+tests/load_test/.results/*.csv
+.locust_env
+.saved_chats
+.env
+.graph-agents-cli/
+.env.*
+!.env.example
+# The local `langgraph dev` server's threads and the app's approvals (conversation content)
+.langgraph_api/
+
+# A2A Inspector
+tools/a2a-inspector/
+
+# Credentials and private keys
+*.pem
+*-key.json
+credentials*.json
+
+# Helm dependency downloads and their lock (rebuilt by `helm dependency build`, which
+# `deploy` and the chart tests run; Chart.yaml pins the versions)
+deployment/helm/*/charts/
+deployment/helm/*/Chart.lock

graph_agents_cli/scaffold/base_templates/python/tests/unit/test_dummy.py

@@ -0,0 +1,23 @@
+# Copyright 2026 Google LLC
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+"""
+You can add your unit tests here.
+This is where you test your business logic, including agent functionality,
+data processing, and other core components of your application.
+"""
+
+
+def test_dummy() -> None:
+    """Placeholder - replace with real tests."""
+    assert 1 == 1