parseforge 0.2.9__tar.gz → 0.2.12__tar.gz

{parseforge-0.2.9/parseforge.egg-info → parseforge-0.2.12}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: parseforge
-Version: 0.2.9
+Version: 0.2.12
 Summary: LLM-driven pipeline that forges, validates, and promotes TextFSM templates from network CLI output
 Author-email: Tuyen Mathew Duong <tuyen@geekstrident.com>
 Maintainer-email: Tuyen Mathew Duong <tuyen@geekstrident.com>
@@ -69,6 +69,18 @@ Requires-Dist: textfsm-ai[cohere]>=0.6.1; extra == "cohere"
 Provides-Extra: azure
 Requires-Dist: azure-ai-inference>=1.0.0b9; extra == "azure"
 Requires-Dist: textfsm-ai[azure]>=0.6.1; extra == "azure"
+Provides-Extra: gemini
+Requires-Dist: google-genai>=0.2.0; extra == "gemini"
+Requires-Dist: textfsm-ai[gemini]>=0.6.1; extra == "gemini"
+Provides-Extra: vertexai
+Requires-Dist: google-genai>=0.2.0; extra == "vertexai"
+Requires-Dist: textfsm-ai[vertexai]>=0.6.1; extra == "vertexai"
+Provides-Extra: bedrock
+Requires-Dist: boto3==1.42.97; extra == "bedrock"
+Requires-Dist: textfsm-ai[bedrock]>=0.6.1; extra == "bedrock"
+Provides-Extra: oci
+Requires-Dist: oci==2.182.0; extra == "oci"
+Requires-Dist: textfsm-ai[oci]>=0.6.1; extra == "oci"
 Provides-Extra: sampling
 Requires-Dist: netmiko>=4.0; extra == "sampling"
 Provides-Extra: dev
@@ -82,6 +94,9 @@ Requires-Dist: openai>=1.0.0; extra == "dev"
 Requires-Dist: mistralai==1.10.0; extra == "dev"
 Requires-Dist: cohere==5.21.1; extra == "dev"
 Requires-Dist: azure-ai-inference>=1.0.0b9; extra == "dev"
+Requires-Dist: google-genai>=0.2.0; extra == "dev"
+Requires-Dist: boto3==1.42.97; extra == "dev"
+Requires-Dist: oci==2.182.0; extra == "dev"
 Provides-Extra: release
 Requires-Dist: bump2version; extra == "release"
 Requires-Dist: build; extra == "release"
@@ -124,11 +139,12 @@ command that's pure local processing (`canonical`/`readable`/`recognizers`,
 LLM (`name`, `check --provider`, `run`, `generate-template`, `trial`) needs the
 extra for whichever provider it uses: `anthropic`, `openai`, `deepseek`,
 `groq`, `xai`, `together`, `fireworks`, `perplexity`, `openrouter`,
-`moonshot`, `cerebras`, `mistral`, `cohere`, or `azure`. `--provider` defaults
-to `anthropic` wherever it isn't required, so that's the one most setups
-need. `pip install parseforge[sampling]` adds Netmiko for live device
-sampling; combine extras as needed, e.g.
-`pip install parseforge[anthropic,openai,deepseek,groq,xai,together,fireworks,perplexity,openrouter,moonshot,cerebras,mistral,cohere,azure,sampling]`.
+`moonshot`, `cerebras`, `mistral`, `cohere`, `azure`, `gemini`, `vertexai`,
+`bedrock`, or `oci`. `--provider` defaults to `anthropic` wherever it isn't
+required, so that's the one most setups need. `pip install
+parseforge[sampling]` adds Netmiko for live device sampling; combine
+extras as needed, e.g.
+`pip install parseforge[anthropic,openai,deepseek,groq,xai,together,fireworks,perplexity,openrouter,moonshot,cerebras,mistral,cohere,azure,gemini,vertexai,bedrock,oci,sampling]`.
 
 ## Development
 
@@ -136,13 +152,14 @@ sampling; combine extras as needed, e.g.
 pip install -e ".[dev,sampling]"
 pytest
 ```
-`dev` already includes the `anthropic`, `openai`, `mistralai`, `cohere`, and
-`azure-ai-inference` SDKs (tests exercise all fourteen providers —
-`anthropic`, `openai`, `deepseek`, `groq`, `xai`, `together`, `fireworks`,
-`perplexity`, `openrouter`, `moonshot`, `cerebras` share just the first two
-packages, and `mistral`/`cohere`/`azure` each need their own SDK — and never
-silently skip) — add the specific `,<provider>` extra explicitly only if
-installing outside of `dev`.
+`dev` already includes the `anthropic`, `openai`, `mistralai`, `cohere`,
+`azure-ai-inference`, `google-genai`, `boto3`, and `oci` SDKs (tests exercise
+all eighteen providers — `anthropic`, `openai`, `deepseek`, `groq`, `xai`,
+`together`, `fireworks`, `perplexity`, `openrouter`, `moonshot`, `cerebras`
+share just the first two packages, `mistral`/`cohere`/`azure`/`bedrock`/`oci`
+each need their own SDK, and `gemini`/`vertexai` share `google-genai` — and
+never silently skip) — add the specific `,<provider>` extra explicitly only
+if installing outside of `dev`.
 
 Linting/formatting/type-checking/docs run through tox instead of extras — see
 `tox.ini` (`tox -e lint`/`format`/`typecheck`/`docs`), each installing its own
@@ -167,11 +184,23 @@ and `--api-key` falls back to that provider's own env var (`ANTHROPIC_API_KEY`/
 `OPENAI_API_KEY`/`DEEPSEEK_API_KEY`/etc.). A cache hit (a command already seen
 before) never touches the LLM, so no key is needed at all in that case.
 
-`--provider azure` is the one exception to the usual `--api-key`/`--model` shape —
-Azure has no fixed base_url or model catalog, so it also needs `--endpoint`
+`--provider azure`/`--provider vertexai`/`--provider bedrock`/`--provider oci`
+are the four exceptions to the usual `--api-key`/`--model` shape. Azure has
+no fixed base_url or model catalog, so it also needs `--endpoint`
 (`AZURE_ENDPOINT`), `--api-version` (`AZURE_API_VERSION`), and `--deployment`
-(`AZURE_DEPLOYMENT`, replacing `--model`). Same three options exist on
-`check --provider`, `run`, and `generate-template` below.
+(`AZURE_DEPLOYMENT`, replacing `--model`). Vertex AI has no API key at all —
+it authenticates via GCP's own Application Default Credentials — so
+`--api-key`/`AZURE_API_KEY`-style env vars don't apply; it needs
+`--gcp-project` (`VERTEXAI_PROJECT`) and `--gcp-location` (`VERTEXAI_REGION`)
+instead. Bedrock likewise has no API key at all — it authenticates via AWS's
+own credential chain — and just needs `--region` (`BEDROCK_REGION`, then
+`BEDROCK_DEFAULT_REGION`). OCI also has no API key at all — it signs each
+request cryptographically against local credentials in `~/.oci/config`
+(DEFAULT profile) — and needs both `--region` (`OCI_REGION`, then whatever
+region is already set in `~/.oci/config`) and `--compartment-id`
+(`OCI_COMPARTMENT_ID`, the OCID of the compartment/tenancy to bill and scope
+requests to). Same options exist on `check --provider`, `run`, and
+`generate-template` below.
 
 **`check`** — validate a connector or provider before spending time/tokens on a real
 run. With neither `--env` nor explicit connection flags, prints what a connector needs
@@ -212,14 +241,21 @@ parseforge run --vendor cisco --family catalyst9200 --os ios-xe --version 17.9.1
   --model claude-haiku-4-5-20251001 \
   show clock
 ```
-`--provider`/`--api-key`/`--model` are for generation. Naming has its own separate
+`--provider`/`--api-key`/`--model` are for generation (`--api-key` isn't
+required for `--provider vertexai`/`--provider bedrock`/`--provider oci`).
+Naming has its own separate
 `--naming-provider`/`--naming-api-key`/`--naming-model`, defaulting independently
 (`--naming-provider` defaults to `anthropic`; the other two fall back to that
 provider's own env var/default model) — set them explicitly if naming needs a
 different provider than generation. `--provider azure`/`--naming-provider azure`
 each get their own `--endpoint`/`--api-version`/`--deployment` (generation) and
-`--naming-endpoint`/`--naming-api-version`/`--naming-deployment` (naming) — see
-the `name` section above for what they're for.
+`--naming-endpoint`/`--naming-api-version`/`--naming-deployment` (naming);
+`--provider vertexai`/`--naming-provider vertexai` similarly get
+`--gcp-project`/`--gcp-location` and `--naming-gcp-project`/
+`--naming-gcp-location`; `--provider bedrock`/`--naming-provider bedrock` get
+`--region` and `--naming-region`; `--provider oci`/`--naming-provider oci` get
+`--region`/`--compartment-id` and `--naming-region`/`--naming-compartment-id`
+— see the `name` section above for what they're for.
 
 **`init-trial-config`** — write a placeholder `trial.yaml` to fill in, instead of
 writing one by hand:
@@ -253,8 +289,15 @@ workers: 1
 `provider`/`api_key`/`model` are one shared LLM source used for both naming and
 generation. Use the `run` command's separate `--naming-*`/`--generation-*` flags
 instead if a trial actually needs two different providers. For `provider: azure`,
-also set `endpoint`/`api_version`/`deployment` (`deployment` replaces `model`) —
-see `parseforge init-trial-config`'s generated placeholder for the exact keys.
+also set `endpoint`/`api_version`/`deployment` (`deployment` replaces `model`).
+For `provider: vertexai`, set `project`/`location` instead — `api_key` can be
+omitted entirely (Vertex AI authenticates via GCP's own Application Default
+Credentials). For `provider: bedrock`, set `region` instead — `api_key` can
+likewise be omitted entirely (Bedrock authenticates via AWS's own credential
+chain). For `provider: oci`, set `region`/`compartment_id` instead —
+`api_key` can likewise be omitted entirely (OCI authenticates via local
+request-signing credentials in `~/.oci/config`). See
+`parseforge init-trial-config`'s generated placeholder for the exact keys.
 
 **`integration`** — rebuild `integration/` for every case under `trials/` (SPEC §5
 step 8):

{parseforge-0.2.9 → parseforge-0.2.12}/README.md

@@ -35,11 +35,12 @@ command that's pure local processing (`canonical`/`readable`/`recognizers`,
 LLM (`name`, `check --provider`, `run`, `generate-template`, `trial`) needs the
 extra for whichever provider it uses: `anthropic`, `openai`, `deepseek`,
 `groq`, `xai`, `together`, `fireworks`, `perplexity`, `openrouter`,
-`moonshot`, `cerebras`, `mistral`, `cohere`, or `azure`. `--provider` defaults
-to `anthropic` wherever it isn't required, so that's the one most setups
-need. `pip install parseforge[sampling]` adds Netmiko for live device
-sampling; combine extras as needed, e.g.
-`pip install parseforge[anthropic,openai,deepseek,groq,xai,together,fireworks,perplexity,openrouter,moonshot,cerebras,mistral,cohere,azure,sampling]`.
+`moonshot`, `cerebras`, `mistral`, `cohere`, `azure`, `gemini`, `vertexai`,
+`bedrock`, or `oci`. `--provider` defaults to `anthropic` wherever it isn't
+required, so that's the one most setups need. `pip install
+parseforge[sampling]` adds Netmiko for live device sampling; combine
+extras as needed, e.g.
+`pip install parseforge[anthropic,openai,deepseek,groq,xai,together,fireworks,perplexity,openrouter,moonshot,cerebras,mistral,cohere,azure,gemini,vertexai,bedrock,oci,sampling]`.
 
 ## Development
 
@@ -47,13 +48,14 @@ sampling; combine extras as needed, e.g.
 pip install -e ".[dev,sampling]"
 pytest
 ```
-`dev` already includes the `anthropic`, `openai`, `mistralai`, `cohere`, and
-`azure-ai-inference` SDKs (tests exercise all fourteen providers —
-`anthropic`, `openai`, `deepseek`, `groq`, `xai`, `together`, `fireworks`,
-`perplexity`, `openrouter`, `moonshot`, `cerebras` share just the first two
-packages, and `mistral`/`cohere`/`azure` each need their own SDK — and never
-silently skip) — add the specific `,<provider>` extra explicitly only if
-installing outside of `dev`.
+`dev` already includes the `anthropic`, `openai`, `mistralai`, `cohere`,
+`azure-ai-inference`, `google-genai`, `boto3`, and `oci` SDKs (tests exercise
+all eighteen providers — `anthropic`, `openai`, `deepseek`, `groq`, `xai`,
+`together`, `fireworks`, `perplexity`, `openrouter`, `moonshot`, `cerebras`
+share just the first two packages, `mistral`/`cohere`/`azure`/`bedrock`/`oci`
+each need their own SDK, and `gemini`/`vertexai` share `google-genai` — and
+never silently skip) — add the specific `,<provider>` extra explicitly only
+if installing outside of `dev`.
 
 Linting/formatting/type-checking/docs run through tox instead of extras — see
 `tox.ini` (`tox -e lint`/`format`/`typecheck`/`docs`), each installing its own
@@ -78,11 +80,23 @@ and `--api-key` falls back to that provider's own env var (`ANTHROPIC_API_KEY`/
 `OPENAI_API_KEY`/`DEEPSEEK_API_KEY`/etc.). A cache hit (a command already seen
 before) never touches the LLM, so no key is needed at all in that case.
 
-`--provider azure` is the one exception to the usual `--api-key`/`--model` shape —
-Azure has no fixed base_url or model catalog, so it also needs `--endpoint`
+`--provider azure`/`--provider vertexai`/`--provider bedrock`/`--provider oci`
+are the four exceptions to the usual `--api-key`/`--model` shape. Azure has
+no fixed base_url or model catalog, so it also needs `--endpoint`
 (`AZURE_ENDPOINT`), `--api-version` (`AZURE_API_VERSION`), and `--deployment`
-(`AZURE_DEPLOYMENT`, replacing `--model`). Same three options exist on
-`check --provider`, `run`, and `generate-template` below.
+(`AZURE_DEPLOYMENT`, replacing `--model`). Vertex AI has no API key at all —
+it authenticates via GCP's own Application Default Credentials — so
+`--api-key`/`AZURE_API_KEY`-style env vars don't apply; it needs
+`--gcp-project` (`VERTEXAI_PROJECT`) and `--gcp-location` (`VERTEXAI_REGION`)
+instead. Bedrock likewise has no API key at all — it authenticates via AWS's
+own credential chain — and just needs `--region` (`BEDROCK_REGION`, then
+`BEDROCK_DEFAULT_REGION`). OCI also has no API key at all — it signs each
+request cryptographically against local credentials in `~/.oci/config`
+(DEFAULT profile) — and needs both `--region` (`OCI_REGION`, then whatever
+region is already set in `~/.oci/config`) and `--compartment-id`
+(`OCI_COMPARTMENT_ID`, the OCID of the compartment/tenancy to bill and scope
+requests to). Same options exist on `check --provider`, `run`, and
+`generate-template` below.
 
 **`check`** — validate a connector or provider before spending time/tokens on a real
 run. With neither `--env` nor explicit connection flags, prints what a connector needs
@@ -123,14 +137,21 @@ parseforge run --vendor cisco --family catalyst9200 --os ios-xe --version 17.9.1
   --model claude-haiku-4-5-20251001 \
   show clock
 ```
-`--provider`/`--api-key`/`--model` are for generation. Naming has its own separate
+`--provider`/`--api-key`/`--model` are for generation (`--api-key` isn't
+required for `--provider vertexai`/`--provider bedrock`/`--provider oci`).
+Naming has its own separate
 `--naming-provider`/`--naming-api-key`/`--naming-model`, defaulting independently
 (`--naming-provider` defaults to `anthropic`; the other two fall back to that
 provider's own env var/default model) — set them explicitly if naming needs a
 different provider than generation. `--provider azure`/`--naming-provider azure`
 each get their own `--endpoint`/`--api-version`/`--deployment` (generation) and
-`--naming-endpoint`/`--naming-api-version`/`--naming-deployment` (naming) — see
-the `name` section above for what they're for.
+`--naming-endpoint`/`--naming-api-version`/`--naming-deployment` (naming);
+`--provider vertexai`/`--naming-provider vertexai` similarly get
+`--gcp-project`/`--gcp-location` and `--naming-gcp-project`/
+`--naming-gcp-location`; `--provider bedrock`/`--naming-provider bedrock` get
+`--region` and `--naming-region`; `--provider oci`/`--naming-provider oci` get
+`--region`/`--compartment-id` and `--naming-region`/`--naming-compartment-id`
+— see the `name` section above for what they're for.
 
 **`init-trial-config`** — write a placeholder `trial.yaml` to fill in, instead of
 writing one by hand:
@@ -164,8 +185,15 @@ workers: 1
 `provider`/`api_key`/`model` are one shared LLM source used for both naming and
 generation. Use the `run` command's separate `--naming-*`/`--generation-*` flags
 instead if a trial actually needs two different providers. For `provider: azure`,
-also set `endpoint`/`api_version`/`deployment` (`deployment` replaces `model`) —
-see `parseforge init-trial-config`'s generated placeholder for the exact keys.
+also set `endpoint`/`api_version`/`deployment` (`deployment` replaces `model`).
+For `provider: vertexai`, set `project`/`location` instead — `api_key` can be
+omitted entirely (Vertex AI authenticates via GCP's own Application Default
+Credentials). For `provider: bedrock`, set `region` instead — `api_key` can
+likewise be omitted entirely (Bedrock authenticates via AWS's own credential
+chain). For `provider: oci`, set `region`/`compartment_id` instead —
+`api_key` can likewise be omitted entirely (OCI authenticates via local
+request-signing credentials in `~/.oci/config`). See
+`parseforge init-trial-config`'s generated placeholder for the exact keys.
 
 **`integration`** — rebuild `integration/` for every case under `trials/` (SPEC §5
 step 8):

parseforge-0.2.12/parseforge/__init__.py

@@ -0,0 +1 @@
+__version__ = "0.2.12"

{parseforge-0.2.9 → parseforge-0.2.12}/parseforge/cli/config.py

@@ -15,6 +15,16 @@ from typing import Any
 import click
 import yaml
 
+# Providers that don't take an API key at all — Vertex AI relies on GCP's
+# Application Default Credentials, Bedrock on AWS's own credential chain,
+# and OCI on locally-configured request-signing credentials (see
+# naming/providers/vertexai.py, naming/providers/bedrock.py, and
+# naming/providers/oci.py). api_key is required for every other
+# provider, but never for these; kept as a small named set (rather than
+# scattered `provider not in (...)` checks) so a future provider with
+# the same trait is a one-line addition.
+NO_API_KEY_PROVIDERS = frozenset({"vertexai", "bedrock", "oci"})
+
 
 @dataclass(frozen=True)
 class TrialConfig:
@@ -33,10 +43,13 @@ class TrialConfig:
     password: str
     device_type: str
     provider: str
-    api_key: str
     model: str
     commands: list[str]
     user: str
+    # Required unless provider is in NO_API_KEY_PROVIDERS — see
+    # load_trial_config()'s explicit check; not in the dataclass's
+    # required-field position since it's conditionally optional.
+    api_key: str | None = None
     email: str | None = None
     description: str | None = None
     note: str | None = None
@@ -50,6 +63,21 @@ class TrialConfig:
     endpoint: str | None = None
     api_version: str | None = None
     deployment: str | None = None
+    # Only meaningful for provider: vertexai — see
+    # naming/providers/vertexai.py. Falls back to VERTEXAI_PROJECT/
+    # VERTEXAI_REGION if omitted, same as api_key falls back to a
+    # provider's own env var.
+    project: str | None = None
+    location: str | None = None
+    # Only meaningful for provider: bedrock — see
+    # naming/providers/bedrock.py. Falls back to BEDROCK_REGION, then
+    # BEDROCK_DEFAULT_REGION, if omitted.
+    region: str | None = None
+    # Only meaningful for provider: oci — see naming/providers/oci.py.
+    # compartment_id falls back to OCI_COMPARTMENT_ID if omitted; region
+    # (shared with the bedrock field above) falls back to OCI_REGION,
+    # then whatever region is already set in ~/.oci/config.
+    compartment_id: str | None = None
 
 
 @dataclass(frozen=True)
@@ -69,6 +97,13 @@ class GenerationRequestConfig:
     endpoint: str | None = None
     api_version: str | None = None
     deployment: str | None = None
+    # Only meaningful for provider: vertexai — see TrialConfig above.
+    project: str | None = None
+    location: str | None = None
+    # Only meaningful for provider: bedrock — see TrialConfig above.
+    region: str | None = None
+    # Only meaningful for provider: oci — see TrialConfig above.
+    compartment_id: str | None = None
 
 
 _TRIAL_REQUIRED = (
@@ -82,7 +117,6 @@ _TRIAL_REQUIRED = (
     "password",
     "device_type",
     "provider",
-    "api_key",
     "model",
     "commands",
     "user",
@@ -112,6 +146,10 @@ def load_trial_config(path: Path) -> TrialConfig:
     raw = _load_yaml_mapping(path)
     _require_keys(raw, _TRIAL_REQUIRED, path)
 
+    provider = raw["provider"]
+    if provider not in NO_API_KEY_PROVIDERS and not raw.get("api_key"):
+        raise click.ClickException(f"{path}: missing required config key(s): api_key")
+
     commands = raw["commands"]
     if not isinstance(commands, list) or not all(isinstance(c, str) for c in commands):
         raise click.ClickException(f"{path}: 'commands' must be a list of strings")
@@ -126,8 +164,8 @@ def load_trial_config(path: Path) -> TrialConfig:
         username=raw["username"],
         password=raw["password"],
         device_type=raw["device_type"],
-        provider=raw["provider"],
-        api_key=raw["api_key"],
+        provider=provider,
+        api_key=raw.get("api_key"),
         model=raw["model"],
         commands=commands,
         user=raw["user"],
@@ -139,6 +177,10 @@ def load_trial_config(path: Path) -> TrialConfig:
         endpoint=raw.get("endpoint"),
         api_version=raw.get("api_version"),
         deployment=raw.get("deployment"),
+        project=raw.get("project"),
+        location=raw.get("location"),
+        region=raw.get("region"),
+        compartment_id=raw.get("compartment_id"),
     )
 
 
@@ -161,4 +203,8 @@ def load_generation_config(path: Path) -> GenerationRequestConfig:
         endpoint=raw.get("endpoint"),
         api_version=raw.get("api_version"),
         deployment=raw.get("deployment"),
+        project=raw.get("project"),
+        location=raw.get("location"),
+        region=raw.get("region"),
+        compartment_id=raw.get("compartment_id"),
     )