airbyte-internal-ops 0.4.2__py3-none-any.whl → 0.5.1__py3-none-any.whl

airbyte_ops_mcp/_legacy/airbyte_ci/metadata_models/README.md

@@ -1,91 +0,0 @@
-# Connector Metadata Service Library
-
-This submodule is responsible for managing all the logic related to validating, uploading, and managing connector metadata.
-
-## Installation
-
-To use this submodule, it is recommended that you use Poetry to manage dependencies.
-
-```
-poetry install
-```
-
-### Node.js Requirement
-
-The model generation process also requires Node.js to bundle JSON schemas. Install Node.js:
-
-- On macOS: `brew install node`
-- On Ubuntu/Debian: `sudo apt-get install nodejs npm`
-- On other systems: https://nodejs.org/
-
-Node.js dependencies will be automatically installed when running `poetry run poe generate-models`.
-
-## Generating Models
-
-This submodule includes a tool for generating Python models from JSON Schema specifications. To generate the models, we use the library [datamodel-code-generator](https://github.com/koxudaxi/datamodel-code-generator). The generated models are stored in `models/generated`.
-
-To generate the models, run the following command:
-
-```bash
-poetry run poe generate-models
-
-```
-
-This will read the JSON Schema specifications in `models/src` and generate Python models in `models/generated`.
-
-## Running Tests
-
-```bash
-poetry run pytest
-```
-
-## Changelog
-
-### 0.24.1
-Update Python version requirement from 3.10 to 3.11.
-
-## Validating Metadata Files
-
-To be considered valid, a connector must have a metadata.yaml file which must conform to the [ConnectorMetadataDefinitionV0](./metadata_service/models/src/ConnectorMetadataDefinitionV0.yaml) schema, and a documentation file.
-
-The paths to both files must be passed to the validate command.
-
-```bash
-poetry run metadata_service validate tests/fixtures/metadata_validate/valid/metadata_simple.yaml tests/fixtures/doc.md
-```
-
-## Useful Commands
-
-### Replicate Production Data in your Development Bucket
-
-This will replicate all the production data to your development bucket. This is useful for testing the metadata service with real up to date data.
-
-_💡 Note: A prerequisite is you have [gsutil](https://cloud.google.com/storage/docs/gsutil) installed and have run `gsutil auth login`_
-
-_⚠️ Warning: Its important to know that this will remove ANY files you have in your destination buckets as it calls `gsutil rsync` with `-d` enabled._
-
-```bash
-TARGET_BUCKET=<YOUR-DEV_BUCKET> poetry run poe replicate-prod
-```
-
-### Copy specific connector version to your Development Bucket
-
-This will copy the specified connector version to your development bucket. This is useful for testing the metadata service with a specific version of a connector.
-
-_💡 Note: A prerequisite is you have [gsutil](https://cloud.google.com/storage/docs/gsutil) installed and have run `gsutil auth login`_
-
-```bash
-TARGET_BUCKET=<YOUR-DEV_BUCKET> CONNECTOR="airbyte/source-stripe" VERSION="3.17.0-preview.ea013c8" poetry run poe copy-connector-from-prod
-```
-
-### Promote Connector Version to Latest
-
-This will promote the specified connector version to the latest version in the registry. This is useful for creating a mocked registry in which a prerelease connector is treated as if it was already published.
-
-_💡 Note: A prerequisite is you have [gsutil](https://cloud.google.com/storage/docs/gsutil) installed and have run `gsutil auth login`_
-
-_⚠️ Warning: Its important to know that this will remove ANY existing files in the latest folder that are not in the versioned folder as it calls `gsutil rsync` with `-d` enabled._
-
-```bash
-TARGET_BUCKET=<YOUR-DEV_BUCKET> CONNECTOR="airbyte/source-stripe" VERSION="3.17.0-preview.ea013c8" poetry run poe promote-connector-to-latest
-```

airbyte_ops_mcp/_legacy/airbyte_ci/metadata_models/bin/bundle-schemas.js

@@ -1,48 +0,0 @@
-#!/usr/bin/env node
-
-/**
- * Bundle JSON schemas using @apidevtools/json-schema-ref-parser
- * This script resolves all $ref references in the schema files and creates a single bundled schema.
- */
-
-const $RefParser = require('@apidevtools/json-schema-ref-parser');
-const fs = require('fs');
-const path = require('path');
-
-const YAML_DIR = 'metadata_service/models/src';
-const OUTPUT_DIR = 'metadata_service/models/generated';
-const ENTRY_SCHEMA = path.join(YAML_DIR, 'ConnectorMetadataDefinitionV0.yaml');
-const BUNDLE_OUTPUT = path.join(OUTPUT_DIR, 'ConnectorMetadataDefinitionV0.json');
-
-async function bundleSchemas() {
-  try {
-    console.log('📦 Bundling JSON schemas...');
-    console.log(`   Entry schema: ${ENTRY_SCHEMA}`);
-    console.log(`   Output: ${BUNDLE_OUTPUT}`);
-
-    if (!fs.existsSync(YAML_DIR)) {
-      console.error(`❌ Error: The yaml directory does not exist: ${YAML_DIR}`);
-      process.exit(1);
-    }
-
-    if (!fs.existsSync(OUTPUT_DIR)) {
-      fs.mkdirSync(OUTPUT_DIR, { recursive: true });
-    }
-
-    const schema = await $RefParser.bundle(ENTRY_SCHEMA, {
-      dereference: {
-        circular: 'ignore' // Handle circular references gracefully
-      }
-    });
-
-    fs.writeFileSync(BUNDLE_OUTPUT, JSON.stringify(schema, null, 2));
-
-    console.log('✅ Successfully bundled schema to', BUNDLE_OUTPUT);
-    console.log('   This bundled schema can be used for IDE validation and other tools.');
-  } catch (error) {
-    console.error('❌ Error bundling schemas:', error.message);
-    process.exit(1);
-  }
-}
-
-bundleSchemas();

airbyte_ops_mcp/_legacy/airbyte_ci/metadata_models/bin/generate-metadata-models.sh

@@ -1,36 +0,0 @@
-#!/usr/bin/env bash
-
-set -e
-
-
-YAML_DIR=metadata_service/models/src
-OUTPUT_DIR=metadata_service/models/generated
-
-# Ensure the yaml directory exists
-if [ ! -d "$YAML_DIR" ]; then
-  echo "The yaml directory does not exist: $YAML_DIR"
-  exit 1
-fi
-
-
-rm -rf "$OUTPUT_DIR"/*.py
-mkdir -p "$OUTPUT_DIR"
-
-echo "# generated by generate-metadata-models" > "$OUTPUT_DIR"/__init__.py
-
-for f in "$YAML_DIR"/*.yaml; do
-  filename_wo_ext=$(basename "$f" | cut -d . -f 1)
-  echo "from .$filename_wo_ext import *" >> "$OUTPUT_DIR"/__init__.py
-
-  datamodel-codegen \
-    --input "$YAML_DIR/$filename_wo_ext.yaml" \
-    --output "$OUTPUT_DIR/$filename_wo_ext.py" \
-    --use-title-as-name \
-    --use-double-quotes \
-    --enum-field-as-literal all \
-    --disable-timestamp
-done
-
-echo ""
-echo "Generating bundled JSON schema..."
-node bin/bundle-schemas.js

airbyte_ops_mcp/_legacy/airbyte_ci/metadata_models/generated/ActorDefinitionResourceRequirements.py

@@ -1,54 +0,0 @@
-# generated by datamodel-codegen:
-#   filename:  ActorDefinitionResourceRequirements.yaml
-
-from __future__ import annotations
-
-from typing import List, Optional
-
-from pydantic import BaseModel, Extra, Field
-from typing_extensions import Literal
-
-
-class ResourceRequirements(BaseModel):
-    class Config:
-        extra = Extra.forbid
-
-    cpu_request: Optional[str] = None
-    cpu_limit: Optional[str] = None
-    memory_request: Optional[str] = None
-    memory_limit: Optional[str] = None
-
-
-class JobType(BaseModel):
-    __root__: Literal[
-        "get_spec",
-        "check_connection",
-        "discover_schema",
-        "sync",
-        "reset_connection",
-        "connection_updater",
-        "replicate",
-    ] = Field(
-        ...,
-        description="enum that describes the different types of jobs that the platform runs.",
-        title="JobType",
-    )
-
-
-class JobTypeResourceLimit(BaseModel):
-    class Config:
-        extra = Extra.forbid
-
-    jobType: JobType
-    resourceRequirements: ResourceRequirements
-
-
-class ActorDefinitionResourceRequirements(BaseModel):
-    class Config:
-        extra = Extra.forbid
-
-    default: Optional[ResourceRequirements] = Field(
-        None,
-        description="if set, these are the requirements that should be set for ALL jobs run for this actor definition.",
-    )
-    jobSpecific: Optional[List[JobTypeResourceLimit]] = None

airbyte_ops_mcp/_legacy/airbyte_ci/metadata_models/generated/AirbyteInternal.py

@@ -1,22 +0,0 @@
-# generated by datamodel-codegen:
-#   filename:  AirbyteInternal.yaml
-
-from __future__ import annotations
-
-from typing import Optional
-
-from pydantic import BaseModel, Extra, Field
-from typing_extensions import Literal
-
-
-class AirbyteInternal(BaseModel):
-    class Config:
-        extra = Extra.allow
-
-    sl: Optional[Literal[0, 100, 200, 300]] = None
-    ql: Optional[Literal[0, 100, 200, 300, 400, 500, 600]] = None
-    isEnterprise: Optional[bool] = False
-    requireVersionIncrementsInPullRequests: Optional[bool] = Field(
-        True,
-        description="When false, version increment checks will be skipped for this connector",
-    )

airbyte_ops_mcp/_legacy/airbyte_ci/metadata_models/generated/AllowedHosts.py

@@ -1,18 +0,0 @@
-# generated by datamodel-codegen:
-#   filename:  AllowedHosts.yaml
-
-from __future__ import annotations
-
-from typing import List, Optional
-
-from pydantic import BaseModel, Extra, Field
-
-
-class AllowedHosts(BaseModel):
-    class Config:
-        extra = Extra.allow
-
-    hosts: Optional[List[str]] = Field(
-        None,
-        description="An array of hosts that this connector can connect to.  AllowedHosts not being present for the source or destination means that access to all hosts is allowed.  An empty list here means that no network access is granted.",
-    )

airbyte_ops_mcp/_legacy/airbyte_ci/metadata_models/generated/ConnectorBreakingChanges.py

@@ -1,65 +0,0 @@
-# generated by datamodel-codegen:
-#   filename:  ConnectorBreakingChanges.yaml
-
-from __future__ import annotations
-
-from datetime import date
-from typing import Dict, List, Optional
-
-from pydantic import AnyUrl, BaseModel, Extra, Field, constr
-from typing_extensions import Literal
-
-
-class StreamBreakingChangeScope(BaseModel):
-    class Config:
-        extra = Extra.forbid
-
-    scopeType: str = Field("stream", const=True)
-    impactedScopes: List[str] = Field(
-        ...,
-        description="List of streams that are impacted by the breaking change.",
-        min_items=1,
-    )
-
-
-class BreakingChangeScope(BaseModel):
-    __root__: StreamBreakingChangeScope = Field(
-        ...,
-        description="A scope that can be used to limit the impact of a breaking change.",
-    )
-
-
-class VersionBreakingChange(BaseModel):
-    class Config:
-        extra = Extra.forbid
-
-    upgradeDeadline: date = Field(
-        ...,
-        description="The deadline by which to upgrade before the breaking change takes effect.",
-    )
-    message: str = Field(
-        ..., description="Descriptive message detailing the breaking change."
-    )
-    deadlineAction: Optional[Literal["auto_upgrade", "disable"]] = Field(
-        None, description="Action to do when the deadline is reached."
-    )
-    migrationDocumentationUrl: Optional[AnyUrl] = Field(
-        None,
-        description="URL to documentation on how to migrate to the current version. Defaults to ${documentationUrl}-migrations#${version}",
-    )
-    scopedImpact: Optional[List[BreakingChangeScope]] = Field(
-        None,
-        description="List of scopes that are impacted by the breaking change. If not specified, the breaking change cannot be scoped to reduce impact via the supported scope types.",
-        min_items=1,
-    )
-
-
-class ConnectorBreakingChanges(BaseModel):
-    class Config:
-        extra = Extra.forbid
-
-    __root__: Dict[constr(regex=r"^\d+\.\d+\.\d+$"), VersionBreakingChange] = Field(
-        ...,
-        description="Each entry denotes a breaking change in a specific version of a connector that requires user action to upgrade.",
-        title="ConnectorBreakingChanges",
-    )

airbyte_ops_mcp/_legacy/airbyte_ci/metadata_models/generated/ConnectorBuildOptions.py

@@ -1,15 +0,0 @@
-# generated by datamodel-codegen:
-#   filename:  ConnectorBuildOptions.yaml
-
-from __future__ import annotations
-
-from typing import Optional
-
-from pydantic import BaseModel, Extra
-
-
-class ConnectorBuildOptions(BaseModel):
-    class Config:
-        extra = Extra.forbid
-
-    baseImage: Optional[str] = None

airbyte_ops_mcp/_legacy/airbyte_ci/metadata_models/generated/ConnectorIPCOptions.py

@@ -1,25 +0,0 @@
-# generated by datamodel-codegen:
-#   filename:  ConnectorIPCOptions.yaml
-
-from __future__ import annotations
-
-from typing import List
-
-from pydantic import BaseModel, Extra
-from typing_extensions import Literal
-
-
-class DataChannel(BaseModel):
-    class Config:
-        extra = Extra.forbid
-
-    version: str
-    supportedSerialization: List[Literal["JSONL", "PROTOBUF", "FLATBUFFERS"]]
-    supportedTransport: List[Literal["STDIO", "SOCKET"]]
-
-
-class ConnectorIPCOptions(BaseModel):
-    class Config:
-        extra = Extra.forbid
-
-    dataChannel: DataChannel