get-systems 0.2.21__tar.gz

get_systems-0.2.21/PKG-INFO

@@ -0,0 +1,202 @@
+Metadata-Version: 2.4
+Name: get-systems
+Version: 0.2.21
+Summary: Get Systems Prefect Blocks - Enterprise LLM and HTTP operations
+Author: Get Systems
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+Requires-Dist: prefect>=3.6.5
+Requires-Dist: pydantic>=2.0.0
+Provides-Extra: llm
+Requires-Dist: openai>=2.21.0; extra == "llm"
+Provides-Extra: http
+Requires-Dist: httpx>=0.27.0; extra == "http"
+Provides-Extra: models
+Requires-Dist: nameparser>=1.1.3; extra == "models"
+Requires-Dist: gender-guesser>=0.4.0; extra == "models"
+Requires-Dist: python-stdnum>=1.19; extra == "models"
+Provides-Extra: azure-cu
+Requires-Dist: azure-ai-contentunderstanding; extra == "azure-cu"
+Requires-Dist: azure-identity; extra == "azure-cu"
+Provides-Extra: all
+Requires-Dist: openai>=2.21.0; extra == "all"
+Requires-Dist: httpx>=0.27.0; extra == "all"
+Requires-Dist: nameparser>=1.1.3; extra == "all"
+Requires-Dist: gender-guesser>=0.4.0; extra == "all"
+Requires-Dist: python-stdnum>=1.19; extra == "all"
+Provides-Extra: dev
+Requires-Dist: pytest>=9.0.2; extra == "dev"
+Requires-Dist: pytest-asyncio>=0.23.0; extra == "dev"
+
+# get_systems - Get Systems Prefect Blocks
+
+Enterprise-grade Prefect blocks for LLM operations and HTTP requests.
+
+## Features
+
+### LLM Module (`get_systems.llm`)
+- ✅ **OpenAI & Azure OpenAI Support** - Seamlessly switch between providers
+- ✅ **Environment Variables** - Automatic fallback to env vars
+- ✅ **Retry Logic** - Exponential backoff with jitter
+- ✅ **Caching** - Optional in-memory response caching
+- ✅ **Safe Logging** - No API key leaks
+- ✅ **Flexible Parameters** - Pass any OpenAI API parameter via **kwarget_systems
+- ✅ **Function Calling** - Full support for tools
+
+### HTTP Module (`get_systems.http`)
+- ✅ **Multiple Auth Types** - None, Basic, Token, Bearer
+- ✅ **Async HTTP Client** - Built on httpx
+- ✅ **Prefect Integration** - First-class block support
+
+## Installation
+
+### Install Everything (Recommended)
+
+```bash
+pip install "get_systems[all]"
+```
+
+### Install Specific Modules
+
+Install only what you need:
+
+```bash
+# For LLM operations only
+pip install "get_systems[llm]"
+
+# For HTTP operations only  
+pip install "get_systems[http]"
+
+# Install both
+pip install "get_systems[llm,http]"
+```
+
+### From Azure Artifacts
+
+```bash
+# All modules
+pip install "get_systems[all]" --extra-index-url https://pkget_systems.dev.azure.com/get-systems/_packaging/get-systems/pypi/simple/
+
+# Specific modules
+pip install "get_systems[llm]" --extra-index-url https://pkget_systems.dev.azure.com/get-systems/_packaging/get-systems/pypi/simple/
+pip install "get_systems[http]" --extra-index-url https://pkget_systems.dev.azure.com/get-systems/_packaging/get-systems/pypi/simple/
+```
+
+### What Gets Installed
+
+| Installation | Dependencies |
+|-------------|--------------|
+| `pip install get_systems` | `prefect`, `pydantic` (base only) |
+| `pip install "get_systems[llm]"` | Base + `openai` |
+| `pip install "get_systems[http]"` | Base + `httpx` |
+| `pip install "get_systems[all]"` | Base + `openai` + `httpx` |
+
+## Quick Start
+
+### LLM Operations
+
+```python
+from get_systems.llm import GptCompletionBlock, GptAuth, LlmRuntime
+from prefect import flow
+
+# Configure auth
+auth = GptAuth(
+    api_key="sk-...",
+    model="gpt-4o-mini",
+    is_azure=False
+)
+
+# Create completion block
+block = GptCompletionBlock(
+    auth=auth,
+    prompt="What is Prefect?",
+    temperature=0.7
+)
+
+@flow
+async def my_llm_flow():
+    result = await block.run()
+    print(result.content)
+```
+
+### HTTP Operations
+
+```python
+from get_systems.http import HttpAuth, HttpBlock
+from prefect import flow
+
+# Configure HTTP auth
+auth = HttpAuth(
+    auth_type="bearer",
+    token="your-token",
+    base_url="https://api.example.com"
+)
+
+# Create HTTP block
+http_block = HttpBlock(auth=auth)
+
+@flow
+async def my_http_flow():
+    response = await http_block.request("GET", "/users")
+    print(response.json())
+```
+
+## Register Blocks in Prefect
+
+```bash
+# Register all blocks
+prefect block register -m get_systems.llm.gpt_blocks
+prefect block register -m get_systems.http.http_block
+
+# View registered blocks
+prefect block ls
+```
+
+## Import Styles
+
+All import styles are supported:
+
+```python
+# Submodule imports
+from get_systems.llm import GptCompletionBlock, GptAuth
+from get_systems.http import HttpAuth, HttpBlock
+
+# Direct module imports
+from get_systems.llm.gpt_blocks import GptCompletionBlock
+from get_systems.http.http_block import HttpAuth
+
+# Package-level imports
+from get_systems import GptCompletionBlock, HttpAuth
+```
+
+## Environment Variables
+
+### OpenAI Configuration:
+
+```bash
+OPENAI_API_KEY=sk-...
+OPENAI_MODEL=gpt-4o-mini
+OPENAI_BASE_URL=https://api.openai.com/v1  # optional
+```
+
+### Azure OpenAI Configuration:
+
+```bash
+OPENAI_API_KEY=your-azure-key
+OPENAI_BASE_URL=https://your-resource.openai.azure.com
+OPENAI_MODEL=your-deployment-name
+OPENAI_API_VERSION=2024-02-15-preview
+OPENAI_IS_AZURE=true
+```
+
+## Documentation
+
+- [docs/QUICKSTART-get_systems.md](docs/QUICKSTART-get_systems.md) - Quick start and usage examples
+- [docs/MIGRATION.md](docs/MIGRATION.md) - Migration guide from old packages
+- **LLM Module**: Full OpenAI/Azure OpenAI integration with enterprise features
+- **HTTP Module**: Flexible HTTP client with multiple authentication types
+- **Prefect Integration**: Native Prefect block support for both modules
+
+## License
+
+Proprietary - Get Systems

get_systems-0.2.21/README.md

@@ -0,0 +1,172 @@
+# get_systems - Get Systems Prefect Blocks
+
+Enterprise-grade Prefect blocks for LLM operations and HTTP requests.
+
+## Features
+
+### LLM Module (`get_systems.llm`)
+- ✅ **OpenAI & Azure OpenAI Support** - Seamlessly switch between providers
+- ✅ **Environment Variables** - Automatic fallback to env vars
+- ✅ **Retry Logic** - Exponential backoff with jitter
+- ✅ **Caching** - Optional in-memory response caching
+- ✅ **Safe Logging** - No API key leaks
+- ✅ **Flexible Parameters** - Pass any OpenAI API parameter via **kwarget_systems
+- ✅ **Function Calling** - Full support for tools
+
+### HTTP Module (`get_systems.http`)
+- ✅ **Multiple Auth Types** - None, Basic, Token, Bearer
+- ✅ **Async HTTP Client** - Built on httpx
+- ✅ **Prefect Integration** - First-class block support
+
+## Installation
+
+### Install Everything (Recommended)
+
+```bash
+pip install "get_systems[all]"
+```
+
+### Install Specific Modules
+
+Install only what you need:
+
+```bash
+# For LLM operations only
+pip install "get_systems[llm]"
+
+# For HTTP operations only  
+pip install "get_systems[http]"
+
+# Install both
+pip install "get_systems[llm,http]"
+```
+
+### From Azure Artifacts
+
+```bash
+# All modules
+pip install "get_systems[all]" --extra-index-url https://pkget_systems.dev.azure.com/get-systems/_packaging/get-systems/pypi/simple/
+
+# Specific modules
+pip install "get_systems[llm]" --extra-index-url https://pkget_systems.dev.azure.com/get-systems/_packaging/get-systems/pypi/simple/
+pip install "get_systems[http]" --extra-index-url https://pkget_systems.dev.azure.com/get-systems/_packaging/get-systems/pypi/simple/
+```
+
+### What Gets Installed
+
+| Installation | Dependencies |
+|-------------|--------------|
+| `pip install get_systems` | `prefect`, `pydantic` (base only) |
+| `pip install "get_systems[llm]"` | Base + `openai` |
+| `pip install "get_systems[http]"` | Base + `httpx` |
+| `pip install "get_systems[all]"` | Base + `openai` + `httpx` |
+
+## Quick Start
+
+### LLM Operations
+
+```python
+from get_systems.llm import GptCompletionBlock, GptAuth, LlmRuntime
+from prefect import flow
+
+# Configure auth
+auth = GptAuth(
+    api_key="sk-...",
+    model="gpt-4o-mini",
+    is_azure=False
+)
+
+# Create completion block
+block = GptCompletionBlock(
+    auth=auth,
+    prompt="What is Prefect?",
+    temperature=0.7
+)
+
+@flow
+async def my_llm_flow():
+    result = await block.run()
+    print(result.content)
+```
+
+### HTTP Operations
+
+```python
+from get_systems.http import HttpAuth, HttpBlock
+from prefect import flow
+
+# Configure HTTP auth
+auth = HttpAuth(
+    auth_type="bearer",
+    token="your-token",
+    base_url="https://api.example.com"
+)
+
+# Create HTTP block
+http_block = HttpBlock(auth=auth)
+
+@flow
+async def my_http_flow():
+    response = await http_block.request("GET", "/users")
+    print(response.json())
+```
+
+## Register Blocks in Prefect
+
+```bash
+# Register all blocks
+prefect block register -m get_systems.llm.gpt_blocks
+prefect block register -m get_systems.http.http_block
+
+# View registered blocks
+prefect block ls
+```
+
+## Import Styles
+
+All import styles are supported:
+
+```python
+# Submodule imports
+from get_systems.llm import GptCompletionBlock, GptAuth
+from get_systems.http import HttpAuth, HttpBlock
+
+# Direct module imports
+from get_systems.llm.gpt_blocks import GptCompletionBlock
+from get_systems.http.http_block import HttpAuth
+
+# Package-level imports
+from get_systems import GptCompletionBlock, HttpAuth
+```
+
+## Environment Variables
+
+### OpenAI Configuration:
+
+```bash
+OPENAI_API_KEY=sk-...
+OPENAI_MODEL=gpt-4o-mini
+OPENAI_BASE_URL=https://api.openai.com/v1  # optional
+```
+
+### Azure OpenAI Configuration:
+
+```bash
+OPENAI_API_KEY=your-azure-key
+OPENAI_BASE_URL=https://your-resource.openai.azure.com
+OPENAI_MODEL=your-deployment-name
+OPENAI_API_VERSION=2024-02-15-preview
+OPENAI_IS_AZURE=true
+```
+
+## Documentation
+
+- [docs/QUICKSTART-get_systems.md](docs/QUICKSTART-get_systems.md) - Quick start and usage examples
+- [docs/MIGRATION.md](docs/MIGRATION.md) - Migration guide from old packages
+- **LLM Module**: Full OpenAI/Azure OpenAI integration with enterprise features
+- **HTTP Module**: Flexible HTTP client with multiple authentication types
+- **Prefect Integration**: Native Prefect block support for both modules
+
+## License
+
+Proprietary - Get Systems

get_systems-0.2.21/get_systems/__init__.py

@@ -0,0 +1,93 @@
+from __future__ import annotations
+
+from importlib import import_module
+from importlib.util import find_spec
+from importlib.metadata import version, PackageNotFoundError
+from typing import Any
+
+try:
+    __version__ = version("get-systems")  # package name in pyproject
+except PackageNotFoundError:
+    # fallback for local/dev run (not installed via pip)
+    __version__ = "0.0.0"
+
+# Какие "пространства" сканируем.
+# Можешь расширять: plugins, integrations и т.п.
+_NAMESPACES = ("models", "llm", "http")
+
+# Здесь будет: name -> (module_path, attr_name)
+_EXPORTS: dict[str, tuple[str, str]] = {}
+
+
+def _discover_exports() -> None:
+    """
+    Discover exports from get_systems.<namespace> packages.
+
+    Strategy:
+    - For each namespace package (models/llm/http), import only its __init__
+      (not every submodule), read __all__ and register lazy exports.
+    - The heavy dependencies should be imported inside that namespace package,
+      or inside its submodules, not here.
+    """
+    pkg_root = "get_systems"
+
+    for ns in _NAMESPACES:
+        ns_mod_path = f"{pkg_root}.{ns}"
+
+        # Namespace may not exist if extra isn't installed or package not shipped
+        if find_spec(ns_mod_path) is None:
+            continue
+
+        try:
+            ns_mod = import_module(ns_mod_path)  # imports get_systems.<ns>.__init__
+        except ImportError:
+            # If optional deps of that namespace are missing, just skip.
+            # Real error will appear when user tries to access something.
+            continue
+
+        ns_all = getattr(ns_mod, "__all__", None)
+        if not ns_all:
+            continue
+
+        for name in ns_all:
+            # Detect collisions early
+            if name in _EXPORTS:
+                prev = _EXPORTS[name][0]
+                raise RuntimeError(
+                    f"Export name collision: '{name}' provided by both '{prev}' and '{ns_mod_path}'. "
+                    f"Rename one of them or avoid exporting it at top-level."
+                )
+
+            _EXPORTS[name] = (ns_mod_path, name)
+
+
+_discover_exports()
+
+# Public API is whatever we discovered
+__all__ = sorted(_EXPORTS.keys())
+
+
+def __getattr__(name: str) -> Any:
+    """
+    Lazy attribute resolver for dynamically discovered exports.
+    """
+    if name not in _EXPORTS:
+        raise AttributeError(f"module 'get_systems' has no attribute '{name}'")
+
+    module_name, attr_name = _EXPORTS[name]
+
+    # Optional nice hints based on namespace
+    if module_name.endswith(".llm"):
+        # if llm extra not installed, most likely it fails inside llm import
+        pass
+    if module_name.endswith(".http"):
+        pass
+    if module_name.endswith(".models"):
+        pass
+
+    mod = import_module(module_name)
+    value = getattr(mod, attr_name)
+
+    # Cache for next time
+    globals()[name] = value
+    return value

get_systems-0.2.21/get_systems/http/__init__.py

@@ -0,0 +1,15 @@
+"""
+HTTP authentication and request module - Prefect blocks for HTTP operations
+
+Usage:
+    from get_systems.http import HttpAuth, HttpBlock
+    # or
+    from get_systems.http.http_block import HttpAuth
+"""
+
+from get_systems.http.http_block import HttpAuth, HttpBlock
+
+__all__ = [
+    "HttpAuth",
+    "HttpBlock",
+]

get_systems-0.2.21/get_systems/http/http_block.py

@@ -0,0 +1,69 @@
+from typing import Any, Literal, Optional
+
+import httpx
+from pydantic import Field, SecretStr
+from prefect.blocks.core import Block
+
+
+class HttpAuth(Block):
+    """HTTP authentication configuration and async client factory."""
+
+    auth_type: Literal["none", "basic", "token", "bearer"] = Field(
+        default="none",
+        description="Authentication type for HTTP requests",
+    )
+    username: Optional[str] = Field(default=None, description="Basic auth username")
+    password: Optional[SecretStr] = Field(default=None, description="Basic auth password")
+    token: Optional[SecretStr] = Field(default=None, description="Token or bearer value")
+    headers: dict[str, str] = Field(default_factory=dict, description="Extra headers")
+
+    def _auth(self) -> Optional[httpx.Auth]:
+        if self.auth_type != "basic":
+            return None
+        if not self.username or not self.password:
+            raise ValueError("Basic auth requires username and password.")
+        return httpx.BasicAuth(self.username, self.password.get_secret_value())
+
+    def _headers(self) -> dict[str, str]:
+        headers = dict(self.headers)
+        if self.auth_type in ("token", "bearer"):
+            if not self.token:
+                raise ValueError("Token auth requires token.")
+            prefix = "Token" if self.auth_type == "token" else "Bearer"
+            headers["Authorization"] = f"{prefix} {self.token.get_secret_value()}"
+        return headers
+
+    def get_async_client(
+        self,
+        base_url: Optional[str] = None,
+        timeout_s: float = 60.0,
+        extra_headers: Optional[dict[str, str]] = None,
+    ) -> httpx.AsyncClient:
+        headers = self._headers()
+        if extra_headers:
+            headers.update(extra_headers)
+
+        return httpx.AsyncClient(
+            base_url=base_url or "",
+            timeout=httpx.Timeout(timeout_s),
+            headers=headers,
+            auth=self._auth(),
+        )
+
+
+class HttpBlock(Block):
+    """Base class for HTTP-based blocks, providing common functionality for API interactions."""
+
+    url: str = "https://api.example.com"  # Default URL, can be overridden by subclasses
+    extract_token: bool = False  # Whether to extract token from response for chaining
+    auth: Optional[HttpAuth] = None
+    timeout_s: float = 60.0
+
+    def get_async_client(self) -> httpx.AsyncClient:
+        if self.auth:
+            return self.auth.get_async_client(base_url=self.url, timeout_s=self.timeout_s)
+        return httpx.AsyncClient(base_url=self.url, timeout=httpx.Timeout(self.timeout_s))
+
+    async def request(self, method: str, path: str = "", **kwargs: Any) -> httpx.Response:
+        async with self.get_async_client() as client:
+            return await client.request(method=method, url=path, **kwargs)

get_systems-0.2.21/get_systems/llm/__init__.py

@@ -0,0 +1,22 @@
+"""
+LLM operations module - OpenAI and Azure OpenAI Prefect blocks
+
+Usage:
+    from get_systems.llm import GptCompletionBlock, GptAuth, LlmRuntime, LlmResult
+    # or
+    from get_systems.llm.gpt_blocks import GptCompletionBlock
+"""
+
+from get_systems.llm.gpt_blocks import (
+    GptAuth,
+    GptCompletionBlock,
+    LlmResult,
+    LlmRuntime,
+)
+
+__all__ = [
+    "GptAuth",
+    "GptCompletionBlock",
+    "LlmResult",
+    "LlmRuntime",
+]