brownllama 0.1.0__tar.gz

brownllama-0.1.0/.gitignore

@@ -0,0 +1,40 @@
+# Python-generated files
+__pycache__/
+*.py[oc]
+build/
+dist/
+wheels/
+*.egg-info
+.ruff_cache
+.venv
+
+# Aider
+.aider*
+
+# Keys and Secrets
+*.pem
+*.key
+*.crt
+development_gcp_service_account_key.json
+id_rsa
+id_rsa.pub
+terraform_service_account_key.json
+*service_account*
+*credential*
+.env
+
+# Local Deployment Scripts
+*run-podman.sh
+*run-terraform.sh
+
+# Test Scripts and logs
+test-scripts
+logs/
+
+# Terraform
+.terraform
+.terraform.lock.hcl
+terraform.tfstate
+
+# Extras
+.DS_Store

brownllama-0.1.0/.pre-commit-config.yaml

@@ -0,0 +1,43 @@
+---
+repos:
+  - repo: https://github.com/pre-commit/pre-commit-hooks
+    rev: v5.0.0
+    hooks:
+      - id: check-yaml
+      - id: end-of-file-fixer
+      - id: trailing-whitespace
+      - id: requirements-txt-fixer
+      - id: detect-private-key
+      - id: check-added-large-files
+      - id: check-json
+      - id: check-toml
+      - id: check-shebang-scripts-are-executable
+
+  - repo: https://github.com/astral-sh/ruff-pre-commit
+    rev: v0.11.11
+    hooks:
+      - id: ruff
+        args: [--fix, --show-fixes]
+      - id: ruff-format
+
+  - repo: https://github.com/astral-sh/uv-pre-commit
+    rev: 0.7.8
+    hooks:
+      - id: uv-lock
+
+  - repo: https://github.com/terrencepreilly/darglint
+    rev: v1.8.1
+    hooks:
+      - id: darglint
+
+  - repo: https://github.com/antonbabenko/pre-commit-terraform
+    rev: v1.99.0
+    hooks:
+      - id: terraform_fmt
+      - id: terraform_validate
+      - id: terraform_docs
+
+  - repo: https://github.com/detailyang/pre-commit-shell
+    rev: 1.0.5
+    hooks:
+      - id: shell-lint

brownllama-0.1.0/.python-version

@@ -0,0 +1 @@
+3.12

brownllama-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 brownLlama
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

brownllama-0.1.0/PKG-INFO

@@ -0,0 +1,90 @@
+Metadata-Version: 2.4
+Name: brownllama
+Version: 0.1.0
+Summary: Standard PIP Package for GCP integration apps.
+Author-email: Sanu Maharjan <inbox.sanu@gmail.com>
+License-File: LICENSE
+Classifier: Programming Language :: Python :: 3 :: Only
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Requires-Python: >=3.12
+Requires-Dist: google-cloud-bigquery>=3.34
+Requires-Dist: google-cloud-secret-manager>=2.23.3
+Requires-Dist: google-cloud-storage>=3.1
+Requires-Dist: pandas>=2.2.3
+Requires-Dist: pydantic>=2.11.5
+Description-Content-Type: text/markdown
+
+# brownLlama Pip Package
+
+## Overview
+
+`brownllama-pip` (or `brownllama` when imported in Python) is a utility library designed to provide common functionalities and standardized components for VNP's Python projects. It aims to reduce code duplication and promote best practices across different projects.
+
+## Modules
+
+The package currently includes the following modules:
+
+- **bigquery.py**:
+
+  - Provides the `BigQueryController` class for simplified interaction with Google BigQuery.
+  - Supports creating tables, checking table existence, loading data from JSON, loading data from Google Cloud Storage (GCS), and executing queries.
+  - Offers methods for schema inference from JSON data and efficient data loading via GCS staging.
+
+- **logger.py**:
+
+  - Provides the `get_logger` function for obtaining configured logger instances.
+  - Standardizes logging format and setup across projects.
+  - Configures both root logger and common third-party library loggers to ensure consistent logging behavior.
+
+- **secret_manager.py**
+
+  - Provides the `get_secret` function for retrieving secrets from Google Secret Manager.
+  - Enables to get, create, delete and lists the secrets.
+
+- **storage.py**:
+  - Provides the `StorageManager` class for managing Google Cloud Storage operations.
+  - Supports uploading data (dictionaries, lists of dictionaries, Pandas DataFrames) to GCS as JSON files.
+  - Includes functionality for deleting files from GCS.
+
+## Building and Publishing
+
+To build and publish the package, follow these steps:
+
+1.  Install build dependencies:
+
+    ```bash
+    uv add build twine
+    ```
+
+2.  Build the package:
+
+    ```bash
+    uv build
+    ```
+
+3.  Publish the package in PyPI
+
+    ```bash
+    uv run twine upload --verbose dist/*
+    ```
+
+    NOTE: PyPI is public and should not be used for sensitive information. Also, you need to setup `~/.pypirc` with your PyPI credentials.
+
+## Usage
+
+After installation, you can import and use the modules and classes provided by `brownllama` in your Python projects.
+
+**Example (using BigQueryController):**
+
+```python
+from brownllama.bigquery import BigQueryController
+
+bq_controller = BigQueryController(bigquery_payload=bigquery_payload, key_path=key_path)
+
+# Example: Export JSON data to BigQuery via GCS
+gcs_uri = bq_controller.export_to_bq_via_gcs(json_data=data)
+print(f"Data loaded to BigQuery via GCS: {gcs_uri}")
+```
+
+Refer to the individual module files (`bigquery.py`, `logger.py`, `storage.py`) for detailed class and function documentation and usage examples.

brownllama-0.1.0/README.md

@@ -0,0 +1,73 @@
+# brownLlama Pip Package
+
+## Overview
+
+`brownllama-pip` (or `brownllama` when imported in Python) is a utility library designed to provide common functionalities and standardized components for VNP's Python projects. It aims to reduce code duplication and promote best practices across different projects.
+
+## Modules
+
+The package currently includes the following modules:
+
+- **bigquery.py**:
+
+  - Provides the `BigQueryController` class for simplified interaction with Google BigQuery.
+  - Supports creating tables, checking table existence, loading data from JSON, loading data from Google Cloud Storage (GCS), and executing queries.
+  - Offers methods for schema inference from JSON data and efficient data loading via GCS staging.
+
+- **logger.py**:
+
+  - Provides the `get_logger` function for obtaining configured logger instances.
+  - Standardizes logging format and setup across projects.
+  - Configures both root logger and common third-party library loggers to ensure consistent logging behavior.
+
+- **secret_manager.py**
+
+  - Provides the `get_secret` function for retrieving secrets from Google Secret Manager.
+  - Enables to get, create, delete and lists the secrets.
+
+- **storage.py**:
+  - Provides the `StorageManager` class for managing Google Cloud Storage operations.
+  - Supports uploading data (dictionaries, lists of dictionaries, Pandas DataFrames) to GCS as JSON files.
+  - Includes functionality for deleting files from GCS.
+
+## Building and Publishing
+
+To build and publish the package, follow these steps:
+
+1.  Install build dependencies:
+
+    ```bash
+    uv add build twine
+    ```
+
+2.  Build the package:
+
+    ```bash
+    uv build
+    ```
+
+3.  Publish the package in PyPI
+
+    ```bash
+    uv run twine upload --verbose dist/*
+    ```
+
+    NOTE: PyPI is public and should not be used for sensitive information. Also, you need to setup `~/.pypirc` with your PyPI credentials.
+
+## Usage
+
+After installation, you can import and use the modules and classes provided by `brownllama` in your Python projects.
+
+**Example (using BigQueryController):**
+
+```python
+from brownllama.bigquery import BigQueryController
+
+bq_controller = BigQueryController(bigquery_payload=bigquery_payload, key_path=key_path)
+
+# Example: Export JSON data to BigQuery via GCS
+gcs_uri = bq_controller.export_to_bq_via_gcs(json_data=data)
+print(f"Data loaded to BigQuery via GCS: {gcs_uri}")
+```
+
+Refer to the individual module files (`bigquery.py`, `logger.py`, `storage.py`) for detailed class and function documentation and usage examples.

brownllama-0.1.0/brownllama/__init__.py

@@ -0,0 +1,2 @@
+# This file makes the directory a Python package
+# It can be left empty or can include imports to expose specific modules