dtSpark 1.0.4__tar.gz

dtspark-1.0.4/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2024-2025 Matthew Westwood-Hill / Digital-Thought
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

dtspark-1.0.4/MANIFEST.in

@@ -0,0 +1,7 @@
+include LICENSE
+include README.md
+include pyproject.toml
+recursive-include src/dtSpark *.txt *.yaml *.html *.css *.js *.template
+recursive-include tests *.py *.md
+global-exclude __pycache__
+global-exclude *.py[cod]

dtspark-1.0.4/PKG-INFO

@@ -0,0 +1,187 @@
+Metadata-Version: 2.4
+Name: dtSpark
+Version: 1.0.4
+Summary: Secure Personal AI Research Kit - Multi-provider LLM CLI/Web interface with MCP tool integration
+Home-page: https://github.com/digital-thought/dtSpark
+Author: Matthew Westwood-Hill
+Author-email: Matthew Westwood-Hill <matthew@digital-thought.org>
+License: MIT
+Project-URL: Homepage, https://github.com/digital-thought/dtSpark
+Project-URL: Documentation, https://github.com/digital-thought/dtSpark#readme
+Project-URL: Repository, https://github.com/digital-thought/dtSpark
+Project-URL: Issues, https://github.com/digital-thought/dtSpark/issues
+Keywords: llm,ai,chatbot,aws,bedrock,anthropic,claude,ollama,mcp,model-context-protocol,cli,web
+Classifier: Development Status :: 4 - Beta
+Classifier: Environment :: Console
+Classifier: Environment :: Web Environment
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Information Technology
+Classifier: Intended Audience :: Science/Research
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Topic :: Software Development :: Libraries :: Python Modules
+Classifier: Topic :: Communications :: Chat
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: boto3>=1.28.0
+Requires-Dist: botocore>=1.31.0
+Requires-Dist: fastapi>=0.100.0
+Requires-Dist: uvicorn>=0.22.0
+Requires-Dist: jinja2>=3.1.0
+Requires-Dist: python-multipart>=0.0.6
+Requires-Dist: sse-starlette>=1.6.0
+Requires-Dist: rich>=13.0.0
+Requires-Dist: prompt_toolkit>=3.0.0
+Requires-Dist: httpx>=0.24.0
+Requires-Dist: aiohttp>=3.8.0
+Requires-Dist: mcp>=0.9.0
+Requires-Dist: pyyaml>=6.0
+Requires-Dist: dtPyAppFramework>=4.0.3
+Requires-Dist: tiktoken>=0.5.0
+Requires-Dist: ollama>=0.2.0
+Requires-Dist: cryptography>=41.0.0
+Requires-Dist: anthropic>=0.18.0
+Requires-Dist: APScheduler>=3.10.0
+Requires-Dist: markdown>=3.4.0
+Provides-Extra: dev
+Requires-Dist: pytest>=7.0.0; extra == "dev"
+Requires-Dist: pytest-asyncio>=0.21.0; extra == "dev"
+Requires-Dist: pytest-cov>=4.0.0; extra == "dev"
+Requires-Dist: black>=23.0.0; extra == "dev"
+Requires-Dist: isort>=5.12.0; extra == "dev"
+Requires-Dist: mypy>=1.0.0; extra == "dev"
+Requires-Dist: flake8>=6.0.0; extra == "dev"
+Provides-Extra: mysql
+Requires-Dist: mysql-connector-python>=8.0.0; extra == "mysql"
+Provides-Extra: postgresql
+Requires-Dist: psycopg2-binary>=2.9.0; extra == "postgresql"
+Provides-Extra: mssql
+Requires-Dist: pyodbc>=4.0.0; extra == "mssql"
+Provides-Extra: all-databases
+Requires-Dist: mysql-connector-python>=8.0.0; extra == "all-databases"
+Requires-Dist: psycopg2-binary>=2.9.0; extra == "all-databases"
+Requires-Dist: pyodbc>=4.0.0; extra == "all-databases"
+Dynamic: author
+Dynamic: home-page
+Dynamic: license-file
+Dynamic: requires-python
+
+# Spark - Secure Personal AI Research Kit
+
+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+[![Python 3.10+](https://img.shields.io/badge/python-3.10+-blue.svg)](https://www.python.org/downloads/)
+
+**Spark** is a powerful, multi-provider LLM interface for conversational AI with integrated tool support. It supports AWS Bedrock, Anthropic Direct API, and Ollama local models through both CLI and Web interfaces.
+
+## Key Features
+
+- **Multi-Provider Support** - AWS Bedrock, Anthropic Direct API, and Ollama local models
+- **Dual Interface** - Rich CLI terminal UI and modern Web browser interface
+- **MCP Tool Integration** - Connect external tools via Model Context Protocol
+- **Intelligent Context Management** - Automatic conversation compaction with model-aware limits
+- **Security Features** - Prompt inspection, tool permissions, and audit logging
+- **Multiple Database Backends** - SQLite, MySQL, PostgreSQL, and Microsoft SQL Server
+
+## Quick Start
+
+### Installation
+
+```bash
+pip install dtSpark
+```
+
+### First-Time Setup
+
+Run the interactive setup wizard to configure Spark:
+
+```bash
+spark --setup
+```
+
+This guides you through:
+- LLM provider selection and configuration
+- Database setup
+- Interface preferences
+- Security settings
+
+### Running Spark
+
+```bash
+# Start with CLI interface
+spark
+
+# Or use the alternative command
+dtSpark
+```
+
+## Documentation
+
+Comprehensive documentation is available in the [docs](docs/) folder:
+
+- [Installation Guide](docs/installation.md) - Detailed installation instructions
+- [Configuration Reference](docs/configuration.md) - Complete config.yaml documentation
+- [Features Guide](docs/features.md) - Detailed feature documentation
+- [CLI Reference](docs/cli-reference.md) - Command-line options and chat commands
+- [Web Interface](docs/web-interface.md) - Web UI guide
+- [MCP Integration](docs/mcp-integration.md) - Tool integration documentation
+- [Security](docs/security.md) - Security features and best practices
+
+## Architecture Overview
+
+```mermaid
+graph LR
+    subgraph Interfaces
+        CLI[CLI]
+        WEB[Web]
+    end
+
+    subgraph Core
+        CM[Conversation<br/>Manager]
+    end
+
+    subgraph Providers
+        BEDROCK[AWS Bedrock]
+        ANTHROPIC[Anthropic]
+        OLLAMA[Ollama]
+    end
+
+    subgraph Tools
+        MCP[MCP Servers]
+        BUILTIN[Built-in Tools]
+    end
+
+    CLI --> CM
+    WEB --> CM
+    CM --> BEDROCK
+    CM --> ANTHROPIC
+    CM --> OLLAMA
+    CM --> MCP
+    CM --> BUILTIN
+```
+
+## Requirements
+
+- Python 3.10 or higher
+- AWS credentials (for Bedrock)
+- Anthropic API key (for direct API)
+- Ollama server (for local models)
+
+## Licence
+
+MIT Licence - see [LICENSE](LICENSE) for details.
+
+## Author
+
+Matthew Westwood-Hill
+matthew@digital-thought.org
+
+## Support
+
+- **Documentation**: [docs/](docs/)
+- **Issues**: [GitHub Issues](https://github.com/digital-thought/dtSpark/issues)

dtspark-1.0.4/README.md

@@ -0,0 +1,113 @@
+# Spark - Secure Personal AI Research Kit
+
+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+[![Python 3.10+](https://img.shields.io/badge/python-3.10+-blue.svg)](https://www.python.org/downloads/)
+
+**Spark** is a powerful, multi-provider LLM interface for conversational AI with integrated tool support. It supports AWS Bedrock, Anthropic Direct API, and Ollama local models through both CLI and Web interfaces.
+
+## Key Features
+
+- **Multi-Provider Support** - AWS Bedrock, Anthropic Direct API, and Ollama local models
+- **Dual Interface** - Rich CLI terminal UI and modern Web browser interface
+- **MCP Tool Integration** - Connect external tools via Model Context Protocol
+- **Intelligent Context Management** - Automatic conversation compaction with model-aware limits
+- **Security Features** - Prompt inspection, tool permissions, and audit logging
+- **Multiple Database Backends** - SQLite, MySQL, PostgreSQL, and Microsoft SQL Server
+
+## Quick Start
+
+### Installation
+
+```bash
+pip install dtSpark
+```
+
+### First-Time Setup
+
+Run the interactive setup wizard to configure Spark:
+
+```bash
+spark --setup
+```
+
+This guides you through:
+- LLM provider selection and configuration
+- Database setup
+- Interface preferences
+- Security settings
+
+### Running Spark
+
+```bash
+# Start with CLI interface
+spark
+
+# Or use the alternative command
+dtSpark
+```
+
+## Documentation
+
+Comprehensive documentation is available in the [docs](docs/) folder:
+
+- [Installation Guide](docs/installation.md) - Detailed installation instructions
+- [Configuration Reference](docs/configuration.md) - Complete config.yaml documentation
+- [Features Guide](docs/features.md) - Detailed feature documentation
+- [CLI Reference](docs/cli-reference.md) - Command-line options and chat commands
+- [Web Interface](docs/web-interface.md) - Web UI guide
+- [MCP Integration](docs/mcp-integration.md) - Tool integration documentation
+- [Security](docs/security.md) - Security features and best practices
+
+## Architecture Overview
+
+```mermaid
+graph LR
+    subgraph Interfaces
+        CLI[CLI]
+        WEB[Web]
+    end
+
+    subgraph Core
+        CM[Conversation<br/>Manager]
+    end
+
+    subgraph Providers
+        BEDROCK[AWS Bedrock]
+        ANTHROPIC[Anthropic]
+        OLLAMA[Ollama]
+    end
+
+    subgraph Tools
+        MCP[MCP Servers]
+        BUILTIN[Built-in Tools]
+    end
+
+    CLI --> CM
+    WEB --> CM
+    CM --> BEDROCK
+    CM --> ANTHROPIC
+    CM --> OLLAMA
+    CM --> MCP
+    CM --> BUILTIN
+```
+
+## Requirements
+
+- Python 3.10 or higher
+- AWS credentials (for Bedrock)
+- Anthropic API key (for direct API)
+- Ollama server (for local models)
+
+## Licence
+
+MIT Licence - see [LICENSE](LICENSE) for details.
+
+## Author
+
+Matthew Westwood-Hill
+matthew@digital-thought.org
+
+## Support
+
+- **Documentation**: [docs/](docs/)
+- **Issues**: [GitHub Issues](https://github.com/digital-thought/dtSpark/issues)

dtspark-1.0.4/pyproject.toml

@@ -0,0 +1,156 @@
+[build-system]
+requires = ["setuptools>=61.0", "wheel"]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "dtSpark"
+dynamic = ["version"]
+description = "Secure Personal AI Research Kit - Multi-provider LLM CLI/Web interface with MCP tool integration"
+readme = "README.md"
+license = {text = "MIT"}
+requires-python = ">=3.10"
+authors = [
+    {name = "Matthew Westwood-Hill", email = "matthew@digital-thought.org"}
+]
+keywords = [
+    "llm",
+    "ai",
+    "chatbot",
+    "aws",
+    "bedrock",
+    "anthropic",
+    "claude",
+    "ollama",
+    "mcp",
+    "model-context-protocol",
+    "cli",
+    "web",
+]
+classifiers = [
+    "Development Status :: 4 - Beta",
+    "Environment :: Console",
+    "Environment :: Web Environment",
+    "Intended Audience :: Developers",
+    "Intended Audience :: Information Technology",
+    "Intended Audience :: Science/Research",
+    "License :: OSI Approved :: MIT License",
+    "Operating System :: OS Independent",
+    "Programming Language :: Python :: 3",
+    "Programming Language :: Python :: 3.10",
+    "Programming Language :: Python :: 3.11",
+    "Programming Language :: Python :: 3.12",
+    "Topic :: Scientific/Engineering :: Artificial Intelligence",
+    "Topic :: Software Development :: Libraries :: Python Modules",
+    "Topic :: Communications :: Chat",
+]
+dependencies = [
+    "boto3>=1.28.0",
+    "botocore>=1.31.0",
+    "fastapi>=0.100.0",
+    "uvicorn>=0.22.0",
+    "jinja2>=3.1.0",
+    "python-multipart>=0.0.6",
+    "sse-starlette>=1.6.0",
+    "rich>=13.0.0",
+    "prompt_toolkit>=3.0.0",
+    "httpx>=0.24.0",
+    "aiohttp>=3.8.0",
+    "mcp>=0.9.0",
+    "pyyaml>=6.0",
+    "dtPyAppFramework>=4.0.3",
+    "tiktoken>=0.5.0",
+    "ollama>=0.2.0",
+    "cryptography>=41.0.0",
+    "anthropic>=0.18.0",
+    "APScheduler>=3.10.0",
+    "markdown>=3.4.0",
+]
+
+[project.optional-dependencies]
+dev = [
+    "pytest>=7.0.0",
+    "pytest-asyncio>=0.21.0",
+    "pytest-cov>=4.0.0",
+    "black>=23.0.0",
+    "isort>=5.12.0",
+    "mypy>=1.0.0",
+    "flake8>=6.0.0",
+]
+mysql = ["mysql-connector-python>=8.0.0"]
+postgresql = ["psycopg2-binary>=2.9.0"]
+mssql = ["pyodbc>=4.0.0"]
+all-databases = [
+    "mysql-connector-python>=8.0.0",
+    "psycopg2-binary>=2.9.0",
+    "pyodbc>=4.0.0",
+]
+
+[project.scripts]
+spark = "dtSpark.launch:main"
+dtSpark = "dtSpark.launch:main"
+
+[project.urls]
+Homepage = "https://github.com/digital-thought/dtSpark"
+Documentation = "https://github.com/digital-thought/dtSpark#readme"
+Repository = "https://github.com/digital-thought/dtSpark"
+Issues = "https://github.com/digital-thought/dtSpark/issues"
+
+[tool.poetry]
+name = "dtSpark"
+
+[tool.setuptools]
+package-dir = {"" = "src"}
+
+[tool.setuptools.packages.find]
+where = ["src"]
+
+[tool.setuptools.dynamic]
+version = {file = "src/dtSpark/_version.txt"}
+
+[tool.setuptools.package-data]
+dtSpark = [
+    "_*.txt",
+    "_*.yaml",
+    "resources/*.yaml",
+    "resources/*.template",
+    "web/templates/*.html",
+    "web/static/css/*.css",
+    "web/static/js/*.js",
+]
+
+[tool.black]
+line-length = 100
+target-version = ['py310', 'py311', 'py312']
+include = '\.pyi?$'
+exclude = '''
+/(
+    \.eggs
+  | \.git
+  | \.hg
+  | \.mypy_cache
+  | \.tox
+  | \.venv
+  | _build
+  | buck-out
+  | build
+  | dist
+)/
+'''
+
+[tool.isort]
+profile = "black"
+line_length = 100
+skip_gitignore = true
+
+[tool.mypy]
+python_version = "3.10"
+warn_return_any = true
+warn_unused_configs = true
+ignore_missing_imports = true
+
+[tool.pytest.ini_options]
+testpaths = ["tests"]
+python_files = "test_*.py"
+python_classes = "Test*"
+python_functions = "test_*"
+addopts = "-v --tb=short"

dtspark-1.0.4/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

dtspark-1.0.4/setup.py

@@ -0,0 +1,139 @@
+#!/usr/bin/env python3
+"""
+Setup script for Spark - Secure Personal AI Research Kit.
+
+A multi-provider LLM CLI and Web interface with MCP tool integration.
+"""
+
+from setuptools import setup, find_packages
+from pathlib import Path
+
+# Read the README file
+this_directory = Path(__file__).parent
+long_description = (this_directory / "README.md").read_text(encoding="utf-8")
+
+# Read version from _version.txt
+version_file = this_directory / "src" / "dtSpark" / "_version.txt"
+version = version_file.read_text(encoding="utf-8").strip()
+
+setup(
+    name="dtSpark",
+    version=version,
+    author="Matthew Westwood-Hill",
+    author_email="matthew@digital-thought.org",
+    description="Secure Personal AI Research Kit - Multi-provider LLM CLI/Web interface with MCP tool integration",
+    long_description=long_description,
+    long_description_content_type="text/markdown",
+    url="https://github.com/digital-thought/dtSpark",
+    project_urls={
+        "Bug Reports": "https://github.com/digital-thought/dtSpark/issues",
+        "Source": "https://github.com/digital-thought/dtSpark",
+        "Documentation": "https://github.com/digital-thought/dtSpark#readme",
+    },
+    license="MIT",
+    classifiers=[
+        "Development Status :: 4 - Beta",
+        "Environment :: Console",
+        "Environment :: Web Environment",
+        "Intended Audience :: Developers",
+        "Intended Audience :: Information Technology",
+        "Intended Audience :: Science/Research",
+        "License :: OSI Approved :: MIT License",
+        "Operating System :: OS Independent",
+        "Programming Language :: Python :: 3",
+        "Programming Language :: Python :: 3.10",
+        "Programming Language :: Python :: 3.11",
+        "Programming Language :: Python :: 3.12",
+        "Topic :: Scientific/Engineering :: Artificial Intelligence",
+        "Topic :: Software Development :: Libraries :: Python Modules",
+        "Topic :: Communications :: Chat",
+    ],
+    keywords=[
+        "llm",
+        "ai",
+        "chatbot",
+        "aws",
+        "bedrock",
+        "anthropic",
+        "claude",
+        "ollama",
+        "mcp",
+        "model-context-protocol",
+        "cli",
+        "web",
+    ],
+    package_dir={"": "src"},
+    packages=find_packages(where="src"),
+    include_package_data=True,
+    package_data={
+        "dtSpark": [
+            "_*.txt",
+            "_*.yaml",
+            "resources/*.yaml",
+            "resources/*.template",
+            "web/templates/*.html",
+            "web/static/css/*.css",
+            "web/static/js/*.js",
+        ],
+    },
+    python_requires=">=3.10",
+    install_requires=[
+        # AWS SDK
+        "boto3>=1.28.0",
+        "botocore>=1.31.0",
+        # Web framework
+        "fastapi>=0.100.0",
+        "uvicorn>=0.22.0",
+        "jinja2>=3.1.0",
+        "python-multipart>=0.0.6",
+        "sse-starlette>=1.6.0",
+        # CLI interface
+        "rich>=13.0.0",
+        "prompt_toolkit>=3.0.0",
+        # HTTP client
+        "httpx>=0.24.0",
+        "aiohttp>=3.8.0",
+        # MCP (Model Context Protocol)
+        "mcp>=0.9.0",
+        # Data handling
+        "pyyaml>=6.0",
+        # Application framework
+        "dtPyAppFramework>=0.1.0",
+        # Cryptography for SSL
+        "cryptography>=41.0.0",
+        # Anthropic direct API (optional but commonly used)
+        "anthropic>=0.18.0",
+    ],
+    extras_require={
+        "dev": [
+            "pytest>=7.0.0",
+            "pytest-asyncio>=0.21.0",
+            "pytest-cov>=4.0.0",
+            "black>=23.0.0",
+            "isort>=5.12.0",
+            "mypy>=1.0.0",
+            "flake8>=6.0.0",
+        ],
+        "mysql": [
+            "mysql-connector-python>=8.0.0",
+        ],
+        "postgresql": [
+            "psycopg2-binary>=2.9.0",
+        ],
+        "mssql": [
+            "pyodbc>=4.0.0",
+        ],
+        "all-databases": [
+            "mysql-connector-python>=8.0.0",
+            "psycopg2-binary>=2.9.0",
+            "pyodbc>=4.0.0",
+        ],
+    },
+    entry_points={
+        "console_scripts": [
+            "spark=dtSpark.launch:main",
+            "dtSpark=dtSpark.launch:main"
+        ],
+    },
+    zip_safe=False,
+)

dtspark-1.0.4/src/dtSpark/_description.txt

@@ -0,0 +1 @@
+Spark is a powerful, multi-provider LLM interface for conversational AI with integrated tool support. It supports AWS Bedrock, Anthropic Direct API, and Ollama local models through both CLI and Web interfaces.

dtspark-1.0.4/src/dtSpark/_full_name.txt

@@ -0,0 +1 @@
+Secure Personal AI Research Kit

dtspark-1.0.4/src/dtSpark/_licence.txt

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2024 Digital-Thought
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

dtspark-1.0.4/src/dtSpark/_metadata.yaml

@@ -0,0 +1,6 @@
+version: !file _version.txt
+short_name: !file _name.txt
+full_name: !file _full_name.txt
+copyright: 2023-2025 Digital-Thought
+licence: !file _licence.txt
+description: !file _description.txt

dtspark-1.0.4/src/dtSpark/_name.txt

@@ -0,0 +1 @@
+dtSpark

dtspark-1.0.4/src/dtSpark/_version.txt

@@ -0,0 +1 @@
+1.0.4

dtspark-1.0.4/src/dtSpark/aws/__init__.py

@@ -0,0 +1,7 @@
+"""AWS integration module."""
+from .authentication import AWSAuthenticator
+from .bedrock import BedrockService
+from .pricing import BedrockPricing
+from .costs import CostTracker
+
+__all__ = ['AWSAuthenticator', 'BedrockService', 'BedrockPricing', 'CostTracker']