osintkit 0.2.0__tar.gz → 0.3.0__tar.gz

{osintkit-0.2.0 → osintkit-0.3.0}/CHANGELOG.md

@@ -6,6 +6,18 @@ All notable changes are recorded here. The format follows
 
 ## Unreleased
 
+## 0.3.0 — 2026-11-02
+
+### Added
+
+- providers for DeepSeek, Mistral, Groq, Together, Anthropic, and local Ollama
+- provider selection from its own environment variable (`DEEPSEEK_API_KEY`, `MISTRAL_API_KEY`, ...)
+- keyless providers (Ollama) work without any key, including in `doctor`
+
+### Changed
+
+- `doctor` reports the provider and where the key came from
+
 ## 0.2.0 — 2026-11-02
 
 ### Added

{osintkit-0.2.0 → osintkit-0.3.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.5
 Name: osintkit
-Version: 0.2.0
+Version: 0.3.0
 Summary: Public-data OSINT aggregator for emails, usernames, domains, and companies
 Project-URL: Homepage, https://github.com/sjdsjadjajdjsa/osintkit
 Project-URL: Issues, https://github.com/sjdsjadjajdjsa/osintkit/issues
@@ -74,7 +74,7 @@ checksums, and `pip install -e .` works from a clone. Python 3.12+ only.
 ## Quick start
 
 ```bash
-export API_KEY=...                 # model key, any OpenAI-compatible endpoint
+export API_KEY=...                 # or DEEPSEEK_API_KEY, MISTRAL_API_KEY, ...
 osintkit doctor --deep             # prove the key and endpoint work
 osintkit lookup alice@example.com
 ```
@@ -83,8 +83,11 @@ No key? `osintkit lookup example.com --offline` builds the whole report locally
 no model involved. `--raw` gives the collected JSON and `--dry-run` prints the prompt a model
 would receive.
 
-Any OpenAI-compatible endpoint works. `--provider venice|openrouter|openai` picks a preset, and
-a recognisable key prefix picks one for you; `--base-url` and `--model` always win.
+Any OpenAI-compatible endpoint works: export the provider's own variable (`DEEPSEEK_API_KEY`,
+`MISTRAL_API_KEY`, `GROQ_API_KEY`, `VENICE_API_KEY`, `OPENROUTER_API_KEY`, `OPENAI_API_KEY`,
+`TOGETHER_API_KEY`, `ANTHROPIC_API_KEY`) and that provider is used. `--provider` also accepts
+`ollama` for a local server with no key. `--base-url` and `--model` always win, and the full
+preset table is in [docs/REFERENCE.md](docs/REFERENCE.md#providers).
 
 Optional keys: `HIBP_API_KEY` turns on Have I Been Pwned, `GITHUB_TOKEN` lifts GitHub from 60 to
 5000 requests/hour. Everything else needs no credentials.

{osintkit-0.2.0 → osintkit-0.3.0}/README.md

@@ -42,7 +42,7 @@ checksums, and `pip install -e .` works from a clone. Python 3.12+ only.
 ## Quick start
 
 ```bash
-export API_KEY=...                 # model key, any OpenAI-compatible endpoint
+export API_KEY=...                 # or DEEPSEEK_API_KEY, MISTRAL_API_KEY, ...
 osintkit doctor --deep             # prove the key and endpoint work
 osintkit lookup alice@example.com
 ```
@@ -51,8 +51,11 @@ No key? `osintkit lookup example.com --offline` builds the whole report locally
 no model involved. `--raw` gives the collected JSON and `--dry-run` prints the prompt a model
 would receive.
 
-Any OpenAI-compatible endpoint works. `--provider venice|openrouter|openai` picks a preset, and
-a recognisable key prefix picks one for you; `--base-url` and `--model` always win.
+Any OpenAI-compatible endpoint works: export the provider's own variable (`DEEPSEEK_API_KEY`,
+`MISTRAL_API_KEY`, `GROQ_API_KEY`, `VENICE_API_KEY`, `OPENROUTER_API_KEY`, `OPENAI_API_KEY`,
+`TOGETHER_API_KEY`, `ANTHROPIC_API_KEY`) and that provider is used. `--provider` also accepts
+`ollama` for a local server with no key. `--base-url` and `--model` always win, and the full
+preset table is in [docs/REFERENCE.md](docs/REFERENCE.md#providers).
 
 Optional keys: `HIBP_API_KEY` turns on Have I Been Pwned, `GITHUB_TOKEN` lifts GitHub from 60 to
 5000 requests/hour. Everything else needs no credentials.

{osintkit-0.2.0 → osintkit-0.3.0}/docs/REFERENCE.md

@@ -34,11 +34,20 @@ osintkit --provider openrouter ...
 osintkit --base-url https://gateway.internal/v1 --model house-model ...
 ```
 
-| `--provider` | Endpoint | Default model | Auto-selected by |
+| `--provider` | Endpoint | Default model | Key variable |
 | --- | --- | --- | --- |
-| `venice` (default) | `api.venice.ai/api/v1` | `deepseek-v4-1-flash` | anything else |
-| `openrouter` | `openrouter.ai/api/v1` | `deepseek/deepseek-v4.1-flash-1017` | `sk-or-` key |
-| `openai` | `api.openai.com/v1` | `gpt-4.1-mini` | `sk-proj-` key |
+| `venice` (default) | `api.venice.ai/api/v1` | `deepseek-v4-1-flash` | `API_KEY`, `VENICE_API_KEY` |
+| `openrouter` | `openrouter.ai/api/v1` | `deepseek/deepseek-v4.1-flash-1017` | `OPENROUTER_API_KEY`, `sk-or-` keys |
+| `openai` | `api.openai.com/v1` | `gpt-4.1-mini` | `OPENAI_API_KEY`, `sk-proj-` keys |
+| `deepseek` | `api.deepseek.com/v1` | `deepseek-chat` | `DEEPSEEK_API_KEY` |
+| `mistral` | `api.mistral.ai/v1` | `mistral-small-latest` | `MISTRAL_API_KEY` |
+| `groq` | `api.groq.com/openai/v1` | `llama-3.3-70b-versatile` | `GROQ_API_KEY`, `gsk_` keys |
+| `together` | `api.together.xyz/v1` | Llama 3.3 70B | `TOGETHER_API_KEY` |
+| `anthropic` | `api.anthropic.com/v1` | `claude-sonnet-4-5` | `ANTHROPIC_API_KEY`, `sk-ant-` keys |
+| `ollama` | `localhost:11434/v1` | `llama3.2` | none |
+
+Set a provider-specific variable and that provider is chosen; `API_KEY` alone falls back to the
+default. Recognisable key prefixes override that inference. `--provider` beats both.
 
 Explicit `--base-url` and `--model` beat both the provider and the prefix. Temperature is 0.3,
 `--max-tokens` defaults to 2400.

{osintkit-0.2.0 → osintkit-0.3.0}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
 
 [project]
 name = "osintkit"
-version = "0.2.0"
+version = "0.3.0"
 description = "Public-data OSINT aggregator for emails, usernames, domains, and companies"
 readme = "README.md"
 requires-python = ">=3.12"

{osintkit-0.2.0 → osintkit-0.3.0}/src/osintkit/__init__.py

@@ -1,3 +1,3 @@
 """osintkit: a public-data OSINT aggregator."""
 
-__version__ = "0.2.0"
+__version__ = "0.3.0"

{osintkit-0.2.0 → osintkit-0.3.0}/src/osintkit/cli.py

@@ -21,10 +21,12 @@ from rich.table import Table
 from . import __version__, diff, doctor, pipeline, render, retention
 from .collectors import REGISTRY
 from .config import (
+    GENERIC_KEY_ENVS,
     PROVIDERS,
     Settings,
     cache_clear,
     cache_stats,
+    provider_from_env,
     provider_from_key,
 )
 from .errors import OsintKitError, TargetParseError
@@ -32,7 +34,7 @@ from .logging_store import RunLogger, find_report_for_run, read_report, read_run
 from .targets import VALID_TYPES
 
 app = typer.Typer(
-    add_completion=False,
+    add_completion=True,
     no_args_is_help=True,
     help="Public-data OSINT aggregator for emails, usernames, domains, and companies.",
     rich_markup_mode="rich",
@@ -61,7 +63,7 @@ def _version_callback(value: bool) -> None:
 @app.callback()
 def root(
     provider: str | None = typer.Option(
-        None, "--provider", help="Endpoint preset: venice, openrouter, or openai."
+        None, "--provider", help="Endpoint preset; see docs/REFERENCE.md#providers."
     ),
     base_url: str | None = typer.Option(
         None, "--base-url", help="OpenAI-compatible base URL (overrides the provider)."
@@ -88,10 +90,17 @@ def root(
 ) -> None:
     if provider and provider not in PROVIDERS:
         raise typer.BadParameter(f"unknown provider {provider!r}; choose from {', '.join(PROVIDERS)}")
-    effective_key = api_key or os.environ.get("API_KEY") or os.environ.get("OPENAI_API_KEY")
-    chosen = provider or provider_from_key(effective_key) or "venice"
+    generic_env = next((os.environ[name] for name in GENERIC_KEY_ENVS if os.environ.get(name)), None)
+    chosen = (
+        provider
+        or provider_from_key(api_key)
+        or provider_from_env()
+        or provider_from_key(generic_env)
+        or "venice"
+    )
     preset = PROVIDERS[chosen]
     settings = Settings(
+        provider=chosen,
         base_url=base_url or preset[0],
         model=model or preset[1],
         api_key=api_key,

{osintkit-0.2.0 → osintkit-0.3.0}/src/osintkit/config.py

@@ -23,8 +23,31 @@ PROVIDERS: dict[str, tuple[str, str]] = {
     "venice": (DEFAULT_BASE_URL, DEFAULT_MODEL),
     "openrouter": ("https://openrouter.ai/api/v1", "deepseek/deepseek-v4.1-flash-1017"),
     "openai": ("https://api.openai.com/v1", "gpt-4.1-mini"),
+    "deepseek": ("https://api.deepseek.com/v1", "deepseek-chat"),
+    "mistral": ("https://api.mistral.ai/v1", "mistral-small-latest"),
+    "groq": ("https://api.groq.com/openai/v1", "llama-3.3-70b-versatile"),
+    "together": ("https://api.together.xyz/v1", "meta-llama/Llama-3.3-70B-Instruct-Turbo"),
+    "anthropic": ("https://api.anthropic.com/v1", "claude-sonnet-4-5"),
+    "ollama": ("http://localhost:11434/v1", "llama3.2"),
 }
-KEY_PREFIXES: dict[str, str] = {"sk-or-": "openrouter", "sk-proj-": "openai"}
+KEYLESS_PROVIDERS = frozenset({"ollama"})
+KEY_PREFIXES: dict[str, str] = {
+    "sk-or-": "openrouter",
+    "sk-proj-": "openai",
+    "gsk_": "groq",
+    "sk-ant-": "anthropic",
+}
+PROVIDER_ENV: dict[str, str] = {
+    "VENICE_API_KEY": "venice",
+    "OPENROUTER_API_KEY": "openrouter",
+    "OPENAI_API_KEY": "openai",
+    "DEEPSEEK_API_KEY": "deepseek",
+    "MISTRAL_API_KEY": "mistral",
+    "GROQ_API_KEY": "groq",
+    "TOGETHER_API_KEY": "together",
+    "ANTHROPIC_API_KEY": "anthropic",
+}
+GENERIC_KEY_ENVS = ("API_KEY",)
 
 
 def provider_from_key(api_key: str | None) -> str | None:
@@ -37,6 +60,14 @@ def provider_from_key(api_key: str | None) -> str | None:
     return None
 
 
+def provider_from_env() -> str | None:
+    """Infer a provider from whichever provider-specific variable is set."""
+    for variable, provider in PROVIDER_ENV.items():
+        if os.environ.get(variable):
+            return provider
+    return None
+
+
 def app_home() -> Path:
     override = os.environ.get(APP_HOME_ENV)
     if override:
@@ -67,6 +98,7 @@ class Settings:
 
     target: str = ""
     target_type: str = ""
+    provider: str = "venice"
     base_url: str = DEFAULT_BASE_URL
     model: str = DEFAULT_MODEL
     api_key: str | None = None
@@ -95,7 +127,19 @@ class Settings:
         return os.environ.get("GITHUB_TOKEN") or os.environ.get("GH_TOKEN") or None
 
     def resolved_api_key(self) -> str | None:
-        return self.api_key or os.environ.get("API_KEY") or os.environ.get("OPENAI_API_KEY")
+        if self.api_key:
+            return self.api_key
+        for variable, provider in PROVIDER_ENV.items():
+            if provider == self.provider and os.environ.get(variable):
+                return os.environ[variable]
+        for variable in GENERIC_KEY_ENVS:
+            if os.environ.get(variable):
+                return os.environ[variable]
+        return None
+
+    @property
+    def needs_key(self) -> bool:
+        return self.provider not in KEYLESS_PROVIDERS
 
 
 def _cache_key(namespace: str, key: str) -> Path:

{osintkit-0.2.0 → osintkit-0.3.0}/src/osintkit/doctor.py

@@ -7,7 +7,7 @@ import tempfile
 from dataclasses import dataclass, replace
 from pathlib import Path
 
-from .config import Settings, cache_dir, ensure_dirs, log_dir
+from .config import PROVIDER_ENV, Settings, cache_dir, ensure_dirs, log_dir
 from .http import HttpClient
 
 
@@ -30,10 +30,10 @@ def _writable(path: Path) -> bool:
 
 async def _reach_endpoint(settings: Settings, deep: bool = False) -> Check:
     key = settings.resolved_api_key()
-    if not key:
+    if settings.needs_key and not key:
         return Check("model endpoint", "warn", "no API key; synthesis will fail, dry runs still work")
     base = settings.base_url.rstrip("/")
-    headers = {"Authorization": f"Bearer {key}"}
+    headers = {"Authorization": f"Bearer {key}"} if key else {}
     fresh = replace(settings, use_cache=False)
 
     try:
@@ -81,14 +81,30 @@ async def _reach_endpoint(settings: Settings, deep: bool = False) -> Check:
     return Check("model endpoint", "ok", f"{base} accepted a completion for {settings.model}")
 
 
+def _key_source(settings: Settings) -> str | None:
+    if settings.api_key:
+        return "--api-key"
+    for variable, provider in PROVIDER_ENV.items():
+        if provider == settings.provider and os.environ.get(variable):
+            return variable
+    for variable in ("API_KEY",):
+        if os.environ.get(variable):
+            return variable
+    return None
+
+
 def collect_checks(settings: Settings) -> list[Check]:
     key = settings.resolved_api_key()
+    source = _key_source(settings)
+    if not settings.needs_key:
+        key_check = Check("api key", "ok", f"not needed for {settings.provider}")
+    elif key:
+        key_check = Check("api key", "ok", f"from {source}")
+    else:
+        key_check = Check("api key", "warn", f"no key for {settings.provider}; set one or use --offline")
     checks = [
-        Check(
-            "api key",
-            "ok" if key else "warn",
-            "set" if key else "API_KEY is not set",
-        ),
+        Check("provider", "ok", settings.provider),
+        key_check,
         Check(
             "cache dir",
             "ok" if _writable(cache_dir()) else "fail",

{osintkit-0.2.0 → osintkit-0.3.0}/src/osintkit/llm.py

@@ -38,7 +38,7 @@ class LLMClient:
         response_format: Mapping[str, Any] | None = None,
     ) -> str:
         api_key = self.settings.resolved_api_key()
-        if not api_key:
+        if not api_key and self.settings.needs_key:
             raise MissingAPIKey("No API key. Set API_KEY in the environment or pass --api-key.")
 
         payload: dict[str, Any] = {
@@ -57,7 +57,7 @@ class LLMClient:
                 namespace="llm",
                 payload=payload,
                 headers={
-                    "Authorization": f"Bearer {api_key}",
+                    **({"Authorization": f"Bearer {api_key}"} if api_key else {}),
                     "Content-Type": "application/json",
                 },
             )

{osintkit-0.2.0 → osintkit-0.3.0}/src/osintkit/pipeline.py

@@ -212,8 +212,10 @@ async def execute(
             return Outcome(report=report, extra={"prompt": synthesis_prompt}, archived=archived)
 
         try:
-            if not settings.resolved_api_key():
-                raise MissingAPIKey("No API key. Set API_KEY or pass --api-key (dry run works without one).")
+            if settings.needs_key and not settings.resolved_api_key():
+                raise MissingAPIKey(
+                    "No API key. Set API_KEY, pass --api-key, or use --offline for a local report."
+                )
             async with LLMClient(settings, http) as client:
                 with _status(progress, settings, "[cyan]synthesising briefing…[/cyan]"):
                     report.analysis = await synthesis.synthesize(

{osintkit-0.2.0 → osintkit-0.3.0}/tests/test_cli.py

@@ -472,3 +472,39 @@ def test_offline_batch(monkeypatch, tmp_path):
     result = runner.invoke(app, ["batch", "--file", str(csv_file), "--offline", "--json"])
     assert result.exit_code == 0
     assert jsonish(result.output)[0]["analysis"]["risk_level"] == "low"
+
+
+def test_missing_key_mentions_offline(monkeypatch):
+    monkeypatch.delenv("API_KEY")
+    monkeypatch.setattr(pipeline, "LLMClient", None)
+    result = runner.invoke(app, ["lookup", "--domain", "example.com"])
+    assert "--offline" in " ".join(result.output.split())
+
+
+def test_deepseek_env_selects_provider(monkeypatch):
+    monkeypatch.setenv("DEEPSEEK_API_KEY", "d" * 30)
+    monkeypatch.setattr(pipeline, "LLMClient", FakeLLM)
+    result = runner.invoke(app, ["lookup", "--domain", "a.com", "--json"])
+    assert jsonish(result.output)["base_url"] == "https://api.deepseek.com/v1"
+
+
+def test_mistral_env_selects_provider(monkeypatch):
+    monkeypatch.setenv("MISTRAL_API_KEY", "m" * 30)
+    monkeypatch.setattr(pipeline, "LLMClient", FakeLLM)
+    result = runner.invoke(app, ["lookup", "--domain", "a.com", "--json"])
+    assert jsonish(result.output)["base_url"] == "https://api.mistral.ai/v1"
+
+
+def test_explicit_provider_beats_env(monkeypatch):
+    monkeypatch.setenv("DEEPSEEK_API_KEY", "d" * 30)
+    monkeypatch.setattr(pipeline, "LLMClient", FakeLLM)
+    result = runner.invoke(app, ["--provider", "mistral", "lookup", "--domain", "a.com", "--json"])
+    assert jsonish(result.output)["base_url"] == "https://api.mistral.ai/v1"
+
+
+def test_ollama_needs_no_key(monkeypatch):
+    monkeypatch.delenv("API_KEY")
+    monkeypatch.setattr(pipeline, "LLMClient", FakeLLM)
+    result = runner.invoke(app, ["--provider", "ollama", "lookup", "--domain", "a.com", "--json"])
+    assert result.exit_code == 0
+    assert jsonish(result.output)["base_url"] == "http://localhost:11434/v1"

{osintkit-0.2.0 → osintkit-0.3.0}/tests/test_doctor.py

@@ -47,6 +47,19 @@ async def test_no_key_skips_endpoint_call():
     assert "no API key" in checks[-1].detail
 
 
+async def test_keyless_provider_needs_no_key():
+    checks = await doctor.diagnose(Settings(provider="ollama", base_url="http://localhost:1/v1"))
+    key = next(c for c in checks if c.name == "api key")
+    assert key.status == "ok"
+    assert "not needed" in key.detail
+
+
+def test_key_source_names_the_variable(monkeypatch):
+    monkeypatch.setenv("DEEPSEEK_API_KEY", "d" * 25)
+    check = next(c for c in doctor.collect_checks(Settings(provider="deepseek")) if c.name == "api key")
+    assert check.detail == "from DEEPSEEK_API_KEY"
+
+
 @respx.mock
 async def test_deep_probe_accepts_completion():
     respx.get("https://api.test/v1/models").mock(return_value=httpx.Response(200, json={}))
@@ -81,3 +94,11 @@ async def test_shallow_probe_does_not_call_the_model():
     respx.get("https://api.test/v1/models").mock(return_value=httpx.Response(200, json={}))
     checks = await doctor.diagnose(Settings(base_url="https://api.test/v1", api_key="k" * 25))
     assert "not exercised" in checks[-1].detail
+
+
+@respx.mock
+async def test_keyless_provider_probes_without_auth():
+    route = respx.get("http://localhost:1/v1/models").mock(return_value=httpx.Response(200, json={}))
+    checks = await doctor.diagnose(Settings(provider="ollama", base_url="http://localhost:1/v1"))
+    assert checks[-1].status == "ok"
+    assert "authorization" not in route.calls[0].request.headers

{osintkit-0.2.0 → osintkit-0.3.0}/tests/test_llm.py

@@ -96,3 +96,16 @@ async def test_other_errors_stay_source_errors(settings):
     async with client(settings) as llm:
         with pytest.raises(SourceUnavailable):
             await llm.chat([{"role": "user", "content": "x"}])
+
+
+@respx.mock
+async def test_keyless_provider_sends_no_auth_header(settings):
+    settings.provider = "ollama"
+    settings.api_key = None
+    settings.base_url = "http://localhost:1/v1"
+    route = respx.post("http://localhost:1/v1/chat/completions").mock(
+        return_value=httpx.Response(200, json={"choices": [{"message": {"content": "ok"}}]})
+    )
+    async with LLMClient(settings) as llm:
+        assert await llm.chat([{"role": "user", "content": "x"}]) == "ok"
+    assert "authorization" not in route.calls[0].request.headers