archivebox-api 2.5.7__tar.gz → 2.5.9__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/AGENTS.md +8 -8
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/CHANGELOG.md +5 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/PKG-INFO +14 -14
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/README.md +12 -12
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/__init__.py +1 -1
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/__main__.py +1 -1
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/api/api_client_auth.py +2 -2
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/api/api_client_base.py +5 -5
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/api/api_client_cli.py +2 -2
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/api/api_client_core.py +2 -2
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/auth.py +2 -2
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/connector_sources.py +1 -1
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/kg_ingest.py +4 -4
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/mcp_server.py +5 -5
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/ontology/__init__.py +1 -1
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/ontology/archivebox.ttl +1 -1
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/ontology/certification.json +2 -2
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/skills/archivebox-api-development/SKILL.md +1 -1
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/skills/archivebox-kg-ingestion/SKILL.md +1 -1
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/skills/archivebox-snapshot-search/SKILL.md +1 -1
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/skills/archivebox-web-archiving/SKILL.md +1 -1
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/web_source.py +3 -3
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/web_source_contract.py +4 -4
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api.egg-info/PKG-INFO +14 -14
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api.egg-info/SOURCES.txt +1 -0
- archivebox_api-2.5.9/archivebox_api.egg-info/entry_points.txt +8 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api.egg-info/requires.txt +1 -1
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/pyproject.toml +6 -6
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/release-readiness.json +302 -297
- archivebox_api-2.5.9/requirements.txt +1 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/tests/test_action_discovery.py +1 -1
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/tests/test_archivebox_coverage_extra.py +1 -1
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/tests/test_conformance.py +2 -2
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/tests/test_kg_ingest.py +5 -3
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/tests/test_kg_media.py +7 -3
- archivebox_api-2.5.9/tests/test_publication_workflow.py +23 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/tests/test_sdk_transport.py +2 -2
- archivebox_api-2.5.7/archivebox_api.egg-info/entry_points.txt +0 -8
- archivebox_api-2.5.7/requirements.txt +0 -1
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/.pre-commit-config.yaml +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/CLAUDE.md +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/LICENSE +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/MANIFEST.in +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/api/__init__.py +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/api_client.py +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/mcp_config.json +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/ontology/fixtures/records.json +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/ontology/mappings/source.yaml +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/ontology/migrations/manifest.json +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/ontology/shapes/connector.shacl.ttl +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/prompts/web_archivist_specialist.json +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/skills/archivebox-api-operations/SKILL.md +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/skills/archivebox-api-operations/agents/openai.yaml +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/skills/archivebox-api-operations/references/catalog.md +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/skills/archivebox-kg-ingestion/WORKFLOW.md +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/skills/archivebox-snapshot-search/WORKFLOW.md +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api/skills/archivebox-web-archiving/WORKFLOW.md +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api.egg-info/dependency_links.txt +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/archivebox_api.egg-info/top_level.txt +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/mkdocs.yml +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/setup.cfg +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/tests/conftest.py +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/tests/test_archivebox_api_brute_force_coverage.py +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/tests/test_archivebox_coverage.py +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/tests/test_archivebox_development_skill.py +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/tests/test_basic.py +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/tests/test_init_dynamics.py +0 -0
- {archivebox_api-2.5.7 → archivebox_api-2.5.9}/tests/test_web_source.py +0 -0
|
@@ -17,7 +17,7 @@ Tool-neutral rules for any AI agent or human working in this repository. This bl
|
|
|
17
17
|
|
|
18
18
|
## Tech Stack & Architecture
|
|
19
19
|
- Language/Version: Python 3.10+
|
|
20
|
-
- Core Libraries: `
|
|
20
|
+
- Core Libraries: `scion-sdk`, `fastmcp`, `pydantic-ai`
|
|
21
21
|
- Key principles: Functional patterns, Pydantic for data validation, asynchronous tool execution.
|
|
22
22
|
- Architecture:
|
|
23
23
|
- `mcp_server.py`: Main MCP server entry point and tool registration.
|
|
@@ -77,14 +77,14 @@ pre-commit run --all-files
|
|
|
77
77
|
|
|
78
78
|
## Code Style & Conventions
|
|
79
79
|
**Always:**
|
|
80
|
-
- Use `
|
|
80
|
+
- Use `scion-sdk` for common patterns (e.g., `create_mcp_server`, `create_agent`).
|
|
81
81
|
- Define input/output models using Pydantic.
|
|
82
82
|
- Include descriptive docstrings for all tools (they are used as tool descriptions for LLMs).
|
|
83
83
|
- Check for optional dependencies using `try/except ImportError`.
|
|
84
84
|
|
|
85
85
|
**Good example:**
|
|
86
86
|
```python
|
|
87
|
-
from
|
|
87
|
+
from scion_sdk import create_mcp_server
|
|
88
88
|
from mcp.server.fastmcp import FastMCP
|
|
89
89
|
|
|
90
90
|
mcp = create_mcp_server("my-agent")
|
|
@@ -98,7 +98,7 @@ async def my_tool(param: str) -> str:
|
|
|
98
98
|
## Dos and Don'ts
|
|
99
99
|
**Do:**
|
|
100
100
|
- Run `pre-commit` before pushing changes.
|
|
101
|
-
- Use existing patterns from `
|
|
101
|
+
- Use existing patterns from `scion-sdk`.
|
|
102
102
|
- Keep tools focused and idempotent where possible.
|
|
103
103
|
|
|
104
104
|
**Don't:**
|
|
@@ -109,7 +109,7 @@ async def my_tool(param: str) -> str:
|
|
|
109
109
|
## Safety & Boundaries
|
|
110
110
|
**Always do:**
|
|
111
111
|
- Run lint/test via `pre-commit`.
|
|
112
|
-
- Use `
|
|
112
|
+
- Use `scion-sdk` base classes.
|
|
113
113
|
|
|
114
114
|
**Ask first:**
|
|
115
115
|
- Major refactors of `mcp_server.py` or `agent_server.py`.
|
|
@@ -117,11 +117,11 @@ async def my_tool(param: str) -> str:
|
|
|
117
117
|
|
|
118
118
|
**Never do:**
|
|
119
119
|
- Commit `.env` files or secrets.
|
|
120
|
-
- Modify `
|
|
120
|
+
- Modify `scion-sdk` or `universal-skills` files from within this package.
|
|
121
121
|
|
|
122
122
|
## When Stuck
|
|
123
123
|
- Propose a plan first before making large changes.
|
|
124
|
-
- Check `
|
|
124
|
+
- Check `scion-sdk` documentation for existing helpers.
|
|
125
125
|
|
|
126
126
|
|
|
127
127
|
## Graph Architecture
|
|
@@ -273,7 +273,7 @@ alone).
|
|
|
273
273
|
Working in parallel with other sessions/worktrees? **Reserve a concept id before you write its `CONCEPT:` marker** so two sessions never collide:
|
|
274
274
|
|
|
275
275
|
```bash
|
|
276
|
-
|
|
276
|
+
scion-sdk --json concept reserve --ns EG-KG.compute.backend # or a package prefix, e.g. KEY
|
|
277
277
|
```
|
|
278
278
|
|
|
279
279
|
Full protocol (ledger, merge=union, reconcile, MCP/REST): <https://knuckles-team.github.io/agent-connector-sdk/concept_coordination/>
|
|
@@ -5,6 +5,11 @@ All notable changes to this project will be documented in this file.
|
|
|
5
5
|
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
|
|
6
6
|
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
|
|
7
7
|
|
|
8
|
+
## [2.5.9] - 2026-10-30
|
|
9
|
+
|
|
10
|
+
### Changed
|
|
11
|
+
- Require `scion-sdk>=0.6.4,<0.7.0`; `uv.lock` relocked.
|
|
12
|
+
|
|
8
13
|
## [2.5.7] - 2026-10-27
|
|
9
14
|
|
|
10
15
|
### Added
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.4
|
|
2
2
|
Name: archivebox-api
|
|
3
|
-
Version: 2.5.
|
|
3
|
+
Version: 2.5.9
|
|
4
4
|
Summary: Pythonic ArchiveBox API Wrapper and Fast MCP Server for Agentic AI use!
|
|
5
5
|
Author-email: Repository Maintainers <maintainers@knuckles.team>
|
|
6
6
|
License: MIT
|
|
@@ -12,7 +12,7 @@ Classifier: Programming Language :: Python :: 3
|
|
|
12
12
|
Requires-Python: <3.15,>=3.12
|
|
13
13
|
Description-Content-Type: text/markdown
|
|
14
14
|
License-File: LICENSE
|
|
15
|
-
Requires-Dist:
|
|
15
|
+
Requires-Dist: scion-sdk[mcp]<0.7.0,>=0.6.4
|
|
16
16
|
Provides-Extra: test
|
|
17
17
|
Requires-Dist: pytest-xdist>=3.8.0; extra == "test"
|
|
18
18
|
Requires-Dist: pytest>=9.1.1; extra == "test"
|
|
@@ -79,7 +79,7 @@ Dynamic: license-file
|
|
|
79
79
|
|
|
80
80
|
## Concept Registry
|
|
81
81
|
|
|
82
|
-
This codebase is aligned with the **5 Core Pillars Architecture** of the `
|
|
82
|
+
This codebase is aligned with the **5 Core Pillars Architecture** of the `scion-sdk` ecosystem:
|
|
83
83
|
|
|
84
84
|
| Concept ID | Pillar Name | Domain | Implementation Details in archivebox-api |
|
|
85
85
|
|------------|-------------|--------|-----------------------------------------|
|
|
@@ -129,7 +129,7 @@ This codebase is aligned with the **5 Core Pillars Architecture** of the `agent-
|
|
|
129
129
|
| `KGTOOL` | `True` | |
|
|
130
130
|
| `ARCHIVEBOX_KG_AUTO_INGEST` | `1` | |
|
|
131
131
|
|
|
132
|
-
#### Inherited
|
|
132
|
+
#### Inherited scion-sdk variables (apply to every connector)
|
|
133
133
|
|
|
134
134
|
| Variable | Example | Description |
|
|
135
135
|
|----------|---------|-------------|
|
|
@@ -148,7 +148,7 @@ This codebase is aligned with the **5 Core Pillars Architecture** of the `agent-
|
|
|
148
148
|
| `MODEL_ID` | `gpt-4o` | Model id for the agent |
|
|
149
149
|
| `ENABLE_WEB_UI` | `True` | Serve the AG-UI web interface |
|
|
150
150
|
|
|
151
|
-
_26 package + 14 inherited variable(s). Auto-generated from `.env.example` + the shared
|
|
151
|
+
_26 package + 14 inherited variable(s). Auto-generated from `.env.example` + the shared scion-sdk set — do not edit._
|
|
152
152
|
<!-- ENV-VARS-TABLE:END -->
|
|
153
153
|
|
|
154
154
|
|
|
@@ -230,7 +230,7 @@ Refer to [docs/index.md](docs/index.md) for full developer SDK and class referen
|
|
|
230
230
|
## MCP Server Setup
|
|
231
231
|
|
|
232
232
|
> **Install the connector-focused `[mcp]` extra.** Examples use `archivebox-api[mcp]` to add
|
|
233
|
-
> FastMCP / FastAPI through `
|
|
233
|
+
> FastMCP / FastAPI through `scion-sdk[mcp]`; the required Agent Utilities core
|
|
234
234
|
> still carries `epistemic-graph[full]`. The `[agent]` extra also
|
|
235
235
|
> enables model orchestration.
|
|
236
236
|
|
|
@@ -310,7 +310,7 @@ Detailed graph node architecture explanations, custom skill configurations, and
|
|
|
310
310
|
|
|
311
311
|
## Security & Governance
|
|
312
312
|
|
|
313
|
-
Built directly upon the enterprise-ready [`
|
|
313
|
+
Built directly upon the enterprise-ready [`scion-sdk`](https://github.com/Knuckles-Team/scion-sdk) core, standard security parameters are fully supported:
|
|
314
314
|
|
|
315
315
|
### Access Control & Policy Enforcement
|
|
316
316
|
- **Eunomia Policies:** Fine-grained, policy-driven tool authorization. Supports `none`, local `embedded` (`mcp_policies.json`), or centralized `remote` modes.
|
|
@@ -332,8 +332,8 @@ Pick the extra that matches what the operator want to run:
|
|
|
332
332
|
|
|
333
333
|
| Extra | Installs | Use when |
|
|
334
334
|
|-------|----------|----------|
|
|
335
|
-
| `archivebox-api[mcp]` | Connector-focused MCP server (`
|
|
336
|
-
| `archivebox-api[agent]` | Agent runtime (`
|
|
335
|
+
| `archivebox-api[mcp]` | Connector-focused MCP server (`scion-sdk[mcp]` — FastMCP/FastAPI + `epistemic-graph[full]`) | The operator only run the **MCP server** (smallest install / image) |
|
|
336
|
+
| `archivebox-api[agent]` | Agent runtime (`scion-sdk[agent-runtime,logfire]` — model orchestration + `epistemic-graph[full]`) | The operator run the **integrated agent** |
|
|
337
337
|
| `archivebox-api[all]` | Everything (`mcp` + `agent` + `logfire`) | Development / both surfaces |
|
|
338
338
|
|
|
339
339
|
```bash
|
|
@@ -464,15 +464,15 @@ the detailed transport contract.
|
|
|
464
464
|
<!-- END GENERATED: additional-deployment-options -->
|
|
465
465
|
|
|
466
466
|
|
|
467
|
-
<!-- BEGIN
|
|
467
|
+
<!-- BEGIN scion-sdk-deployment (generated; do not edit between markers) -->
|
|
468
468
|
|
|
469
|
-
## Deploy with `
|
|
469
|
+
## Deploy with `scion-sdk-deployment`
|
|
470
470
|
|
|
471
|
-
Provision this package with the consolidated **`
|
|
471
|
+
Provision this package with the consolidated **`scion-sdk-deployment`**
|
|
472
472
|
workflow. It selects an installed-package, editable-source, or immutable-container
|
|
473
473
|
path; records only runtime secret and TLS-profile references in `AgentConfig`; and
|
|
474
474
|
runs doctor, registration, policy, observability, and rollback gates. Ask your agent
|
|
475
|
-
to **"deploy `archivebox-api` with
|
|
475
|
+
to **"deploy `archivebox-api` with scion-sdk-deployment"**.
|
|
476
476
|
|
|
477
477
|
| Install mode | Command |
|
|
478
478
|
|------|---------|
|
|
@@ -484,7 +484,7 @@ The repository embeds no deployment profile, credential value, certificate path,
|
|
|
484
484
|
environment-specific endpoint. Supply those at runtime through `AgentConfig` and the
|
|
485
485
|
configured secret provider.
|
|
486
486
|
|
|
487
|
-
<!-- END
|
|
487
|
+
<!-- END scion-sdk-deployment -->
|
|
488
488
|
|
|
489
489
|
<!-- GOVERNED-CAPABILITY:START -->
|
|
490
490
|
## Governed capability contract
|
|
@@ -57,7 +57,7 @@
|
|
|
57
57
|
|
|
58
58
|
## Concept Registry
|
|
59
59
|
|
|
60
|
-
This codebase is aligned with the **5 Core Pillars Architecture** of the `
|
|
60
|
+
This codebase is aligned with the **5 Core Pillars Architecture** of the `scion-sdk` ecosystem:
|
|
61
61
|
|
|
62
62
|
| Concept ID | Pillar Name | Domain | Implementation Details in archivebox-api |
|
|
63
63
|
|------------|-------------|--------|-----------------------------------------|
|
|
@@ -107,7 +107,7 @@ This codebase is aligned with the **5 Core Pillars Architecture** of the `agent-
|
|
|
107
107
|
| `KGTOOL` | `True` | |
|
|
108
108
|
| `ARCHIVEBOX_KG_AUTO_INGEST` | `1` | |
|
|
109
109
|
|
|
110
|
-
#### Inherited
|
|
110
|
+
#### Inherited scion-sdk variables (apply to every connector)
|
|
111
111
|
|
|
112
112
|
| Variable | Example | Description |
|
|
113
113
|
|----------|---------|-------------|
|
|
@@ -126,7 +126,7 @@ This codebase is aligned with the **5 Core Pillars Architecture** of the `agent-
|
|
|
126
126
|
| `MODEL_ID` | `gpt-4o` | Model id for the agent |
|
|
127
127
|
| `ENABLE_WEB_UI` | `True` | Serve the AG-UI web interface |
|
|
128
128
|
|
|
129
|
-
_26 package + 14 inherited variable(s). Auto-generated from `.env.example` + the shared
|
|
129
|
+
_26 package + 14 inherited variable(s). Auto-generated from `.env.example` + the shared scion-sdk set — do not edit._
|
|
130
130
|
<!-- ENV-VARS-TABLE:END -->
|
|
131
131
|
|
|
132
132
|
|
|
@@ -208,7 +208,7 @@ Refer to [docs/index.md](docs/index.md) for full developer SDK and class referen
|
|
|
208
208
|
## MCP Server Setup
|
|
209
209
|
|
|
210
210
|
> **Install the connector-focused `[mcp]` extra.** Examples use `archivebox-api[mcp]` to add
|
|
211
|
-
> FastMCP / FastAPI through `
|
|
211
|
+
> FastMCP / FastAPI through `scion-sdk[mcp]`; the required Agent Utilities core
|
|
212
212
|
> still carries `epistemic-graph[full]`. The `[agent]` extra also
|
|
213
213
|
> enables model orchestration.
|
|
214
214
|
|
|
@@ -288,7 +288,7 @@ Detailed graph node architecture explanations, custom skill configurations, and
|
|
|
288
288
|
|
|
289
289
|
## Security & Governance
|
|
290
290
|
|
|
291
|
-
Built directly upon the enterprise-ready [`
|
|
291
|
+
Built directly upon the enterprise-ready [`scion-sdk`](https://github.com/Knuckles-Team/scion-sdk) core, standard security parameters are fully supported:
|
|
292
292
|
|
|
293
293
|
### Access Control & Policy Enforcement
|
|
294
294
|
- **Eunomia Policies:** Fine-grained, policy-driven tool authorization. Supports `none`, local `embedded` (`mcp_policies.json`), or centralized `remote` modes.
|
|
@@ -310,8 +310,8 @@ Pick the extra that matches what the operator want to run:
|
|
|
310
310
|
|
|
311
311
|
| Extra | Installs | Use when |
|
|
312
312
|
|-------|----------|----------|
|
|
313
|
-
| `archivebox-api[mcp]` | Connector-focused MCP server (`
|
|
314
|
-
| `archivebox-api[agent]` | Agent runtime (`
|
|
313
|
+
| `archivebox-api[mcp]` | Connector-focused MCP server (`scion-sdk[mcp]` — FastMCP/FastAPI + `epistemic-graph[full]`) | The operator only run the **MCP server** (smallest install / image) |
|
|
314
|
+
| `archivebox-api[agent]` | Agent runtime (`scion-sdk[agent-runtime,logfire]` — model orchestration + `epistemic-graph[full]`) | The operator run the **integrated agent** |
|
|
315
315
|
| `archivebox-api[all]` | Everything (`mcp` + `agent` + `logfire`) | Development / both surfaces |
|
|
316
316
|
|
|
317
317
|
```bash
|
|
@@ -442,15 +442,15 @@ the detailed transport contract.
|
|
|
442
442
|
<!-- END GENERATED: additional-deployment-options -->
|
|
443
443
|
|
|
444
444
|
|
|
445
|
-
<!-- BEGIN
|
|
445
|
+
<!-- BEGIN scion-sdk-deployment (generated; do not edit between markers) -->
|
|
446
446
|
|
|
447
|
-
## Deploy with `
|
|
447
|
+
## Deploy with `scion-sdk-deployment`
|
|
448
448
|
|
|
449
|
-
Provision this package with the consolidated **`
|
|
449
|
+
Provision this package with the consolidated **`scion-sdk-deployment`**
|
|
450
450
|
workflow. It selects an installed-package, editable-source, or immutable-container
|
|
451
451
|
path; records only runtime secret and TLS-profile references in `AgentConfig`; and
|
|
452
452
|
runs doctor, registration, policy, observability, and rollback gates. Ask your agent
|
|
453
|
-
to **"deploy `archivebox-api` with
|
|
453
|
+
to **"deploy `archivebox-api` with scion-sdk-deployment"**.
|
|
454
454
|
|
|
455
455
|
| Install mode | Command |
|
|
456
456
|
|------|---------|
|
|
@@ -462,7 +462,7 @@ The repository embeds no deployment profile, credential value, certificate path,
|
|
|
462
462
|
environment-specific endpoint. Supply those at runtime through `AgentConfig` and the
|
|
463
463
|
configured secret provider.
|
|
464
464
|
|
|
465
|
-
<!-- END
|
|
465
|
+
<!-- END scion-sdk-deployment -->
|
|
466
466
|
|
|
467
467
|
<!-- GOVERNED-CAPABILITY:START -->
|
|
468
468
|
## Governed capability contract
|
|
@@ -87,7 +87,7 @@ def __dir__() -> list[str]:
|
|
|
87
87
|
return sorted(list(globals().keys()) + __all__)
|
|
88
88
|
|
|
89
89
|
|
|
90
|
-
from
|
|
90
|
+
from scion_sdk.connector import Connector
|
|
91
91
|
|
|
92
92
|
from archivebox_api.api_client import Api
|
|
93
93
|
from archivebox_api.auth import get_client
|
|
@@ -1,10 +1,10 @@
|
|
|
1
1
|
from typing import Any
|
|
2
2
|
|
|
3
3
|
import httpx
|
|
4
|
-
from
|
|
4
|
+
from pydantic import ValidationError
|
|
5
|
+
from scion_sdk.exceptions import (
|
|
5
6
|
ParameterError,
|
|
6
7
|
)
|
|
7
|
-
from pydantic import ValidationError
|
|
8
8
|
|
|
9
9
|
from archivebox_api.api.api_client_base import BaseApiClient
|
|
10
10
|
|
|
@@ -2,14 +2,14 @@ import sys
|
|
|
2
2
|
from abc import ABC, abstractmethod
|
|
3
3
|
|
|
4
4
|
import httpx
|
|
5
|
-
from
|
|
5
|
+
from scion_sdk.exceptions import (
|
|
6
6
|
AuthError,
|
|
7
7
|
MissingParameterError,
|
|
8
8
|
)
|
|
9
|
-
from
|
|
10
|
-
from
|
|
11
|
-
from
|
|
12
|
-
from
|
|
9
|
+
from scion_sdk.http.client import create_http_client
|
|
10
|
+
from scion_sdk.http.options import HttpClientOptions
|
|
11
|
+
from scion_sdk.tls.profile import ResolvedTLSProfile
|
|
12
|
+
from scion_sdk.tls.resolve import resolve_tls_profile
|
|
13
13
|
|
|
14
14
|
|
|
15
15
|
class BaseApiClient(ABC):
|
|
@@ -1,11 +1,11 @@
|
|
|
1
1
|
from typing import Any
|
|
2
2
|
|
|
3
3
|
import httpx
|
|
4
|
-
from
|
|
4
|
+
from pydantic import ValidationError
|
|
5
|
+
from scion_sdk.exceptions import (
|
|
5
6
|
ParameterError,
|
|
6
7
|
require_auth,
|
|
7
8
|
)
|
|
8
|
-
from pydantic import ValidationError
|
|
9
9
|
|
|
10
10
|
from archivebox_api.api.api_client_base import BaseApiClient
|
|
11
11
|
|
|
@@ -1,11 +1,11 @@
|
|
|
1
1
|
from typing import Any
|
|
2
2
|
|
|
3
3
|
import httpx
|
|
4
|
-
from
|
|
4
|
+
from pydantic import ValidationError
|
|
5
|
+
from scion_sdk.exceptions import (
|
|
5
6
|
ParameterError,
|
|
6
7
|
require_auth,
|
|
7
8
|
)
|
|
8
|
-
from pydantic import ValidationError
|
|
9
9
|
|
|
10
10
|
from archivebox_api.api.api_client_base import BaseApiClient
|
|
11
11
|
|
|
@@ -2,8 +2,8 @@
|
|
|
2
2
|
|
|
3
3
|
import logging
|
|
4
4
|
|
|
5
|
-
from
|
|
6
|
-
from
|
|
5
|
+
from scion_sdk.config import setting
|
|
6
|
+
from scion_sdk.tls.resolve import resolve_tls_profile
|
|
7
7
|
|
|
8
8
|
from archivebox_api.api_client import Api
|
|
9
9
|
|
|
@@ -11,7 +11,7 @@ every applicable modality (the "maximum ingestion" bar):
|
|
|
11
11
|
* **blobs** — raw web-capture bytes (HTML, screenshot, PDF, WARC) → a content-addressed
|
|
12
12
|
media record via :func:`ingest_snapshot_blob`.
|
|
13
13
|
|
|
14
|
-
Everything rides the shared ``
|
|
14
|
+
Everything rides the shared ``scion_sdk.ingest`` knowledge-ingest facade. Engine
|
|
15
15
|
failures are explicit; the connector never acknowledges a partial or absent write. Node ids
|
|
16
16
|
follow ``archivebox:<class>:<externalId>`` and ``node_type`` matches a class the package's
|
|
17
17
|
``archivebox_api.connector_sources`` declares.
|
|
@@ -22,8 +22,8 @@ from __future__ import annotations
|
|
|
22
22
|
import logging
|
|
23
23
|
from typing import Any
|
|
24
24
|
|
|
25
|
-
from
|
|
26
|
-
from
|
|
25
|
+
from scion_sdk.connector_identity import connector_name
|
|
26
|
+
from scion_sdk.ingest import (
|
|
27
27
|
ChangeSet,
|
|
28
28
|
Document,
|
|
29
29
|
Entity,
|
|
@@ -56,7 +56,7 @@ _BLOB_BINDING = IngestBinding(
|
|
|
56
56
|
def _required_text(record: dict[str, Any], key: str) -> str:
|
|
57
57
|
value = record.get(key)
|
|
58
58
|
if not isinstance(value, str) or not value:
|
|
59
|
-
from
|
|
59
|
+
from scion_sdk.ingest import IngestError
|
|
60
60
|
|
|
61
61
|
raise IngestError(
|
|
62
62
|
f"every entity needs an id and a node_type, got {key}={value!r}"
|
|
@@ -9,12 +9,12 @@ Provides dynamic tool registration and stdio/SSE/http interfaces using FastMCP.
|
|
|
9
9
|
import logging
|
|
10
10
|
from typing import Any
|
|
11
11
|
|
|
12
|
-
from agent_connector_sdk.mcp.action_dispatch import resolve_action
|
|
13
|
-
from agent_connector_sdk.mcp.concurrency import run_blocking
|
|
14
12
|
from fastmcp import Context, FastMCP
|
|
15
13
|
from fastmcp.dependencies import Depends
|
|
16
14
|
from fastmcp.utilities.logging import get_logger
|
|
17
15
|
from pydantic import Field
|
|
16
|
+
from scion_sdk.mcp.action_dispatch import resolve_action
|
|
17
|
+
from scion_sdk.mcp.concurrency import run_blocking
|
|
18
18
|
|
|
19
19
|
from archivebox_api.auth import get_client
|
|
20
20
|
|
|
@@ -300,7 +300,7 @@ def get_web_source() -> Any:
|
|
|
300
300
|
"""The process-wide ArchiveBox web source (CONN-ARCHIVEBOX-API-WEB-SOURCE-R001)."""
|
|
301
301
|
global _WEB_SOURCE
|
|
302
302
|
if _WEB_SOURCE is None:
|
|
303
|
-
from
|
|
303
|
+
from scion_sdk.config import setting
|
|
304
304
|
|
|
305
305
|
from archivebox_api.web_source import ArchiveSession, ArchiveWebSource
|
|
306
306
|
|
|
@@ -326,7 +326,7 @@ def get_contract_source() -> Any:
|
|
|
326
326
|
"""The web-source contract's source over the configured ArchiveBox."""
|
|
327
327
|
global _CONTRACT_SOURCE
|
|
328
328
|
if _CONTRACT_SOURCE is None:
|
|
329
|
-
from
|
|
329
|
+
from scion_sdk.config import setting
|
|
330
330
|
|
|
331
331
|
from archivebox_api.web_source_contract import ArchiveboxSource
|
|
332
332
|
|
|
@@ -343,6 +343,6 @@ def register_web_tools(mcp: FastMCP):
|
|
|
343
343
|
CONN-ARCHIVEBOX-API-WEB-SOURCE-R001.1. The same names, schemas, refusal
|
|
344
344
|
reasons and output shape as every other page connector's.
|
|
345
345
|
"""
|
|
346
|
-
from
|
|
346
|
+
from scion_sdk.ports.web_source import register_web_source_tools
|
|
347
347
|
|
|
348
348
|
register_web_source_tools(mcp, get_contract_source)
|
|
@@ -2,6 +2,6 @@
|
|
|
2
2
|
|
|
3
3
|
Data-only subpackage: it carries ``archivebox.ttl`` (the ``owl:Ontology``
|
|
4
4
|
``http://knuckles.team/kg/archivebox`` module) which the Arbora hub federates in via
|
|
5
|
-
the ``
|
|
5
|
+
the ``scion_sdk.ontology_providers`` entry-point. It holds no business logic
|
|
6
6
|
and no heavy imports so the hub can resolve it cheaply.
|
|
7
7
|
"""
|
|
@@ -94,7 +94,7 @@
|
|
|
94
94
|
rdfs:comment """ArchiveBox self-hosted web-archiving model — snapshots of source URLs,
|
|
95
95
|
the per-extractor archive results they yield, their tags, extracted page-text documents,
|
|
96
96
|
and the raw web-capture blobs (HTML, screenshot, PDF, WARC) — federated into the
|
|
97
|
-
|
|
97
|
+
scion-sdk knowledge-graph hub. Reuses the shared :Document, :Tag, :AssetOccurrence,
|
|
98
98
|
:Blob and :Person classes.""" .
|
|
99
99
|
|
|
100
100
|
# ontology-codemod R4
|
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
{
|
|
2
2
|
"api_version": "graphos.io/v1",
|
|
3
3
|
"artifacts": {
|
|
4
|
-
"archivebox_api/ontology/archivebox.ttl": "
|
|
4
|
+
"archivebox_api/ontology/archivebox.ttl": "561df75285515468918b6f7c2a30ec45d9fc8593dfef09c185ace8669023adf1",
|
|
5
5
|
"archivebox_api/ontology/fixtures/records.json": "dd1e07464a2be222f78443652363eadcf93250f97b2e2a456d5458e1f138c9c9",
|
|
6
6
|
"archivebox_api/ontology/mappings/source.yaml": "db82464dd78924eab2ba6c77b6f934c5f4a8c416bb17ac9365c97ba1c170d951",
|
|
7
7
|
"archivebox_api/ontology/migrations/manifest.json": "45125750a384f7077b2714d1392c91a630d12f8f0fa2aa1f86a345cd34582540",
|
|
@@ -29,5 +29,5 @@
|
|
|
29
29
|
"signer": "UNSIGNED-PREVIEW",
|
|
30
30
|
"signing_public_key": "",
|
|
31
31
|
"status": "source-validated",
|
|
32
|
-
"validated_at": "2026-10-
|
|
32
|
+
"validated_at": "2026-10-31T02:56:01Z"
|
|
33
33
|
}
|
|
@@ -27,9 +27,9 @@ from dataclasses import dataclass, field
|
|
|
27
27
|
from typing import Any, cast
|
|
28
28
|
|
|
29
29
|
import httpx
|
|
30
|
-
from
|
|
31
|
-
from
|
|
32
|
-
from
|
|
30
|
+
from scion_sdk.http.client import create_http_client
|
|
31
|
+
from scion_sdk.http.options import HttpClientOptions
|
|
32
|
+
from scion_sdk.tls.resolve import resolve_tls_profile
|
|
33
33
|
|
|
34
34
|
__all__ = [
|
|
35
35
|
"REFUSAL_REASONS",
|
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
"""archivebox-api's implementation of the SDK web-source contract.
|
|
2
2
|
|
|
3
3
|
CONN-ARCHIVEBOX-API-WEB-SOURCE-R001.1. ``web_fetch`` and ``web_extract`` are
|
|
4
|
-
served by :func:`
|
|
4
|
+
served by :func:`scion_sdk.ports.web_source.register_web_source_tools`
|
|
5
5
|
over :class:`ArchiveboxSource`, so their names, schemas, refusal reasons and
|
|
6
6
|
output shape are the contract's, identical to the webarchiver connector's.
|
|
7
7
|
ArchiveBox archives the page; the connector applies robots.txt and the
|
|
@@ -19,9 +19,9 @@ from typing import Any
|
|
|
19
19
|
from urllib.parse import urlsplit
|
|
20
20
|
|
|
21
21
|
import httpx
|
|
22
|
-
from
|
|
23
|
-
from
|
|
24
|
-
from
|
|
22
|
+
from scion_sdk.http.client import create_http_client
|
|
23
|
+
from scion_sdk.http.options import HttpClientOptions
|
|
24
|
+
from scion_sdk.ports.web_source import (
|
|
25
25
|
DEFAULT_MIN_INTERVAL_S,
|
|
26
26
|
DomainRateLimiter,
|
|
27
27
|
RobotsRules,
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.4
|
|
2
2
|
Name: archivebox-api
|
|
3
|
-
Version: 2.5.
|
|
3
|
+
Version: 2.5.9
|
|
4
4
|
Summary: Pythonic ArchiveBox API Wrapper and Fast MCP Server for Agentic AI use!
|
|
5
5
|
Author-email: Repository Maintainers <maintainers@knuckles.team>
|
|
6
6
|
License: MIT
|
|
@@ -12,7 +12,7 @@ Classifier: Programming Language :: Python :: 3
|
|
|
12
12
|
Requires-Python: <3.15,>=3.12
|
|
13
13
|
Description-Content-Type: text/markdown
|
|
14
14
|
License-File: LICENSE
|
|
15
|
-
Requires-Dist:
|
|
15
|
+
Requires-Dist: scion-sdk[mcp]<0.7.0,>=0.6.4
|
|
16
16
|
Provides-Extra: test
|
|
17
17
|
Requires-Dist: pytest-xdist>=3.8.0; extra == "test"
|
|
18
18
|
Requires-Dist: pytest>=9.1.1; extra == "test"
|
|
@@ -79,7 +79,7 @@ Dynamic: license-file
|
|
|
79
79
|
|
|
80
80
|
## Concept Registry
|
|
81
81
|
|
|
82
|
-
This codebase is aligned with the **5 Core Pillars Architecture** of the `
|
|
82
|
+
This codebase is aligned with the **5 Core Pillars Architecture** of the `scion-sdk` ecosystem:
|
|
83
83
|
|
|
84
84
|
| Concept ID | Pillar Name | Domain | Implementation Details in archivebox-api |
|
|
85
85
|
|------------|-------------|--------|-----------------------------------------|
|
|
@@ -129,7 +129,7 @@ This codebase is aligned with the **5 Core Pillars Architecture** of the `agent-
|
|
|
129
129
|
| `KGTOOL` | `True` | |
|
|
130
130
|
| `ARCHIVEBOX_KG_AUTO_INGEST` | `1` | |
|
|
131
131
|
|
|
132
|
-
#### Inherited
|
|
132
|
+
#### Inherited scion-sdk variables (apply to every connector)
|
|
133
133
|
|
|
134
134
|
| Variable | Example | Description |
|
|
135
135
|
|----------|---------|-------------|
|
|
@@ -148,7 +148,7 @@ This codebase is aligned with the **5 Core Pillars Architecture** of the `agent-
|
|
|
148
148
|
| `MODEL_ID` | `gpt-4o` | Model id for the agent |
|
|
149
149
|
| `ENABLE_WEB_UI` | `True` | Serve the AG-UI web interface |
|
|
150
150
|
|
|
151
|
-
_26 package + 14 inherited variable(s). Auto-generated from `.env.example` + the shared
|
|
151
|
+
_26 package + 14 inherited variable(s). Auto-generated from `.env.example` + the shared scion-sdk set — do not edit._
|
|
152
152
|
<!-- ENV-VARS-TABLE:END -->
|
|
153
153
|
|
|
154
154
|
|
|
@@ -230,7 +230,7 @@ Refer to [docs/index.md](docs/index.md) for full developer SDK and class referen
|
|
|
230
230
|
## MCP Server Setup
|
|
231
231
|
|
|
232
232
|
> **Install the connector-focused `[mcp]` extra.** Examples use `archivebox-api[mcp]` to add
|
|
233
|
-
> FastMCP / FastAPI through `
|
|
233
|
+
> FastMCP / FastAPI through `scion-sdk[mcp]`; the required Agent Utilities core
|
|
234
234
|
> still carries `epistemic-graph[full]`. The `[agent]` extra also
|
|
235
235
|
> enables model orchestration.
|
|
236
236
|
|
|
@@ -310,7 +310,7 @@ Detailed graph node architecture explanations, custom skill configurations, and
|
|
|
310
310
|
|
|
311
311
|
## Security & Governance
|
|
312
312
|
|
|
313
|
-
Built directly upon the enterprise-ready [`
|
|
313
|
+
Built directly upon the enterprise-ready [`scion-sdk`](https://github.com/Knuckles-Team/scion-sdk) core, standard security parameters are fully supported:
|
|
314
314
|
|
|
315
315
|
### Access Control & Policy Enforcement
|
|
316
316
|
- **Eunomia Policies:** Fine-grained, policy-driven tool authorization. Supports `none`, local `embedded` (`mcp_policies.json`), or centralized `remote` modes.
|
|
@@ -332,8 +332,8 @@ Pick the extra that matches what the operator want to run:
|
|
|
332
332
|
|
|
333
333
|
| Extra | Installs | Use when |
|
|
334
334
|
|-------|----------|----------|
|
|
335
|
-
| `archivebox-api[mcp]` | Connector-focused MCP server (`
|
|
336
|
-
| `archivebox-api[agent]` | Agent runtime (`
|
|
335
|
+
| `archivebox-api[mcp]` | Connector-focused MCP server (`scion-sdk[mcp]` — FastMCP/FastAPI + `epistemic-graph[full]`) | The operator only run the **MCP server** (smallest install / image) |
|
|
336
|
+
| `archivebox-api[agent]` | Agent runtime (`scion-sdk[agent-runtime,logfire]` — model orchestration + `epistemic-graph[full]`) | The operator run the **integrated agent** |
|
|
337
337
|
| `archivebox-api[all]` | Everything (`mcp` + `agent` + `logfire`) | Development / both surfaces |
|
|
338
338
|
|
|
339
339
|
```bash
|
|
@@ -464,15 +464,15 @@ the detailed transport contract.
|
|
|
464
464
|
<!-- END GENERATED: additional-deployment-options -->
|
|
465
465
|
|
|
466
466
|
|
|
467
|
-
<!-- BEGIN
|
|
467
|
+
<!-- BEGIN scion-sdk-deployment (generated; do not edit between markers) -->
|
|
468
468
|
|
|
469
|
-
## Deploy with `
|
|
469
|
+
## Deploy with `scion-sdk-deployment`
|
|
470
470
|
|
|
471
|
-
Provision this package with the consolidated **`
|
|
471
|
+
Provision this package with the consolidated **`scion-sdk-deployment`**
|
|
472
472
|
workflow. It selects an installed-package, editable-source, or immutable-container
|
|
473
473
|
path; records only runtime secret and TLS-profile references in `AgentConfig`; and
|
|
474
474
|
runs doctor, registration, policy, observability, and rollback gates. Ask your agent
|
|
475
|
-
to **"deploy `archivebox-api` with
|
|
475
|
+
to **"deploy `archivebox-api` with scion-sdk-deployment"**.
|
|
476
476
|
|
|
477
477
|
| Install mode | Command |
|
|
478
478
|
|------|---------|
|
|
@@ -484,7 +484,7 @@ The repository embeds no deployment profile, credential value, certificate path,
|
|
|
484
484
|
environment-specific endpoint. Supply those at runtime through `AgentConfig` and the
|
|
485
485
|
configured secret provider.
|
|
486
486
|
|
|
487
|
-
<!-- END
|
|
487
|
+
<!-- END scion-sdk-deployment -->
|
|
488
488
|
|
|
489
489
|
<!-- GOVERNED-CAPABILITY:START -->
|
|
490
490
|
## Governed capability contract
|