rhinestone 0.1.0__tar.gz

rhinestone-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 kitazawa
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

rhinestone-0.1.0/PKG-INFO

@@ -0,0 +1,140 @@
+Metadata-Version: 2.4
+Name: rhinestone
+Version: 0.1.0
+Summary: Knowledge and specification layer for Japanese public and geospatial data
+Keywords: geospatial,open-data,japan,data-access
+Author: kitazawa
+Author-email: kitazawa <88121050+U-KITAZAWA@users.noreply.github.com>
+License-Expression: MIT
+License-File: LICENSE
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3 :: Only
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Typing :: Typed
+Requires-Dist: jsonschema>=4.18,<5
+Requires-Python: >=3.10
+Project-URL: Homepage, https://github.com/u-kitazawa/rhinestone
+Project-URL: Repository, https://github.com/u-kitazawa/rhinestone
+Project-URL: Issues, https://github.com/u-kitazawa/rhinestone/issues
+Project-URL: Documentation, https://github.com/u-kitazawa/rhinestone/tree/main/docs
+Description-Content-Type: text/markdown
+
+# Rhinestone
+
+Rhinestoneは、日本の公的・地理空間データを探し、利用可能なResourceへ解決し、既存の専門ライブラリへ渡すPythonライブラリです。
+
+利用者が覚える中心概念は次の4つです。
+
+```text
+Catalog -> Provider -> Result -> Resource
+```
+
+- `Catalog`: Rhinestoneが知っているProviderの集合
+- `Provider`: データを提供する主体・サービス
+- `Result`: 検索で見つかった候補
+- `Resource`: 実際に利用できる具体的なデータ
+
+## 対象ユーザー
+
+Rhinestoneは、次のような利用者を対象にしています。
+
+- 日本の行政・公的オープンデータをPythonから横断的に探索したい利用者
+- GIS・リモートセンシングの研究者
+- 公的データを扱うデータエンジニア・データ基盤開発者
+- Rasterio、GDAL、pyogrioなどへ渡す前のProvider固有処理を共通化したい利用者
+
+Rhinestoneは、Catalogに構成されたProvider内のデータを検索してResultとして発見し、Resourceへ解決することを担当します。実際のGIS処理やデータ解析は既存の専門ライブラリへ委譲します。
+
+## 対象外のユースケース
+
+RhinestoneはGIS処理ライブラリやワークフローエンジンではありません。次の用途には、そのまま利用できないか、追加の検討が必要です。
+
+- GISの空間演算・形式変換・解析そのもの
+- ETLやワークフローの実行基盤
+- 外部RuntimeやProvider固有の制約を完全に隠蔽すること
+- 0.1.x時点で公開APIの長期固定を前提とする本番システム
+
+対応するProvider、Runtime、形式の範囲は[Compatibility](docs/compatibility.md)を、Runtimeの注入方法は[Configuration](docs/configuration.md)を参照してください。RhinestoneはAlpha版のため、公開APIは今後変更される可能性があります。
+
+## インストール
+
+```console
+python -m pip install rhinestone
+```
+
+## 基本的な使い方
+
+```python
+from rhinestone import configure
+from rhinestone.catalogs import BUILTIN
+
+app = configure(catalog=BUILTIN)
+results = app.search(text="河川")
+resource = app.resolve(results[0])
+
+print(resource.uri)
+print(resource.metadata)
+```
+
+`BUILTIN`はRhinestoneが提供する組み込みCatalogです。`search()`はCatalogに構成されたProvider内のデータを検索してResultを返し、検索結果は`app.resolve(result)`で直接Resourceへ解決できます。
+複数Provider時の整数indexingは構成したProvider順の走査用であり、Providerを横断した関連度rankingではありません。詳細は[Search resultの順序](docs/search.md#結果の順序)を参照してください。
+
+検索を使わず、既知のProviderを選んで構成することもできます。
+
+```python
+from rhinestone import Catalog, Provider, configure
+
+catalog = Catalog((
+    Provider(
+        id="my-stac",
+        adapter_type="stac",
+        settings={"endpoint": "https://stac.example/api"},
+    ),
+))
+app = configure(catalog=catalog)
+```
+
+## RuntimeとCredential
+
+GDAL、Rasterio、pyogrio、RDFLibなどの外部Runtimeは利用者が用意します。API keyやtokenはCredentialとして分離します。
+
+```python
+app = configure(
+    catalog=BUILTIN,
+    dependencies={"rasterio": rasterio},
+    credentials={"odpt": lambda: odpt_consumer_key},
+)
+```
+
+HTTP通信はRhinestoneに組み込まれています。
+
+## 内部アーキテクチャ
+
+利用者が意識する必要のない`Source`、`Config`、`AccessPlan`、`Resolver`、各種Adapter、Registryは内部実装です。内部では責務分離のためにこれらの段階を保持しますが、通常の利用導線には出しません。
+
+RhinestoneはGIS I/O、形式変換、空間演算、データ解析を実装せず、解決済みResourceを既存の専門Runtimeへ渡します。
+
+## ドキュメント
+
+- [Documentation](docs/index.md)
+- [Getting started](docs/getting-started.md)
+- [Configuration](docs/configuration.md)
+- [API reference](docs/api.md)
+- [Compatibility](docs/compatibility.md)
+- [Runtime guide](docs/runtimes.md)
+- [API stability and release policy](docs/release-policy.md)
+
+## 開発環境
+
+```console
+uv sync --dev
+bash scripts/check.sh
+```
+
+MIT Licenseです。

rhinestone-0.1.0/README.md

@@ -0,0 +1,113 @@
+# Rhinestone
+
+Rhinestoneは、日本の公的・地理空間データを探し、利用可能なResourceへ解決し、既存の専門ライブラリへ渡すPythonライブラリです。
+
+利用者が覚える中心概念は次の4つです。
+
+```text
+Catalog -> Provider -> Result -> Resource
+```
+
+- `Catalog`: Rhinestoneが知っているProviderの集合
+- `Provider`: データを提供する主体・サービス
+- `Result`: 検索で見つかった候補
+- `Resource`: 実際に利用できる具体的なデータ
+
+## 対象ユーザー
+
+Rhinestoneは、次のような利用者を対象にしています。
+
+- 日本の行政・公的オープンデータをPythonから横断的に探索したい利用者
+- GIS・リモートセンシングの研究者
+- 公的データを扱うデータエンジニア・データ基盤開発者
+- Rasterio、GDAL、pyogrioなどへ渡す前のProvider固有処理を共通化したい利用者
+
+Rhinestoneは、Catalogに構成されたProvider内のデータを検索してResultとして発見し、Resourceへ解決することを担当します。実際のGIS処理やデータ解析は既存の専門ライブラリへ委譲します。
+
+## 対象外のユースケース
+
+RhinestoneはGIS処理ライブラリやワークフローエンジンではありません。次の用途には、そのまま利用できないか、追加の検討が必要です。
+
+- GISの空間演算・形式変換・解析そのもの
+- ETLやワークフローの実行基盤
+- 外部RuntimeやProvider固有の制約を完全に隠蔽すること
+- 0.1.x時点で公開APIの長期固定を前提とする本番システム
+
+対応するProvider、Runtime、形式の範囲は[Compatibility](docs/compatibility.md)を、Runtimeの注入方法は[Configuration](docs/configuration.md)を参照してください。RhinestoneはAlpha版のため、公開APIは今後変更される可能性があります。
+
+## インストール
+
+```console
+python -m pip install rhinestone
+```
+
+## 基本的な使い方
+
+```python
+from rhinestone import configure
+from rhinestone.catalogs import BUILTIN
+
+app = configure(catalog=BUILTIN)
+results = app.search(text="河川")
+resource = app.resolve(results[0])
+
+print(resource.uri)
+print(resource.metadata)
+```
+
+`BUILTIN`はRhinestoneが提供する組み込みCatalogです。`search()`はCatalogに構成されたProvider内のデータを検索してResultを返し、検索結果は`app.resolve(result)`で直接Resourceへ解決できます。
+複数Provider時の整数indexingは構成したProvider順の走査用であり、Providerを横断した関連度rankingではありません。詳細は[Search resultの順序](docs/search.md#結果の順序)を参照してください。
+
+検索を使わず、既知のProviderを選んで構成することもできます。
+
+```python
+from rhinestone import Catalog, Provider, configure
+
+catalog = Catalog((
+    Provider(
+        id="my-stac",
+        adapter_type="stac",
+        settings={"endpoint": "https://stac.example/api"},
+    ),
+))
+app = configure(catalog=catalog)
+```
+
+## RuntimeとCredential
+
+GDAL、Rasterio、pyogrio、RDFLibなどの外部Runtimeは利用者が用意します。API keyやtokenはCredentialとして分離します。
+
+```python
+app = configure(
+    catalog=BUILTIN,
+    dependencies={"rasterio": rasterio},
+    credentials={"odpt": lambda: odpt_consumer_key},
+)
+```
+
+HTTP通信はRhinestoneに組み込まれています。
+
+## 内部アーキテクチャ
+
+利用者が意識する必要のない`Source`、`Config`、`AccessPlan`、`Resolver`、各種Adapter、Registryは内部実装です。内部では責務分離のためにこれらの段階を保持しますが、通常の利用導線には出しません。
+
+RhinestoneはGIS I/O、形式変換、空間演算、データ解析を実装せず、解決済みResourceを既存の専門Runtimeへ渡します。
+
+## ドキュメント
+
+- [Documentation](docs/index.md)
+- [Getting started](docs/getting-started.md)
+- [Configuration](docs/configuration.md)
+- [API reference](docs/api.md)
+- [Compatibility](docs/compatibility.md)
+- [Runtime guide](docs/runtimes.md)
+- [API stability and release policy](docs/release-policy.md)
+
+## 開発環境
+
+```console
+uv sync --dev
+bash scripts/check.sh
+```
+
+MIT Licenseです。

rhinestone-0.1.0/pyproject.toml

@@ -0,0 +1,87 @@
+[project]
+name = "rhinestone"
+version = "0.1.0"
+description = "Knowledge and specification layer for Japanese public and geospatial data"
+readme = "README.md"
+license = "MIT"
+license-files = ["LICENSE"]
+requires-python = ">=3.10"
+keywords = [
+    "geospatial",
+    "open-data",
+    "japan",
+    "data-access",
+]
+classifiers = [
+    "Development Status :: 3 - Alpha",
+    "Intended Audience :: Developers",
+    "License :: OSI Approved :: MIT License",
+    "Programming Language :: Python :: 3",
+    "Programming Language :: Python :: 3 :: Only",
+    "Programming Language :: Python :: 3.10",
+    "Programming Language :: Python :: 3.11",
+    "Programming Language :: Python :: 3.12",
+    "Programming Language :: Python :: 3.13",
+    "Typing :: Typed",
+]
+dependencies = ["jsonschema>=4.18,<5"]
+
+[[project.authors]]
+name = "kitazawa"
+email = "88121050+U-KITAZAWA@users.noreply.github.com"
+
+[project.urls]
+Homepage = "https://github.com/u-kitazawa/rhinestone"
+Repository = "https://github.com/u-kitazawa/rhinestone"
+Issues = "https://github.com/u-kitazawa/rhinestone/issues"
+Documentation = "https://github.com/u-kitazawa/rhinestone/tree/main/docs"
+
+[dependency-groups]
+dev = [
+    "rdflib>=6,<7",
+    "pyright>=1.1.339,<1.1.390",
+    "pytest>=7.4.4,<8",
+    "pytest-cov>=4.1,<5",
+    "ruff>=0.12.12,<0.13",
+    "mkdocs-material>=9.7.7",
+]
+
+[tool.coverage.run]
+source = ["rhinestone"]
+
+[tool.pytest.ini_options]
+addopts = [
+    "--cov=rhinestone",
+    "--cov-branch",
+    "--cov-report=term-missing",
+    "--cov-fail-under=100",
+]
+testpaths = ["tests"]
+
+[tool.ruff]
+line-length = 88
+target-version = "py37"
+
+[tool.ruff.lint]
+select = [
+    "E4",
+    "E7",
+    "E9",
+    "F",
+    "I",
+    "UP",
+]
+
+[tool.pyright]
+include = [
+    "src",
+    "tests",
+]
+pythonVersion = "3.10"
+typeCheckingMode = "strict"
+venv = ".venv"
+venvPath = "."
+
+[build-system]
+requires = ["uv_build>=0.12.9,<0.13.0"]
+build-backend = "uv_build"

rhinestone-0.1.0/pyproject.toml.orig

@@ -0,0 +1,73 @@
+[project]
+name = "rhinestone"
+version = "0.1.0"
+description = "Knowledge and specification layer for Japanese public and geospatial data"
+readme = "README.md"
+license = "MIT"
+license-files = ["LICENSE"]
+authors = [
+    { name = "kitazawa", email = "88121050+U-KITAZAWA@users.noreply.github.com" }
+]
+requires-python = ">=3.10"
+keywords = ["geospatial", "open-data", "japan", "data-access"]
+classifiers = [
+    "Development Status :: 3 - Alpha",
+    "Intended Audience :: Developers",
+    "License :: OSI Approved :: MIT License",
+    "Programming Language :: Python :: 3",
+    "Programming Language :: Python :: 3 :: Only",
+    "Programming Language :: Python :: 3.10",
+    "Programming Language :: Python :: 3.11",
+    "Programming Language :: Python :: 3.12",
+    "Programming Language :: Python :: 3.13",
+    "Typing :: Typed",
+]
+dependencies = [
+    "jsonschema>=4.18,<5",
+]
+
+[project.urls]
+Homepage = "https://github.com/u-kitazawa/rhinestone"
+Repository = "https://github.com/u-kitazawa/rhinestone"
+Issues = "https://github.com/u-kitazawa/rhinestone/issues"
+Documentation = "https://github.com/u-kitazawa/rhinestone/tree/main/docs"
+
+[dependency-groups]
+dev = [
+    "rdflib>=6,<7",
+    "pyright>=1.1.339,<1.1.390",
+    "pytest>=7.4.4,<8",
+    "pytest-cov>=4.1,<5",
+    "ruff>=0.12.12,<0.13",
+    "mkdocs-material>=9.7.7",
+]
+
+[tool.coverage.run]
+source = ["rhinestone"]
+
+[build-system]
+requires = ["uv_build>=0.12.9,<0.13.0"]
+build-backend = "uv_build"
+
+[tool.pytest.ini_options]
+addopts = [
+    "--cov=rhinestone",
+    "--cov-branch",
+    "--cov-report=term-missing",
+    "--cov-fail-under=100",
+]
+testpaths = ["tests"]
+
+[tool.ruff]
+line-length = 88
+target-version = "py37"
+
+[tool.ruff.lint]
+select = ["E4", "E7", "E9", "F", "I", "UP"]
+
+[tool.pyright]
+include = ["src", "tests"]
+pythonVersion = "3.10"
+typeCheckingMode = "strict"
+venv = ".venv"
+venvPath = "."

rhinestone-0.1.0/src/rhinestone/__init__.py

@@ -0,0 +1,60 @@
+"""Rhinestone public package."""
+
+from . import sources
+from .api import Rhinestone, configure
+from .catalogs import Catalog
+from .models import (
+    AccessPlan,
+    Config,
+    Dependencies,
+    FileAccessPlan,
+    LibraryName,
+    Metadata,
+    Provenance,
+    Provider,
+    RemoteDatasetPlan,
+    Resource,
+    ResourceCandidate,
+    Result,
+    Runtime,
+    RuntimeFactory,
+    SearchDiagnostic,
+    SearchQuery,
+    SearchResult,
+    ServiceQueryPlan,
+    Source,
+    SourceDefinition,
+)
+from .search import SearchResults
+from .security import DestinationPolicy, DestinationRule, NetworkPolicyLevel
+
+__all__ = [
+    "AccessPlan",
+    "Catalog",
+    "Config",
+    "DestinationPolicy",
+    "DestinationRule",
+    "Dependencies",
+    "FileAccessPlan",
+    "LibraryName",
+    "Metadata",
+    "NetworkPolicyLevel",
+    "Provenance",
+    "Provider",
+    "RemoteDatasetPlan",
+    "Rhinestone",
+    "Resource",
+    "ResourceCandidate",
+    "Result",
+    "Runtime",
+    "RuntimeFactory",
+    "SearchDiagnostic",
+    "SearchQuery",
+    "SearchResult",
+    "SearchResults",
+    "ServiceQueryPlan",
+    "Source",
+    "SourceDefinition",
+    "configure",
+    "sources",
+]

rhinestone-0.1.0/src/rhinestone/_http.py

@@ -0,0 +1,152 @@
+"""Built-in standard-library HTTP transport."""
+
+import json
+from typing import Any, Mapping, Optional, cast
+from urllib.error import HTTPError
+from urllib.parse import urlencode, urlsplit, urlunsplit
+from urllib.request import HTTPRedirectHandler, Request, build_opener, urlopen
+
+from .errors import ProviderResponseError
+
+_TIMEOUT_SECONDS = 30
+_DEFAULT_HEADERS = {
+    "Accept": "application/json",
+    "User-Agent": "rhinestone",
+}
+
+
+class _JsonIntegerDecodeError(ValueError):
+    """JSON integer conversion failed inside the decoder."""
+
+
+def _parse_json_int(value: str) -> int:
+    try:
+        return int(value)
+    except ValueError as error:
+        raise _JsonIntegerDecodeError from error
+
+
+class JsonDocument(dict[str, Any]):
+    """Decoded JSON object together with the URI that supplied it."""
+
+    def __init__(self, value: Mapping[str, Any], response_uri: str) -> None:
+        super().__init__(value)
+        self.response_uri = response_uri
+
+
+def get_json(
+    url: str,
+    params: Mapping[str, Any],
+    headers: Optional[Mapping[str, str]] = None,
+) -> Any:
+    """Fetch and decode JSON over HTTP using the standard library."""
+    request = _request(url, params, headers)
+    opener = (
+        build_opener(_NoRedirectHandler())
+        if getattr(headers, "_rhinestone_no_redirects", False)
+        else None
+    )
+    open_request = opener.open if opener is not None else urlopen
+    with open_request(request, timeout=_TIMEOUT_SECONDS) as response:
+        try:
+            decoded = json.load(response, parse_int=_parse_json_int)
+        except (
+            UnicodeDecodeError,
+            json.JSONDecodeError,
+            _JsonIntegerDecodeError,
+        ):
+            raise ProviderResponseError("Provider response is not valid JSON") from None
+        if isinstance(decoded, Mapping):
+            response_uri = getattr(response, "geturl", lambda: request.full_url)()
+            return JsonDocument(
+                cast(Mapping[str, Any], decoded), response_uri or request.full_url
+            )
+        return decoded
+
+
+def get_text(url: str) -> str:
+    """Fetch a text document without following HTTP redirects."""
+    request = Request(url, headers={"User-Agent": "rhinestone"})
+    opener = build_opener(_NoRedirectHandler())
+    with opener.open(request, timeout=_TIMEOUT_SECONDS) as response:
+        charset = response.headers.get_content_charset() or "utf-8"
+        return response.read().decode(charset)
+
+
+class JsonServiceRuntime:
+    """Small requests-compatible runtime used by ``JsonServiceAdapter``."""
+
+    def get(
+        self,
+        url: str,
+        *,
+        params: Mapping[str, Any],
+        headers: Mapping[str, str],
+        timeout: int,
+        allow_redirects: bool,
+    ) -> "JsonResponse":
+        request = _request(url, params, headers)
+        opener = build_opener(_NoRedirectHandler())
+        try:
+            response = opener.open(request, timeout=timeout)
+        except HTTPError as error:
+            response = error
+        with response:
+            charset = response.headers.get_content_charset() or "utf-8"
+            status_code = cast(int, response.getcode())
+            return JsonResponse(status_code, response.read(), charset)
+
+
+class JsonResponse:
+    """Subset of the requests response contract used by ``JsonServiceAdapter``."""
+
+    def __init__(self, status_code: int, body: bytes, charset: str) -> None:
+        self.status_code = status_code
+        self._body = body
+        self._charset = charset
+
+    def raise_for_status(self) -> None:
+        if self.status_code >= 400:
+            raise OSError(f"HTTP request failed with status {self.status_code}")
+
+    def json(self) -> Any:
+        return json.loads(self._body.decode(self._charset))
+
+
+class _NoRedirectHandler(HTTPRedirectHandler):
+    def redirect_request(
+        self,
+        req: Request,
+        fp: Any,
+        code: int,
+        msg: str,
+        headers: Any,
+        newurl: str,
+    ) -> Optional[Request]:
+        return None
+
+
+def _request(
+    url: str,
+    params: Mapping[str, Any],
+    headers: Optional[Mapping[str, str]] = None,
+) -> Request:
+    request_url = _append_query(url, params)
+    return Request(
+        request_url,
+        headers={**_DEFAULT_HEADERS, **dict(headers or {})},
+    )
+
+
+def _append_query(url: str, params: Mapping[str, Any]) -> str:
+    """Append parameters without replacing or normalizing an existing query."""
+    additional_query = urlencode(params, doseq=True)
+    if not additional_query:
+        return url
+    components = urlsplit(url)
+    query = (
+        f"{components.query}&{additional_query}"
+        if components.query
+        else additional_query
+    )
+    return urlunsplit(components._replace(query=query))

rhinestone-0.1.0/src/rhinestone/adapters/__init__.py

@@ -0,0 +1,33 @@
+"""Compatibility exports for built-in source adapters."""
+
+from .execution import ExecutionAdapter
+from .source import (
+    CkanAdapter,
+    DcatAdapter,
+    DirectAdapter,
+    GsiFundamentalAdapter,
+    JsonGetter,
+    JsonObject,
+    OdptAdapter,
+    OgcFeaturesAdapter,
+    PlateauAdapter,
+    ProviderAdapter,
+    StacAdapter,
+    StaticAdapter,
+)
+
+__all__ = [
+    "CkanAdapter",
+    "DirectAdapter",
+    "DcatAdapter",
+    "GsiFundamentalAdapter",
+    "JsonGetter",
+    "JsonObject",
+    "OdptAdapter",
+    "OgcFeaturesAdapter",
+    "PlateauAdapter",
+    "ProviderAdapter",
+    "StacAdapter",
+    "StaticAdapter",
+    "ExecutionAdapter",
+]