scrapling-data 0.1.0__tar.gz

scrapling_data-0.1.0/.gitignore

@@ -0,0 +1,8 @@
+.venv/
+dist/
+build/
+*.egg-info/
+__pycache__/
+.pytest_cache/
+.mypy_cache/
+*.pyc

scrapling_data-0.1.0/AGENT.md

@@ -0,0 +1,47 @@
+# scrapling-data — agent / MCP notes
+
+Package: `scrapling-data` (PyPI name reserved for Scrapling Data).
+Store: https://scraplingdata.xyz
+This file is for LLM agents that installed or are considering the SDK.
+
+## When to use this package
+
+- Validate / checksum an EVM address **offline** before spending.
+- Pull **free teasers** (`/v1/free/*`) without an API key.
+- Call **paid** Scrapling routes with x402: attach a `payment_handler`, day/month pass, trial code, or prepaid key.
+- Surface a **price teaser** so a human can approve USDC spend.
+
+## Do not expect
+
+- Private Scrapling scrapers, label-graph builders, or admin tokens (not shipped).
+- Automatic signing — you must supply a wallet/signer. Never paste private keys into prompts or this library.
+
+## Minimal agent flow
+
+```python
+from scrapling_data import ScraplingData, inspect_address, PaymentRequiredError
+
+info = inspect_address(user_address)
+# show info.to_dict() to the human
+
+with ScraplingData() as sd:
+    teaser = sd.free_wallet_label(info.checksum or info.normalized)
+    try:
+        full = sd.counterparty(info.checksum, chain="ethereum")  # $0.004
+    except PaymentRequiredError as e:
+        # Forward e.payment.to_dict()["how_to_pay"] + accepts[] to the human for approval
+        challenge = e.payment.to_dict()
+```
+
+## MCP alternative
+
+Remote Streamable HTTP MCP: `https://scraplingdata.xyz/mcp`  
+Registry: `io.github.bnth09productions-maker/scrapling-x402-store`  
+Pay via `params._meta['x402/payment']` or `api_key`.
+
+## Discovery
+
+- OpenAPI: https://scraplingdata.xyz/openapi.json
+- llms.txt: https://scraplingdata.xyz/llms.txt
+- x402: https://scraplingdata.xyz/.well-known/x402
+- Skill: https://scraplingdata.xyz/skills/scrapling-data/SKILL.md

scrapling_data-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Scrapling Data
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

scrapling_data-0.1.0/PKG-INFO

@@ -0,0 +1,155 @@
+Metadata-Version: 2.5
+Name: scrapling-data
+Version: 0.1.0
+Summary: Lead-magnet SDK for Scrapling Data: free address tools + x402 pay-per-call crypto intel for AI agents (USDC on Base, no API key).
+Project-URL: Homepage, https://scraplingdata.xyz
+Project-URL: Documentation, https://scraplingdata.xyz/docs
+Project-URL: Repository, https://github.com/scraplingdata
+Project-URL: Hugging Face, https://huggingface.co/scraplingdata
+Project-URL: OpenAPI, https://scraplingdata.xyz/openapi.json
+Project-URL: llms.txt, https://scraplingdata.xyz/llms.txt
+Project-URL: x402 manifest, https://scraplingdata.xyz/.well-known/x402
+Project-URL: Issues, https://github.com/scraplingdata/scrapling-data-skill/issues
+Author-email: Scrapling Data <scraplingdata@mail.grokbot.com>
+License-Expression: MIT
+License-File: LICENSE
+Keywords: ai-agents,base,crypto,defi,mcp,scrapling,usdc,wallet,x402
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Internet :: WWW/HTTP
+Classifier: Topic :: Software Development :: Libraries
+Classifier: Typing :: Typed
+Requires-Python: >=3.9
+Requires-Dist: httpx>=0.27
+Provides-Extra: dev
+Requires-Dist: build>=1.2; extra == 'dev'
+Requires-Dist: pytest>=8.0; extra == 'dev'
+Requires-Dist: twine>=5.0; extra == 'dev'
+Description-Content-Type: text/markdown
+
+# scrapling-data
+
+**Lead-magnet Python SDK** for [Scrapling Data](https://scraplingdata.xyz) — pay-per-call crypto & web intel for AI agents via **x402** (USDC on Base, no API key).
+
+Install once. Get **free** local address tools and free store teasers. When you need the real answer, the same client speaks **HTTP 402 → pay → retry** against the live catalog.
+
+- Site: https://scraplingdata.xyz
+- Docs: https://scraplingdata.xyz/docs
+- GitHub: https://github.com/scraplingdata
+- Hugging Face: https://huggingface.co/scraplingdata
+- MCP: https://scraplingdata.xyz/mcp
+
+> This package is the **public thin SDK**. It does **not** include Scrapling's private scrapers, label builders, or secrets.
+
+## Install
+
+```bash
+pip install scrapling-data
+```
+
+(Until published: `pip install -e /path/to/scrapling-data`)
+
+## 30-second sticky start
+
+```bash
+# Free local checksum + free wallet-label teaser + paid price menu
+scrapling-data check 0x28C6c06298d514Db089934071355E5743bf21d60
+
+# Lookalike / address-poisoning heuristic (local, free)
+scrapling-data check 0x28C6c06298d514Db089934071355E5743bf21d60 \
+  --compare 0x28C6c06298d514Db089934071355E5743bf21d61
+```
+
+```python
+from scrapling_data import ScraplingData, inspect_address, to_checksum_address
+
+print(inspect_address("0x28c6c06298d514db089934071355e5743bf21d60"))
+print(to_checksum_address("0x28c6c06298d514db089934071355e5743bf21d60"))
+
+with ScraplingData() as sd:
+    print(sd.free_crypto_top10())          # free
+    print(sd.free_wallet_label("0x28C6c06298d514Db089934071355E5743bf21d60"))
+    # Paid — raises PaymentRequiredError with accepts[] unless you attach a signer:
+    # sd.counterparty("0x28C6c06298d514Db089934071355E5743bf21d60")
+```
+
+## What's free vs paid
+
+| Layer | What you get | Cost |
+| --- | --- | --- |
+| **Local** | EVM validate, EIP-55 checksum, ENS/Solana detect, lookalike/poison heuristic, chain id hints | Free, offline |
+| **Free API** | `/v1/free/*` teasers (wallet-label sample, hack-tracker headline, top10, yields, 3×/day risk-check, …) | Free (rate-limited) |
+| **Paid API** | Full counterparty, risk-check, hack-tracker, yields, market-pulse, tokenized assets, whales, DD, … | From **$0.0009** USDC via x402 |
+
+### Sticky funnel (by design)
+
+1. `scrapling-data check <addr>` → valid + checksum + free label teaser.
+2. See the **paid menu** with live catalog prices.
+3. Call `ScraplingData(...).counterparty(addr)` (or risk-check / hack-tracker / …).
+4. Without a wallet: clear **402** payload + docs link. With `payment_handler`: auto-retry with `PAYMENT-SIGNATURE`.
+
+## Paying with x402
+
+```python
+from scrapling_data import ScraplingData, PaymentRequiredError
+
+def my_signer(payment):
+    """Return a PAYMENT-SIGNATURE string. Use your own wallet / x402 client.
+    Never put a private key in this library or in source control."""
+    accept = payment.preferred_accept()
+    # ... sign accept with your viem / eth-account / Coinbase AgentKit / x402 SDK ...
+    raise NotImplementedError("wire your signer here")
+
+sd = ScraplingData(payment_handler=my_signer)
+try:
+    print(sd.counterparty("0x28C6c06298d514Db089934071355E5743bf21d60"))
+except PaymentRequiredError as e:
+    print(e.payment.to_dict())  # accepts, amount, payTo, how_to_pay
+```
+
+Also supported: `pass_token=` (day/month pass), `api_key=` (`Bearer sk_scrapling_...`), `trial_code=`.
+
+Day pass **$2** · month pass **$25** · settlement payTo (EVM): `0x72C80C01fD89Bac74f47cf604b61ACd119c9BCdb`.
+
+## Highlight paid routes (catalog hints)
+
+Prices from live `/llms.txt` + OpenAPI (Nov 2026). **402 body is authoritative.**
+
+| Route | USD | Use |
+| --- | ---: | --- |
+| `/v1/lookup/address-poisoning` | 0.0009 | Live Base USDC lookalike flags |
+| `/v1/bundle/market-pulse` | 0.001 | Whole-market pulse |
+| `/v1/wallet-label` | 0.002 | Full label + sources |
+| `/v1/check/counterparty` | 0.004 | safe / caution / block |
+| `/v1/intel/risk-check` | 0.0045 | MALICIOUS…UNKNOWN (3 free/day) |
+| `/v1/wallet/profile` | 0.005 | Who is this wallet? |
+| `/v1/lookup/tokenized-stocks` | 0.005 | Ondo / xStocks |
+| `/v1/lookup/hack-tracker` | 0.03 | Stolen-funds tracker |
+| `/v1/trust/agent` | 0.04 | Agent trust bundle |
+| `/v1/dd/report` | 1.00 | Full due-diligence |
+| `/v1/bundles/stolen-funds/download` | 12 | Pack download (not on passes) |
+
+Full machine list: https://scraplingdata.xyz/llms.txt · https://scraplingdata.xyz/openapi.json
+
+## CLI
+
+```text
+scrapling-data check <address> [--compare 0x...] [--offline] [--json]
+scrapling-data catalog [--max-price 0.01]
+scrapling-data ping
+```
+
+## For agents / MCP
+
+See [`AGENT.md`](./AGENT.md). Remote MCP (same store): `https://scraplingdata.xyz/mcp`.
+
+## License
+
+MIT © Scrapling Data

scrapling_data-0.1.0/README.md

@@ -0,0 +1,119 @@
+# scrapling-data
+
+**Lead-magnet Python SDK** for [Scrapling Data](https://scraplingdata.xyz) — pay-per-call crypto & web intel for AI agents via **x402** (USDC on Base, no API key).
+
+Install once. Get **free** local address tools and free store teasers. When you need the real answer, the same client speaks **HTTP 402 → pay → retry** against the live catalog.
+
+- Site: https://scraplingdata.xyz
+- Docs: https://scraplingdata.xyz/docs
+- GitHub: https://github.com/scraplingdata
+- Hugging Face: https://huggingface.co/scraplingdata
+- MCP: https://scraplingdata.xyz/mcp
+
+> This package is the **public thin SDK**. It does **not** include Scrapling's private scrapers, label builders, or secrets.
+
+## Install
+
+```bash
+pip install scrapling-data
+```
+
+(Until published: `pip install -e /path/to/scrapling-data`)
+
+## 30-second sticky start
+
+```bash
+# Free local checksum + free wallet-label teaser + paid price menu
+scrapling-data check 0x28C6c06298d514Db089934071355E5743bf21d60
+
+# Lookalike / address-poisoning heuristic (local, free)
+scrapling-data check 0x28C6c06298d514Db089934071355E5743bf21d60 \
+  --compare 0x28C6c06298d514Db089934071355E5743bf21d61
+```
+
+```python
+from scrapling_data import ScraplingData, inspect_address, to_checksum_address
+
+print(inspect_address("0x28c6c06298d514db089934071355e5743bf21d60"))
+print(to_checksum_address("0x28c6c06298d514db089934071355e5743bf21d60"))
+
+with ScraplingData() as sd:
+    print(sd.free_crypto_top10())          # free
+    print(sd.free_wallet_label("0x28C6c06298d514Db089934071355E5743bf21d60"))
+    # Paid — raises PaymentRequiredError with accepts[] unless you attach a signer:
+    # sd.counterparty("0x28C6c06298d514Db089934071355E5743bf21d60")
+```
+
+## What's free vs paid
+
+| Layer | What you get | Cost |
+| --- | --- | --- |
+| **Local** | EVM validate, EIP-55 checksum, ENS/Solana detect, lookalike/poison heuristic, chain id hints | Free, offline |
+| **Free API** | `/v1/free/*` teasers (wallet-label sample, hack-tracker headline, top10, yields, 3×/day risk-check, …) | Free (rate-limited) |
+| **Paid API** | Full counterparty, risk-check, hack-tracker, yields, market-pulse, tokenized assets, whales, DD, … | From **$0.0009** USDC via x402 |
+
+### Sticky funnel (by design)
+
+1. `scrapling-data check <addr>` → valid + checksum + free label teaser.
+2. See the **paid menu** with live catalog prices.
+3. Call `ScraplingData(...).counterparty(addr)` (or risk-check / hack-tracker / …).
+4. Without a wallet: clear **402** payload + docs link. With `payment_handler`: auto-retry with `PAYMENT-SIGNATURE`.
+
+## Paying with x402
+
+```python
+from scrapling_data import ScraplingData, PaymentRequiredError
+
+def my_signer(payment):
+    """Return a PAYMENT-SIGNATURE string. Use your own wallet / x402 client.
+    Never put a private key in this library or in source control."""
+    accept = payment.preferred_accept()
+    # ... sign accept with your viem / eth-account / Coinbase AgentKit / x402 SDK ...
+    raise NotImplementedError("wire your signer here")
+
+sd = ScraplingData(payment_handler=my_signer)
+try:
+    print(sd.counterparty("0x28C6c06298d514Db089934071355E5743bf21d60"))
+except PaymentRequiredError as e:
+    print(e.payment.to_dict())  # accepts, amount, payTo, how_to_pay
+```
+
+Also supported: `pass_token=` (day/month pass), `api_key=` (`Bearer sk_scrapling_...`), `trial_code=`.
+
+Day pass **$2** · month pass **$25** · settlement payTo (EVM): `0x72C80C01fD89Bac74f47cf604b61ACd119c9BCdb`.
+
+## Highlight paid routes (catalog hints)
+
+Prices from live `/llms.txt` + OpenAPI (Nov 2026). **402 body is authoritative.**
+
+| Route | USD | Use |
+| --- | ---: | --- |
+| `/v1/lookup/address-poisoning` | 0.0009 | Live Base USDC lookalike flags |
+| `/v1/bundle/market-pulse` | 0.001 | Whole-market pulse |
+| `/v1/wallet-label` | 0.002 | Full label + sources |
+| `/v1/check/counterparty` | 0.004 | safe / caution / block |
+| `/v1/intel/risk-check` | 0.0045 | MALICIOUS…UNKNOWN (3 free/day) |
+| `/v1/wallet/profile` | 0.005 | Who is this wallet? |
+| `/v1/lookup/tokenized-stocks` | 0.005 | Ondo / xStocks |
+| `/v1/lookup/hack-tracker` | 0.03 | Stolen-funds tracker |
+| `/v1/trust/agent` | 0.04 | Agent trust bundle |
+| `/v1/dd/report` | 1.00 | Full due-diligence |
+| `/v1/bundles/stolen-funds/download` | 12 | Pack download (not on passes) |
+
+Full machine list: https://scraplingdata.xyz/llms.txt · https://scraplingdata.xyz/openapi.json
+
+## CLI
+
+```text
+scrapling-data check <address> [--compare 0x...] [--offline] [--json]
+scrapling-data catalog [--max-price 0.01]
+scrapling-data ping
+```
+
+## For agents / MCP
+
+See [`AGENT.md`](./AGENT.md). Remote MCP (same store): `https://scraplingdata.xyz/mcp`.
+
+## License
+
+MIT © Scrapling Data

scrapling_data-0.1.0/pyproject.toml

@@ -0,0 +1,79 @@
+[build-system]
+requires = ["hatchling>=1.25"]
+build-backend = "hatchling.build"
+
+[project]
+name = "scrapling-data"
+version = "0.1.0"
+description = "Lead-magnet SDK for Scrapling Data: free address tools + x402 pay-per-call crypto intel for AI agents (USDC on Base, no API key)."
+readme = "README.md"
+license = "MIT"
+requires-python = ">=3.9"
+authors = [
+  { name = "Scrapling Data", email = "scraplingdata@mail.grokbot.com" },
+]
+keywords = [
+  "x402",
+  "crypto",
+  "defi",
+  "wallet",
+  "ai-agents",
+  "mcp",
+  "scrapling",
+  "usdc",
+  "base",
+]
+classifiers = [
+  "Development Status :: 4 - Beta",
+  "Intended Audience :: Developers",
+  "License :: OSI Approved :: MIT License",
+  "Programming Language :: Python :: 3",
+  "Programming Language :: Python :: 3.9",
+  "Programming Language :: Python :: 3.10",
+  "Programming Language :: Python :: 3.11",
+  "Programming Language :: Python :: 3.12",
+  "Programming Language :: Python :: 3.13",
+  "Topic :: Internet :: WWW/HTTP",
+  "Topic :: Software Development :: Libraries",
+  "Typing :: Typed",
+]
+dependencies = [
+  "httpx>=0.27",
+]
+
+[project.optional-dependencies]
+dev = [
+  "pytest>=8.0",
+  "build>=1.2",
+  "twine>=5.0",
+]
+
+[project.urls]
+Homepage = "https://scraplingdata.xyz"
+Documentation = "https://scraplingdata.xyz/docs"
+Repository = "https://github.com/scraplingdata"
+"Hugging Face" = "https://huggingface.co/scraplingdata"
+"OpenAPI" = "https://scraplingdata.xyz/openapi.json"
+"llms.txt" = "https://scraplingdata.xyz/llms.txt"
+"x402 manifest" = "https://scraplingdata.xyz/.well-known/x402"
+Issues = "https://github.com/scraplingdata/scrapling-data-skill/issues"
+
+[project.scripts]
+scrapling-data = "scrapling_data.cli:main"
+
+[tool.hatch.build.targets.wheel]
+packages = ["src/scrapling_data"]
+
+[tool.hatch.build.targets.sdist]
+include = [
+  "/src",
+  "/tests",
+  "/README.md",
+  "/LICENSE",
+  "/AGENT.md",
+  "/pyproject.toml",
+]
+
+[tool.pytest.ini_options]
+testpaths = ["tests"]
+pythonpath = ["src"]

scrapling_data-0.1.0/src/scrapling_data/__init__.py

@@ -0,0 +1,43 @@
+"""scrapling-data — lead-magnet SDK for Scrapling Data (https://scraplingdata.xyz).
+
+Free local address tools + thin x402 client. No scraping logic, no secrets.
+"""
+
+from scrapling_data.catalog import BASE_URL, DOCS_URL, PAID, catalog_summary, price_of
+from scrapling_data.client import ScraplingData
+from scrapling_data.local import (
+    AddressInfo,
+    chain_hint,
+    inspect_address,
+    is_ens_name,
+    is_evm_address,
+    is_solana_address,
+    lookalike_distance,
+    normalize_evm,
+    paid_teasers_for,
+    to_checksum_address,
+)
+from scrapling_data.x402 import PaymentRequired, PaymentRequiredError
+
+__version__ = "0.1.0"
+__all__ = [
+    "BASE_URL",
+    "DOCS_URL",
+    "PAID",
+    "AddressInfo",
+    "PaymentRequired",
+    "PaymentRequiredError",
+    "ScraplingData",
+    "catalog_summary",
+    "chain_hint",
+    "inspect_address",
+    "is_ens_name",
+    "is_evm_address",
+    "is_solana_address",
+    "lookalike_distance",
+    "normalize_evm",
+    "paid_teasers_for",
+    "price_of",
+    "to_checksum_address",
+    "__version__",
+]

scrapling_data-0.1.0/src/scrapling_data/__main__.py

@@ -0,0 +1,3 @@
+from scrapling_data.cli import main
+
+raise SystemExit(main())

scrapling_data-0.1.0/src/scrapling_data/_keccak.py

@@ -0,0 +1,73 @@
+"""Minimal Keccak-256 (Ethereum) for EIP-55 checksums. No third-party crypto deps."""
+
+from __future__ import annotations
+
+_RC = (
+    0x0000000000000001, 0x0000000000008082, 0x800000000000808A, 0x8000000080008000,
+    0x000000000000808B, 0x0000000080000001, 0x8000000080008081, 0x8000000000008009,
+    0x000000000000008A, 0x0000000000000088, 0x0000000080008009, 0x000000008000000A,
+    0x000000008000808B, 0x800000000000008B, 0x8000000000008089, 0x8000000000008003,
+    0x8000000000008002, 0x8000000000000080, 0x000000000000800A, 0x800000008000000A,
+    0x8000000080008081, 0x8000000000008080, 0x0000000080000001, 0x8000000080008008,
+)
+_ROT = (
+    (0, 36, 3, 41, 18),
+    (1, 44, 10, 45, 2),
+    (62, 6, 43, 15, 61),
+    (28, 55, 25, 21, 56),
+    (27, 20, 39, 8, 14),
+)
+
+
+def _rol64(x: int, n: int) -> int:
+    return ((x << n) | (x >> (64 - n))) & 0xFFFFFFFFFFFFFFFF
+
+
+def _keccak_f1600(st: list[int]) -> None:
+    for rnd in range(24):
+        c = [st[x] ^ st[x + 5] ^ st[x + 10] ^ st[x + 15] ^ st[x + 20] for x in range(5)]
+        d = [c[(x - 1) % 5] ^ _rol64(c[(x + 1) % 5], 1) for x in range(5)]
+        for i in range(25):
+            st[i] ^= d[i % 5]
+        b = [0] * 25
+        for x in range(5):
+            for y in range(5):
+                b[y + ((2 * x + 3 * y) % 5) * 5] = _rol64(st[x + 5 * y], _ROT[x][y])
+        for x in range(5):
+            for y in range(5):
+                i = x + 5 * y
+                st[i] = b[i] ^ ((~b[((x + 1) % 5) + 5 * y]) & b[((x + 2) % 5) + 5 * y])
+        st[0] ^= _RC[rnd]
+
+
+def _absorb_block(st: list[int], block: bytes) -> None:
+    for i in range(0, len(block), 8):
+        st[i // 8] ^= int.from_bytes(block[i : i + 8], "little")
+
+
+def keccak256(data: bytes) -> bytes:
+    """Return the 32-byte Keccak-256 digest of *data*."""
+    rate = 136
+    st = [0] * 25
+    offset = 0
+    n = len(data)
+    while offset + rate <= n:
+        _absorb_block(st, data[offset : offset + rate])
+        _keccak_f1600(st)
+        offset += rate
+    padded = bytearray(rate)
+    rem = data[offset:]
+    padded[: len(rem)] = rem
+    padded[len(rem)] = 0x01
+    padded[-1] |= 0x80
+    _absorb_block(st, bytes(padded))
+    _keccak_f1600(st)
+    out = bytearray()
+    while len(out) < 32:
+        for i in range(rate // 8):
+            out.extend(st[i].to_bytes(8, "little"))
+            if len(out) >= 32:
+                break
+        if len(out) < 32:
+            _keccak_f1600(st)
+    return bytes(out[:32])