allegro-cli 0.1.0__tar.gz

allegro_cli-0.1.0/PKG-INFO

@@ -0,0 +1,152 @@
+Metadata-Version: 2.4
+Name: allegro-cli
+Version: 0.1.0
+Summary: CLI for browsing Allegro offers, managing cart, and tracking packages — human-readable and LLM-agent friendly
+Author: Piotr Konowrocki
+Project-URL: Repository, https://github.com/pkonowrocki/allegro-cli
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+Requires-Dist: httpx>=0.27
+Requires-Dist: beautifulsoup4>=4.12
+Requires-Dist: lxml>=5.0
+Requires-Dist: curl_cffi>=0.7
+Provides-Extra: dev
+Requires-Dist: pytest>=8.0; extra == "dev"
+Requires-Dist: commitizen>=4.1; extra == "dev"
+Requires-Dist: build>=1.0; extra == "dev"
+
+# allegro-cli
+
+[![CI](https://github.com/pkonowrocki/allegro-cli/actions/workflows/ci.yml/badge.svg)](https://github.com/pkonowrocki/allegro-cli/actions/workflows/ci.yml)
+
+CLI for browsing [Allegro](https://allegro.pl) offers, managing your cart, and tracking packages. Designed to be both human-readable and LLM-agent friendly.
+
+All output is available as aligned text tables, JSON, or TSV — pick what suits your workflow or pipe it into other tools.
+
+## Install
+
+**From GitHub Releases** (recommended):
+
+```bash
+pip install https://github.com/pkonowrocki/allegro-cli/releases/latest/download/allegro_cli-0.1.0-py3-none-any.whl
+```
+
+**From source (latest)**:
+
+```bash
+pip install git+https://github.com/pkonowrocki/allegro-cli.git
+```
+
+**For development**:
+
+```bash
+git clone https://github.com/pkonowrocki/allegro-cli.git
+cd allegro-cli
+pip install -e ".[dev]"
+```
+
+## Setup
+
+Import cookies from your browser:
+
+```bash
+allegro login
+```
+
+Paste cookies from Chrome DevTools (Application > Cookies > allegro.pl). Both the DevTools table format and raw cookie header strings are accepted.
+
+Alternatively, set cookies directly:
+
+```bash
+allegro config set --cookies 'cookie1=value1; cookie2=value2'
+```
+
+## Usage
+
+### Search
+
+```bash
+allegro search "laptop"
+allegro search "laptop" --category 491
+allegro search "laptop" --category laptopy-491 --sort pd --price-min 2000 --price-max 5000
+allegro search "laptop" --columns "id,name,sellingMode.price.amount,parameters"
+```
+
+| Flag | Description |
+|------|-------------|
+| `--category` | Category ID or slug (e.g. `491`, `laptopy-491`) |
+| `--sort` | Sort order: `p` (price asc), `pd` (price desc), `m` (relevance), `n` (newest) |
+| `--price-min` | Minimum price in PLN |
+| `--price-max` | Maximum price in PLN |
+| `--page` | Page number (default: 1) |
+| `--columns` | Comma-separated columns to display |
+
+### Offer details
+
+```bash
+allegro offer 12345678
+allegro offer 12345678 --columns "name,sellingMode.price.amount,parameters"
+```
+
+Offer pages include a `parameters` field with product specifications (e.g. processor, RAM, screen size) extracted automatically from the listing.
+
+### Cart
+
+```bash
+allegro cart list
+allegro cart add OFFER_ID SELLER_ID --quantity 2
+allegro cart remove OFFER_ID SELLER_ID
+```
+
+### Packages
+
+```bash
+allegro packages
+```
+
+### Configuration
+
+```bash
+allegro config show
+allegro config set --output-format json
+allegro config set --flaresolverr-url http://localhost:8191/v1
+```
+
+## Output formats
+
+All commands support `--format text` (default), `--format json`, and `--format tsv`.
+
+```bash
+allegro search "laptop" --format json     # full JSON array
+allegro search "laptop" --format tsv      # tab-separated, pipe-friendly
+allegro search "laptop"                   # aligned text table (default)
+allegro offer 12345678 --format json      # full offer with parameters
+```
+
+Use `--columns` to select specific fields (dot-notation supported):
+
+```bash
+allegro search "laptop" --columns "id,name,sellingMode.price.amount"
+allegro offer 12345678 --columns "name,parameters"
+```
+
+Set a persistent default:
+
+```bash
+allegro config set --output-format json
+```
+
+## Anti-bot handling
+
+Allegro uses anti-bot protection (DataDome). The CLI first tries a direct request with your cookies via `curl_cffi` (Chrome TLS fingerprint). If that gets a 403, it falls back to [FlareSolverr](https://github.com/FlareSolverr/FlareSolverr):
+
+```bash
+docker run -d --name flaresolverr -p 8191:8191 ghcr.io/flaresolverr/flaresolverr:latest
+```
+
+## Development
+
+```bash
+pip install -e ".[dev]"
+pytest
+```

allegro_cli-0.1.0/README.md

@@ -0,0 +1,135 @@
+# allegro-cli
+
+[![CI](https://github.com/pkonowrocki/allegro-cli/actions/workflows/ci.yml/badge.svg)](https://github.com/pkonowrocki/allegro-cli/actions/workflows/ci.yml)
+
+CLI for browsing [Allegro](https://allegro.pl) offers, managing your cart, and tracking packages. Designed to be both human-readable and LLM-agent friendly.
+
+All output is available as aligned text tables, JSON, or TSV — pick what suits your workflow or pipe it into other tools.
+
+## Install
+
+**From GitHub Releases** (recommended):
+
+```bash
+pip install https://github.com/pkonowrocki/allegro-cli/releases/latest/download/allegro_cli-0.1.0-py3-none-any.whl
+```
+
+**From source (latest)**:
+
+```bash
+pip install git+https://github.com/pkonowrocki/allegro-cli.git
+```
+
+**For development**:
+
+```bash
+git clone https://github.com/pkonowrocki/allegro-cli.git
+cd allegro-cli
+pip install -e ".[dev]"
+```
+
+## Setup
+
+Import cookies from your browser:
+
+```bash
+allegro login
+```
+
+Paste cookies from Chrome DevTools (Application > Cookies > allegro.pl). Both the DevTools table format and raw cookie header strings are accepted.
+
+Alternatively, set cookies directly:
+
+```bash
+allegro config set --cookies 'cookie1=value1; cookie2=value2'
+```
+
+## Usage
+
+### Search
+
+```bash
+allegro search "laptop"
+allegro search "laptop" --category 491
+allegro search "laptop" --category laptopy-491 --sort pd --price-min 2000 --price-max 5000
+allegro search "laptop" --columns "id,name,sellingMode.price.amount,parameters"
+```
+
+| Flag | Description |
+|------|-------------|
+| `--category` | Category ID or slug (e.g. `491`, `laptopy-491`) |
+| `--sort` | Sort order: `p` (price asc), `pd` (price desc), `m` (relevance), `n` (newest) |
+| `--price-min` | Minimum price in PLN |
+| `--price-max` | Maximum price in PLN |
+| `--page` | Page number (default: 1) |
+| `--columns` | Comma-separated columns to display |
+
+### Offer details
+
+```bash
+allegro offer 12345678
+allegro offer 12345678 --columns "name,sellingMode.price.amount,parameters"
+```
+
+Offer pages include a `parameters` field with product specifications (e.g. processor, RAM, screen size) extracted automatically from the listing.
+
+### Cart
+
+```bash
+allegro cart list
+allegro cart add OFFER_ID SELLER_ID --quantity 2
+allegro cart remove OFFER_ID SELLER_ID
+```
+
+### Packages
+
+```bash
+allegro packages
+```
+
+### Configuration
+
+```bash
+allegro config show
+allegro config set --output-format json
+allegro config set --flaresolverr-url http://localhost:8191/v1
+```
+
+## Output formats
+
+All commands support `--format text` (default), `--format json`, and `--format tsv`.
+
+```bash
+allegro search "laptop" --format json     # full JSON array
+allegro search "laptop" --format tsv      # tab-separated, pipe-friendly
+allegro search "laptop"                   # aligned text table (default)
+allegro offer 12345678 --format json      # full offer with parameters
+```
+
+Use `--columns` to select specific fields (dot-notation supported):
+
+```bash
+allegro search "laptop" --columns "id,name,sellingMode.price.amount"
+allegro offer 12345678 --columns "name,parameters"
+```
+
+Set a persistent default:
+
+```bash
+allegro config set --output-format json
+```
+
+## Anti-bot handling
+
+Allegro uses anti-bot protection (DataDome). The CLI first tries a direct request with your cookies via `curl_cffi` (Chrome TLS fingerprint). If that gets a 403, it falls back to [FlareSolverr](https://github.com/FlareSolverr/FlareSolverr):
+
+```bash
+docker run -d --name flaresolverr -p 8191:8191 ghcr.io/flaresolverr/flaresolverr:latest
+```
+
+## Development
+
+```bash
+pip install -e ".[dev]"
+pytest
+```

allegro_cli-0.1.0/allegro_cli/__init__.py

@@ -0,0 +1 @@
+__version__ = "0.1.0"

allegro_cli-0.1.0/allegro_cli/api/client.py

@@ -0,0 +1,332 @@
+from __future__ import annotations
+
+import re
+import time
+from urllib.parse import urlencode
+
+import httpx
+from curl_cffi.requests import Session as CffiSession
+
+from allegro_cli.api.models import (
+    AllegroCliError,
+    AuthenticationError,
+    Offer,
+)
+from allegro_cli.config import Config
+
+_COMMON_HEADERS = {
+    "origin": "https://allegro.pl",
+    "referer": "https://allegro.pl/",
+    "sec-ch-ua-mobile": "?0",
+    "sec-ch-ua-platform": '"Windows"',
+    "sec-fetch-dest": "empty",
+    "sec-fetch-mode": "cors",
+    "sec-fetch-site": "same-site",
+    "accept-language": "pl-PL",
+    "user-agent": (
+        "Mozilla/5.0 (Windows NT 10.0; Win64; x64) "
+        "AppleWebKit/537.36 (KHTML, like Gecko) "
+        "Chrome/144.0.0.0 Safari/537.36"
+    ),
+}
+
+
+class AllegroClient:
+    def __init__(self, config: Config, verbose: bool = False):
+        self._config = config
+        self._verbose = verbose
+
+        # Edge client for cart/packages — only when cookies are present
+        self._edge: httpx.Client | None = None
+        self._web: CffiSession | None = None
+        if config.cookies:
+            self._edge = httpx.Client(
+                base_url=config.edgeBaseUrl,
+                headers={**_COMMON_HEADERS, "cookie": config.cookies},
+                timeout=30.0,
+            )
+            # curl_cffi session — impersonates Chrome TLS fingerprint to pass Cloudflare
+            self._web = CffiSession(impersonate="chrome")
+            self._web.headers.update({"cookie": config.cookies})
+
+    # --- Scrape (allegro.pl, cookie auth) ---
+
+    def scrape_search(
+        self,
+        phrase: str,
+        page: int = 1,
+        category: str | None = None,
+        sort: str | None = None,
+        price_min: str | None = None,
+        price_max: str | None = None,
+    ) -> list[Offer]:
+        if not self._config.cookies:
+            raise AuthenticationError(
+                "No cookies configured. Scrape requires browser cookies.\n"
+                "Run: allegro login"
+            )
+
+        from allegro_cli.scraper import parse_search_results
+
+        if category:
+            cat_match = re.search(r"(\d+)$", category)
+            if cat_match:
+                base_url = f"https://allegro.pl/kategoria/-{cat_match.group(1)}"
+            else:
+                base_url = f"https://allegro.pl/kategoria/{category}"
+        else:
+            base_url = "https://allegro.pl/listing"
+
+        params: dict[str, str] = {"string": phrase}
+        if page > 1:
+            params["p"] = str(page)
+        if sort:
+            params["order"] = sort
+        if price_min:
+            params["price_from"] = price_min
+        if price_max:
+            params["price_to"] = price_max
+
+        full_url = base_url + "?" + urlencode(params)
+
+        html = self._fetch_page(full_url)
+        return parse_search_results(html)
+
+    def scrape_offer(self, offer_id: str) -> Offer:
+        """Fetch and parse a single offer page by ID."""
+        if not self._config.cookies:
+            raise AuthenticationError(
+                "No cookies configured. Scrape requires browser cookies.\n"
+                "Run: allegro login"
+            )
+
+        from allegro_cli.scraper import (
+            extract_lazy_contexts,
+            parse_offer_page,
+        )
+
+        url = f"https://allegro.pl/oferta/-{offer_id}"
+        html = self._fetch_page(url)
+        offer = parse_offer_page(html, offer_id=offer_id)
+
+        # If we only got a few params, try lazy loading the rest
+        if len(offer.parameters) < 15:
+            contexts = extract_lazy_contexts(html)
+            if contexts:
+                lazy_params = self._fetch_lazy_parameters(url, contexts)
+                for k, v in lazy_params.items():
+                    offer.parameters.setdefault(k, v)
+
+        return offer
+
+    def _fetch_lazy_parameters(
+        self, offer_url: str, contexts: list[dict],
+    ) -> dict[str, str]:
+        """Fetch lazy-loaded parameter groups via the opbox API."""
+        from allegro_cli.scraper import parse_opbox_parameters
+
+        result: dict[str, str] = {}
+        max_requests = 3
+        for ctx in contexts[:max_requests]:
+            lazy_url = f"{offer_url}?lazyContext={ctx['value']}"
+            self._log(f"GET {lazy_url} (lazy params)")
+            try:
+                resp = self._web.get(
+                    lazy_url,
+                    headers={
+                        "Accept": "application/vnd.opbox-web.subtree+json",
+                    },
+                    timeout=15,
+                )
+            except Exception:
+                continue
+            if resp.status_code != 200:
+                continue
+            try:
+                data = resp.json()
+            except (ValueError, Exception):
+                continue
+            params = parse_opbox_parameters(data)
+            for k, v in params.items():
+                result.setdefault(k, v)
+            if len(result) > 15:
+                break
+        return result
+
+    def _fetch_page(self, url: str) -> str:
+        # Try direct curl_cffi first
+        if self._web:
+            self._log(f"GET {url} (direct)")
+            t0 = time.monotonic()
+            resp = self._web.get(url, timeout=30)
+            elapsed = time.monotonic() - t0
+            self._log(f"Response: {resp.status_code} ({elapsed:.1f}s)")
+
+            if resp.status_code == 200:
+                return resp.text
+
+            if resp.status_code == 401:
+                raise AuthenticationError("Session expired (401). Run: allegro login")
+
+            # 403 = DataDome challenge — fall through to FlareSolverr
+            if resp.status_code != 403:
+                raise AllegroCliError(
+                    message=f"Scrape returned {resp.status_code}: {resp.text[:300]}",
+                    code="ScrapeException",
+                    userMessage=f"Could not fetch search page ({resp.status_code}).",
+                )
+            self._log("Direct fetch got 403 (DataDome), trying FlareSolverr...")
+
+        # Fall back to FlareSolverr
+        return self._fetch_via_flaresolverr(url)
+
+    def _fetch_via_flaresolverr(self, url: str) -> str:
+        fs_url = self._config.flareSolverrUrl
+        if not fs_url:
+            # Auto-detect on default port
+            fs_url = "http://localhost:8191/v1"
+
+        self._log(f"FlareSolverr POST {fs_url}")
+        t0 = time.monotonic()
+
+        try:
+            resp = httpx.post(
+                fs_url,
+                json={"cmd": "request.get", "url": url, "maxTimeout": 60000},
+                timeout=90.0,
+            )
+        except httpx.ConnectError:
+            raise AllegroCliError(
+                message=f"Cannot connect to FlareSolverr at {fs_url}",
+                code="FlareSolverrUnavailable",
+                userMessage=(
+                    "Direct fetch blocked by anti-bot (403) and FlareSolverr "
+                    "is not running.\n"
+                    "Start it with:\n"
+                    "  docker run -d --name flaresolverr -p 8191:8191 "
+                    "ghcr.io/flaresolverr/flaresolverr:latest\n"
+                    "Or refresh your cookies:\n"
+                    "  allegro login"
+                ),
+            )
+
+        elapsed = time.monotonic() - t0
+        self._log(f"FlareSolverr response: {resp.status_code} ({elapsed:.1f}s)")
+
+        if resp.status_code != 200:
+            raise AllegroCliError(
+                message=f"FlareSolverr returned {resp.status_code}: {resp.text[:300]}",
+                code="FlareSolverrError",
+                userMessage="FlareSolverr returned an error.",
+            )
+
+        data = resp.json()
+        if data.get("status") != "ok":
+            raise AllegroCliError(
+                message=f"FlareSolverr error: {data.get('message', 'unknown')}",
+                code="FlareSolverrError",
+                userMessage=f"FlareSolverr: {data.get('message', 'unknown error')}",
+            )
+
+        solution = data.get("solution", {})
+        sol_status = solution.get("status", 0)
+        if sol_status >= 400:
+            raise AllegroCliError(
+                message=f"FlareSolverr got {sol_status} from target",
+                code="ScrapeException",
+                userMessage=f"Could not fetch search page ({sol_status}).",
+            )
+
+        return solution.get("response", "")
+
+    # --- Cart (edge.allegro.pl, cookie auth) ---
+
+    def _require_edge(self) -> httpx.Client:
+        if not self._edge:
+            raise AuthenticationError(
+                "No cookies configured. Cart/packages require browser cookies.\n"
+                "Run: allegro login"
+            )
+        return self._edge
+
+    def get_cart(self) -> dict:
+        resp = self._request(
+            "GET", "/carts",
+            accept="application/vnd.allegro.internal.v6+json",
+        )
+        return resp.json()
+
+    def change_cart_quantity(
+        self,
+        item_id: str,
+        delta: int,
+        seller_id: str,
+        nav_category_id: str | None = None,
+    ) -> None:
+        body = {
+            "items": [
+                {
+                    "itemId": item_id,
+                    "delta": delta,
+                    "sellerId": seller_id,
+                    **({"navCategoryId": nav_category_id} if nav_category_id else {}),
+                    "navTree": "navigation-pl",
+                }
+            ]
+        }
+        self._request(
+            "POST",
+            "/carts/changeQuantityCommand",
+            json=body,
+            accept="application/vnd.allegro.public.v5+json",
+            content_type="application/vnd.allegro.public.v5+json",
+        )
+
+    # --- Packages / delivery ---
+
+    def get_packages_summary(self) -> dict:
+        resp = self._request(
+            "GET", "/packages/summary",
+            accept="application/vnd.allegro.internal.v1+json",
+        )
+        return resp.json()
+
+    # --- HTTP layer (edge API, cookie auth) ---
+
+    def _request(
+        self,
+        method: str,
+        path: str,
+        accept: str = "application/vnd.allegro.internal.v1+json",
+        content_type: str | None = None,
+        **kwargs,
+    ) -> httpx.Response:
+        edge = self._require_edge()
+        headers = {"accept": accept}
+        if content_type:
+            headers["content-type"] = content_type
+
+        resp = edge.request(method, path, headers=headers, **kwargs)
+
+        if resp.status_code == 401:
+            raise AuthenticationError(
+                "Session expired (401). Run: allegro login"
+            )
+        if resp.status_code == 403:
+            raise AllegroCliError(
+                message="Forbidden (403)",
+                code="ForbiddenException",
+                userMessage="Access denied. Your session cookies may have expired.",
+            )
+        if resp.status_code >= 400 and resp.status_code != 204:
+            raise AllegroCliError(
+                message=f"API returned {resp.status_code}: {resp.text[:300]}",
+                code="ApiException",
+                userMessage=f"Allegro API error ({resp.status_code}).",
+            )
+        return resp
+
+    def _log(self, msg: str) -> None:
+        if self._verbose:
+            import sys
+            print(msg, file=sys.stderr, flush=True)

allegro_cli-0.1.0/allegro_cli/api/models.py

@@ -0,0 +1,88 @@
+from __future__ import annotations
+
+from dataclasses import dataclass, field
+
+
+# --- Data models (Allegro REST API conventions) ---
+
+@dataclass
+class Price:
+    amount: str
+    currency: str = "PLN"
+
+
+@dataclass
+class Seller:
+    id: str
+    name: str
+
+
+@dataclass
+class Category:
+    id: str
+    name: str | None = None
+
+
+@dataclass
+class Image:
+    url: str
+
+
+@dataclass
+class SellingMode:
+    format: str  # BUY_NOW, AUCTION, ADVERTISEMENT
+    price: Price
+    popularity: int | None = None
+
+
+@dataclass
+class DeliveryInfo:
+    lowestPrice: Price | None = None
+    availableForFree: bool = False
+
+
+@dataclass
+class Stock:
+    unit: str = "UNIT"
+    available: int = 0
+
+
+@dataclass
+class Offer:
+    id: str
+    name: str
+    seller: Seller
+    sellingMode: SellingMode
+    category: Category
+    images: list[Image] = field(default_factory=list)
+    delivery: DeliveryInfo | None = None
+    stock: Stock | None = None
+    parameters: dict[str, str] = field(default_factory=dict)
+
+
+# --- Exceptions ---
+
+class AllegroCliError(Exception):
+    def __init__(
+        self,
+        message: str,
+        code: str,
+        path: str | None = None,
+        userMessage: str | None = None,
+    ):
+        self.message = message
+        self.code = code
+        self.path = path
+        self.userMessage = userMessage or message
+        super().__init__(message)
+
+
+class AuthenticationError(AllegroCliError):
+    def __init__(self, message: str = "Authentication failed"):
+        super().__init__(
+            message=message,
+            code="AuthenticationException",
+            userMessage="Could not authenticate. Check your client-id and client-secret.",
+        )
+
+