hydrafetch 0.3.0__tar.gz → 0.5.0__tar.gz

{hydrafetch-0.3.0 → hydrafetch-0.5.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.5
 Name: hydrafetch
-Version: 0.3.0
+Version: 0.5.0
 Summary: Official Python client for the Hydrafetch web data API. Turn any URL into clean Markdown and structured data.
 Project-URL: Homepage, https://hydrafetch.com
 Project-URL: Documentation, https://docs.hydrafetch.com
@@ -48,7 +48,7 @@ page = hf.scrape("https://example.com/article")
 print(page["markdown"])
 ```
 
-Create a key at [app.hydrafetch.com](https://app.hydrafetch.com). The constructor reads `HYDRAFETCH_API_KEY` when no key is passed.
+Copy your key from [app.hydrafetch.com](https://app.hydrafetch.com). The constructor reads `HYDRAFETCH_API_KEY` when no key is passed.
 
 Both clients are context managers, which closes the connection pool deterministically:
 
@@ -165,6 +165,29 @@ for r in res["results"]:
     print(((r.get("data") or {}).get("markdown") or "")[:500])
 ```
 
+## Jobs
+
+Search open jobs collected from company career sites and hiring platforms, by the words in the job title:
+
+```python
+jobs = hf.search_jobs("data engineer", location="Berlin", postedWithinDays=14, limit=20)
+
+for job in jobs:
+    print(job["title"], job["company"], job["location"], job["url"])
+```
+
+See what changed in a company's hiring since a date: what is open now, what opened and what closed, by department, seniority and location, with the jobs themselves:
+
+```python
+[acme] = hf.hiring_changes("acme.com", "2026-10-01")
+
+print(acme["totals"])  # {"open": 42, "opened": 6, "closed": 3}
+for job in acme["opened"]:
+    print(job["title"], job["seniority"], job["firstSeenAt"])
+```
+
+A search costs 1 credit per 10 jobs returned, and an empty one is free. Hiring changes cost 1 credit per company we have jobs for; companies we do not track yet come back empty and are free.
+
 ## Brand data
 
 ```python
@@ -176,6 +199,24 @@ hf.styleguide("https://stripe.com/pricing", maxAge=0)  # one page, read fresh
 
 For logos in a browser use [`@hydrafetch/client-sdk`](https://github.com/Hydrafetch/client-sdk) with a publishable key. Those bill against logo pulls rather than credits.
 
+## Rating results
+
+Tell us when a result was wrong, so it gets looked at. It is free, and rating the same request again replaces the earlier rating.
+
+```python
+page = hf.scrape("https://stripe.com/pricing")
+hf.rate_result(
+    "bad",
+    request_id=hf.last_request_id,
+    reasons=["missing_content"],
+    note="The enterprise tier is missing",
+)
+
+hf.rate_result("good", url="https://stripe.com/pricing")  # by URL, last 24 hours
+```
+
+Reasons are `missing_content`, `wrong_content`, `blocked`, `slow`, `formatting` and `other`.
+
 ## Async
 
 `AsyncHydrafetch` mirrors the same surface. Use it when several calls can run concurrently.
@@ -252,6 +293,8 @@ hf = Hydrafetch(
 | `markdown(url, **options)` | `str` | 1 |
 | `map(url, **options)` | links dict | 1 |
 | `search(query, **options)` | results dict | 1 + 1 per scraped result |
+| `search_jobs(query, **options)` | list of jobs | 1 per 10 jobs |
+| `hiring_changes(domains, since, **options)` | list of companies | 1 per company with jobs |
 | `extract(urls, **options)` | dict with `"results"` | 5 per URL |
 | `brand(domain)` | brand dict | 5 |
 | `logo(domain, **options)` | logo dict | 1 |
@@ -262,6 +305,7 @@ hf = Hydrafetch(
 | `batch(urls, **options)` | job dict, polled to completion | 1 per page |
 | `start_crawl`, `start_batch` | job id `str` | 1 per page |
 | `crawl_status(id)`, `batch_status(id)` | job dict | free |
+| `rate_result(rating, request_id=, url=, reasons=, note=)` | rating dict | free |
 
 Failed requests are not billed. Pricing does not vary with page difficulty, so there is no render, stealth or proxy option to set.
 

{hydrafetch-0.3.0 → hydrafetch-0.5.0}/README.md

@@ -25,7 +25,7 @@ page = hf.scrape("https://example.com/article")
 print(page["markdown"])
 ```
 
-Create a key at [app.hydrafetch.com](https://app.hydrafetch.com). The constructor reads `HYDRAFETCH_API_KEY` when no key is passed.
+Copy your key from [app.hydrafetch.com](https://app.hydrafetch.com). The constructor reads `HYDRAFETCH_API_KEY` when no key is passed.
 
 Both clients are context managers, which closes the connection pool deterministically:
 
@@ -142,6 +142,29 @@ for r in res["results"]:
     print(((r.get("data") or {}).get("markdown") or "")[:500])
 ```
 
+## Jobs
+
+Search open jobs collected from company career sites and hiring platforms, by the words in the job title:
+
+```python
+jobs = hf.search_jobs("data engineer", location="Berlin", postedWithinDays=14, limit=20)
+
+for job in jobs:
+    print(job["title"], job["company"], job["location"], job["url"])
+```
+
+See what changed in a company's hiring since a date: what is open now, what opened and what closed, by department, seniority and location, with the jobs themselves:
+
+```python
+[acme] = hf.hiring_changes("acme.com", "2026-10-01")
+
+print(acme["totals"])  # {"open": 42, "opened": 6, "closed": 3}
+for job in acme["opened"]:
+    print(job["title"], job["seniority"], job["firstSeenAt"])
+```
+
+A search costs 1 credit per 10 jobs returned, and an empty one is free. Hiring changes cost 1 credit per company we have jobs for; companies we do not track yet come back empty and are free.
+
 ## Brand data
 
 ```python
@@ -153,6 +176,24 @@ hf.styleguide("https://stripe.com/pricing", maxAge=0)  # one page, read fresh
 
 For logos in a browser use [`@hydrafetch/client-sdk`](https://github.com/Hydrafetch/client-sdk) with a publishable key. Those bill against logo pulls rather than credits.
 
+## Rating results
+
+Tell us when a result was wrong, so it gets looked at. It is free, and rating the same request again replaces the earlier rating.
+
+```python
+page = hf.scrape("https://stripe.com/pricing")
+hf.rate_result(
+    "bad",
+    request_id=hf.last_request_id,
+    reasons=["missing_content"],
+    note="The enterprise tier is missing",
+)
+
+hf.rate_result("good", url="https://stripe.com/pricing")  # by URL, last 24 hours
+```
+
+Reasons are `missing_content`, `wrong_content`, `blocked`, `slow`, `formatting` and `other`.
+
 ## Async
 
 `AsyncHydrafetch` mirrors the same surface. Use it when several calls can run concurrently.
@@ -229,6 +270,8 @@ hf = Hydrafetch(
 | `markdown(url, **options)` | `str` | 1 |
 | `map(url, **options)` | links dict | 1 |
 | `search(query, **options)` | results dict | 1 + 1 per scraped result |
+| `search_jobs(query, **options)` | list of jobs | 1 per 10 jobs |
+| `hiring_changes(domains, since, **options)` | list of companies | 1 per company with jobs |
 | `extract(urls, **options)` | dict with `"results"` | 5 per URL |
 | `brand(domain)` | brand dict | 5 |
 | `logo(domain, **options)` | logo dict | 1 |
@@ -239,6 +282,7 @@ hf = Hydrafetch(
 | `batch(urls, **options)` | job dict, polled to completion | 1 per page |
 | `start_crawl`, `start_batch` | job id `str` | 1 per page |
 | `crawl_status(id)`, `batch_status(id)` | job dict | free |
+| `rate_result(rating, request_id=, url=, reasons=, note=)` | rating dict | free |
 
 Failed requests are not billed. Pricing does not vary with page difficulty, so there is no render, stealth or proxy option to set.
 

{hydrafetch-0.3.0 → hydrafetch-0.5.0}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "hydrafetch"
-version = "0.3.0"
+version = "0.5.0"
 description = "Official Python client for the Hydrafetch web data API. Turn any URL into clean Markdown and structured data."
 readme = "README.md"
 license = "MIT"

{hydrafetch-0.3.0 → hydrafetch-0.5.0}/src/hydrafetch/__init__.py

@@ -4,4 +4,4 @@ from ._client import AsyncHydrafetch, Hydrafetch
 from .errors import HydrafetchError, HydrafetchTimeout
 
 __all__ = ["AsyncHydrafetch", "Hydrafetch", "HydrafetchError", "HydrafetchTimeout"]
-__version__ = "0.1.0"
+__version__ = "0.5.0"

{hydrafetch-0.3.0 → hydrafetch-0.5.0}/src/hydrafetch/_client.py

@@ -4,6 +4,7 @@ import os
 import random
 import time
 from collections.abc import Iterable, Mapping
+from datetime import datetime
 from typing import Any, Callable, Literal, TypeVar
 
 import httpx
@@ -88,6 +89,31 @@ class _Base:
         self._base_url = base_url.rstrip("/")
         self._timeout = timeout
         self._max_retries = max_retries
+        self.last_request_id: str | None = None
+
+    def _rate_body(
+        self,
+        rating: str,
+        request_id: str | None,
+        url: str | None,
+        reasons: Iterable[str] | None,
+        note: str | None,
+    ) -> dict[str, Any]:
+        if request_id is None and url is None:
+            raise HydrafetchError(
+                "Pass request_id or url to say which result you are rating.",
+                code="VALIDATION_ERROR",
+                status=400,
+            )
+        return _drop_none(
+            {
+                "requestId": request_id,
+                "url": url,
+                "rating": rating,
+                "reasons": list(reasons) if reasons is not None else None,
+                "note": note,
+            }
+        )
 
     def _scrape_body(self, url: str, options: Mapping[str, Any]) -> dict[str, Any]:
         return {"url": url, **_drop_none(options)}
@@ -105,6 +131,13 @@ class _Base:
             body["schema"] = to_json_schema(body["schema"])
         return {"urls": url_list, **body}
 
+    def _changes_body(
+        self, domains: str | Iterable[str], since: str | datetime, options: Mapping[str, Any]
+    ) -> dict[str, Any]:
+        domain_list = [domains] if isinstance(domains, str) else list(domains)
+        when = since.isoformat() if isinstance(since, datetime) else since
+        return {"domains": domain_list, "since": when, **_drop_none(options)}
+
     def _job_id(self, payload: Any, *keys: str) -> str:
         if isinstance(payload, dict):
             for key in (*keys, "id"):
@@ -150,6 +183,7 @@ class Hydrafetch(_Base):
                     "or use the crawl and batch job endpoints for long work."
                 ) from exc
 
+            self.last_request_id = response.headers.get("x-request-id") or self.last_request_id
             try:
                 return _unwrap(response)
             except HydrafetchError as err:
@@ -162,12 +196,36 @@ class Hydrafetch(_Base):
     def scrape(self, url: str, **options: Any) -> dict[str, Any]:
         return self._request("POST", "/v1/web/scrape", json=self._scrape_body(url, options))
 
+    def rate_result(
+        self,
+        rating: str,
+        *,
+        request_id: str | None = None,
+        url: str | None = None,
+        reasons: Iterable[str] | None = None,
+        note: str | None = None,
+    ) -> dict[str, Any]:
+        body = self._rate_body(rating, request_id, url, reasons, note)
+        return self._request("POST", "/v1/web/feedback", json=body)
+
     def map(self, url: str, **options: Any) -> dict[str, Any]:
         return self._request("POST", "/v1/web/map", json=self._scrape_body(url, options))
 
     def search(self, query: str, **options: Any) -> dict[str, Any]:
         return self._request("POST", "/v1/web/search", json={"query": query, **_drop_none(options)})
 
+    def search_jobs(self, query: str, **options: Any) -> list[dict[str, Any]]:
+        return self._request(
+            "POST", "/v1/web/index/jobs/search", json={"query": query, **_drop_none(options)}
+        )
+
+    def hiring_changes(
+        self, domains: str | Iterable[str], since: str | datetime, **options: Any
+    ) -> list[dict[str, Any]]:
+        return self._request(
+            "POST", "/v1/web/index/jobs/changes", json=self._changes_body(domains, since, options)
+        )
+
     def extract(self, urls: str | Iterable[str], **options: Any) -> Any:
         return self._request("POST", "/v1/web/extract", json=self._extract_body(urls, options))
 
@@ -295,6 +353,7 @@ class AsyncHydrafetch(_Base):
                     "or use the crawl and batch job endpoints for long work."
                 ) from exc
 
+            self.last_request_id = response.headers.get("x-request-id") or self.last_request_id
             try:
                 return _unwrap(response)
             except HydrafetchError as err:
@@ -307,6 +366,18 @@ class AsyncHydrafetch(_Base):
     async def scrape(self, url: str, **options: Any) -> dict[str, Any]:
         return await self._request("POST", "/v1/web/scrape", json=self._scrape_body(url, options))
 
+    async def rate_result(
+        self,
+        rating: str,
+        *,
+        request_id: str | None = None,
+        url: str | None = None,
+        reasons: Iterable[str] | None = None,
+        note: str | None = None,
+    ) -> dict[str, Any]:
+        body = self._rate_body(rating, request_id, url, reasons, note)
+        return await self._request("POST", "/v1/web/feedback", json=body)
+
     async def map(self, url: str, **options: Any) -> dict[str, Any]:
         return await self._request("POST", "/v1/web/map", json=self._scrape_body(url, options))
 
@@ -315,6 +386,18 @@ class AsyncHydrafetch(_Base):
             "POST", "/v1/web/search", json={"query": query, **_drop_none(options)}
         )
 
+    async def search_jobs(self, query: str, **options: Any) -> list[dict[str, Any]]:
+        return await self._request(
+            "POST", "/v1/web/index/jobs/search", json={"query": query, **_drop_none(options)}
+        )
+
+    async def hiring_changes(
+        self, domains: str | Iterable[str], since: str | datetime, **options: Any
+    ) -> list[dict[str, Any]]:
+        return await self._request(
+            "POST", "/v1/web/index/jobs/changes", json=self._changes_body(domains, since, options)
+        )
+
     async def extract(self, urls: str | Iterable[str], **options: Any) -> Any:
         return await self._request(
             "POST", "/v1/web/extract", json=self._extract_body(urls, options)

{hydrafetch-0.3.0 → hydrafetch-0.5.0}/tests/test_client.py

@@ -1,6 +1,7 @@
 from __future__ import annotations
 
 import json
+from datetime import datetime, timezone
 from typing import Any, Optional
 
 import httpx
@@ -256,3 +257,71 @@ def test_extract_rejects_a_recursive_model_rather_than_sending_a_ref():
     with pytest.raises(HydrafetchError) as err:
         client.extract("https://example.com", schema=Node)
     assert err.value.code == "SCHEMA_CONVERSION_FAILED"
+
+
+def test_rate_result_posts_the_rating_for_the_last_request() -> None:
+    seen: list[httpx.Request] = []
+
+    def handler(request: httpx.Request) -> httpx.Response:
+        seen.append(request)
+        if request.url.path == "/v1/web/feedback":
+            return ok({"success": True, "data": {"id": "f1", "requestId": "r1", "rating": "bad"}})
+        return httpx.Response(
+            200, json={"success": True, "data": {}}, headers={"x-request-id": "r1"}
+        )
+
+    client = make_client(handler)
+    client.scrape("https://a.com")
+    assert client.last_request_id == "r1"
+
+    out = client.rate_result(
+        "bad", request_id=client.last_request_id, reasons=["missing_content"], note="no prices"
+    )
+
+    assert out == {"id": "f1", "requestId": "r1", "rating": "bad"}
+    assert json.loads(seen[-1].content) == {
+        "requestId": "r1",
+        "rating": "bad",
+        "reasons": ["missing_content"],
+        "note": "no prices",
+    }
+
+
+def test_rate_result_can_rate_by_url_and_needs_a_target() -> None:
+    rec = Recorder({"success": True, "data": {"id": "f2", "requestId": "r2", "rating": "good"}})
+    client = make_client(rec)
+    client.rate_result("good", url="https://a.com")
+    assert json.loads(rec.last.content) == {"url": "https://a.com", "rating": "good"}
+    with pytest.raises(HydrafetchError):
+        client.rate_result("good")
+
+
+def test_search_jobs_posts_the_query_and_returns_the_list() -> None:
+    job = {"title": "Data Engineer", "domain": "acme.com", "board": "greenhouse"}
+    rec = Recorder({"success": True, "data": [job]})
+    client = make_client(rec)
+    jobs = client.search_jobs("data engineer", location="Berlin", limit=20, remoteOnly=None)
+    assert jobs == [job]
+    assert rec.last.url.path == "/v1/web/index/jobs/search"
+    assert json.loads(rec.last.content) == {
+        "query": "data engineer",
+        "location": "Berlin",
+        "limit": 20,
+    }
+
+
+def test_hiring_changes_takes_one_domain_or_many_and_a_datetime() -> None:
+    rec = Recorder({"success": True, "data": []})
+    client = make_client(rec)
+    client.hiring_changes("stripe.com", datetime(2026, 10, 1, tzinfo=timezone.utc))
+    assert rec.last.url.path == "/v1/web/index/jobs/changes"
+    assert json.loads(rec.last.content) == {
+        "domains": ["stripe.com"],
+        "since": "2026-10-01T00:00:00+00:00",
+    }
+    client.hiring_changes(["a.com", "b.com"], "2026-10-01", includeDescriptions=True)
+    assert json.loads(rec.last.content) == {
+        "domains": ["a.com", "b.com"],
+        "since": "2026-10-01",
+        "includeDescriptions": True,
+    }

{hydrafetch-0.3.0 → hydrafetch-0.5.0}/uv.lock

@@ -75,11 +75,11 @@ wheels = [
 
 [[package]]
 name = "certifi"
-version = "2026.7.22"
+version = "2026.10.19"
 source = { registry = "https://pypi.org/simple" }
-sdist = { url = "https://files.pythonhosted.org/packages/a3/c2/24167ea9858356b47a87a50d39908bfdb72ceeefe0041586e704e5376b3a/certifi-2026.7.22.tar.gz", hash = "sha256:741e2c3b351ddf169a738da9f2c048608ff7f2c5cc02f1ebc6b118bb090d5d55", size = 138112, upload-time = "2026-07-22T03:35:12.644Z" }
+sdist = { url = "https://files.pythonhosted.org/packages/a6/bd/1436c50cc46699de0230fbaacc1d1de7bfec413176099949e9d5112e88f2/certifi-2026.10.19.tar.gz", hash = "sha256:035c1e85572b141bf1c3a3eff0e33a8eb74917522f2559075ff8d2fea780a1ae", size = 137598, upload-time = "2026-10-20T02:24:16.604Z" }
 wheels = [
-    { url = "https://files.pythonhosted.org/packages/0b/a7/71ac2cff56fec219ed242bb11b8efb69fcc4bec75db06fb7bfe35de520e6/certifi-2026.7.22-py3-none-any.whl", hash = "sha256:62f22742b58a1a33014a2b6b706588a8d7e2a88ae7bd1a6ebe8c992928483775", size = 136983, upload-time = "2026-07-22T03:35:11.276Z" },
+    { url = "https://files.pythonhosted.org/packages/c4/51/29046e48f693c54e5b7412216d447a1d8362c9653148d98c02cdf65fa733/certifi-2026.10.19-py3-none-any.whl", hash = "sha256:42d35340cc5b9ba78e818ddbff0c5b1c2b779de448a340fd1b989f5fa8670e1b", size = 136464, upload-time = "2026-10-20T02:24:15.072Z" },
 ]
 
 [[package]]
@@ -143,7 +143,7 @@ wheels = [
 
 [[package]]
 name = "hydrafetch"
-version = "0.3.0"
+version = "0.5.0"
 source = { editable = "." }
 dependencies = [
     { name = "httpx" },