jevaro-server 0.1.0__tar.gz

jevaro_server-0.1.0/LICENSE

@@ -0,0 +1,202 @@
+
+                                 Apache License
+                           Version 2.0, January 2004
+                        http://www.apache.org/licenses/
+
+   TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
+
+   1. Definitions.
+
+      "License" shall mean the terms and conditions for use, reproduction,
+      and distribution as defined by Sections 1 through 9 of this document.
+
+      "Licensor" shall mean the copyright owner or entity authorized by
+      the copyright owner that is granting the License.
+
+      "Legal Entity" shall mean the union of the acting entity and all
+      other entities that control, are controlled by, or are under common
+      control with that entity. For the purposes of this definition,
+      "control" means (i) the power, direct or indirect, to cause the
+      direction or management of such entity, whether by contract or
+      otherwise, or (ii) ownership of fifty percent (50%) or more of the
+      outstanding shares, or (iii) beneficial ownership of such entity.
+
+      "You" (or "Your") shall mean an individual or Legal Entity
+      exercising permissions granted by this License.
+
+      "Source" form shall mean the preferred form for making modifications,
+      including but not limited to software source code, documentation
+      source, and configuration files.
+
+      "Object" form shall mean any form resulting from mechanical
+      transformation or translation of a Source form, including but
+      not limited to compiled object code, generated documentation,
+      and conversions to other media types.
+
+      "Work" shall mean the work of authorship, whether in Source or
+      Object form, made available under the License, as indicated by a
+      copyright notice that is included in or attached to the work
+      (an example is provided in the Appendix below).
+
+      "Derivative Works" shall mean any work, whether in Source or Object
+      form, that is based on (or derived from) the Work and for which the
+      editorial revisions, annotations, elaborations, or other modifications
+      represent, as a whole, an original work of authorship. For the purposes
+      of this License, Derivative Works shall not include works that remain
+      separable from, or merely link (or bind by name) to the interfaces of,
+      the Work and Derivative Works thereof.
+
+      "Contribution" shall mean any work of authorship, including
+      the original version of the Work and any modifications or additions
+      to that Work or Derivative Works thereof, that is intentionally
+      submitted to Licensor for inclusion in the Work by the copyright owner
+      or by an individual or Legal Entity authorized to submit on behalf of
+      the copyright owner. For the purposes of this definition, "submitted"
+      means any form of electronic, verbal, or written communication sent
+      to the Licensor or its representatives, including but not limited to
+      communication on electronic mailing lists, source code control systems,
+      and issue tracking systems that are managed by, or on behalf of, the
+      Licensor for the purpose of discussing and improving the Work, but
+      excluding communication that is conspicuously marked or otherwise
+      designated in writing by the copyright owner as "Not a Contribution."
+
+      "Contributor" shall mean Licensor and any individual or Legal Entity
+      on behalf of whom a Contribution has been received by Licensor and
+      subsequently incorporated within the Work.
+
+   2. Grant of Copyright License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      copyright license to reproduce, prepare Derivative Works of,
+      publicly display, publicly perform, sublicense, and distribute the
+      Work and such Derivative Works in Source or Object form.
+
+   3. Grant of Patent License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      (except as stated in this section) patent license to make, have made,
+      use, offer to sell, sell, import, and otherwise transfer the Work,
+      where such license applies only to those patent claims licensable
+      by such Contributor that are necessarily infringed by their
+      Contribution(s) alone or by combination of their Contribution(s)
+      with the Work to which such Contribution(s) was submitted. If You
+      institute patent litigation against any entity (including a
+      cross-claim or counterclaim in a lawsuit) alleging that the Work
+      or a Contribution incorporated within the Work constitutes direct
+      or contributory patent infringement, then any patent licenses
+      granted to You under this License for that Work shall terminate
+      as of the date such litigation is filed.
+
+   4. Redistribution. You may reproduce and distribute copies of the
+      Work or Derivative Works thereof in any medium, with or without
+      modifications, and in Source or Object form, provided that You
+      meet the following conditions:
+
+      (a) You must give any other recipients of the Work or
+          Derivative Works a copy of this License; and
+
+      (b) You must cause any modified files to carry prominent notices
+          stating that You changed the files; and
+
+      (c) You must retain, in the Source form of any Derivative Works
+          that You distribute, all copyright, patent, trademark, and
+          attribution notices from the Source form of the Work,
+          excluding those notices that do not pertain to any part of
+          the Derivative Works; and
+
+      (d) If the Work includes a "NOTICE" text file as part of its
+          distribution, then any Derivative Works that You distribute must
+          include a readable copy of the attribution notices contained
+          within such NOTICE file, excluding those notices that do not
+          pertain to any part of the Derivative Works, in at least one
+          of the following places: within a NOTICE text file distributed
+          as part of the Derivative Works; within the Source form or
+          documentation, if provided along with the Derivative Works; or,
+          within a display generated by the Derivative Works, if and
+          wherever such third-party notices normally appear. The contents
+          of the NOTICE file are for informational purposes only and
+          do not modify the License. You may add Your own attribution
+          notices within Derivative Works that You distribute, alongside
+          or as an addendum to the NOTICE text from the Work, provided
+          that such additional attribution notices cannot be construed
+          as modifying the License.
+
+      You may add Your own copyright statement to Your modifications and
+      may provide additional or different license terms and conditions
+      for use, reproduction, or distribution of Your modifications, or
+      for any such Derivative Works as a whole, provided Your use,
+      reproduction, and distribution of the Work otherwise complies with
+      the conditions stated in this License.
+
+   5. Submission of Contributions. Unless You explicitly state otherwise,
+      any Contribution intentionally submitted for inclusion in the Work
+      by You to the Licensor shall be under the terms and conditions of
+      this License, without any additional terms or conditions.
+      Notwithstanding the above, nothing herein shall supersede or modify
+      the terms of any separate license agreement you may have executed
+      with Licensor regarding such Contributions.
+
+   6. Trademarks. This License does not grant permission to use the trade
+      names, trademarks, service marks, or product names of the Licensor,
+      except as required for reasonable and customary use in describing the
+      origin of the Work and reproducing the content of the NOTICE file.
+
+   7. Disclaimer of Warranty. Unless required by applicable law or
+      agreed to in writing, Licensor provides the Work (and each
+      Contributor provides its Contributions) on an "AS IS" BASIS,
+      WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+      implied, including, without limitation, any warranties or conditions
+      of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
+      PARTICULAR PURPOSE. You are solely responsible for determining the
+      appropriateness of using or redistributing the Work and assume any
+      risks associated with Your exercise of permissions under this License.
+
+   8. Limitation of Liability. In no event and under no legal theory,
+      whether in tort (including negligence), contract, or otherwise,
+      unless required by applicable law (such as deliberate and grossly
+      negligent acts) or agreed to in writing, shall any Contributor be
+      liable to You for damages, including any direct, indirect, special,
+      incidental, or consequential damages of any character arising as a
+      result of this License or out of the use or inability to use the
+      Work (including but not limited to damages for loss of goodwill,
+      work stoppage, computer failure or malfunction, or any and all
+      other commercial damages or losses), even if such Contributor
+      has been advised of the possibility of such damages.
+
+   9. Accepting Warranty or Additional Liability. While redistributing
+      the Work or Derivative Works thereof, You may choose to offer,
+      and charge a fee for, acceptance of support, warranty, indemnity,
+      or other liability obligations and/or rights consistent with this
+      License. However, in accepting such obligations, You may act only
+      on Your own behalf and on Your sole responsibility, not on behalf
+      of any other Contributor, and only if You agree to indemnify,
+      defend, and hold each Contributor harmless for any liability
+      incurred by, or claims asserted against, such Contributor by reason
+      of your accepting any such warranty or additional liability.
+
+   END OF TERMS AND CONDITIONS
+
+   APPENDIX: How to apply the Apache License to your work.
+
+      To apply the Apache License to your work, attach the following
+      boilerplate notice, with the fields enclosed by brackets "[]"
+      replaced with your own identifying information. (Don't include
+      the brackets!)  The text should be enclosed in the appropriate
+      comment syntax for the file format. We also recommend that a
+      file or class name and description of purpose be included on the
+      same "printed page" as the copyright notice for easier
+      identification within third-party archives.
+
+   Copyright [yyyy] [name of copyright owner]
+
+   Licensed under the Apache License, Version 2.0 (the "License");
+   you may not use this file except in compliance with the License.
+   You may obtain a copy of the License at
+
+       http://www.apache.org/licenses/LICENSE-2.0
+
+   Unless required by applicable law or agreed to in writing, software
+   distributed under the License is distributed on an "AS IS" BASIS,
+   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+   See the License for the specific language governing permissions and
+   limitations under the License.

jevaro_server-0.1.0/MANIFEST.in

@@ -0,0 +1 @@
+recursive-include tests *.py

jevaro_server-0.1.0/NOTICE

@@ -0,0 +1,4 @@
+Jevaro
+Copyright 2026 Columnar Technologies Inc.
+
+Licensed under the Apache License, Version 2.0.

jevaro_server-0.1.0/PKG-INFO

@@ -0,0 +1,96 @@
+Metadata-Version: 2.4
+Name: jevaro-server
+Version: 0.1.0
+Summary: A small TypeSafe-to-Arrow streaming proxy
+Author: Columnar Technologies Inc.
+License-Expression: Apache-2.0
+Project-URL: Homepage, https://github.com/columnar-tech/jevaro
+Project-URL: Documentation, https://github.com/columnar-tech/jevaro/blob/main/jevaro-server/README.md
+Project-URL: Repository, https://github.com/columnar-tech/jevaro
+Project-URL: Issues, https://github.com/columnar-tech/jevaro/issues
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+License-File: LICENSE
+License-File: NOTICE
+Requires-Dist: fastapi<1,>=0.115
+Requires-Dist: uvicorn<1,>=0.30
+Requires-Dist: typesafe-sdk==0.7.2
+Requires-Dist: pyarrow==25.0.1
+Dynamic: license-file
+
+# Jevaro server
+
+A Python proxy that evaluates states with TypeSafe and streams the answers
+as Arrow. See the [quickstart](https://github.com/columnar-tech/jevaro/blob/main/docs/quickstart.md)
+for an example using both SDKs.
+
+## Run
+
+Requires Python 3.11+.
+
+```sh
+python3 -m venv .venv
+.venv/bin/python -m pip install jevaro-server
+export TYPESAFE_API_KEY="your-api-key"
+.venv/bin/jevaro-server
+```
+
+The default address is `http://127.0.0.1:8000`. Change it with `--host` and
+`--port`. `python -m jevaro_server` runs the same command in an activated
+environment.
+
+## Configuration
+
+| Setting | Default | Purpose |
+| --- | --- | --- |
+| `--host` | `127.0.0.1` | Listen address |
+| `--port` | `8000` | Listen port |
+| `TYPESAFE_API_KEY` | Unset | Upstream key when a request has no bearer token |
+| `TYPESAFE_UPSTREAM_URL` | `https://api.typesafe.ai` | Upstream API base URL |
+| `JEVARO_CONCURRENCY` | `8` | Maximum pending calls/results per incoming request; positive integer |
+
+An incoming `Authorization: Bearer <key>` overrides the server's key and is
+forwarded to TypeSafe. A request without that header uses the server's key.
+Jevaro has no separate client access control: keep it local, or put
+authentication in front of a shared server.
+
+`TYPESAFE_BASE_URL` is an SDK setting for reaching Jevaro. The server uses
+`TYPESAFE_UPSTREAM_URL` to reach TypeSafe.
+
+## Streaming
+
+`POST /v1/systemone` accepts `state` or a nonempty `states` array and a map of
+questions. After validating the request, the server sends the schema and an
+empty batch before starting upstream calls. Each later batch contains one
+answer row, in input order.
+
+The response uses `application/vnd.apache.arrow.stream` and has no
+`Content-Length`. It sets `X-Accel-Buffering: no`; configure any reverse proxy
+to pass the stream without buffering.
+
+See the [HTTP API](https://github.com/columnar-tech/jevaro/blob/main/docs/http-api.md)
+and [Arrow schema](https://github.com/columnar-tech/jevaro/blob/main/docs/arrow-schema.md)
+for the request and result formats.
+
+## Limits
+
+The full JSON request is held in memory. Pending calls and completed answers
+waiting for their turn are bounded by `JEVARO_CONCURRENCY`. A slow earlier
+call delays later rows. Closing the stream cancels pending work; calls already
+processed upstream still count as API use.
+
+Retries use the official TypeSafe SDK's default policy, including backoff for
+429 and 529 responses. Concurrency is per incoming request. This version has
+no shared account rate limiter.
+
+If an upstream call fails after retries, the HTTP stream aborts. Its status
+is already 200 at that point. Readers must consume the stream successfully
+before treating the result as complete.
+
+## Development
+
+See [Contributing](https://github.com/columnar-tech/jevaro/blob/main/CONTRIBUTING.md)
+for setup and tests. The server is independent of the earlier demo scripts.
+
+[Apache-2.0](https://github.com/columnar-tech/jevaro/blob/main/LICENSE).
+Copyright 2026 Columnar Technologies Inc.

jevaro_server-0.1.0/README.md

@@ -0,0 +1,76 @@
+# Jevaro server
+
+A Python proxy that evaluates states with TypeSafe and streams the answers
+as Arrow. See the [quickstart](https://github.com/columnar-tech/jevaro/blob/main/docs/quickstart.md)
+for an example using both SDKs.
+
+## Run
+
+Requires Python 3.11+.
+
+```sh
+python3 -m venv .venv
+.venv/bin/python -m pip install jevaro-server
+export TYPESAFE_API_KEY="your-api-key"
+.venv/bin/jevaro-server
+```
+
+The default address is `http://127.0.0.1:8000`. Change it with `--host` and
+`--port`. `python -m jevaro_server` runs the same command in an activated
+environment.
+
+## Configuration
+
+| Setting | Default | Purpose |
+| --- | --- | --- |
+| `--host` | `127.0.0.1` | Listen address |
+| `--port` | `8000` | Listen port |
+| `TYPESAFE_API_KEY` | Unset | Upstream key when a request has no bearer token |
+| `TYPESAFE_UPSTREAM_URL` | `https://api.typesafe.ai` | Upstream API base URL |
+| `JEVARO_CONCURRENCY` | `8` | Maximum pending calls/results per incoming request; positive integer |
+
+An incoming `Authorization: Bearer <key>` overrides the server's key and is
+forwarded to TypeSafe. A request without that header uses the server's key.
+Jevaro has no separate client access control: keep it local, or put
+authentication in front of a shared server.
+
+`TYPESAFE_BASE_URL` is an SDK setting for reaching Jevaro. The server uses
+`TYPESAFE_UPSTREAM_URL` to reach TypeSafe.
+
+## Streaming
+
+`POST /v1/systemone` accepts `state` or a nonempty `states` array and a map of
+questions. After validating the request, the server sends the schema and an
+empty batch before starting upstream calls. Each later batch contains one
+answer row, in input order.
+
+The response uses `application/vnd.apache.arrow.stream` and has no
+`Content-Length`. It sets `X-Accel-Buffering: no`; configure any reverse proxy
+to pass the stream without buffering.
+
+See the [HTTP API](https://github.com/columnar-tech/jevaro/blob/main/docs/http-api.md)
+and [Arrow schema](https://github.com/columnar-tech/jevaro/blob/main/docs/arrow-schema.md)
+for the request and result formats.
+
+## Limits
+
+The full JSON request is held in memory. Pending calls and completed answers
+waiting for their turn are bounded by `JEVARO_CONCURRENCY`. A slow earlier
+call delays later rows. Closing the stream cancels pending work; calls already
+processed upstream still count as API use.
+
+Retries use the official TypeSafe SDK's default policy, including backoff for
+429 and 529 responses. Concurrency is per incoming request. This version has
+no shared account rate limiter.
+
+If an upstream call fails after retries, the HTTP stream aborts. Its status
+is already 200 at that point. Readers must consume the stream successfully
+before treating the result as complete.
+
+## Development
+
+See [Contributing](https://github.com/columnar-tech/jevaro/blob/main/CONTRIBUTING.md)
+for setup and tests. The server is independent of the earlier demo scripts.
+
+[Apache-2.0](https://github.com/columnar-tech/jevaro/blob/main/LICENSE).
+Copyright 2026 Columnar Technologies Inc.

jevaro_server-0.1.0/pyproject.toml

@@ -0,0 +1,31 @@
+[build-system]
+requires = ["setuptools>=77.0.3"]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "jevaro-server"
+version = "0.1.0"
+description = "A small TypeSafe-to-Arrow streaming proxy"
+readme = "README.md"
+authors = [{name = "Columnar Technologies Inc."}]
+license = "Apache-2.0"
+license-files = ["LICENSE", "NOTICE"]
+requires-python = ">=3.11"
+dependencies = [
+  "fastapi>=0.115,<1",
+  "uvicorn>=0.30,<1",
+  "typesafe-sdk==0.7.2",
+  "pyarrow==25.0.1",
+]
+
+[project.urls]
+Homepage = "https://github.com/columnar-tech/jevaro"
+Documentation = "https://github.com/columnar-tech/jevaro/blob/main/jevaro-server/README.md"
+Repository = "https://github.com/columnar-tech/jevaro"
+Issues = "https://github.com/columnar-tech/jevaro/issues"
+
+[project.scripts]
+jevaro-server = "jevaro_server.__main__:main"
+
+[tool.setuptools.packages.find]
+where = ["src"]

jevaro_server-0.1.0/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

jevaro_server-0.1.0/src/jevaro_server/__init__.py

@@ -0,0 +1 @@
+"""Jevaro: TypeSafe questions in, ordered Arrow answers out."""

jevaro_server-0.1.0/src/jevaro_server/__main__.py

@@ -0,0 +1,15 @@
+import argparse
+
+import uvicorn
+
+
+def main():
+    parser = argparse.ArgumentParser(description="Run the Jevaro Arrow proxy")
+    parser.add_argument("--host", default="127.0.0.1")
+    parser.add_argument("--port", type=int, default=8000)
+    args = parser.parse_args()
+    uvicorn.run("jevaro_server.app:app", host=args.host, port=args.port)
+
+
+if __name__ == "__main__":
+    main()

jevaro_server-0.1.0/src/jevaro_server/app.py

@@ -0,0 +1,140 @@
+"""POST /v1/systemone: TypeSafe requests with state or a nonempty states array."""
+
+import asyncio
+import os
+from collections import deque
+from typing import Annotated
+
+import pyarrow as pa
+from fastapi import FastAPI, Header, HTTPException
+from fastapi.responses import StreamingResponse
+from pydantic import BaseModel, ConfigDict, Field, model_validator
+from typesafe_sdk import AsyncTypeSafeClient, Choice, JSONContent, Noul, Score
+
+from .arrow import StreamSink, answer_batch, schema_for
+
+MEDIA_TYPE = "application/vnd.apache.arrow.stream"
+Question = Annotated[Choice | Score | Noul, Field(discriminator="type")]
+
+
+class Evaluation(BaseModel):
+    model_config = ConfigDict(extra="forbid", allow_inf_nan=False)
+
+    state: JSONContent | None = None
+    states: list[JSONContent] | None = None
+    questions: dict[str, Question] = Field(min_length=1)
+    model: str = Field(default="jev-latest", min_length=1)
+
+    @model_validator(mode="after")
+    def validate_request(self):
+        singular = "state" in self.model_fields_set
+        plural = "states" in self.model_fields_set
+        if singular == plural:
+            raise ValueError("Supply exactly one of state or states")
+        if singular and self.state is None:
+            raise ValueError("state must be a string, object, or array")
+        if plural and not self.states:
+            raise ValueError("states must be a nonempty array")
+        for question in self.questions.values():
+            if isinstance(question, Choice) and not 1 <= len(question.criteria) <= 255:
+                raise ValueError("Choice requires 1 to 255 options")
+            if isinstance(question, Score) and not 2 <= len(question.criteria) <= 10:
+                raise ValueError("Score requires 2 to 10 levels")
+        return self
+
+
+async def ordered_responses(client, states, questions, model, concurrency):
+    """A sliding window bounds running calls AND completed results awaiting their turn."""
+    remaining = iter(states)
+    pending = deque()
+
+    def submit():
+        try:
+            state = next(remaining)
+        except StopIteration:
+            return
+        pending.append(asyncio.create_task(
+            client.system_one(state=state, questions=questions, model=model)
+        ))
+
+    try:
+        for _ in range(min(concurrency, len(states))):
+            submit()
+        while pending:
+            # Keep the task in the deque while awaiting it, so cancellation catches it too.
+            response = await pending[0]
+            pending.popleft()
+            yield response
+            submit()
+    finally:
+        for task in pending:
+            task.cancel()
+        await asyncio.gather(*pending, return_exceptions=True)
+
+
+def create_app(*, client_factory=AsyncTypeSafeClient, concurrency=None):
+    if concurrency is None:
+        concurrency = int(os.environ.get("JEVARO_CONCURRENCY", "8"))
+    if isinstance(concurrency, bool) or not isinstance(concurrency, int) or concurrency < 1:
+        raise ValueError("JEVARO_CONCURRENCY must be a positive integer")
+    app = FastAPI(title="Jevaro", version="0.1.0")
+
+    @app.post("/v1/systemone", response_class=StreamingResponse)
+    async def system_one(
+        body: Evaluation, authorization: Annotated[str | None, Header()] = None,
+    ):
+        if authorization is not None:
+            scheme, _, api_key = authorization.partition(" ")
+            if scheme.lower() != "bearer" or not api_key.strip():
+                raise HTTPException(401, "Expected Authorization: Bearer <TYPESAFE_API_KEY>")
+            api_key = api_key.strip()
+        else:
+            api_key = os.environ.get("TYPESAFE_API_KEY")
+        if not api_key:
+            raise HTTPException(401, "Set TYPESAFE_API_KEY or send an Authorization bearer token")
+
+        states = body.states if body.states is not None else [body.state]
+        try:
+            schema = schema_for(body.questions)
+        except (ValueError, TypeError) as error:
+            raise HTTPException(422, str(error)) from error
+
+        async def stream():
+            sink = StreamSink()
+            writer = pa.ipc.new_stream(sink, schema)
+            try:
+                # Arrow emits the schema on the first write. Flush a zero-row batch
+                # before constructing the upstream client or starting any API calls.
+                writer.write_batch(pa.RecordBatch.from_arrays(
+                    [field.type.array([]) for field in schema], schema=schema,
+                ))
+                yield sink.drain()
+                async with client_factory(
+                    api_key=api_key,
+                    base_url=os.environ.get("TYPESAFE_UPSTREAM_URL", "https://api.typesafe.ai"),
+                ) as client:
+                    responses = ordered_responses(
+                        client, states, body.questions, body.model, concurrency,
+                    )
+                    try:
+                        async for response in responses:
+                            writer.write_batch(answer_batch(schema, response))
+                            yield sink.drain()
+                    finally:
+                        await responses.aclose()
+                writer.close()
+                yield sink.drain()  # Normal completion alone sends the Arrow EOS marker.
+            finally:
+                # On failure/disconnect, discard any buffered EOS; the HTTP stream aborts.
+                writer.close()
+                sink.close()
+
+        return StreamingResponse(stream(), media_type=MEDIA_TYPE, headers={
+            "X-Accel-Buffering": "no",
+            "X-Jevaro-Row-Count": str(len(states)),
+        })
+
+    return app
+
+
+app = create_app()

jevaro_server-0.1.0/src/jevaro_server/arrow.py

@@ -0,0 +1,160 @@
+"""Compact answer-only Arrow schema. No original prompts or requested model."""
+
+import io
+import json
+
+import pyarrow as pa
+from typesafe_sdk import Choice, ChoiceAnswer, Noul, NoulAnswer, Score, ScoreAnswer
+
+
+def required(name, data_type):
+    return pa.field(name, data_type, nullable=False)
+
+
+def probabilities(size):
+    return pa.list_(required("item", pa.float64()), size)
+
+
+class AnswerType(pa.ExtensionType):
+    def __init__(self, storage, **metadata):
+        self._metadata = json.dumps(
+            metadata, ensure_ascii=False,
+            separators=(",", ":"), allow_nan=False,
+        ).encode()
+        super().__init__(storage, f"jevaro.{self.kind}")
+
+    def __arrow_ext_serialize__(self):
+        return self._metadata
+
+    @classmethod
+    def __arrow_ext_deserialize__(cls, storage, serialized):
+        metadata = json.loads(serialized)
+        result = cls(**metadata)
+        if not storage.equals(result.storage_type):
+            raise ValueError("Storage does not match Jevaro extension metadata")
+        return result
+
+    def __eq__(self, other):
+        if not isinstance(other, AnswerType):
+            return NotImplemented
+        return (type(self) is type(other) and self.storage_type == other.storage_type
+                and self._metadata == other._metadata)
+
+    def __ne__(self, other):
+        equal = self.__eq__(other)
+        return NotImplemented if equal is NotImplemented else not equal
+
+    def __hash__(self):
+        return hash((type(self), self.storage_type, self._metadata))
+
+    def array(self, answers):
+        storage = pa.array([self.pack(answer) for answer in answers], self.storage_type)
+        return pa.ExtensionArray.from_storage(self, storage)
+
+
+class ChoiceType(AnswerType):
+    kind = "choice"
+
+    def __init__(self, labels):
+        self.labels = tuple(labels)
+        if (not 1 <= len(self.labels) <= 255
+                or any(not isinstance(label, str) for label in self.labels)
+                or len(set(self.labels)) != len(self.labels)):
+            raise ValueError("Choice requires 1 to 255 unique string labels")
+        super().__init__(pa.struct([
+            required("choice", pa.uint8()),
+            required("confidence", pa.float64()),
+            required("probabilities", probabilities(len(self.labels))),
+        ]), labels=self.labels)
+
+    def pack(self, answer):
+        if not isinstance(answer, ChoiceAnswer) or set(answer.probabilities) != set(self.labels):
+            raise ValueError("Choice answer does not match the schema")
+        return {
+            "choice": self.labels.index(answer.choice),
+            "confidence": answer.confidence,
+            "probabilities": [answer.probabilities[label] for label in self.labels],
+        }
+
+
+class ScoreType(AnswerType):
+    kind = "score"
+
+    def __init__(self, legend):
+        if not isinstance(legend, (list, tuple)) or not 2 <= len(legend) <= 10:
+            raise ValueError("Score requires 2 to 10 levels")
+        super().__init__(pa.struct([
+            required("score", pa.float64()),
+            required("confidence", pa.float64()),
+            required("probabilities", probabilities(len(legend))),
+        ]), legend=legend)
+
+    def pack(self, answer):
+        legend = dict(enumerate(json.loads(self._metadata)["legend"]))
+        if (not isinstance(answer, ScoreAnswer) or answer.legend != legend
+                or set(answer.probabilities) != set(legend)):
+            raise ValueError("Score answer does not match the schema")
+        return {
+            "score": answer.score,
+            "confidence": answer.confidence,
+            "probabilities": [answer.probabilities[level] for level in legend],
+        }
+
+
+class NoulType(AnswerType):
+    kind = "noul"
+
+    def __init__(self):
+        super().__init__(pa.float64())
+
+    def pack(self, answer):
+        if not isinstance(answer, NoulAnswer):
+            raise ValueError("Expected a Noul answer")
+        return answer.noul
+
+
+def schema_for(questions):
+    def answer_type(question):
+        if isinstance(question, Choice):
+            return ChoiceType(question.criteria)
+        if isinstance(question, Score):
+            return ScoreType(question.criteria)
+        if isinstance(question, Noul):
+            return NoulType()
+        raise TypeError("Unsupported question type")
+
+    return pa.schema([required(name, answer_type(q)) for name, q in questions.items()])
+
+
+def answer_batch(schema, response):
+    if set(response.answers) != set(schema.names):
+        raise ValueError("Response answer names do not match the questions")
+    return pa.RecordBatch.from_arrays(
+        [field.type.array([response.answers[field.name]]) for field in schema], schema=schema,
+    )
+
+
+class StreamSink(io.RawIOBase):
+    """Keep only the bytes since the last HTTP chunk, not the whole IPC stream."""
+
+    def __init__(self):
+        super().__init__()
+        self._chunks = []
+        self._position = 0
+
+    def writable(self):
+        return True
+
+    def tell(self):
+        return self._position
+
+    def write(self, data):
+        data = bytes(data)
+        self._chunks.append(data)
+        self._position += len(data)
+        return len(data)
+
+    def drain(self):
+        data = b"".join(self._chunks)
+        self._chunks.clear()
+        return data

jevaro_server-0.1.0/src/jevaro_server.egg-info/PKG-INFO

@@ -0,0 +1,96 @@
+Metadata-Version: 2.4
+Name: jevaro-server
+Version: 0.1.0
+Summary: A small TypeSafe-to-Arrow streaming proxy
+Author: Columnar Technologies Inc.
+License-Expression: Apache-2.0
+Project-URL: Homepage, https://github.com/columnar-tech/jevaro
+Project-URL: Documentation, https://github.com/columnar-tech/jevaro/blob/main/jevaro-server/README.md
+Project-URL: Repository, https://github.com/columnar-tech/jevaro
+Project-URL: Issues, https://github.com/columnar-tech/jevaro/issues
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+License-File: LICENSE
+License-File: NOTICE
+Requires-Dist: fastapi<1,>=0.115
+Requires-Dist: uvicorn<1,>=0.30
+Requires-Dist: typesafe-sdk==0.7.2
+Requires-Dist: pyarrow==25.0.1
+Dynamic: license-file
+
+# Jevaro server
+
+A Python proxy that evaluates states with TypeSafe and streams the answers
+as Arrow. See the [quickstart](https://github.com/columnar-tech/jevaro/blob/main/docs/quickstart.md)
+for an example using both SDKs.
+
+## Run
+
+Requires Python 3.11+.
+
+```sh
+python3 -m venv .venv
+.venv/bin/python -m pip install jevaro-server
+export TYPESAFE_API_KEY="your-api-key"
+.venv/bin/jevaro-server
+```
+
+The default address is `http://127.0.0.1:8000`. Change it with `--host` and
+`--port`. `python -m jevaro_server` runs the same command in an activated
+environment.
+
+## Configuration
+
+| Setting | Default | Purpose |
+| --- | --- | --- |
+| `--host` | `127.0.0.1` | Listen address |
+| `--port` | `8000` | Listen port |
+| `TYPESAFE_API_KEY` | Unset | Upstream key when a request has no bearer token |
+| `TYPESAFE_UPSTREAM_URL` | `https://api.typesafe.ai` | Upstream API base URL |
+| `JEVARO_CONCURRENCY` | `8` | Maximum pending calls/results per incoming request; positive integer |
+
+An incoming `Authorization: Bearer <key>` overrides the server's key and is
+forwarded to TypeSafe. A request without that header uses the server's key.
+Jevaro has no separate client access control: keep it local, or put
+authentication in front of a shared server.
+
+`TYPESAFE_BASE_URL` is an SDK setting for reaching Jevaro. The server uses
+`TYPESAFE_UPSTREAM_URL` to reach TypeSafe.
+
+## Streaming
+
+`POST /v1/systemone` accepts `state` or a nonempty `states` array and a map of
+questions. After validating the request, the server sends the schema and an
+empty batch before starting upstream calls. Each later batch contains one
+answer row, in input order.
+
+The response uses `application/vnd.apache.arrow.stream` and has no
+`Content-Length`. It sets `X-Accel-Buffering: no`; configure any reverse proxy
+to pass the stream without buffering.
+
+See the [HTTP API](https://github.com/columnar-tech/jevaro/blob/main/docs/http-api.md)
+and [Arrow schema](https://github.com/columnar-tech/jevaro/blob/main/docs/arrow-schema.md)
+for the request and result formats.
+
+## Limits
+
+The full JSON request is held in memory. Pending calls and completed answers
+waiting for their turn are bounded by `JEVARO_CONCURRENCY`. A slow earlier
+call delays later rows. Closing the stream cancels pending work; calls already
+processed upstream still count as API use.
+
+Retries use the official TypeSafe SDK's default policy, including backoff for
+429 and 529 responses. Concurrency is per incoming request. This version has
+no shared account rate limiter.
+
+If an upstream call fails after retries, the HTTP stream aborts. Its status
+is already 200 at that point. Readers must consume the stream successfully
+before treating the result as complete.
+
+## Development
+
+See [Contributing](https://github.com/columnar-tech/jevaro/blob/main/CONTRIBUTING.md)
+for setup and tests. The server is independent of the earlier demo scripts.
+
+[Apache-2.0](https://github.com/columnar-tech/jevaro/blob/main/LICENSE).
+Copyright 2026 Columnar Technologies Inc.

jevaro_server-0.1.0/src/jevaro_server.egg-info/SOURCES.txt

@@ -0,0 +1,18 @@
+LICENSE
+MANIFEST.in
+NOTICE
+README.md
+pyproject.toml
+src/jevaro_server/__init__.py
+src/jevaro_server/__main__.py
+src/jevaro_server/app.py
+src/jevaro_server/arrow.py
+src/jevaro_server.egg-info/PKG-INFO
+src/jevaro_server.egg-info/SOURCES.txt
+src/jevaro_server.egg-info/dependency_links.txt
+src/jevaro_server.egg-info/entry_points.txt
+src/jevaro_server.egg-info/requires.txt
+src/jevaro_server.egg-info/top_level.txt
+tests/fake_upstream.py
+tests/live_smoke.py
+tests/test_proxy.py

jevaro_server-0.1.0/src/jevaro_server.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

jevaro_server-0.1.0/src/jevaro_server.egg-info/entry_points.txt

@@ -0,0 +1,2 @@
+[console_scripts]
+jevaro-server = jevaro_server.__main__:main

jevaro_server-0.1.0/src/jevaro_server.egg-info/requires.txt

@@ -0,0 +1,4 @@
+fastapi<1,>=0.115
+uvicorn<1,>=0.30
+typesafe-sdk==0.7.2
+pyarrow==25.0.1

jevaro_server-0.1.0/src/jevaro_server.egg-info/top_level.txt

@@ -0,0 +1 @@
+jevaro_server

jevaro_server-0.1.0/tests/fake_upstream.py

@@ -0,0 +1,91 @@
+"""Offline test fixture: real TypeSafe SDK over a mocked upstream transport."""
+
+import asyncio
+import json
+import threading
+from collections import Counter
+
+import httpx2
+from typesafe_sdk import AsyncTypeSafeClient, RetryPolicy
+
+from jevaro_server.app import create_app
+
+
+class Upstream:
+    def __init__(self):
+        self.started = []
+        self.finished = []
+        self.cancelled = []
+        self.attempts = Counter()
+        self.active = 0
+        self.peak = 0
+        self.auth_matches = []
+        self.gate = threading.Event()
+
+    def client(self, **kwargs):
+        return AsyncTypeSafeClient(
+            **kwargs, transport=httpx2.MockTransport(self.handle),
+            retry=RetryPolicy(backoff_initial=0.001, backoff_jitter=0),
+        )
+
+    async def handle(self, request):
+        payload = json.loads(request.content)
+        state = payload["state"]
+        config = state if isinstance(state, dict) else {}
+        number = config.get("id", 0)
+        self.started.append(state)
+        self.auth_matches.append(request.headers.get("Authorization") == "Bearer jevaro-test-key")
+        self.attempts[number] += 1
+        self.active += 1
+        self.peak = max(self.peak, self.active)
+        try:
+            if config.get("gate"):
+                while not self.gate.is_set():
+                    await asyncio.sleep(0.005)
+            await asyncio.sleep(config.get("delay", 0))
+            statuses = config.get("statuses", [])
+            attempt = self.attempts[number] - 1
+            if attempt < len(statuses):
+                return httpx2.Response(statuses[attempt], json={"error": "test failure"},
+                                       headers={"retry-after-ms": "1"})
+            answers = {}
+            for name, question in payload["questions"].items():
+                kind = question["type"]
+                if kind == "noul":
+                    answers[name] = {"type": kind, "noul": (number % 1000) / 1000}
+                elif kind == "choice":
+                    labels = list(question["criteria"])
+                    winner = labels[number % len(labels)]
+                    answers[name] = {
+                        "type": kind, "choice": winner, "confidence": 0.12345678901234567,
+                        "probabilities": {label: float(label == winner) for label in labels},
+                    }
+                else:
+                    levels = question["criteria"]
+                    answers[name] = {
+                        "type": kind, "score": 0.9876543210987654,
+                        "confidence": 0.23456789012345678,
+                        "legend": dict(enumerate(levels)),
+                        "probabilities": {str(i): 1 / len(levels) for i in range(len(levels))},
+                    }
+            self.finished.append(number)
+            return httpx2.Response(200, json={
+                "answers": answers, "model": payload["model"],
+                "usage": {"input_tokens": 42, "output_tokens": 4},
+            })
+        except asyncio.CancelledError:
+            self.cancelled.append(number)
+            raise
+        finally:
+            self.active -= 1
+
+
+upstream = Upstream()
+app = create_app(client_factory=upstream.client, concurrency=3)
+
+
+@app.get("/__test__/stats")
+def stats():
+    return {"started": len(upstream.started), "finished": len(upstream.finished),
+            "cancelled": len(upstream.cancelled), "active": upstream.active,
+            "auth_matches": all(upstream.auth_matches)}

jevaro_server-0.1.0/tests/live_smoke.py

@@ -0,0 +1,66 @@
+"""Optional live check: three states through each SDK (six paid evaluations)."""
+
+import os
+from pathlib import Path
+import socket
+import subprocess
+import sys
+import tempfile
+import threading
+import time
+
+import pyarrow as pa
+import uvicorn
+
+from jevaro_server.app import create_app
+
+
+def main():
+    if not os.environ.get("TYPESAFE_API_KEY"):
+        raise SystemExit("Set TYPESAFE_API_KEY before running the live smoke test")
+    root = Path(__file__).resolve().parents[2]
+    started = time.monotonic()
+    with socket.socket() as listener:
+        listener.bind(("127.0.0.1", 0))
+        base_url = f"http://127.0.0.1:{listener.getsockname()[1]}"
+        server = uvicorn.Server(uvicorn.Config(create_app(), log_level="warning", access_log=False))
+        thread = threading.Thread(target=server.run, kwargs={"sockets": [listener]}, daemon=True)
+        thread.start()
+        try:
+            deadline = time.monotonic() + 5
+            while not server.started:
+                if time.monotonic() > deadline:
+                    raise RuntimeError("Server did not start")
+                time.sleep(0.01)
+            env = {**os.environ, "TYPESAFE_BASE_URL": base_url}
+            with tempfile.TemporaryDirectory(prefix="jevaro-smoke-") as directory:
+                output = Path(directory) / "results.arrows"
+                python = subprocess.run(
+                    [sys.executable, str(root / "jevaro-python/example.py"), "--output", str(output)],
+                    env=env, capture_output=True, text=True, timeout=90, check=True,
+                )
+                with pa.ipc.open_stream(output) as reader:
+                    assert reader.read_all().num_rows == 3
+                decoded = subprocess.run(
+                    [sys.executable, str(root / "scripts/read_results.py"), str(output)],
+                    capture_output=True, text=True, timeout=10, check=True,
+                )
+                assert len(decoded.stdout.splitlines()) == 3
+                assert len(python.stdout.splitlines()) == 3
+                print("Python: 3 states streamed, saved as IPC, and decoded from schema metadata")
+            javascript = subprocess.run(
+                ["node", str(root / "jevaro-javascript/example.mjs")],
+                env=env, capture_output=True, text=True, timeout=90, check=True,
+            )
+            assert len(javascript.stdout.splitlines()) == 3
+            print("JavaScript: 3 states streamed and decoded using the schema's labels")
+            print(f"Six live evaluations passed in {time.monotonic() - started:.2f}s")
+        except subprocess.CalledProcessError as error:
+            raise RuntimeError(error.stderr) from error
+        finally:
+            server.should_exit = True
+            thread.join(timeout=10)
+
+
+if __name__ == "__main__":
+    main()

jevaro_server-0.1.0/tests/test_proxy.py

@@ -0,0 +1,228 @@
+import asyncio
+import json
+import os
+from pathlib import Path
+import socket
+import subprocess
+import sys
+import tempfile
+import threading
+import time
+import unittest
+from unittest.mock import patch
+
+import httpx2
+import pyarrow as pa
+import uvicorn
+from jevaro import AsyncTypeSafeClient, Choice, Noul, Score, TypeSafeClient
+from jevaro_server.app import create_app
+from jevaro_server.arrow import schema_for
+
+from fake_upstream import Upstream
+
+
+QUESTIONS = {
+    "department": Choice(instructions="Which department?", criteria={"returns": None, "other": None}),
+    "urgency": Score(instructions="Urgency?", criteria=[{"when": "later"}, ["today"]]),
+    "refund": Noul(instructions="Refund?"),
+}
+RAW_QUESTIONS = {name: q.model_dump(mode="json") for name, q in QUESTIONS.items()}
+
+
+class ProxyTests(unittest.TestCase):
+    def setUp(self):
+        self.upstream = Upstream()
+        self.socket = socket.socket()
+        self.socket.bind(("127.0.0.1", 0))
+        self.base_url = f"http://127.0.0.1:{self.socket.getsockname()[1]}"
+        self.server = uvicorn.Server(uvicorn.Config(
+            create_app(client_factory=self.upstream.client, concurrency=3),
+            log_level="critical", access_log=False,
+        ))
+        self.thread = threading.Thread(target=self.server.run, kwargs={"sockets": [self.socket]}, daemon=True)
+        self.thread.start()
+        self.until(lambda: self.server.started)
+        self.client = TypeSafeClient(api_key="jevaro-test-key", base_url=self.base_url)
+
+    def tearDown(self):
+        self.upstream.gate.set()
+        self.client.close()
+        self.server.should_exit = True
+        self.thread.join(timeout=5)
+        self.socket.close()
+        self.assertFalse(self.thread.is_alive(), "HTTP server failed to shut down")
+
+    def until(self, predicate):
+        deadline = time.monotonic() + 3
+        while not predicate():
+            if time.monotonic() >= deadline:
+                self.fail("Timed out waiting for test condition")
+            time.sleep(0.005)
+
+    def test_schema_before_any_answers_and_bounded_cancellation(self):
+        reader = self.client.system_one(states=[{"id": i, "gate": True} for i in range(1000)], questions=QUESTIONS)
+        self.assertIsInstance(reader, pa.RecordBatchReader)
+        self.assertEqual(reader.schema.names, list(QUESTIONS))
+        self.assertEqual(next(reader).num_rows, 0)
+        self.until(lambda: self.upstream.active == 3)
+        self.assertEqual(self.upstream.finished, [])
+        self.assertEqual(len(self.upstream.started), 3)
+        reader.close()
+        self.until(lambda: self.upstream.active == 0)
+        self.assertEqual(len(self.upstream.cancelled), 3)
+
+    def test_order_types_metadata_and_precision(self):
+        states = [{"id": i, "delay": 0.08 if i == 0 else 0.001} for i in range(7)]
+        with self.client.system_one(states=states, questions=QUESTIONS) as reader:
+            table = reader.read_all()
+        self.assertEqual(table.num_rows, 7)
+        self.assertEqual(table["refund"].to_pylist(), [i / 1000 for i in range(7)])
+        self.assertNotEqual(self.upstream.finished, list(range(7)))
+        self.assertLessEqual(self.upstream.peak, 3)
+        self.assertTrue(all(self.upstream.auth_matches))
+        self.assertIsNone(table.schema.metadata)
+        expected_metadata = {
+            "department": {"labels": ["returns", "other"]},
+            "urgency": {"legend": [{"when": "later"}, ["today"]]},
+            "refund": {},
+        }
+        for field in table.schema:
+            self.assertFalse(field.nullable)
+            metadata = json.loads(field.metadata[b"ARROW:extension:metadata"])
+            self.assertEqual(metadata, expected_metadata[field.name])
+        for field in schema_for(QUESTIONS):
+            extension = field.type
+            self.assertEqual(type(extension).__arrow_ext_deserialize__(
+                extension.storage_type, extension.__arrow_ext_serialize__(),
+            ), extension)
+        choice = table.schema.field("department")
+        self.assertEqual(choice.type.field("choice").type, pa.uint8())
+        self.assertFalse(choice.type.field("probabilities").nullable)
+        self.assertFalse(choice.type.field("probabilities").type.value_field.nullable)
+        self.assertEqual(choice.type.field("probabilities").type.list_size, 2)
+        self.assertEqual(table["department"][0].as_py()["confidence"], 0.12345678901234567)
+        self.assertEqual(table["urgency"][0].as_py()["score"], 0.9876543210987654)
+        self.assertEqual(json.loads(table.schema.field("urgency").metadata[b"ARROW:extension:metadata"])["legend"],
+                         [{"when": "later"}, ["today"]])
+
+    def test_headers_and_single_array_state(self):
+        with httpx2.Client() as client:
+            with client.stream("POST", f"{self.base_url}/v1/systemone", headers={"Authorization": "Bearer jevaro-test-key"},
+                               json={"state": ["a", "b"], "questions": RAW_QUESTIONS}) as response:
+                self.assertEqual(response.headers["content-type"], "application/vnd.apache.arrow.stream")
+                self.assertNotIn("content-length", response.headers)
+                self.assertEqual(response.headers["transfer-encoding"], "chunked")
+                self.assertEqual(response.headers["x-jevaro-row-count"], "1")
+                self.assertEqual(pa.ipc.open_stream(response.read()).read_all().num_rows, 1)
+        self.assertEqual(self.upstream.started, [["a", "b"]])
+
+    def test_validation_before_upstream_and_server_key_fallback(self):
+        with httpx2.Client(base_url=self.base_url) as client:
+            with patch.dict(os.environ, {"TYPESAFE_API_KEY": "jevaro-test-key"}):
+                good = client.post("/v1/systemone", json={"state": "one", "questions": RAW_QUESTIONS})
+                self.assertEqual(good.status_code, 200)
+            self.assertTrue(all(self.upstream.auth_matches))
+            self.upstream.started.clear()
+            for body in ({}, {"states": []}, {"states": None}, {"state": None}, {"states": "bad"},
+                         {"states": [1]}, {"state": "a", "states": ["b"]}, {"state": "a", "extra": True}):
+                response = client.post("/v1/systemone", json={"questions": RAW_QUESTIONS, **body})
+                self.assertEqual(response.status_code, 422, body)
+            with patch.dict(os.environ, {"TYPESAFE_API_KEY": ""}):
+                response = client.post("/v1/systemone", json={"state": "a", "questions": RAW_QUESTIONS})
+                self.assertEqual(response.status_code, 401)
+            self.assertEqual(self.upstream.started, [])
+
+    def test_question_ids_have_no_reserved_names(self):
+        questions = {name: Noul(instructions="Refund?") for name in ("state", "model", "usage")}
+        with self.client.system_one(state="one", questions=questions) as reader:
+            self.assertEqual(reader.read_all().schema.names, list(questions))
+
+    def test_429_and_529_retry_in_place(self):
+        with self.client.system_one(states=[{"id": 11, "statuses": [429, 529]}, {"id": 12}], questions=QUESTIONS) as reader:
+            self.assertEqual(reader.read_all()["refund"].to_pylist(), [0.011, 0.012])
+        self.assertEqual(self.upstream.attempts[11], 3)
+
+    def test_failure_aborts_instead_of_finishing_a_partial_stream(self):
+        with self.client.system_one(states=[{"id": 0}, {"id": 1, "statuses": [401]}], questions=QUESTIONS) as reader:
+            self.assertEqual(next(reader).num_rows, 0)
+            self.assertEqual(next(reader).num_rows, 1)
+            with self.assertRaises((httpx2.HTTPError, OSError, pa.ArrowInvalid)):
+                next(reader)
+        self.assertEqual(self.upstream.attempts[1], 1)
+
+    def test_async_client(self):
+        async def run():
+            async with AsyncTypeSafeClient(api_key="jevaro-test-key", base_url=self.base_url) as client:
+                async with await client.system_one(states=[{"id": 7}, {"id": 8}], questions=QUESTIONS) as reader:
+                    self.assertEqual(reader.schema.names, list(QUESTIONS))
+                    table = await reader.read_all()
+                    self.assertEqual(table["refund"].to_pylist(), [0.007, 0.008])
+        asyncio.run(run())
+
+    def test_async_cancellation_closes_http_and_upstream_work(self):
+        async def run():
+            async with AsyncTypeSafeClient(api_key="jevaro-test-key", base_url=self.base_url, timeout=2) as client:
+                async with await client.system_one(state={"id": 9, "gate": True}, questions=QUESTIONS) as reader:
+                    await reader.read_next_batch()
+                    reading = asyncio.create_task(reader.read_next_batch())
+                    await asyncio.sleep(0.03)
+                    started = time.monotonic()
+                    reading.cancel()
+                    with self.assertRaises(asyncio.CancelledError):
+                        await reading
+                    self.assertLess(time.monotonic() - started, 1.0, "Cancellation waited for the read timeout")
+                    while self.upstream.active and time.monotonic() - started < 1:
+                        await asyncio.sleep(0.005)
+                    self.assertEqual(self.upstream.active, 0, "Upstream work survived cancellation")
+        asyncio.run(run())
+        self.until(lambda: self.upstream.active == 0)
+        self.assertEqual(self.upstream.cancelled, [9])
+
+    def test_javascript_sdk_over_http(self):
+        javascript = Path(__file__).resolve().parents[2] / "jevaro-javascript"
+        result = subprocess.run(
+            ["node", "--test", "test/integration.test.cjs"], cwd=javascript,
+            env={**os.environ, "JEVARO_TEST_URL": self.base_url},
+            capture_output=True, text=True, timeout=20,
+        )
+        self.assertEqual(result.returncode, 0, result.stdout + result.stderr)
+        self.until(lambda: self.upstream.active == 0)
+        self.assertTrue(all(self.upstream.auth_matches))
+
+    def test_examples_save_and_decode(self):
+        root = Path(__file__).resolve().parents[2]
+        env = {**os.environ, "TYPESAFE_BASE_URL": self.base_url,
+               "TYPESAFE_API_KEY": "jevaro-test-key"}
+        with tempfile.TemporaryDirectory(prefix="jevaro-example-") as directory:
+            output = Path(directory) / "results.arrows"
+            result = subprocess.run(
+                [sys.executable, str(root / "jevaro-python/example.py"), "--output", str(output)],
+                env=env, capture_output=True, text=True, timeout=20,
+            )
+            self.assertEqual(result.returncode, 0, result.stdout + result.stderr)
+            self.assertEqual(len(result.stdout.splitlines()), 3)
+            with pa.ipc.open_stream(output) as reader:
+                self.assertEqual(reader.read_all().num_rows, 3)
+            decoded = subprocess.run(
+                [sys.executable, str(root / "scripts/read_results.py"), str(output)],
+                capture_output=True, text=True, timeout=10,
+            )
+            self.assertEqual(decoded.returncode, 0, decoded.stderr)
+            rows = [json.loads(line) for line in decoded.stdout.splitlines()]
+            self.assertEqual(len(rows), 3)
+            self.assertEqual(rows[0]["department"]["choice"], "returns")
+            self.assertEqual(rows[0]["urgency"]["score"], 0.9876543210987654)
+            self.assertEqual(rows[0]["refund"], {"type": "noul", "noul": 0.0})
+        result = subprocess.run(
+            ["node", str(root / "jevaro-javascript/example.mjs")],
+            env=env, capture_output=True, text=True, timeout=20,
+        )
+        self.assertEqual(result.returncode, 0, result.stdout + result.stderr)
+        rows = [json.loads(line) for line in result.stdout.splitlines()]
+        self.assertEqual(len(rows), 3)
+        self.assertEqual(rows[0]["department"], "returns")
+        self.assertTrue(all(self.upstream.auth_matches))
+
+
+if __name__ == "__main__":
+    unittest.main()