flashspec 0.1.2__tar.gz → 0.1.4__tar.gz

{flashspec-0.1.2 → flashspec-0.1.4}/.github/workflows/benchmark.yml

@@ -25,7 +25,7 @@ jobs:
           cache: pip
 
       - name: Install bench dependencies
-        run: pip install -e ".[bench]"
+        run: pip install -e ".[bench,gpu]"
 
       - name: Build Docker image
         run: docker build -t flashspec:latest -f deploy/Dockerfile .

{flashspec-0.1.2 → flashspec-0.1.4}/.github/workflows/ci.yml

@@ -22,7 +22,7 @@ jobs:
           python-version: "3.11"
           cache: pip
       - name: Install dev dependencies
-        run: pip install -e ".[dev]" --extra-index-url https://download.pytorch.org/whl/cpu
+        run: pip install -e ".[dev,gpu]" --extra-index-url https://download.pytorch.org/whl/cpu
       - name: make lint
         run: make lint
       - name: pip-audit (fail on CRITICAL CVE — §15)
@@ -46,7 +46,7 @@ jobs:
           python-version: "3.11"
           cache: pip
       - name: Install
-        run: pip install -e ".[dev]" --extra-index-url https://download.pytorch.org/whl/cpu
+        run: pip install -e ".[dev,gpu]" --extra-index-url https://download.pytorch.org/whl/cpu
       - name: make test
         run: make test
       - name: Upload coverage XML
@@ -70,7 +70,7 @@ jobs:
           python-version: "3.11"
           cache: pip
       - name: Install
-        run: pip install -e ".[dev]" --extra-index-url https://download.pytorch.org/whl/cpu
+        run: pip install -e ".[dev,gpu]" --extra-index-url https://download.pytorch.org/whl/cpu
       - name: make test-chaos
         run: make test-chaos
 
@@ -86,7 +86,7 @@ jobs:
           python-version: "3.11"
           cache: pip
       - name: Install
-        run: pip install -e ".[dev]" --extra-index-url https://download.pytorch.org/whl/cpu
+        run: pip install -e ".[dev,gpu]" --extra-index-url https://download.pytorch.org/whl/cpu
       - name: Download coverage artifact
         uses: actions/download-artifact@v4
         with:
@@ -117,7 +117,7 @@ jobs:
           cache: pip
       - name: Install with ONNX extras
         run: |
-          pip install -e ".[dev,onnx]" \
+          pip install -e ".[dev,onnx,gpu]" \
             --extra-index-url https://download.pytorch.org/whl/cpu
       - name: Run ONNX parity tests
         run: pytest tests/integration/test_onnx_parity.py -v

{flashspec-0.1.2 → flashspec-0.1.4}/.github/workflows/gpu_tests.yml

@@ -20,7 +20,7 @@ jobs:
           python-version: "3.11"
           cache: pip
       - name: Install
-        run: pip install -e ".[dev]"
+        run: pip install -e ".[dev,gpu]"
       - name: make test-gpu
         run: make test-gpu
       - name: Run slow distribution tests (N=10,000 KS gate)
@@ -45,7 +45,7 @@ jobs:
           python-version: "3.11"
           cache: pip
       - name: Install bench dependencies
-        run: pip install -e ".[bench]"
+        run: pip install -e ".[bench,gpu]"
       - name: make bench-quick
         run: make bench-quick
       - name: Assert throughput ≥ 1.5× AR

{flashspec-0.1.2 → flashspec-0.1.4}/.gitignore

@@ -51,9 +51,6 @@ benchmarks/results/*.json
 !benchmarks/results/baseline.json
 !benchmarks/results/.gitkeep
 
-# Jupyter
-*.ipynb
-.ipynb_checkpoints/
 
 # Paper build artefacts
 paper/*.aux

{flashspec-0.1.2 → flashspec-0.1.4}/CHANGELOG.md

@@ -11,6 +11,60 @@ Versioning follows [Semantic Versioning 2.0.0](https://semver.org/).
 ## [Unreleased]
 
 ### Added
+- First real GPU measurements (Tesla T4, TinyLlama-1.1B-Chat NF4, FlashSpec UCB1,
+  γ=4): **44.2 tok/s**, α=0.75, p50=22.1ms.
+  Result in `benchmarks/results/flashspec_ucb_tiny_llama.json`.
+- Bandit regret measured empirically (T=10,000, K=3 arms): UCB1=100.2,
+  Thompson=18.9, Oracle=0.0. Figure saved to `paper/figures/bandit_regret.jpg`.
+- Gamma sweep results in `benchmarks/results/gamma_sweep.csv` (synthetic
+  logprobs, acceptance rates genuine).
+- Draft size sweep results in `benchmarks/results/draft_size_sweep.csv`.
+- Updated `notebooks/01_quickstart.ipynb`, `02_bandit_analysis.ipynb`, and
+  `03_kernel_profiling.ipynb` with real Colab T4 execution outputs.
+- Kernel profiling table (T4): reference 0.07–0.72ms; Triton kernel faster
+  at batch=8 (1.6×) but slower at batch=1 on T4 (expected — T4 is
+  bandwidth-constrained, H100 profiling pending).
+- README updated: real measurements clearly separated from H100 design targets;
+  ⊛ symbol marks all unverified target numbers.
+
+---
+
+## [0.1.3] — Critical packaging fix (Windows/macOS install)
+
+### Fixed
+- **Critical**: `pip install flashspec` failed completely on Windows and
+  macOS with `ERROR: No matching distribution found for triton>=3.0.0` —
+  Triton publishes official PyPI wheels for Linux only, but `triton>=3.0.0`
+  was a hard core dependency, making the package uninstallable on those
+  platforms. (Reported against v0.1.0–v0.1.2.)
+  - `pyproject.toml`: moved `triton` out of `dependencies` into a new
+    `gpu` extra with a `platform_system == 'Linux'` environment marker:
+    `pip install flashspec[gpu]`.
+  - `flashspec/kernels/__init__.py`: now imports `verify_kernel` and
+    `gather_kernel` inside a `try/except ImportError`. If Triton is
+    unavailable, `verify_tokens` and `gather_accepted` are bound to a
+    wrapper that raises an actionable `ImportError` only when *called*
+    (not at import time), explaining `pip install flashspec[gpu]`
+    (Linux-only) and pointing to the cross-platform
+    `flashspec.kernels._reference` module (identical numerics, verified in
+    `tests/unit/test_verify_kernel.py`). Adds module-level
+    `flashspec.kernels.TRITON_AVAILABLE: bool`.
+  - `tests/unit/test_verify_kernel.py`: added
+    `TestKernelsPackageWithoutTriton` (3 tests, CPU-only, no GPU/Triton
+    required) verifying the package imports cleanly and raises the
+    actionable error when Triton is absent.
+  - `.github/workflows/{ci,gpu_tests,benchmark}.yml`: updated `pip install`
+    steps to request the `gpu` extra wherever Triton-backed kernel tests
+    or benchmarks actually run (all on `ubuntu-22.04`/self-hosted Linux
+    runners, where the extra resolves normally).
+  - `README.md`: rewrote the Installation section — `pip install flashspec`
+    is now correctly described as cross-platform (CPU reference kernels),
+    with `pip install flashspec[gpu]` for Linux+CUDA accelerated kernels.
+  - Bumped version `0.1.0` → `0.1.3` in `pyproject.toml` and
+    `flashspec/__init__.py` (0.1.0–0.1.2 are broken on non-Linux and
+    should be marked yanked on PyPI after this release).
+
+---
 - Initial project scaffold following AGENTS.md specification.
 - `flashspec.utils.config`: Pydantic v2 configuration models (`FlashSpecConfig`,
   `BanditConfig`, `SamplingConfig`, `MetricsConfig`). All immutable (`frozen=True`).

{flashspec-0.1.2 → flashspec-0.1.4}/CITATION.cff

@@ -27,7 +27,7 @@ abstract: >-
   O(sqrt(K T log T)) regret bound. The output distribution is
   provably identical to standard autoregressive sampling, verified
   continuously via a Kolmogorov-Smirnov test in CI.
-version: 0.1.0
+version: 0.1.3
 date-released: "2026-06-12"
 license: Apache-2.0
 repository-code: "https://github.com/Mattral/FlashSpec"

{flashspec-0.1.2 → flashspec-0.1.4}/LICENSE

@@ -1,117 +1,117 @@
-                                 Apache License
-                           Version 2.0, January 2004
-                        http://www.apache.org/licenses/
-
-   TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
-
-   1. Definitions.
-
-      "License" shall mean the terms and conditions for use, reproduction,
-      and distribution as defined by Sections 1 through 9 of this document.
-
-      "Licensor" shall mean the copyright owner or entity authorized by
-      the copyright owner that is granting the License.
-
-      "Legal Entity" shall mean the union of the acting entity and all
-      other entities that control, are controlled by, or are under common
-      control with that entity.
-
-      "You" (or "Your") shall mean an individual or Legal Entity
-      exercising permissions granted by this License.
-
-      "Source" form shall mean the preferred form for making modifications,
-      including but not limited to software source code, documentation
-      source, and configuration files.
-
-      "Object" form shall mean any form resulting from mechanical
-      transformation or translation of a Source form, including but
-      not limited to compiled object code, generated documentation,
-      and conversions to other media types.
-
-      "Work" shall mean the work of authorship made available under
-      the License, as indicated by a copyright notice that is included in
-      or attached to the work.
-
-      "Derivative Works" shall mean any work, whether in Source or Object
-      form, that is based on (or derived from) the Work and for which the
-      editorial revisions, annotations, elaborations, or other transformations
-      represent, as a whole, an original work of authorship.
-
-      "Contribution" shall mean any work of authorship, including the
-      original version of the Work and any modifications or additions
-      to that Work or Derivative Works of the Work, that is intentionally
-      submitted to the Licensor for inclusion in the Work by the copyright
-      owner or by an individual or Legal Entity authorized to submit on
-      behalf of the copyright owner.
-
-      "Contributor" shall mean Licensor and any Legal Entity on behalf of
-      whom a Contribution has been received by the Licensor and included
-      within the Work.
-
-   2. Grant of Copyright License. Subject to the terms and conditions of
-      this License, each Contributor hereby grants to You a perpetual,
-      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
-      copyright license to reproduce, prepare Derivative Works of,
-      publicly display, publicly perform, sublicense, and distribute the
-      Work and such Derivative Works in Source or Object form.
-
-   3. Grant of Patent License. Subject to the terms and conditions of
-      this License, each Contributor hereby grants to You a perpetual,
-      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
-      (except as stated in this section) patent license to make, have made,
-      use, offer to sell, sell, import, and otherwise transfer the Work,
-      where such license applies only to those patent claims licensable
-      by such Contributor that are necessarily infringed by their
-      Contribution(s) alone or by the combined contribution of their
-      Contribution(s) with the Work to which such Contribution(s) was
-      submitted.
-
-   4. Redistribution. You may reproduce and distribute copies of the
-      Work or Derivative Works thereof in any medium, with or without
-      modifications, and in Source or Object form, provided that You
-      meet the following conditions:
-
-      (a) You must give any other recipients of the Work or Derivative
-          Works a copy of this License; and
-
-      (b) You must cause any modified files to carry prominent notices
-          stating that You changed the files; and
-
-      (c) You must retain, in the Source form of any Derivative Works
-          that You distribute, all copyright, patent, trademark, and
-          attribution notices from the Source form of the Work,
-          excluding those notices that do not pertain to any part of
-          the Derivative Works; and
-
-      (d) If the Work includes a "NOTICE" text file as part of its
-          distribution, You must include a readable copy of the
-          attribution notices contained within such NOTICE file, in
-          at least one of the following places: within a NOTICE text
-          file distributed as part of the Derivative Works; within
-          the Source form or documentation, if provided along with the
-          Derivative Works; or, within a display generated by the
-          Derivative Works, if and wherever such third-party notices
-          normally appear. The contents of the NOTICE file are for
-          informational purposes only and do not modify the License.
-          You may add Your own attribution notices within Derivative
-          Works that You distribute, alongside or in addition to the
-          NOTICE text from the Work, provided that such additional
-          attribution notices cannot be construed as modifying the License.
-
-   You may add Your own license statement for Your modifications and
-   may provide additional grant of rights to use, copy, modify, merge,
-   publish, distribute, sublicense, and/or sell copies of the Work.
-
-   Copyright 2025 Min Htet Myet (Mattral)
-
-   Licensed under the Apache License, Version 2.0 (the "License");
-   you may not use this file except in compliance with the License.
-   You may obtain a copy of the License at
-
-       http://www.apache.org/licenses/LICENSE-2.0
-
-   Unless required by applicable law or agreed to in writing, software
-   distributed under the License is distributed on an "AS IS" BASIS,
-   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-   See the License for the specific language governing permissions and
-   limitations under the License.
+                                 Apache License
+                           Version 2.0, January 2004
+                        http://www.apache.org/licenses/
+
+   TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
+
+   1. Definitions.
+
+      "License" shall mean the terms and conditions for use, reproduction,
+      and distribution as defined by Sections 1 through 9 of this document.
+
+      "Licensor" shall mean the copyright owner or entity authorized by
+      the copyright owner that is granting the License.
+
+      "Legal Entity" shall mean the union of the acting entity and all
+      other entities that control, are controlled by, or are under common
+      control with that entity.
+
+      "You" (or "Your") shall mean an individual or Legal Entity
+      exercising permissions granted by this License.
+
+      "Source" form shall mean the preferred form for making modifications,
+      including but not limited to software source code, documentation
+      source, and configuration files.
+
+      "Object" form shall mean any form resulting from mechanical
+      transformation or translation of a Source form, including but
+      not limited to compiled object code, generated documentation,
+      and conversions to other media types.
+
+      "Work" shall mean the work of authorship made available under
+      the License, as indicated by a copyright notice that is included in
+      or attached to the work.
+
+      "Derivative Works" shall mean any work, whether in Source or Object
+      form, that is based on (or derived from) the Work and for which the
+      editorial revisions, annotations, elaborations, or other transformations
+      represent, as a whole, an original work of authorship.
+
+      "Contribution" shall mean any work of authorship, including the
+      original version of the Work and any modifications or additions
+      to that Work or Derivative Works of the Work, that is intentionally
+      submitted to the Licensor for inclusion in the Work by the copyright
+      owner or by an individual or Legal Entity authorized to submit on
+      behalf of the copyright owner.
+
+      "Contributor" shall mean Licensor and any Legal Entity on behalf of
+      whom a Contribution has been received by the Licensor and included
+      within the Work.
+
+   2. Grant of Copyright License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      copyright license to reproduce, prepare Derivative Works of,
+      publicly display, publicly perform, sublicense, and distribute the
+      Work and such Derivative Works in Source or Object form.
+
+   3. Grant of Patent License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      (except as stated in this section) patent license to make, have made,
+      use, offer to sell, sell, import, and otherwise transfer the Work,
+      where such license applies only to those patent claims licensable
+      by such Contributor that are necessarily infringed by their
+      Contribution(s) alone or by the combined contribution of their
+      Contribution(s) with the Work to which such Contribution(s) was
+      submitted.
+
+   4. Redistribution. You may reproduce and distribute copies of the
+      Work or Derivative Works thereof in any medium, with or without
+      modifications, and in Source or Object form, provided that You
+      meet the following conditions:
+
+      (a) You must give any other recipients of the Work or Derivative
+          Works a copy of this License; and
+
+      (b) You must cause any modified files to carry prominent notices
+          stating that You changed the files; and
+
+      (c) You must retain, in the Source form of any Derivative Works
+          that You distribute, all copyright, patent, trademark, and
+          attribution notices from the Source form of the Work,
+          excluding those notices that do not pertain to any part of
+          the Derivative Works; and
+
+      (d) If the Work includes a "NOTICE" text file as part of its
+          distribution, You must include a readable copy of the
+          attribution notices contained within such NOTICE file, in
+          at least one of the following places: within a NOTICE text
+          file distributed as part of the Derivative Works; within
+          the Source form or documentation, if provided along with the
+          Derivative Works; or, within a display generated by the
+          Derivative Works, if and wherever such third-party notices
+          normally appear. The contents of the NOTICE file are for
+          informational purposes only and do not modify the License.
+          You may add Your own attribution notices within Derivative
+          Works that You distribute, alongside or in addition to the
+          NOTICE text from the Work, provided that such additional
+          attribution notices cannot be construed as modifying the License.
+
+   You may add Your own license statement for Your modifications and
+   may provide additional grant of rights to use, copy, modify, merge,
+   publish, distribute, sublicense, and/or sell copies of the Work.
+
+   Copyright 2025 Min Htet Myet (Mattral)
+
+   Licensed under the Apache License, Version 2.0 (the "License");
+   you may not use this file except in compliance with the License.
+   You may obtain a copy of the License at
+
+       http://www.apache.org/licenses/LICENSE-2.0
+
+   Unless required by applicable law or agreed to in writing, software
+   distributed under the License is distributed on an "AS IS" BASIS,
+   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+   See the License for the specific language governing permissions and
+   limitations under the License.