hpc-as-api 0.1.0__tar.gz

hpc_as_api-0.1.0/.gitignore

@@ -0,0 +1,43 @@
+# Python
+__pycache__/
+*.py[cod]
+*.pyo
+*.pyd
+.Python
+*.egg
+*.egg-info/
+dist/
+build/
+.eggs/
+pip-wheel-metadata/
+*.so
+
+# Virtual environments
+.venv/
+venv/
+env/
+
+# uv
+.uv/
+
+# Testing
+.pytest_cache/
+.coverage
+htmlcov/
+.tox/
+
+# IDE
+.vscode/
+.idea/
+*.swp
+*.swo
+
+# Secrets — never commit these
+.env
+*.env
+proxy.env
+secrets/
+
+# OS
+.DS_Store
+Thumbs.db

hpc_as_api-0.1.0/CONTRIBUTING.md

@@ -0,0 +1,70 @@
+# Contributing to hpc-as-api
+
+Thank you for your interest in contributing. This document describes how to set up a development environment, run the test suite, and submit changes.
+
+## Development setup
+
+```bash
+git clone https://github.com/uicacer/hpc-as-api
+cd hpc-as-api
+uv sync --extra dev        # installs all dev dependencies
+uv run pytest -v           # should show 28 tests passing
+```
+
+If you don't have `uv`, install it with `pip install uv` or see [uv docs](https://docs.astral.sh/uv/).
+
+## Running tests
+
+```bash
+# All tests (no Globus credentials needed — Globus SDK is mocked)
+uv run --extra dev pytest -v
+
+# A single test module
+uv run --extra dev pytest tests/test_utils.py -v
+```
+
+The `test_compute.py` and `test_app.py` tests mock the Globus SDK so they run offline without any HPC credentials.
+
+## Project structure
+
+```
+hpc_as_api/
+  auth.py      — Globus token + API key authentication, rate limiting
+  compute.py   — GlobusComputeClient: job submission and streaming
+  crypto.py    — AES-256-GCM end-to-end encryption
+  utils.py     — OpenAI multimodal message utilities
+  app.py       — FastAPI routes (standalone + embeddable router)
+paper/
+  paper.md     — JOSS paper
+  paper.bib    — BibTeX references
+tests/
+  test_utils.py    — message utility tests
+  test_compute.py  — GlobusComputeClient unit tests
+  test_app.py      — FastAPI route tests
+docs/
+  deployment.md    — production deployment guide
+```
+
+## Making changes
+
+1. Fork the repository and create a branch: `git checkout -b feature/my-change`
+2. Make your changes, add tests where appropriate
+3. Run `uv run --extra dev pytest` to confirm tests pass
+4. Run `uv run --extra dev ruff check hpc_as_api/` for style checks
+5. Open a pull request with a clear description of what changed and why
+
+## Reporting bugs / requesting features
+
+Open an issue at <https://github.com/uicacer/hpc-as-api/issues>. Include:
+- Python version (`python --version`)
+- hpc-as-api version (`pip show hpc-as-api`)
+- A minimal reproducing example
+- The full error traceback
+
+## Support and governance
+
+This project is maintained by the [ACER group at UIC](https://acer.uic.edu). Questions and bug reports via GitHub Issues are the primary support channel. Response time is typically within one week.
+
+## License
+
+By contributing, you agree that your contributions will be licensed under the [Apache License 2.0](LICENSE).

hpc_as_api-0.1.0/LICENSE

@@ -0,0 +1,153 @@
+                                 Apache License
+                           Version 2.0, January 2004
+                        http://www.apache.org/licenses/
+
+   TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
+
+   1. Definitions.
+
+      "License" shall mean the terms and conditions for use, reproduction,
+      and distribution as defined by Sections 1 through 9 of this document.
+
+      "Licensor" shall mean the copyright owner or entity authorized by
+      the copyright owner that is granting the License.
+
+      "Legal Entity" shall mean the union of the acting entity and all
+      other entities that control, are controlled by, or are under common
+      control with that entity. For the purposes of this definition,
+      "control" means (i) the power, direct or indirect, to cause the
+      direction or management of such entity, whether by contract or
+      otherwise, or (ii) ownership of fifty percent (50%) or more of the
+      outstanding shares, or (iii) beneficial ownership of such entity.
+
+      "You" (or "Your") shall mean an individual or Legal Entity
+      exercising permissions granted by this License.
+
+      "Source" form shall mean the preferred form for making modifications,
+      including but not limited to software source code, documentation
+      source, and configuration files.
+
+      "Object" form shall mean any form resulting from mechanical
+      transformation or translation of a Source form, including but
+      not limited to compiled object code, generated documentation,
+      and conversions to other media types.
+
+      "Work" shall mean the work of authorship made available under
+      the License, as indicated by a copyright notice that is included in
+      or attached to the work (an example is provided in the Appendix below).
+
+      "Derivative Works" shall mean any work, whether in Source or Object
+      form, that is based on (or derived from) the Work and for which the
+      editorial revisions, annotations, elaborations, or other modifications
+      represent, as a whole, an original work of authorship. For the purposes
+      of this License, Derivative Works shall not include works that remain
+      separable from, or merely link (or bind by name) to the interfaces of,
+      the Work and Derivative Works thereof.
+
+      "Contribution" shall mean, as defined by Section 1(a), any work of
+      authorship submitted to the Licensor for inclusion in the Work by the
+      code owner or by an individual or Legal Entity authorized to
+      submit on behalf of the copyright owner.
+
+      "Contributor" shall mean Licensor and any Legal Entity on behalf of
+      whom a Contribution has been received by the Licensor and included
+      within the Work.
+
+   2. Grant of Copyright License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      copyright license to reproduce, prepare Derivative Works of,
+      publicly display, publicly perform, sublicense, and distribute the
+      Work and such Derivative Works in Source or Object form.
+
+   3. Grant of Patent License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      (except as stated in this section) patent license to make, have made,
+      use, offer to sell, sell, import, and otherwise transfer the Work,
+      where such license applies only to those patent claims licensable
+      by such Contributor that are necessarily infringed by their
+      Contribution(s) alone or by the combinations of their Contribution(s)
+      with the Work to which such Contribution(s) was submitted. If You
+      institute patent proceedings against any entity (including a
+      cross-claim or counterclaim in a lawsuit) alleging that the Work
+      or a Contribution incorporated within the Work constitutes direct
+      or contributory patent infringement, then any patent licenses
+      granted to You under this License for that Work shall terminate
+      as of the date such litigation is filed.
+
+   4. Redistribution. You may reproduce and distribute copies of the
+      Work or Distribute or Derivative Works thereof in any medium, with or without
+      modifications, and in Source or Object form, provided that You
+      meet the following conditions:
+
+      (a) You must give any other recipients of the Work or Derivative
+          Works a copy of this License; and
+
+      (b) You must cause any modified files to carry prominent notices
+          stating that You changed the files; and
+
+      (c) You must retain, in the Source form of any Derivative Works
+          that You distribute, all copyright, patent, trademark, and
+          attribution notices from the Source form of the Work,
+          excluding those notices that do not pertain to any part of
+          the Derivative Works; and
+
+      (d) If the Work includes a "NOTICE" text file as part of its
+          distribution, You must include a readable copy of the
+          attribution notices contained within such NOTICE file, in
+          at least one of the following places: within a NOTICE text
+          file distributed as part of the Derivative Works; within
+          the Source form or documentation, if provided along with the
+          Derivative Works; or, within a display generated by the
+          Derivative Works, if and wherever such third-party notices
+          normally appear. The contents of the NOTICE file are for
+          informational purposes only and do not modify the License.
+
+   5. Submission of Contributions. Unless You explicitly state otherwise,
+      any Contribution intentionally submitted for inclusion in the Work
+      by You to the Licensor shall be under the terms and conditions of
+      this License, without any additional terms or conditions.
+
+   6. Trademarks. This License does not grant permission to use the trade
+      names, trademarks, service marks, or product names of the Licensor,
+      except as required for reasonable and customary use in describing the
+      origin of the Work and reproducing the content of the NOTICE file.
+
+   7. Disclaimer of Warranty. Unless required by applicable law or agreed
+      to in writing, Licensor provides the Work (and each Contributor
+      provides its Contributions) on an "AS IS" BASIS, WITHOUT WARRANTIES
+      OR CONDITIONS OF ANY KIND, either express or implied, including,
+      without limitation, any warranties or conditions of TITLE,
+      NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A PARTICULAR PURPOSE.
+
+   8. Limitation of Liability. In no event and under no legal theory,
+      whether in tort (including negligence), contract, or otherwise,
+      unless required by applicable law (such as deliberate and grossly
+      negligent acts) or agreed to in writing, shall any Contributor be
+      liable to You for damages, including any direct, indirect, special,
+      incidental, or exemplary damages of any kind arising as a result of
+      this License or out of the use or inability to use the Work.
+
+   9. Accepting Warranty or Liability. While redistributing the Work or
+      Derivative Works thereof, You may choose to offer, and charge a fee
+      for, acceptance of support, warranty, indemnity, or other liability
+      obligations and/or rights consistent to the Law. However, in accepting
+      such obligations, You may offer such obligations only on Your own behalf
+      and on Your sole responsibility, not on behalf of any other Contributor.
+
+   END OF TERMS AND CONDITIONS
+
+   Copyright 2026 Anas Nassar, University of Illinois Chicago
+
+   Licensed under the Apache License, Version 2.0 (the "License");
+   you may not use this file except in compliance with the License.
+   You may obtain a copy of the License at
+
+       http://www.apache.org/licenses/LICENSE-2.0
+
+   Unless required by applicable law or agreed to in writing, software
+   distributed under the License is distributed on an "AS IS" BASIS,
+   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+   See the License for the specific language governing permissions and
+   limitations under the License.

hpc_as_api-0.1.0/PKG-INFO

@@ -0,0 +1,344 @@
+Metadata-Version: 2.4
+Name: hpc-as-api
+Version: 0.1.0
+Summary: OpenAI-compatible API gateway for HPC clusters via Globus Compute
+Project-URL: Homepage, https://github.com/uicacer/hpc-as-api
+Project-URL: Repository, https://github.com/uicacer/hpc-as-api
+Project-URL: Bug Tracker, https://github.com/uicacer/hpc-as-api/issues
+Author-email: Anas Nassar <nassar@uic.edu>
+License:                                  Apache License
+                                   Version 2.0, January 2004
+                                http://www.apache.org/licenses/
+        
+           TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
+        
+           1. Definitions.
+        
+              "License" shall mean the terms and conditions for use, reproduction,
+              and distribution as defined by Sections 1 through 9 of this document.
+        
+              "Licensor" shall mean the copyright owner or entity authorized by
+              the copyright owner that is granting the License.
+        
+              "Legal Entity" shall mean the union of the acting entity and all
+              other entities that control, are controlled by, or are under common
+              control with that entity. For the purposes of this definition,
+              "control" means (i) the power, direct or indirect, to cause the
+              direction or management of such entity, whether by contract or
+              otherwise, or (ii) ownership of fifty percent (50%) or more of the
+              outstanding shares, or (iii) beneficial ownership of such entity.
+        
+              "You" (or "Your") shall mean an individual or Legal Entity
+              exercising permissions granted by this License.
+        
+              "Source" form shall mean the preferred form for making modifications,
+              including but not limited to software source code, documentation
+              source, and configuration files.
+        
+              "Object" form shall mean any form resulting from mechanical
+              transformation or translation of a Source form, including but
+              not limited to compiled object code, generated documentation,
+              and conversions to other media types.
+        
+              "Work" shall mean the work of authorship made available under
+              the License, as indicated by a copyright notice that is included in
+              or attached to the work (an example is provided in the Appendix below).
+        
+              "Derivative Works" shall mean any work, whether in Source or Object
+              form, that is based on (or derived from) the Work and for which the
+              editorial revisions, annotations, elaborations, or other modifications
+              represent, as a whole, an original work of authorship. For the purposes
+              of this License, Derivative Works shall not include works that remain
+              separable from, or merely link (or bind by name) to the interfaces of,
+              the Work and Derivative Works thereof.
+        
+              "Contribution" shall mean, as defined by Section 1(a), any work of
+              authorship submitted to the Licensor for inclusion in the Work by the
+              code owner or by an individual or Legal Entity authorized to
+              submit on behalf of the copyright owner.
+        
+              "Contributor" shall mean Licensor and any Legal Entity on behalf of
+              whom a Contribution has been received by the Licensor and included
+              within the Work.
+        
+           2. Grant of Copyright License. Subject to the terms and conditions of
+              this License, each Contributor hereby grants to You a perpetual,
+              worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+              copyright license to reproduce, prepare Derivative Works of,
+              publicly display, publicly perform, sublicense, and distribute the
+              Work and such Derivative Works in Source or Object form.
+        
+           3. Grant of Patent License. Subject to the terms and conditions of
+              this License, each Contributor hereby grants to You a perpetual,
+              worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+              (except as stated in this section) patent license to make, have made,
+              use, offer to sell, sell, import, and otherwise transfer the Work,
+              where such license applies only to those patent claims licensable
+              by such Contributor that are necessarily infringed by their
+              Contribution(s) alone or by the combinations of their Contribution(s)
+              with the Work to which such Contribution(s) was submitted. If You
+              institute patent proceedings against any entity (including a
+              cross-claim or counterclaim in a lawsuit) alleging that the Work
+              or a Contribution incorporated within the Work constitutes direct
+              or contributory patent infringement, then any patent licenses
+              granted to You under this License for that Work shall terminate
+              as of the date such litigation is filed.
+        
+           4. Redistribution. You may reproduce and distribute copies of the
+              Work or Distribute or Derivative Works thereof in any medium, with or without
+              modifications, and in Source or Object form, provided that You
+              meet the following conditions:
+        
+              (a) You must give any other recipients of the Work or Derivative
+                  Works a copy of this License; and
+        
+              (b) You must cause any modified files to carry prominent notices
+                  stating that You changed the files; and
+        
+              (c) You must retain, in the Source form of any Derivative Works
+                  that You distribute, all copyright, patent, trademark, and
+                  attribution notices from the Source form of the Work,
+                  excluding those notices that do not pertain to any part of
+                  the Derivative Works; and
+        
+              (d) If the Work includes a "NOTICE" text file as part of its
+                  distribution, You must include a readable copy of the
+                  attribution notices contained within such NOTICE file, in
+                  at least one of the following places: within a NOTICE text
+                  file distributed as part of the Derivative Works; within
+                  the Source form or documentation, if provided along with the
+                  Derivative Works; or, within a display generated by the
+                  Derivative Works, if and wherever such third-party notices
+                  normally appear. The contents of the NOTICE file are for
+                  informational purposes only and do not modify the License.
+        
+           5. Submission of Contributions. Unless You explicitly state otherwise,
+              any Contribution intentionally submitted for inclusion in the Work
+              by You to the Licensor shall be under the terms and conditions of
+              this License, without any additional terms or conditions.
+        
+           6. Trademarks. This License does not grant permission to use the trade
+              names, trademarks, service marks, or product names of the Licensor,
+              except as required for reasonable and customary use in describing the
+              origin of the Work and reproducing the content of the NOTICE file.
+        
+           7. Disclaimer of Warranty. Unless required by applicable law or agreed
+              to in writing, Licensor provides the Work (and each Contributor
+              provides its Contributions) on an "AS IS" BASIS, WITHOUT WARRANTIES
+              OR CONDITIONS OF ANY KIND, either express or implied, including,
+              without limitation, any warranties or conditions of TITLE,
+              NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A PARTICULAR PURPOSE.
+        
+           8. Limitation of Liability. In no event and under no legal theory,
+              whether in tort (including negligence), contract, or otherwise,
+              unless required by applicable law (such as deliberate and grossly
+              negligent acts) or agreed to in writing, shall any Contributor be
+              liable to You for damages, including any direct, indirect, special,
+              incidental, or exemplary damages of any kind arising as a result of
+              this License or out of the use or inability to use the Work.
+        
+           9. Accepting Warranty or Liability. While redistributing the Work or
+              Derivative Works thereof, You may choose to offer, and charge a fee
+              for, acceptance of support, warranty, indemnity, or other liability
+              obligations and/or rights consistent to the Law. However, in accepting
+              such obligations, You may offer such obligations only on Your own behalf
+              and on Your sole responsibility, not on behalf of any other Contributor.
+        
+           END OF TERMS AND CONDITIONS
+        
+           Copyright 2026 Anas Nassar, University of Illinois Chicago
+        
+           Licensed under the Apache License, Version 2.0 (the "License");
+           you may not use this file except in compliance with the License.
+           You may obtain a copy of the License at
+        
+               http://www.apache.org/licenses/LICENSE-2.0
+        
+           Unless required by applicable law or agreed to in writing, software
+           distributed under the License is distributed on an "AS IS" BASIS,
+           WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+           See the License for the specific language governing permissions and
+           limitations under the License.
+License-File: LICENSE
+Keywords: api-gateway,globus-compute,hpc,llm,openai,slurm,vllm
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Science/Research
+Classifier: License :: OSI Approved :: Apache Software License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Topic :: Internet :: WWW/HTTP :: HTTP Servers
+Classifier: Topic :: Scientific/Engineering
+Classifier: Topic :: System :: Distributed Computing
+Requires-Python: >=3.11
+Requires-Dist: cryptography>=43.0
+Requires-Dist: fastapi>=0.115
+Requires-Dist: httpx>=0.28
+Requires-Dist: streamrelay>=0.2.0
+Requires-Dist: uvicorn[standard]>=0.34
+Requires-Dist: websockets>=13.0
+Provides-Extra: dev
+Requires-Dist: httpx>=0.28; extra == 'dev'
+Requires-Dist: pytest-asyncio>=0.23; extra == 'dev'
+Requires-Dist: pytest>=8.0; extra == 'dev'
+Requires-Dist: ruff; extra == 'dev'
+Provides-Extra: globus
+Requires-Dist: globus-compute-sdk>=2.0; extra == 'globus'
+Requires-Dist: globus-sdk>=4.0; extra == 'globus'
+Description-Content-Type: text/markdown
+
+# hpc-as-api
+
+[![PyPI](https://img.shields.io/pypi/v/hpc-as-api)](https://pypi.org/project/hpc-as-api/)
+[![License](https://img.shields.io/badge/license-Apache%202.0-blue)](https://github.com/uicacer/hpc-as-api/blob/main/LICENSE)
+[![Tests](https://github.com/uicacer/hpc-as-api/actions/workflows/tests.yml/badge.svg)](https://github.com/uicacer/hpc-as-api/actions)
+
+**OpenAI-compatible API gateway for HPC clusters via Globus Compute.**
+
+`hpc-as-api` exposes any vLLM-served model running on an HPC cluster (SLURM, PBS, etc.) as a standard OpenAI-compatible REST API. It handles authentication, rate limiting, payload size management, and real-time token streaming — so your existing OpenAI clients work without modification.
+
+```python
+from hpc_as_api.compute import GlobusComputeClient
+
+client = GlobusComputeClient(
+    endpoint_id="8d978809-xxxx-xxxx-xxxx-xxxxxxxxxxxx",
+    models={
+        "qwen25-vl-72b": {
+            "hf_name": "Qwen/Qwen2.5-VL-72B-Instruct-AWQ",
+            "url": "http://ghi2-002:8000",
+            "context_reserve_output": 4096,
+        }
+    },
+)
+result = await client.submit_inference(
+    messages=[{"role": "user", "content": "Explain quantum entanglement."}],
+    model="qwen25-vl-72b",
+)
+```
+
+## Why
+
+HPC clusters run the largest open-source LLMs (72B+ parameters) on GPU hardware that typical cloud users can't afford. But HPC infrastructure has no standard API surface — each cluster has its own SLURM scripts, SSH tunnels, and authentication systems. `hpc-as-api` provides a uniform OpenAI-compatible interface over any vLLM-served model, using [Globus Compute](https://www.globus.org/compute) for authentication and job dispatch (no open ports required on the HPC side).
+
+## Architecture
+
+```
+Your App / OpenAI Client
+        │  POST /v1/chat/completions
+        ▼
+  hpc-as-api (FastAPI)
+        │  Globus Compute (AMQP — no HPC firewall holes)
+        ▼
+  HPC Cluster (SLURM)
+        │  vLLM HTTP API (internal LAN)
+        ▼
+  GPU Compute Node
+        │  tokens flow via WebSocket relay (streamrelay)
+        ▼
+  hpc-as-api → SSE stream → Your App
+```
+
+Key design points:
+- **No open ports on HPC**: Globus Compute is outbound-only from the cluster
+- **Real-time streaming**: Tokens stream back via [streamrelay](https://github.com/uicacer/streamrelay) WebSocket relay
+- **E2E encryption**: Optional AES-256-GCM encryption between HPC and consumer (relay sees only ciphertext)
+- **OpenAI-compatible**: Drop-in for any client using the OpenAI SDK
+
+## Installation
+
+```bash
+# Base package (no Globus SDK)
+pip install hpc-as-api
+
+# With Globus Compute support
+pip install "hpc-as-api[globus]"
+```
+
+## Quickstart: Run as a service
+
+Set environment variables and start:
+
+```bash
+export GLOBUS_COMPUTE_ENDPOINT_ID="your-endpoint-uuid"
+export HPC_MODELS='{"qwen25-vl-72b": {"hf_name": "Qwen/Qwen2.5-VL-72B-Instruct-AWQ", "url": "http://ghi2-002:8000", "context_reserve_output": 4096}}'
+export RELAY_URL="wss://relay.example.com"
+export RELAY_SECRET="your-relay-secret"
+
+uvicorn hpc_as_api.app:app --host 0.0.0.0 --port 8001
+```
+
+The gateway is now reachable at `http://localhost:8001/v1/chat/completions` with the standard OpenAI API schema.
+
+## Embed in an existing FastAPI app
+
+```python
+from fastapi import FastAPI
+from hpc_as_api.app import router
+
+app = FastAPI()
+app.include_router(router, prefix="/hpc")
+```
+
+## Configuration reference
+
+| Variable | Default | Description |
+|---|---|---|
+| `GLOBUS_COMPUTE_ENDPOINT_ID` | — | Globus endpoint UUID for the HPC cluster |
+| `HPC_MODELS` | `{}` | JSON dict: model name → HPC config |
+| `RELAY_URL` | — | WebSocket relay URL for token streaming |
+| `RELAY_SECRET` | — | Shared secret for relay auth |
+| `RELAY_ENCRYPTION_KEY` | — | AES-256 hex key for E2E encryption |
+| `USE_GLOBUS_COMPUTE` | `true` | `false` to route directly via SSH tunnel |
+| `LAKESHORE_VLLM_ENDPOINT` | `http://localhost:8000` | Direct vLLM URL (SSH mode) |
+| `HPC_PROXY_HOST` | `0.0.0.0` | Bind host |
+| `HPC_PROXY_PORT` | `8001` | Bind port |
+
+### HPC_MODELS schema
+
+```json
+{
+  "my-model-name": {
+    "hf_name": "org/ModelName",
+    "url": "http://compute-node:8000",
+    "context_reserve_output": 4096
+  }
+}
+```
+
+## Authentication
+
+The gateway supports two auth modes (configured in `hpc_as_api/auth.py`):
+
+- **Globus token**: Bearer token from Globus Auth, validated via introspection
+- **API key**: Static key from `HPC_API_KEYS` env var (comma-separated)
+
+## Development
+
+```bash
+git clone https://github.com/uicacer/hpc-as-api
+cd hpc-as-api
+uv sync --extra dev
+uv run pytest
+```
+
+## Related
+
+- [streamrelay](https://github.com/uicacer/streamrelay) — WebSocket relay for real-time token streaming from Globus Compute
+- [STREAM](https://github.com/uicacer/stream) — Full tiered LLM routing system that uses hpc-as-api
+
+## License
+
+Apache 2.0 — see [LICENSE](LICENSE).
+
+## Citation
+
+If you use hpc-as-api in research, please cite:
+
+```bibtex
+@software{nassar2025hpcgateway,
+  author = {Nassar, Anas},
+  title  = {hpc-as-api: OpenAI-compatible API gateway for HPC clusters via Globus Compute},
+  year   = {2025},
+  url    = {https://github.com/uicacer/hpc-as-api}
+}
+```