flash-xlstm-exp 0.1.0__tar.gz

flash_xlstm_exp-0.1.0/LICENSE

@@ -0,0 +1,102 @@
+NXAI COMMUNITY LICENSE AGREEMENT
+
+Preamble 1
+We are proud to present the NXAI xLSTM 7B model and software, demonstrating the strength of next-generation RNN-based large language models, delivering high-quality performance and fast inference speeds. While xLSTM 7B is freely available for open research and development, we believe that organizations significantly benefiting from our technology should contribute back. Our goal is to support research, small and medium-sized enterprises (SMEs), and open innovation, while ensuring that large enterprises who incorporate xLSTM 7B into commercial products or services fairly compensate the creators for their research and development efforts.
+Linz, December 12, 2024.
+
+Preamble 2
+The NXAI COMMUNITY LICENSE AGREEMENT is based on the META LLAMA 3 COMMUNITY LICENSE AGREEMENT and contains some modifications, especially Section 2, “Additional Commercial Terms” is different.
+
+“Agreement” means the terms and conditions for use, reproduction, distribution and modification of the NXAI Materials set forth herein.
+“Documentation” means the specifications, manuals and documentation accompanying NXAI Materials distributed by NXAI at https://github.com/NX-AI/.
+“Licensee” or “you” means you, or your employer or any other person or entity (if you are entering into this Agreement on such person or entity’s behalf), of the age required under applicable laws, rules or regulations to provide legal consent and that has legal authority to bind your employer or such other person or entity if you are entering in this Agreement on their behalf.
+“NXAI Materials” means, collectively, NXAI’s proprietary large language models, algorithms and any Software, including machine-learning model code, trained model weights, inference-enabling code, training-enabling code, fine-tuning enabling code and all other work of NXAI in the field of neural networks, Documentation (and any portion thereof) made available under this Agreement.
+“NXAI” or “we” means NXAI GmbH, Linz, Austria.
+
+By using or distributing any portion or element of the NXAI Materials, you agree to be bound by this Agreement.
+
+1. License Rights and Redistribution.
+
+    a. Grant of Rights. You are granted a non-exclusive, worldwide, non-transferable and royalty-free limited license under NXAI’s intellectual property embodied in the NXAI Materials to use, reproduce, distribute, copy, create derivative works of, and make modifications to the NXAI Materials.
+
+    b. Redistribution and Use.
+
+        i. If you distribute or make available the NXAI Materials (or any derivative works thereof), or a product or service that uses any of them, including another AI model, you shall (A) provide a copy of this Agreement with any such NXAI Materials; and (B) prominently display “Built with technology from NXAI” on a related website, user interface, blogpost, about page, or product documentation.
+
+        ii. If you receive NXAI Materials, or any derivative works thereof, from a Licensee as part of an integrated end user product, then Section 2 of this Agreement will not apply to you.
+
+        iii. You must retain in all copies of the NXAI Materials that you distribute the following attribution notice within a “Notice” text file distributed as a part of such copies: “This product includes materials developed at NXAI that are licensed under the NXAI Community License, Copyright © NXAI GmbH, All Rights Reserved.”
+
+2. Additional Commercial Terms. If (a) the Licensee, on a consolidated basis (including parent, subsidiaries, and affiliates), exceeds the annual revenue of one hundred million Euros (€100,000,000), and (b) the Licensee incorporates NXAI Material, in whole or in part, into a Commercial Product or Service, then the Licensee must obtain a commercial license from NXAI, which NXAI may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under this Agreement unless or until NXAI otherwise expressly grants you such rights
+
+3. Disclaimer of Warranty. UNLESS REQUIRED BY APPLICABLE LAW, THE NXAI MATERIALS AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED ON AN “AS IS” BASIS, WITHOUT WARRANTIES OF ANY KIND, AND NXAI DISCLAIMS ALL WARRANTIES OF ANY KIND, BOTH EXPRESS AND IMPLIED, INCLUDING, WITHOUT LIMITATION, ANY WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE FOR DETERMINING THE APPROPRIATENESS OF USING OR REDISTRIBUTING THE NXAI MATERIALS AND ASSUME ANY RISKS ASSOCIATED WITH YOUR USE OF THE NXAI MATERIALS AND ANY OUTPUT AND RESULTS.
+
+4. Limitation of Liability. IN NO EVENT WILL NXAI OR ITS AFFILIATES BE LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT, NEGLIGENCE, PRODUCTS LIABILITY, OR OTHERWISE, ARISING OUT OF THIS AGREEMENT, FOR ANY LOST PROFITS OR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL, EXEMPLARY OR PUNITIVE DAMAGES, EVEN IF NXAI OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF ANY OF THE FOREGOING.
+
+5. Intellectual Property.
+
+    a. No trademark licenses are granted under this Agreement, and in connection with the NXAI Materials, neither NXAI nor Licensee may use any name or mark owned by or associated with the other or any of its affiliates, except as required for reasonable and customary use in describing and redistributing the NXAI Materials or as set forth in this Section 5(a). NXAI hereby grants you a license to use “NXAI” (the “Mark”) solely as required to comply with the last sentence of Section 1.b.i. All goodwill arising out of your use of the Mark will insure to the benefit of NXAI.
+
+    b. Subject to NXAI’s ownership of NXAI Materials and derivatives made by or for NXAI, with respect to any derivative works and modifications of the NXAI Materials that are made by you, as between you and NXAI, you are and will be the owner of such derivative works and modifications.
+
+c. If you institute litigation or other proceedings against NXAI or any entity (including a cross-claim or counterclaim in a lawsuit) alleging that the NXAI Materials or models released by NXAI outputs or results, or any portion of any of the foregoing, constitutes infringement of intellectual property or other rights owned or licensable by you, then any licenses granted to you under this Agreement shall terminate as of the date such litigation or claim is filed or instituted. You will indemnify and hold harmless NXAI from and against any claim by any third party arising out of or related to your use or distribution of the NXAI Materials.
+
+6. Term and Termination. The term of this Agreement will commence upon your acceptance of this Agreement or access to the NXAI Materials and will continue in full force and effect until terminated in accordance with the terms and conditions herein. NXAI may terminate this Agreement if you are in breach of any term or condition of this Agreement. Upon termination of this Agreement, you shall delete and cease use of the NXAI Materials. Sections 3, 4 and 7 shall survive the termination of this Agreement.
+
+7. Governing Law and Jurisdiction. This Agreement shall be governed by and construed in accordance with the laws of the Republic of Austria, without regard to its conflict of laws principles. The courts located in Linz, Austria shall have exclusive jurisdiction over any disputes arising out of or in connection with this Agreement.
+
+====================================================================================================
+
+This product includes software licensed under the MIT License:
+
+MIT License
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files
+(the "Software"), to deal in the Software without restriction,
+including without limitation the rights to use, copy, modify, merge,
+publish, distribute, sublicense, and/or sell copies of the Software,
+and to permit persons to whom the Software is furnished to do so,
+subject to the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.
+IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY
+CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT,
+TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE
+SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
+
+====================================================================================================
+
+This product includes software licensed under the BSD-3-Clause License.
+
+BSD 3-Clause License
+
+Redistribution and use in source and binary forms, with or without
+modification, are permitted provided that the following conditions are met:
+
+* Redistributions of source code must retain the above copyright notice, this
+  list of conditions and the following disclaimer.
+
+* Redistributions in binary form must reproduce the above copyright notice,
+  this list of conditions and the following disclaimer in the documentation
+  and/or other materials provided with the distribution.
+
+* Neither the name of the copyright holder nor the names of its
+  contributors may be used to endorse or promote products derived from
+  this software without specific prior written permission.
+
+THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
+AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
+IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE
+FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
+DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
+SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
+CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
+OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
+OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

flash_xlstm_exp-0.1.0/MANIFEST.in

@@ -0,0 +1,3 @@
+include LICENSE
+include NOTICE
+include README.md

flash_xlstm_exp-0.1.0/NOTICE

@@ -0,0 +1,19 @@
+This product includes materials developed at NXAI that are licensed under
+the NXAI Community License, Copyright © NXAI GmbH, All Rights Reserved.
+
+Portions of this repository (fsp/vendor/**) are vendored, with minimal
+import-path adaptations, from:
+
+    NX-AI/mlstm_kernels
+    https://github.com/NX-AI/mlstm_kernels
+    Copyright (c) NXAI GmbH
+    Authors: Maximilian Beck, Korbinian Pöppel, Phillip Lippe, and contributors
+    Licensed under the NXAI Community License Agreement (see LICENSE)
+
+Original paper:
+
+    Tiled Flash Linear Attention: More Efficient Linear RNN and xLSTM Kernels
+    Maximilian Beck, Korbinian Pöppel, Phillip Lippe, Sepp Hochreiter
+    https://arxiv.org/abs/2503.14376
+
+flash_xlstm_exp (fsp) — Built with technology from NXAI.

flash_xlstm_exp-0.1.0/PKG-INFO

@@ -0,0 +1,217 @@
+Metadata-Version: 2.4
+Name: flash-xlstm-exp
+Version: 0.1.0
+Summary: Fork-and-upgrade experiments on top of NX-AI TFLA mLSTM Triton kernels.
+Author: Nata
+License: NXAI COMMUNITY LICENSE AGREEMENT
+        
+        Preamble 1
+        We are proud to present the NXAI xLSTM 7B model and software, demonstrating the strength of next-generation RNN-based large language models, delivering high-quality performance and fast inference speeds. While xLSTM 7B is freely available for open research and development, we believe that organizations significantly benefiting from our technology should contribute back. Our goal is to support research, small and medium-sized enterprises (SMEs), and open innovation, while ensuring that large enterprises who incorporate xLSTM 7B into commercial products or services fairly compensate the creators for their research and development efforts.
+        Linz, December 12, 2024.
+        
+        Preamble 2
+        The NXAI COMMUNITY LICENSE AGREEMENT is based on the META LLAMA 3 COMMUNITY LICENSE AGREEMENT and contains some modifications, especially Section 2, “Additional Commercial Terms” is different.
+        
+        “Agreement” means the terms and conditions for use, reproduction, distribution and modification of the NXAI Materials set forth herein.
+        “Documentation” means the specifications, manuals and documentation accompanying NXAI Materials distributed by NXAI at https://github.com/NX-AI/.
+        “Licensee” or “you” means you, or your employer or any other person or entity (if you are entering into this Agreement on such person or entity’s behalf), of the age required under applicable laws, rules or regulations to provide legal consent and that has legal authority to bind your employer or such other person or entity if you are entering in this Agreement on their behalf.
+        “NXAI Materials” means, collectively, NXAI’s proprietary large language models, algorithms and any Software, including machine-learning model code, trained model weights, inference-enabling code, training-enabling code, fine-tuning enabling code and all other work of NXAI in the field of neural networks, Documentation (and any portion thereof) made available under this Agreement.
+        “NXAI” or “we” means NXAI GmbH, Linz, Austria.
+        
+        By using or distributing any portion or element of the NXAI Materials, you agree to be bound by this Agreement.
+        
+        1. License Rights and Redistribution.
+        
+            a. Grant of Rights. You are granted a non-exclusive, worldwide, non-transferable and royalty-free limited license under NXAI’s intellectual property embodied in the NXAI Materials to use, reproduce, distribute, copy, create derivative works of, and make modifications to the NXAI Materials.
+        
+            b. Redistribution and Use.
+        
+                i. If you distribute or make available the NXAI Materials (or any derivative works thereof), or a product or service that uses any of them, including another AI model, you shall (A) provide a copy of this Agreement with any such NXAI Materials; and (B) prominently display “Built with technology from NXAI” on a related website, user interface, blogpost, about page, or product documentation.
+        
+                ii. If you receive NXAI Materials, or any derivative works thereof, from a Licensee as part of an integrated end user product, then Section 2 of this Agreement will not apply to you.
+        
+                iii. You must retain in all copies of the NXAI Materials that you distribute the following attribution notice within a “Notice” text file distributed as a part of such copies: “This product includes materials developed at NXAI that are licensed under the NXAI Community License, Copyright © NXAI GmbH, All Rights Reserved.”
+        
+        2. Additional Commercial Terms. If (a) the Licensee, on a consolidated basis (including parent, subsidiaries, and affiliates), exceeds the annual revenue of one hundred million Euros (€100,000,000), and (b) the Licensee incorporates NXAI Material, in whole or in part, into a Commercial Product or Service, then the Licensee must obtain a commercial license from NXAI, which NXAI may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under this Agreement unless or until NXAI otherwise expressly grants you such rights
+        
+        3. Disclaimer of Warranty. UNLESS REQUIRED BY APPLICABLE LAW, THE NXAI MATERIALS AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED ON AN “AS IS” BASIS, WITHOUT WARRANTIES OF ANY KIND, AND NXAI DISCLAIMS ALL WARRANTIES OF ANY KIND, BOTH EXPRESS AND IMPLIED, INCLUDING, WITHOUT LIMITATION, ANY WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE FOR DETERMINING THE APPROPRIATENESS OF USING OR REDISTRIBUTING THE NXAI MATERIALS AND ASSUME ANY RISKS ASSOCIATED WITH YOUR USE OF THE NXAI MATERIALS AND ANY OUTPUT AND RESULTS.
+        
+        4. Limitation of Liability. IN NO EVENT WILL NXAI OR ITS AFFILIATES BE LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT, NEGLIGENCE, PRODUCTS LIABILITY, OR OTHERWISE, ARISING OUT OF THIS AGREEMENT, FOR ANY LOST PROFITS OR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL, EXEMPLARY OR PUNITIVE DAMAGES, EVEN IF NXAI OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF ANY OF THE FOREGOING.
+        
+        5. Intellectual Property.
+        
+            a. No trademark licenses are granted under this Agreement, and in connection with the NXAI Materials, neither NXAI nor Licensee may use any name or mark owned by or associated with the other or any of its affiliates, except as required for reasonable and customary use in describing and redistributing the NXAI Materials or as set forth in this Section 5(a). NXAI hereby grants you a license to use “NXAI” (the “Mark”) solely as required to comply with the last sentence of Section 1.b.i. All goodwill arising out of your use of the Mark will insure to the benefit of NXAI.
+        
+            b. Subject to NXAI’s ownership of NXAI Materials and derivatives made by or for NXAI, with respect to any derivative works and modifications of the NXAI Materials that are made by you, as between you and NXAI, you are and will be the owner of such derivative works and modifications.
+        
+        c. If you institute litigation or other proceedings against NXAI or any entity (including a cross-claim or counterclaim in a lawsuit) alleging that the NXAI Materials or models released by NXAI outputs or results, or any portion of any of the foregoing, constitutes infringement of intellectual property or other rights owned or licensable by you, then any licenses granted to you under this Agreement shall terminate as of the date such litigation or claim is filed or instituted. You will indemnify and hold harmless NXAI from and against any claim by any third party arising out of or related to your use or distribution of the NXAI Materials.
+        
+        6. Term and Termination. The term of this Agreement will commence upon your acceptance of this Agreement or access to the NXAI Materials and will continue in full force and effect until terminated in accordance with the terms and conditions herein. NXAI may terminate this Agreement if you are in breach of any term or condition of this Agreement. Upon termination of this Agreement, you shall delete and cease use of the NXAI Materials. Sections 3, 4 and 7 shall survive the termination of this Agreement.
+        
+        7. Governing Law and Jurisdiction. This Agreement shall be governed by and construed in accordance with the laws of the Republic of Austria, without regard to its conflict of laws principles. The courts located in Linz, Austria shall have exclusive jurisdiction over any disputes arising out of or in connection with this Agreement.
+        
+        ====================================================================================================
+        
+        This product includes software licensed under the MIT License:
+        
+        MIT License
+        
+        Permission is hereby granted, free of charge, to any person obtaining
+        a copy of this software and associated documentation files
+        (the "Software"), to deal in the Software without restriction,
+        including without limitation the rights to use, copy, modify, merge,
+        publish, distribute, sublicense, and/or sell copies of the Software,
+        and to permit persons to whom the Software is furnished to do so,
+        subject to the following conditions:
+        
+        The above copyright notice and this permission notice shall be
+        included in all copies or substantial portions of the Software.
+        
+        THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+        EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+        MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.
+        IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY
+        CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT,
+        TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE
+        SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
+        
+        ====================================================================================================
+        
+        This product includes software licensed under the BSD-3-Clause License.
+        
+        BSD 3-Clause License
+        
+        Redistribution and use in source and binary forms, with or without
+        modification, are permitted provided that the following conditions are met:
+        
+        * Redistributions of source code must retain the above copyright notice, this
+          list of conditions and the following disclaimer.
+        
+        * Redistributions in binary form must reproduce the above copyright notice,
+          this list of conditions and the following disclaimer in the documentation
+          and/or other materials provided with the distribution.
+        
+        * Neither the name of the copyright holder nor the names of its
+          contributors may be used to endorse or promote products derived from
+          this software without specific prior written permission.
+        
+        THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
+        AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
+        IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+        DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE
+        FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
+        DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
+        SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
+        CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
+        OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
+        OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+        
+Project-URL: Repository, https://github.com/Natarizki/flash_xlstm_exp
+Project-URL: Upstream, https://github.com/NX-AI/mlstm_kernels
+Project-URL: Author, https://github.com/Natarizki
+Keywords: xlstm,mlstm,triton,flash-attention,linear-attention,tfla,deep-learning
+Classifier: Development Status :: 2 - Pre-Alpha
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Science/Research
+Classifier: License :: Other/Proprietary License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Environment :: GPU :: NVIDIA CUDA
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+License-File: LICENSE
+License-File: NOTICE
+Requires-Dist: torch>=2.4
+Requires-Dist: triton>=3.0
+Requires-Dist: einops>=0.7
+Provides-Extra: dev
+Requires-Dist: pytest>=8.0; extra == "dev"
+Dynamic: license-file
+
+# flash_xlstm_exp (fsp)
+
+Experimental fork-and-upgrade of NX-AI's **TFLA** (Tiled Flash Linear
+Attention) mLSTM kernels, targeting further GPU/Triton-level optimization
+on top of the official implementation.
+
+Built with technology from NXAI. See [NOTICE](./NOTICE) and
+[LICENSE](./LICENSE) — this repo is derived from
+[`NX-AI/mlstm_kernels`](https://github.com/NX-AI/mlstm_kernels), licensed
+under the **NXAI Community License Agreement**, not a permissive OSS
+license. Redistributing fsp (or derivatives of it) requires keeping the
+LICENSE + NOTICE files and the "Built with technology from NXAI" attribution
+intact. See the NXAI Community License for the (currently inapplicable to
+solo/small-scale use) large-enterprise commercial terms.
+
+## Upgrade roadmap
+
+| # | Upgrade | Status |
+|---|---------|--------|
+| 1 | Dynamic tile-size autotuner (`triton.autotune` in place of the static `get_head_dim_block_size` / hardcoded `siz_b_LQ=32,siz_b_LKV=32` heuristic) | **Implemented** — `fsp/kernels/autotune.py` |
+| 2 | Fused recurrent+parallel forward kernel (avoid materializing intermediate chunk states to HBM between the two kernel launches) | Planned |
+| 3 | Quantized (fp8/int8) memory state `C` for long-context inference | Planned |
+
+## Why GPU-only
+
+TFLA's kernels are written in [Triton](https://github.com/triton-lang/triton)
+and target NVIDIA/AMD GPUs via CUDA/ROCm. There is currently no Triton
+backend for mobile/ARM64-without-GPU environments (e.g. Termux on Android),
+so fsp's kernels can be *written and code-reviewed* in such an environment,
+but must be **benchmarked and numerically validated on an actual CUDA (or
+ROCm) GPU** — a local NVIDIA GPU, or a rented cloud GPU instance.
+
+## Layout
+
+```
+fsp/
+├── vendor/                  # Baseline TFLA, vendored from NX-AI/mlstm_kernels
+│   ├── triton_kernels/      #   - the @triton.jit kernels themselves
+│   ├── torch_fw/            #   - PyTorch launchers/wrappers (forward pass only, so far)
+│   └── utils/               #   - small shared dtype/validation helpers
+├── kernels/
+│   └── autotune.py          # Upgrade #1: autotuned forward-parallel kernel
+└── benchmark/
+    └── bench_autotune_vs_baseline.py
+tests/
+└── test_autotune_equivalence.py
+```
+
+> **Scope note:** only the *forward* pass (recurrent + parallel kernels) is
+> vendored so far. Backward-pass kernels
+> (`bw_kernel_parallel_dK/dQ/dV`, `bw_kernel_recurrent`) will be vendored in
+> a later batch once the forward-pass upgrades are validated on real
+> hardware.
+
+## Install
+
+```bash
+pip install torch triton
+pip install -e .
+```
+
+## Usage
+
+```python
+from fsp.kernels.autotune import mlstm_chunkwise__parallel_fw_Hintra_autotuned
+
+matH_out, vecN_out, vecM_out = mlstm_chunkwise__parallel_fw_Hintra_autotuned(
+    matQ, matK, matV, vecI, vecF,
+    matC_states, vecN_states, scaMinter_states,
+    chunk_size=128,
+)
+```
+
+Drop-in replacement for
+`fsp.vendor.torch_fw.fw_parallel.mlstm_chunkwise__parallel_fw_Hintra` — same
+inputs/outputs, same math, but tile sizes are chosen empirically per shape
+instead of by static heuristic.
+
+## Running tests / benchmarks
+
+Both require a CUDA-capable GPU:
+
+```bash
+pytest tests/test_autotune_equivalence.py
+python -m fsp.benchmark.bench_autotune_vs_baseline
+```

flash_xlstm_exp-0.1.0/README.md

@@ -0,0 +1,86 @@
+# flash_xlstm_exp (fsp)
+
+Experimental fork-and-upgrade of NX-AI's **TFLA** (Tiled Flash Linear
+Attention) mLSTM kernels, targeting further GPU/Triton-level optimization
+on top of the official implementation.
+
+Built with technology from NXAI. See [NOTICE](./NOTICE) and
+[LICENSE](./LICENSE) — this repo is derived from
+[`NX-AI/mlstm_kernels`](https://github.com/NX-AI/mlstm_kernels), licensed
+under the **NXAI Community License Agreement**, not a permissive OSS
+license. Redistributing fsp (or derivatives of it) requires keeping the
+LICENSE + NOTICE files and the "Built with technology from NXAI" attribution
+intact. See the NXAI Community License for the (currently inapplicable to
+solo/small-scale use) large-enterprise commercial terms.
+
+## Upgrade roadmap
+
+| # | Upgrade | Status |
+|---|---------|--------|
+| 1 | Dynamic tile-size autotuner (`triton.autotune` in place of the static `get_head_dim_block_size` / hardcoded `siz_b_LQ=32,siz_b_LKV=32` heuristic) | **Implemented** — `fsp/kernels/autotune.py` |
+| 2 | Fused recurrent+parallel forward kernel (avoid materializing intermediate chunk states to HBM between the two kernel launches) | Planned |
+| 3 | Quantized (fp8/int8) memory state `C` for long-context inference | Planned |
+
+## Why GPU-only
+
+TFLA's kernels are written in [Triton](https://github.com/triton-lang/triton)
+and target NVIDIA/AMD GPUs via CUDA/ROCm. There is currently no Triton
+backend for mobile/ARM64-without-GPU environments (e.g. Termux on Android),
+so fsp's kernels can be *written and code-reviewed* in such an environment,
+but must be **benchmarked and numerically validated on an actual CUDA (or
+ROCm) GPU** — a local NVIDIA GPU, or a rented cloud GPU instance.
+
+## Layout
+
+```
+fsp/
+├── vendor/                  # Baseline TFLA, vendored from NX-AI/mlstm_kernels
+│   ├── triton_kernels/      #   - the @triton.jit kernels themselves
+│   ├── torch_fw/            #   - PyTorch launchers/wrappers (forward pass only, so far)
+│   └── utils/               #   - small shared dtype/validation helpers
+├── kernels/
+│   └── autotune.py          # Upgrade #1: autotuned forward-parallel kernel
+└── benchmark/
+    └── bench_autotune_vs_baseline.py
+tests/
+└── test_autotune_equivalence.py
+```
+
+> **Scope note:** only the *forward* pass (recurrent + parallel kernels) is
+> vendored so far. Backward-pass kernels
+> (`bw_kernel_parallel_dK/dQ/dV`, `bw_kernel_recurrent`) will be vendored in
+> a later batch once the forward-pass upgrades are validated on real
+> hardware.
+
+## Install
+
+```bash
+pip install torch triton
+pip install -e .
+```
+
+## Usage
+
+```python
+from fsp.kernels.autotune import mlstm_chunkwise__parallel_fw_Hintra_autotuned
+
+matH_out, vecN_out, vecM_out = mlstm_chunkwise__parallel_fw_Hintra_autotuned(
+    matQ, matK, matV, vecI, vecF,
+    matC_states, vecN_states, scaMinter_states,
+    chunk_size=128,
+)
+```
+
+Drop-in replacement for
+`fsp.vendor.torch_fw.fw_parallel.mlstm_chunkwise__parallel_fw_Hintra` — same
+inputs/outputs, same math, but tile sizes are chosen empirically per shape
+instead of by static heuristic.
+
+## Running tests / benchmarks
+
+Both require a CUDA-capable GPU:
+
+```bash
+pytest tests/test_autotune_equivalence.py
+python -m fsp.benchmark.bench_autotune_vs_baseline
+```