numkong 7.0.0

package/include/numkong/dot/README.md

@@ -0,0 +1,425 @@
+# Vector-Vector Dot Products in NumKong
+
+NumKong implements dot products for every numeric type supported by the library, as the most important building block of higher-level functionality for vectors and higher rank tensors.
+
+Dot product for real numbers and integers is defined as:
+
+```math
+\text{dot}(a, b) = \sum_{i=0}^{n-1} a_i \cdot b_i
+```
+
+For complex numbers, the dot product expands via the distributive property of complex multiplication:
+
+```math
+\text{dot}(a, b) = \sum_{i=0}^{n-1} (a_{i,re} \cdot b_{i,re} - a_{i,im} \cdot b_{i,im}) + j \sum_{i=0}^{n-1} (a_{i,re} \cdot b_{i,im} + a_{i,im} \cdot b_{i,re})
+```
+
+The conjugate dot product negates the imaginary part of $b$:
+
+```math
+\text{vdot}(a, b) = \sum_{i=0}^{n-1} a_i \cdot \bar{b_i} = \sum_{i=0}^{n-1} (a_{i,re} \cdot b_{i,re} + a_{i,im} \cdot b_{i,im}) + j \sum_{i=0}^{n-1} (a_{i,im} \cdot b_{i,re} - a_{i,re} \cdot b_{i,im})
+```
+
+Where $\bar{b_i}$ is the complex conjugate of $b_i$.
+Reformulating as Python pseudocode for interleaved real/imaginary scalar arrays:
+
+```python
+def dot_real(a: List[number], b: List[number]) -> number:
+    return sum(ai * bi for ai, bi in zip(a, b))
+
+def dot_complex(a: List[number], b: List[number]) -> Tuple[number, number]:
+    a_re, a_im = a[0::2], a[1::2]
+    b_re, b_im = b[0::2], b[1::2]
+    ab_re = sum(ar * br - ai * bi for ar, ai, br, bi in zip(a_re, a_im, b_re, b_im))
+    ab_im = sum(ar * bi + ai * br for ar, ai, br, bi in zip(a_re, a_im, b_re, b_im))
+    return ab_re, ab_im
+
+def vdot_complex(a: List[number], b: List[number]) -> Tuple[number, number]:
+    a_re, a_im = a[0::2], a[1::2]
+    b_re, b_im = b[0::2], b[1::2]
+    ab_re = sum(ar * br + ai * bi for ar, ai, br, bi in zip(a_re, a_im, b_re, b_im))
+    ab_im = sum(ai * br - ar * bi for ar, ai, br, bi in zip(a_re, a_im, b_re, b_im))
+    return ab_re, ab_im
+```
+
+## Input & Output Types
+
+Real and integer dot products:
+
+| Input Type | Output Type | Description                                    |
+| ---------- | ----------- | ---------------------------------------------- |
+| `f64`      | `f64`       | 64-bit IEEE 754 double precision               |
+| `f32`      | `f32`       | 32-bit IEEE 754 single precision               |
+| `f16`      | `f32`       | 16-bit IEEE 754 half precision, widened output |
+| `bf16`     | `f32`       | 16-bit brain float, widened output             |
+| `e4m3`     | `f32`       | 8-bit Float8: 4 exponent, 3 mantissa bits      |
+| `e5m2`     | `f32`       | 8-bit Float8: 5 exponent, 2 mantissa bits      |
+| `e2m3`     | `f32`       | 8-bit MX format: 2 exponent, 3 mantissa bits   |
+| `e3m2`     | `f32`       | 8-bit MX format: 3 exponent, 2 mantissa bits   |
+| `i8`       | `i32`       | 8-bit signed integers                          |
+| `u8`       | `u32`       | 8-bit unsigned integers                        |
+| `i4`       | `i32`       | 4-bit signed integers, packed nibble pairs     |
+| `u4`       | `u32`       | 4-bit unsigned integers, packed nibble pairs   |
+| `u1`       | `u32`       | 1-bit binary packed octets, popcount of AND    |
+
+Complex dot products (both `dot` and `vdot`):
+
+| Input Type | Output Type | Description                                |
+| ---------- | ----------- | ------------------------------------------ |
+| `f64c`     | `f64c`      | 64-bit complex pairs                       |
+| `f32c`     | `f32c`      | 32-bit complex pairs                       |
+| `f16c`     | `f32c`      | 16-bit complex pairs, widened output       |
+| `bf16c`    | `f32c`      | 16-bit brain complex pairs, widened output |
+
+## Optimizations
+
+### Compensated Arithmetic for Large Floats
+
+`nk_dot_f64_serial` uses Neumaier compensated summation — tracking a correction term adjusted by magnitude comparison at each step.
+`nk_dot_f64_haswell`, `nk_dot_f64_skylake`, `nk_dot_f64_sve` implement the Dot2 algorithm by Ogita, Rump, and Oishi: TwoProd via FMA captures the rounding error of each product exactly, and a TwoSum chain propagates it through the accumulator.
+On SVE, the final horizontal reduction uses `svtbl` to extract upper halves at each tree level, applying TwoSum at every stage.
+The serial path uses Neumaier because it processes one element at a time and can cheaply branch on magnitudes.
+Dot2 avoids those branches entirely — TwoProd and TwoSum are pure arithmetic with no comparisons, mapping naturally to wide SIMD where branching per lane is impossible.
+
+### Lookup Tables for Mini-Floats
+
+`nk_dot_e2m3_haswell`, `nk_dot_e3m2_haswell`, `nk_dot_e2m3_skylake`, `nk_dot_e3m2_skylake` encode 32 MX format values into scaled integers via dual 16-entry LUTs loaded into vector registers.
+The low 4 magnitude bits index `VPSHUFB`, bit 4 selects between the lower and upper table via blending, and the results feed into `VPMADDUBSW` + `VPMADDWD` chains with a final $\div 256$ scaling.
+The Sapphire-specific MX implementation in `sapphire.h` replaces this with a single 64-entry signed LUT via `VPERMUTEX2VAR`, where the sign bit naturally selects between positive and negative tables.
+That path accumulates in native Float16 via `VFMADD_PH` and flushes to Float32 every 128 elements to avoid overflow.
+
+### Algebraic Domain Shifting
+
+`nk_dot_i8_icelake`, `nk_dot_u8_icelake` work around `VPDPBUSD` requiring UInt8 × Int8 operands.
+For Int8 × Int8, one operand is XORed with `0x80` to shift to unsigned, and the correction $128 \cdot \sum b_i$ is computed via `VPSADBW`, which runs on port 5 and avoids contention with `DPBUSD` on ports 0-1.
+`nk_dot_i4_icelake` extends this to packed nibbles using the identity $(a'-8)(b'-8) = a' b' - 8(a'+b') + 64$ — two `VPDPBUSD` calls handle low and high nibbles separately, with SAD-based correction.
+`nk_dot_i8_v128relaxed`, `nk_dot_u8_v128relaxed` face an even tighter constraint: WASM's `i32x4_relaxed_dot_i8x16_i7x16_add` computes Int8 × Int7, so the sign bit of one operand must be masked off entirely.
+For Int8 × Int8, the sign bit of $b$ is cleared to produce a 7-bit value, and a windowed correction $-128 \cdot \sum_{b_i < 0} a_i$ is accumulated in Int16 and flushed every 127 iterations to prevent overflow.
+For UInt8 × UInt8, $b$ is XORed with `0x80` to shift into signed range, same as Ice Lake, with the correction $128 \cdot \sum a_i$ computed via pairwise widening adds.
+
+### Widening Fusion Through BFloat16 on x86
+
+`nk_dot_e4m3_genoa`, `nk_dot_e5m2_genoa` convert FP8 values to BF16, then accumulate via `VDPBF16PS` — repurposing Genoa's BF16 dot-product hardware for types it was never designed for.
+Each `VDPBF16PS` fuses two BF16 multiply-adds per 32-bit lane at 6-cycle throughput.
+`nk_dot_bf16c_genoa` uses the same instruction for complex BF16, preparing operands with `VPSHUFB` for lane swapping and `VPXORD` with `0x80000000` for sign flips before feeding into `VDPBF16PS`.
+
+### Deferred Sign-Flip in Complex Dot Products
+
+The Haswell BFloat16Complex/Float16Complex/Float32Complex kernels compute $\sum (a_r b_r - a_i b_i)$ without per-pair subtraction.
+Instead, two accumulators collect interleaved products $[a_r b_r, a_i b_i, \ldots]$ and $[a_r b_i, a_i b_r, \ldots]$, and a post-loop XOR flips the sign of every odd lane to produce the subtraction.
+This gives one FMA per accumulator per iteration, but each lane grows $O(n)$ while the true result is $O(\sqrt{n})$.
+The Float32Complex kernel absorbs this via Float64 accumulators; Genoa's `VDPBF16PS` and ARM's `FMLSL` pair terms naturally.
+For BFloat16Complex/Float16Complex on Haswell the accumulator is Float32, so the $O(\log n)$ precision loss from lane separation is visible in max ULP at large $n$, though mean ULP remains low.
+
+### Widening Fusion Through Float16 on Arm
+
+`nk_dot_f16_neonfhm`, `nk_dot_f16c_neonfhm` use the ARMv8.4-FHM instructions `FMLAL`/`FMLSL`, which fuse FP16-to-FP32 conversion with multiply-accumulate in a single operation.
+`vfmlalq_low_f16` and `vfmlalq_high_f16` process the lower and upper 4 elements of an 8-wide FP16 vector respectively.
+For complex dot products, `FMLSL` provides the subtraction path $a_{re} b_{im} - a_{im} b_{re}$ without a separate negate step.
+
+### Widening Chains on RISC-V
+
+`nk_dot_i8_rvv`, `nk_dot_u8_rvv` use `vwmul` for Int8 × Int8 → Int16 widening multiply followed by `vwadd` to widen-accumulate into Int32 — a two-stage chain that naturally prevents overflow.
+`nk_dot_bf16_rvvbf16` uses the Zvfbfwma extension's `vfwmaccbf16` for fused BFloat16 × BFloat16 → Float32 widening multiply-accumulate.
+`nk_dot_e4m3_rvvbf16`, `nk_dot_e5m2_rvvbf16` convert Float8 to BFloat16 via 256-entry LUTs, then feed the same `vfwmaccbf16` path.
+
+## Performance
+
+The following performance tables are produced by manually re-running `nk_test` and `nk_bench` included internal tools to measure both accuracy and throughput at different input shapes.
+The input size is controlled by the `NK_DENSE_DIMENSIONS` environment variable and set to 256, 1024, and 4096 elements.
+The throughput is measured in gb/s as the number of bytes read per second amortized for a large batch of vector pairs.
+Accuracy is reported as mean ULP (units in last place) unless noted otherwise — the average number of representable floating-point values between the result and the exact answer.
+Rows marked `🧩` use external BLAS baselines rather than NumKong kernels.
+Each kernel runs for at least 20 seconds per configuration.
+Benchmark threads are pinned to specific cores; on machines with heterogeneous core types (e.g., Apple P/E cores), only the fastest cores are used.
+Workloads that significantly degrade CPU frequencies (Intel AMX, Apple SME) run in separate passes to avoid affecting throughput measurements of other kernels.
+
+### Intel Sapphire Rapids
+
+#### Native
+
+| Kernel                  |                      256 |                     1024 |                     4096 |
+| :---------------------- | -----------------------: | -----------------------: | -----------------------: |
+| __f64c__                | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `dot_f64c_with_blas` 🧩  |        29.1 gb/s, 25 ulp |        27.6 gb/s, 97 ulp |        13.6 gb/s, 32 ulp |
+| `vdot_f64c_with_blas` 🧩 |        29.1 gb/s, 18 ulp |        27.9 gb/s, 17 ulp |        15.3 gb/s, 25 ulp |
+| `nk_dot_f64c_serial`    |       5.45 gb/s, 3.9 ulp |       6.49 gb/s, 9.0 ulp |       6.84 gb/s, 2.9 ulp |
+| `nk_vdot_f64c_serial`   |       5.47 gb/s, 4.6 ulp |       6.41 gb/s, 1.6 ulp |       6.76 gb/s, 2.2 ulp |
+| `nk_dot_f64c_skylake`   |         23.8 gb/s, 0 ulp |         23.4 gb/s, 0 ulp |         11.8 gb/s, 0 ulp |
+| `nk_vdot_f64c_skylake`  |         23.6 gb/s, 0 ulp |         23.7 gb/s, 0 ulp |         11.6 gb/s, 0 ulp |
+| __f32c__                | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `dot_f32c_with_blas` 🧩  |       28.7 gb/s, 8.6 ulp |        29.8 gb/s, 13 ulp |        15.8 gb/s, 19 ulp |
+| `vdot_f32c_with_blas` 🧩 |        29.2 gb/s, 11 ulp |        30.2 gb/s, 14 ulp |        15.7 gb/s, 21 ulp |
+| `nk_dot_f32c_serial`    |         9.46 gb/s, 0 ulp |         9.82 gb/s, 0 ulp |         9.71 gb/s, 0 ulp |
+| `nk_vdot_f32c_serial`   |         9.64 gb/s, 0 ulp |         9.95 gb/s, 0 ulp |         10.1 gb/s, 0 ulp |
+| `nk_dot_f32c_haswell`   |         22.4 gb/s, 0 ulp |         22.2 gb/s, 0 ulp |         12.6 gb/s, 0 ulp |
+| `nk_vdot_f32c_haswell`  |         22.4 gb/s, 0 ulp |         21.8 gb/s, 0 ulp |         14.7 gb/s, 0 ulp |
+| `nk_dot_f32c_skylake`   |         25.6 gb/s, 0 ulp |         27.2 gb/s, 0 ulp |         17.0 gb/s, 0 ulp |
+| `nk_vdot_f32c_skylake`  |         27.8 gb/s, 0 ulp |         27.4 gb/s, 0 ulp |         18.8 gb/s, 0 ulp |
+| __bf16c__               | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_bf16c_serial`   |      0.628 gb/s, 0.1 ulp |      0.627 gb/s, 2.3 ulp |      0.626 gb/s, 7.9 ulp |
+| `nk_vdot_bf16c_serial`  |      0.622 gb/s, 0.2 ulp |      0.624 gb/s, 2.1 ulp |     0.627 gb/s, 11.2 ulp |
+| `nk_dot_bf16c_haswell`  |       21.5 gb/s, 0.1 ulp |       18.5 gb/s, 1.3 ulp |       18.4 gb/s, 3.4 ulp |
+| `nk_vdot_bf16c_haswell` |       21.9 gb/s, 0.8 ulp |       19.0 gb/s, 2.0 ulp |       18.5 gb/s, 4.5 ulp |
+| `nk_dot_bf16c_genoa`    |         37.9 gb/s, 0 ulp |       30.3 gb/s, 1.1 ulp |       29.5 gb/s, 2.8 ulp |
+| `nk_vdot_bf16c_genoa`   |       36.1 gb/s, 0.7 ulp |       30.2 gb/s, 1.2 ulp |       30.2 gb/s, 3.3 ulp |
+| __f16c__                | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f16c_serial`    |      2.02 gb/s, 14.4 ulp |      2.00 gb/s, 27.3 ulp |      2.02 gb/s, 34.0 ulp |
+| `nk_vdot_f16c_serial`   |      1.67 gb/s, 15.0 ulp |      1.64 gb/s, 26.3 ulp |      1.64 gb/s, 34.2 ulp |
+| `nk_dot_f16c_haswell`   |      23.9 gb/s, 12.7 ulp |      19.4 gb/s, 22.3 ulp |      19.3 gb/s, 40.1 ulp |
+| `nk_vdot_f16c_haswell`  |      24.0 gb/s, 11.1 ulp |      20.0 gb/s, 17.4 ulp |      17.1 gb/s, 29.2 ulp |
+| __f64__                 | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `dot_f64_with_blas` 🧩   |       27.8 gb/s, 6.9 ulp |       30.1 gb/s, 9.3 ulp |        15.7 gb/s, 20 ulp |
+| `nk_dot_f64_serial`     |       5.41 gb/s, 2.2 ulp |       6.31 gb/s, 2.0 ulp |       6.77 gb/s, 3.3 ulp |
+| `nk_dot_f64_haswell`    |         21.9 gb/s, 0 ulp |         26.1 gb/s, 0 ulp |         12.4 gb/s, 0 ulp |
+| `nk_dot_f64_skylake`    |         23.9 gb/s, 0 ulp |         27.0 gb/s, 0 ulp |         16.4 gb/s, 0 ulp |
+| __f32__                 | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `dot_f32_with_blas` 🧩   |        47.8 gb/s, 14 ulp |        30.7 gb/s, 14 ulp |        29.7 gb/s, 15 ulp |
+| `nk_dot_f32_serial`     |         11.3 gb/s, 0 ulp |         11.7 gb/s, 0 ulp |         10.7 gb/s, 0 ulp |
+| `nk_dot_f32_haswell`    |         28.0 gb/s, 0 ulp |         23.6 gb/s, 0 ulp |         21.3 gb/s, 0 ulp |
+| `nk_dot_f32_skylake`    |         36.3 gb/s, 0 ulp |         29.2 gb/s, 0 ulp |         23.7 gb/s, 0 ulp |
+| __bf16__                | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_bf16_serial`    |        0.655 gb/s, 0 ulp |      0.644 gb/s, 0.6 ulp |      0.651 gb/s, 5.2 ulp |
+| `nk_dot_bf16_haswell`   |         30.1 gb/s, 0 ulp |       20.3 gb/s, 0.2 ulp |      19.4 gb/s, 41.3 ulp |
+| `nk_dot_bf16_skylake`   |         53.6 gb/s, 0 ulp |       30.4 gb/s, 0.2 ulp |      29.6 gb/s, 21.8 ulp |
+| `nk_dot_bf16_genoa`     |         88.1 gb/s, 0 ulp |       31.6 gb/s, 0.2 ulp |       31.1 gb/s, 2.2 ulp |
+| __f16__                 | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f16_serial`     |      1.38 gb/s, 11.5 ulp |      1.37 gb/s, 33.7 ulp |      1.32 gb/s, 59.7 ulp |
+| `nk_dot_f16_haswell`    |       30.6 gb/s, 7.0 ulp |      23.3 gb/s, 14.0 ulp |      20.0 gb/s, 29.8 ulp |
+| `nk_dot_f16_skylake`    |       54.4 gb/s, 6.2 ulp |       31.4 gb/s, 8.6 ulp |      30.0 gb/s, 22.8 ulp |
+| __e5m2__                | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e5m2_serial`    |         1.99 gb/s, 0 ulp |         2.11 gb/s, 0 ulp |         2.13 gb/s, 0 ulp |
+| `nk_dot_e5m2_haswell`   |         4.90 gb/s, 0 ulp |         4.87 gb/s, 0 ulp |         4.56 gb/s, 0 ulp |
+| `nk_dot_e5m2_skylake`   |         6.34 gb/s, 0 ulp |         6.45 gb/s, 0 ulp |         6.17 gb/s, 0 ulp |
+| `nk_dot_e5m2_genoa`     |         12.6 gb/s, 0 ulp |         12.7 gb/s, 0 ulp |         12.8 gb/s, 0 ulp |
+| __e4m3__                | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e4m3_serial`    |        0.797 gb/s, 0 ulp |        0.801 gb/s, 0 ulp |        0.816 gb/s, 0 ulp |
+| `nk_dot_e4m3_haswell`   |         3.25 gb/s, 0 ulp |         3.25 gb/s, 0 ulp |         2.53 gb/s, 0 ulp |
+| `nk_dot_e4m3_skylake`   |         4.99 gb/s, 0 ulp |         5.03 gb/s, 0 ulp |         4.94 gb/s, 0 ulp |
+| `nk_dot_e4m3_genoa`     |         12.4 gb/s, 0 ulp |         13.0 gb/s, 0 ulp |         12.7 gb/s, 0 ulp |
+| __e3m2__                | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e3m2_serial`    |         2.02 gb/s, 0 ulp |         2.08 gb/s, 0 ulp |         2.14 gb/s, 0 ulp |
+| `nk_dot_e3m2_haswell`   |         11.9 gb/s, 0 ulp |         12.0 gb/s, 0 ulp |         11.5 gb/s, 0 ulp |
+| `nk_dot_e3m2_icelake`   |         22.6 gb/s, 0 ulp |         24.1 gb/s, 0 ulp |         22.5 gb/s, 0 ulp |
+| __e2m3__                | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e2m3_serial`    |         2.07 gb/s, 0 ulp |         2.05 gb/s, 0 ulp |         2.14 gb/s, 0 ulp |
+| `nk_dot_e2m3_haswell`   |         20.0 gb/s, 0 ulp |         19.5 gb/s, 0 ulp |         18.7 gb/s, 0 ulp |
+| `nk_dot_e2m3_icelake`   |         56.9 gb/s, 0 ulp |         43.1 gb/s, 0 ulp |         30.1 gb/s, 0 ulp |
+| `nk_dot_e2m3_alder`     |         29.8 gb/s, 0 ulp |         30.2 gb/s, 0 ulp |         25.6 gb/s, 0 ulp |
+| __i8__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_i8_serial`      |                17.4 gb/s |                17.2 gb/s |                16.0 gb/s |
+| `nk_dot_i8_haswell`     |                33.4 gb/s |                23.5 gb/s |                24.9 gb/s |
+| `nk_dot_i8_skylake`     |                53.6 gb/s |                39.9 gb/s |                29.7 gb/s |
+| `nk_dot_i8_icelake`     |                63.3 gb/s |                49.5 gb/s |                30.4 gb/s |
+| `nk_dot_i8_alder`       |                43.8 gb/s |                43.0 gb/s |                30.4 gb/s |
+| __u8__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_u8_serial`      |                17.4 gb/s |                17.1 gb/s |                16.3 gb/s |
+| `nk_dot_u8_haswell`     |                32.2 gb/s |                37.5 gb/s |                28.3 gb/s |
+| `nk_dot_u8_skylake`     |                54.6 gb/s |                41.0 gb/s |                28.4 gb/s |
+| `nk_dot_u8_icelake`     |                74.4 gb/s |                48.4 gb/s |                30.3 gb/s |
+| `nk_dot_u8_alder`       |                54.2 gb/s |                43.9 gb/s |                32.3 gb/s |
+| __i4__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_i4_serial`      |                9.37 gb/s |                11.8 gb/s |                11.8 gb/s |
+| `nk_dot_i4_haswell`     |                8.39 gb/s |                8.47 gb/s |                8.30 gb/s |
+| `nk_dot_i4_icelake`     |                24.9 gb/s |                35.9 gb/s |                25.8 gb/s |
+| __u4__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_u4_serial`      |                10.6 gb/s |                12.0 gb/s |                11.9 gb/s |
+| `nk_dot_u4_haswell`     |                15.2 gb/s |                16.0 gb/s |                14.4 gb/s |
+| `nk_dot_u4_icelake`     |                49.6 gb/s |                58.3 gb/s |                29.6 gb/s |
+| __u1__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_u1_serial`      |                3.92 gb/s |                5.04 gb/s |                4.97 gb/s |
+| `nk_dot_u1_haswell`     |                14.2 gb/s |                46.7 gb/s |                70.9 gb/s |
+| `nk_dot_u1_icelake`     |                21.1 gb/s |                70.9 gb/s |                 109 gb/s |
+
+#### WASM
+
+Measured with Wasmtime v42 (Cranelift backend).
+
+| Kernel                     |                      256 |                     1024 |                     4096 |
+| :------------------------- | -----------------------: | -----------------------: | -----------------------: |
+| __f64c__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f64c_serial`       |       1.76 gb/s, 5.3 ulp |       2.43 gb/s, 3.3 ulp |       0.28 gb/s, 2.9 ulp |
+| `nk_vdot_f64c_serial`      |       1.02 gb/s, 3.5 ulp |       2.44 gb/s, 5.5 ulp |       0.15 gb/s, 2.2 ulp |
+| `nk_dot_f64c_v128relaxed`  |      2.80 gb/s, 37.8 ulp |      3.01 gb/s, 34.9 ulp |       0.21 gb/s, 167 ulp |
+| `nk_vdot_f64c_v128relaxed` |      2.06 gb/s, 20.1 ulp |      2.87 gb/s, 51.4 ulp |      0.04 gb/s, 57.2 ulp |
+| __f32c__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f32c_serial`       |         1.26 gb/s, 0 ulp |         1.74 gb/s, 0 ulp |         0.08 gb/s, 0 ulp |
+| `nk_vdot_f32c_serial`      |         1.13 gb/s, 0 ulp |         1.78 gb/s, 0 ulp |         0.21 gb/s, 0 ulp |
+| `nk_dot_f32c_v128relaxed`  |         1.62 gb/s, 0 ulp |         1.92 gb/s, 0 ulp |         0.20 gb/s, 0 ulp |
+| `nk_vdot_f32c_v128relaxed` |         1.66 gb/s, 0 ulp |         1.69 gb/s, 0 ulp |         0.13 gb/s, 0 ulp |
+| __bf16c__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_bf16c_serial`      |       1.00 gb/s, 0.1 ulp |       2.29 gb/s, 1.7 ulp |       0.08 gb/s, 7.9 ulp |
+| `nk_vdot_bf16c_serial`     |      0.581 gb/s, 0.1 ulp |      0.919 gb/s, 2.9 ulp |      0.30 gb/s, 11.2 ulp |
+| __f16c__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f16c_serial`       |      1.39 gb/s, 12.6 ulp |     0.759 gb/s, 22.2 ulp |        0.23 gb/s, 34 ulp |
+| `nk_vdot_f16c_serial`      |      1.11 gb/s, 14.4 ulp |     0.828 gb/s, 41.8 ulp |      0.02 gb/s, 34.2 ulp |
+| __f64__                    | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f64_serial`        |       1.53 gb/s, 3.1 ulp |       1.72 gb/s, 2.5 ulp |       0.20 gb/s, 3.3 ulp |
+| `nk_dot_f64_v128relaxed`   |       2.62 gb/s, 3.2 ulp |       2.11 gb/s, 3.6 ulp |       0.28 gb/s, 3.8 ulp |
+| __f32__                    | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f32_serial`        |         1.95 gb/s, 0 ulp |         1.89 gb/s, 0 ulp |         0.28 gb/s, 0 ulp |
+| `nk_dot_f32_v128relaxed`   |        0.083 gb/s, 0 ulp |         1.61 gb/s, 0 ulp |         1.37 gb/s, 0 ulp |
+| __bf16__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_bf16_serial`       |         2.90 gb/s, 0 ulp |       2.27 gb/s, 0.5 ulp |       0.22 gb/s, 5.2 ulp |
+| `nk_dot_bf16_v128relaxed`  |        0.521 gb/s, 0 ulp |       2.30 gb/s, 0.3 ulp |       0.30 gb/s, 2.4 ulp |
+| __f16__                    | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f16_serial`        |     0.648 gb/s, 13.5 ulp |       0.712 gb/s, 32 ulp |      0.08 gb/s, 59.7 ulp |
+| `nk_dot_f16_v128relaxed`   |       1.58 gb/s, 7.0 ulp |      1.05 gb/s, 30.8 ulp |      0.09 gb/s, 65.1 ulp |
+| __e5m2__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e5m2_serial`       |         1.27 gb/s, 0 ulp |        0.679 gb/s, 0 ulp |         0.10 gb/s, 0 ulp |
+| `nk_dot_e5m2_v128relaxed`  |        0.970 gb/s, 0 ulp |        0.955 gb/s, 0 ulp |         0.17 gb/s, 0 ulp |
+| __e4m3__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e4m3_serial`       |        0.312 gb/s, 0 ulp |        0.342 gb/s, 0 ulp |         0.12 gb/s, 0 ulp |
+| `nk_dot_e4m3_v128relaxed`  |         1.05 gb/s, 0 ulp |        0.721 gb/s, 0 ulp |         0.30 gb/s, 0 ulp |
+| __e3m2__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e3m2_serial`       |        0.565 gb/s, 0 ulp |        0.552 gb/s, 0 ulp |         0.06 gb/s, 0 ulp |
+| `nk_dot_e3m2_v128relaxed`  |        0.670 gb/s, 0 ulp |         2.91 gb/s, 0 ulp |         0.24 gb/s, 0 ulp |
+| __e2m3__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e2m3_serial`       |        0.584 gb/s, 0 ulp |        0.661 gb/s, 0 ulp |         0.07 gb/s, 0 ulp |
+| `nk_dot_e2m3_v128relaxed`  |         2.69 gb/s, 0 ulp |        0.131 gb/s, 0 ulp |         0.09 gb/s, 0 ulp |
+| __i8__                     | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_i8_serial`         |                1.17 gb/s |                1.17 gb/s |                0.29 gb/s |
+| `nk_dot_i8_v128relaxed`    |                1.71 gb/s |               0.896 gb/s |                0.24 gb/s |
+| __u8__                     | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_u8_serial`         |                1.16 gb/s |               0.658 gb/s |                0.30 gb/s |
+| `nk_dot_u8_v128relaxed`    |               0.873 gb/s |               0.997 gb/s |                0.15 gb/s |
+| __i4__                     | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_i4_serial`         |               0.217 gb/s |               0.226 gb/s |                0.28 gb/s |
+| `nk_dot_i4_v128relaxed`    |                1.53 gb/s |                2.87 gb/s |                0.24 gb/s |
+| __u4__                     | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_u4_serial`         |               0.303 gb/s |               0.250 gb/s |               0.003 gb/s |
+| `nk_dot_u4_v128relaxed`    |               0.126 gb/s |                2.70 gb/s |                0.08 gb/s |
+| __u1__                     | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_u1_serial`         |                1.95 gb/s |                1.53 gb/s |                0.09 gb/s |
+| `nk_dot_u1_v128relaxed`    |               0.548 gb/s |                1.88 gb/s |                0.13 gb/s |
+
+### Apple M4
+
+#### Native
+
+| Kernel                    |                      256 |                     1024 |                     4096 |
+| :------------------------ | -----------------------: | -----------------------: | -----------------------: |
+| __f64c__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f64c_serial`      |         12.5 gb/s, 5 ulp |         12.4 gb/s, 3 ulp |       11.9 gb/s, 9.7 ulp |
+| `nk_vdot_f64c_serial`     |       12.4 gb/s, 4.2 ulp |       12.3 gb/s, 3.3 ulp |       11.7 gb/s, 3.3 ulp |
+| `nk_dot_f64c_neon`        |         8.06 gb/s, 0 ulp |         8.05 gb/s, 0 ulp |         7.85 gb/s, 0 ulp |
+| `nk_vdot_f64c_neon`       |         7.79 gb/s, 0 ulp |         8.05 gb/s, 0 ulp |         7.88 gb/s, 0 ulp |
+| __f32c__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f32c_serial`      |         12.9 gb/s, 0 ulp |         12.4 gb/s, 0 ulp |         11.9 gb/s, 0 ulp |
+| `nk_vdot_f32c_serial`     |         12.8 gb/s, 0 ulp |         12.4 gb/s, 0 ulp |         12.1 gb/s, 0 ulp |
+| `nk_dot_f32c_neon`        |         7.97 gb/s, 0 ulp |         7.26 gb/s, 0 ulp |         7.00 gb/s, 0 ulp |
+| `nk_vdot_f32c_neon`       |         8.29 gb/s, 0 ulp |         7.58 gb/s, 0 ulp |         7.36 gb/s, 0 ulp |
+| __bf16c__                 | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_bf16c_serial`     |       7.47 gb/s, 0.2 ulp |       6.33 gb/s, 2.8 ulp |      6.08 gb/s, 15.8 ulp |
+| `nk_vdot_bf16c_serial`    |       7.47 gb/s, 0.2 ulp |       6.43 gb/s, 2.6 ulp |      6.08 gb/s, 11.4 ulp |
+| `nk_dot_bf16c_neonbfdot`  |       12.9 gb/s, 0.1 ulp |         9.31 gb/s, 2 ulp |       8.56 gb/s, 8.8 ulp |
+| `nk_vdot_bf16c_neonbfdot` |       12.9 gb/s, 0.1 ulp |       9.29 gb/s, 1.8 ulp |       8.56 gb/s, 8.8 ulp |
+| __f16c__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f16c_serial`      |      7.53 gb/s, 20.8 ulp |      6.34 gb/s, 64.1 ulp |      6.07 gb/s, 73.1 ulp |
+| `nk_vdot_f16c_serial`     |      7.53 gb/s, 24.8 ulp |      6.34 gb/s, 31.9 ulp |       6.07 gb/s, 137 ulp |
+| `nk_dot_f16c_neonhalf`    |       9.94 gb/s, 3.0 ulp |       7.94 gb/s, 6.5 ulp |      7.60 gb/s, 20.5 ulp |
+| `nk_vdot_f16c_neonhalf`   |      9.85 gb/s, 34.9 ulp |      7.79 gb/s, 40.7 ulp |      7.57 gb/s, 73.1 ulp |
+| `nk_dot_f16c_neonfhm`     |       9.39 gb/s, 3.0 ulp |       7.46 gb/s, 6.5 ulp |      7.19 gb/s, 20.5 ulp |
+| `nk_vdot_f16c_neonfhm`    |      9.75 gb/s, 31.4 ulp |      7.50 gb/s, 38.6 ulp |      7.29 gb/s, 67.6 ulp |
+| __f64__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f64_serial`       |       7.79 gb/s, 2.4 ulp |       7.79 gb/s, 175 ulp |       7.74 gb/s, 2.7 ulp |
+| `nk_dot_f64_neon`         |         14.8 gb/s, 0 ulp |         15.1 gb/s, 0 ulp |         14.7 gb/s, 0 ulp |
+| __f32__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f32_serial`       |         11.0 gb/s, 0 ulp |         7.77 gb/s, 0 ulp |         7.18 gb/s, 0 ulp |
+| `nk_dot_f32_neon`         |         9.23 gb/s, 0 ulp |         7.30 gb/s, 0 ulp |         6.96 gb/s, 0 ulp |
+| __bf16__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_bf16_serial`      |         5.76 gb/s, 0 ulp |       4.10 gb/s, 0.9 ulp |         3.62 gb/s, 6 ulp |
+| `nk_dot_bf16_neonbfdot`   |         35.1 gb/s, 0 ulp |       28.6 gb/s, 0.6 ulp |       22.9 gb/s, 4.5 ulp |
+| __f16__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f16_serial`       |        5.66 gb/s, 19 ulp |      3.99 gb/s, 31.1 ulp |      3.51 gb/s, 57.8 ulp |
+| `nk_dot_f16_neonhalf`     |      12.1 gb/s, 19.4 ulp |      9.18 gb/s, 21.5 ulp |      7.72 gb/s, 36.3 ulp |
+| `nk_dot_f16_neonfhm`      |      16.3 gb/s, 14.9 ulp |      10.7 gb/s, 26.7 ulp |      7.95 gb/s, 39.9 ulp |
+| __e5m2__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e5m2_serial`      |         1.87 gb/s, 0 ulp |         1.76 gb/s, 0 ulp |         1.74 gb/s, 0 ulp |
+| `nk_dot_e5m2_neon`        |         7.15 gb/s, 0 ulp |         4.95 gb/s, 0 ulp |         4.23 gb/s, 0 ulp |
+| __e4m3__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e4m3_serial`      |        0.874 gb/s, 0 ulp |        0.873 gb/s, 0 ulp |        0.871 gb/s, 0 ulp |
+| `nk_dot_e4m3_neon`        |         1.62 gb/s, 0 ulp |         1.62 gb/s, 0 ulp |         1.60 gb/s, 0 ulp |
+| __e3m2__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e3m2_serial`      |         1.24 gb/s, 0 ulp |         1.15 gb/s, 0 ulp |         1.13 gb/s, 0 ulp |
+| `nk_dot_e3m2_neonsdot`    |         7.69 gb/s, 0 ulp |         7.64 gb/s, 0 ulp |         7.70 gb/s, 0 ulp |
+| __e2m3__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e2m3_serial`      |         1.23 gb/s, 0 ulp |         1.15 gb/s, 0 ulp |         1.13 gb/s, 0 ulp |
+| `nk_dot_e2m3_neonsdot`    |         16.6 gb/s, 0 ulp |         16.8 gb/s, 0 ulp |         16.4 gb/s, 0 ulp |
+| __i8__                    | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_i8_serial`        |                43.2 gb/s |                48.5 gb/s |                48.0 gb/s |
+| `nk_dot_i8_neonsdot`      |                29.8 gb/s |                29.4 gb/s |                22.9 gb/s |
+| __u8__                    | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_u8_serial`        |                44.1 gb/s |                45.7 gb/s |                50.0 gb/s |
+| `nk_dot_u8_neonsdot`      |                30.6 gb/s |                28.4 gb/s |                22.3 gb/s |
+| __i4__                    | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_i4_serial`        |                11.9 gb/s |                12.4 gb/s |                12.6 gb/s |
+| `nk_dot_i4_neonsdot`      |                19.5 gb/s |                15.5 gb/s |                11.3 gb/s |
+| __u4__                    | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_u4_serial`        |                12.9 gb/s |                13.7 gb/s |                13.9 gb/s |
+| `nk_dot_u4_neonsdot`      |                21.7 gb/s |                16.1 gb/s |                11.4 gb/s |
+| __u1__                    | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_u1_serial`        |                3.32 gb/s |                3.56 gb/s |                3.58 gb/s |
+| `nk_dot_u1_neon`          |                11.2 gb/s |                21.8 gb/s |                27.4 gb/s |
+
+#### WASM
+
+Measured with Wasmtime v42 (Cranelift backend).
+
+| Kernel                     |                      256 |                     1024 |                     4096 |
+| :------------------------- | -----------------------: | -----------------------: | -----------------------: |
+| __f64c__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f64c_serial`       |       27.7 gb/s, 3.8 ulp |       24.1 gb/s, 3.9 ulp |       26.9 gb/s, 3.2 ulp |
+| `nk_vdot_f64c_serial`      |       5.87 gb/s, 3.8 ulp |       5.47 gb/s, 3.4 ulp |      5.66 gb/s, 15.1 ulp |
+| `nk_dot_f64c_v128relaxed`  |        45.0 gb/s, 26 ulp |        34.0 gb/s, 42 ulp |        35.9 gb/s, 88 ulp |
+| `nk_vdot_f64c_v128relaxed` |      22.0 gb/s, 22.8 ulp |      19.0 gb/s, 37.3 ulp |      17.6 gb/s, 43.6 ulp |
+| __f32c__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f32c_serial`       |         21.3 gb/s, 0 ulp |         19.8 gb/s, 0 ulp |         20.4 gb/s, 0 ulp |
+| `nk_vdot_f32c_serial`      |         11.1 gb/s, 0 ulp |         10.7 gb/s, 0 ulp |         10.7 gb/s, 0 ulp |
+| `nk_dot_f32c_v128relaxed`  |         21.4 gb/s, 0 ulp |         17.2 gb/s, 0 ulp |         18.0 gb/s, 0 ulp |
+| `nk_vdot_f32c_v128relaxed` |         10.4 gb/s, 0 ulp |         9.47 gb/s, 0 ulp |         8.71 gb/s, 0 ulp |
+| __bf16c__                  | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_bf16c_serial`      |       11.1 gb/s, 0.1 ulp |       11.2 gb/s, 2.5 ulp |        11.2 gb/s, 10 ulp |
+| `nk_vdot_bf16c_serial`     |       5.79 gb/s, 0.2 ulp |       5.68 gb/s, 2.1 ulp |      5.80 gb/s, 11.4 ulp |
+| __f16c__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f16c_serial`       |        3.52 gb/s, 13 ulp |        3.48 gb/s, 20 ulp |        3.49 gb/s, 90 ulp |
+| `nk_vdot_f16c_serial`      |      1.84 gb/s, 13.9 ulp |      1.79 gb/s, 35.5 ulp |      1.85 gb/s, 42.4 ulp |
+| __f64__                    | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f64_serial`        |       22.2 gb/s, 2.4 ulp |       19.3 gb/s, 2.6 ulp |       21.1 gb/s, 2.2 ulp |
+| `nk_dot_f64_v128relaxed`   |       39.6 gb/s, 2.6 ulp |       41.0 gb/s, 3.2 ulp |       32.9 gb/s, 2.6 ulp |
+| __f32__                    | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f32_serial`        |        17.9 gb/s, 16 ulp |        12.6 gb/s, 69 ulp |       12.7 gb/s, 104 ulp |
+| `nk_dot_f32_v128relaxed`   |         19.5 gb/s, 0 ulp |         17.5 gb/s, 0 ulp |         17.2 gb/s, 0 ulp |
+| __bf16__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_bf16_serial`       |         8.70 gb/s, 0 ulp |       6.36 gb/s, 0.6 ulp |       6.57 gb/s, 5.9 ulp |
+| `nk_dot_bf16_v128relaxed`  |         9.07 gb/s, 0 ulp |       7.98 gb/s, 0.4 ulp |       8.24 gb/s, 3.7 ulp |
+| __f16__                    | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_f16_serial`        |        3.15 gb/s, 16 ulp |        2.74 gb/s, 26 ulp |        3.14 gb/s, 53 ulp |
+| `nk_dot_f16_v128relaxed`   |       4.78 gb/s, 9.0 ulp |        4.70 gb/s, 23 ulp |        4.92 gb/s, 39 ulp |
+| __e5m2__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e5m2_serial`       |         2.90 gb/s, 0 ulp |         2.51 gb/s, 0 ulp |         2.88 gb/s, 0 ulp |
+| `nk_dot_e5m2_v128relaxed`  |         3.05 gb/s, 0 ulp |         2.65 gb/s, 0 ulp |         2.99 gb/s, 0 ulp |
+| __e4m3__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e4m3_serial`       |        0.903 gb/s, 0 ulp |        0.776 gb/s, 0 ulp |        0.874 gb/s, 0 ulp |
+| `nk_dot_e4m3_v128relaxed`  |         2.42 gb/s, 0 ulp |         2.12 gb/s, 0 ulp |         2.36 gb/s, 0 ulp |
+| __e3m2__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e3m2_serial`       |         2.90 gb/s, 0 ulp |         2.53 gb/s, 0 ulp |         2.88 gb/s, 0 ulp |
+| `nk_dot_e3m2_v128relaxed`  |         11.8 gb/s, 0 ulp |         10.5 gb/s, 0 ulp |         11.7 gb/s, 0 ulp |
+| __e2m3__                   | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_e2m3_serial`       |         2.90 gb/s, 0 ulp |         2.53 gb/s, 0 ulp |         2.88 gb/s, 0 ulp |
+| `nk_dot_e2m3_v128relaxed`  |         20.0 gb/s, 0 ulp |         20.0 gb/s, 0 ulp |         20.0 gb/s, 0 ulp |
+| __i8__                     | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_i8_serial`         |                21.7 gb/s |                16.8 gb/s |                16.3 gb/s |
+| `nk_dot_i8_v128relaxed`    |                42.0 gb/s |                47.7 gb/s |                46.3 gb/s |
+| __u8__                     | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_u8_serial`         |                21.4 gb/s |                16.8 gb/s |                16.3 gb/s |
+| `nk_dot_u8_v128relaxed`    |                43.8 gb/s |                51.2 gb/s |                49.2 gb/s |
+| __i4__                     | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_i4_serial`         |               0.984 gb/s |               0.824 gb/s |               0.957 gb/s |
+| `nk_dot_i4_v128relaxed`    |                14.8 gb/s |                15.0 gb/s |                17.9 gb/s |
+| __u4__                     | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_u4_serial`         |               0.988 gb/s |               0.957 gb/s |               0.959 gb/s |
+| `nk_dot_u4_v128relaxed`    |                30.5 gb/s |                27.5 gb/s |                31.4 gb/s |
+| __u1__                     | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ | ░░░░░░░░░░░░░░░░░░░░░░░░ |
+| `nk_dot_u1_serial`         |                4.85 gb/s |                5.38 gb/s |                5.67 gb/s |
+| `nk_dot_u1_v128relaxed`    |                21.8 gb/s |                29.8 gb/s |                52.0 gb/s |