@srsergio/taptapp-ar 1.1.7 โ 1.1.9
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +69 -30
- package/package.json +1 -1
package/README.md
CHANGED
|
@@ -1,11 +1,23 @@
|
|
|
1
|
-
|
|
1
|
+
<div align="center">
|
|
2
|
+
|
|
3
|
+
# ๐ฏ @srsergio/taptapp-ar
|
|
2
4
|
|
|
3
|
-
|
|
4
|
-
|
|
5
|
+
<img src="./docs/images/hero-banner.png" alt="TapTapp AR - High Performance Augmented Reality" width="100%"/>
|
|
6
|
+
|
|
7
|
+
[](https://www.npmjs.com/package/@srsergio/taptapp-ar)
|
|
8
|
+
[](https://www.npmjs.com/package/@srsergio/taptapp-ar)
|
|
5
9
|
[](./LICENSE)
|
|
6
|
-
[](https://bundlephobia.com/package/@srsergio/taptapp-ar)
|
|
10
|
+
[](https://bundlephobia.com/package/@srsergio/taptapp-ar)
|
|
11
|
+
[](https://www.typescriptlang.org/)
|
|
12
|
+
[](https://www.npmjs.com/package/@srsergio/taptapp-ar)
|
|
13
|
+
|
|
14
|
+
### ๐ Ultra-Fast AR Tracking โข 100% Pure JavaScript โข No TensorFlow Required
|
|
15
|
+
|
|
16
|
+
</div>
|
|
17
|
+
|
|
18
|
+
---
|
|
7
19
|
|
|
8
|
-
|
|
20
|
+
**TapTapp AR** is a high-performance Augmented Reality (AR) toolkit for **Node.js** and **Browser** environments. It provides an ultra-fast offline compiler and a lightweight runtime for image tracking.
|
|
9
21
|
|
|
10
22
|
**100% Pure JavaScript**: This package is now completely independent of **TensorFlow.js** for both compilation and real-time tracking, resulting in massive performance gains and zero-latency initialization.
|
|
11
23
|
|
|
@@ -16,35 +28,37 @@
|
|
|
16
28
|
- [๐ Installation](#-installation)
|
|
17
29
|
- [๐ Industry-Leading Benchmarks](#-industry-leading-benchmarks-v7-moonshot)
|
|
18
30
|
- [๐ก๏ธ Robustness & Stability](#๏ธ-robustness--stability-stress-tested)
|
|
19
|
-
- [๐ผ๏ธ Compiler Usage](#๏ธ-compiler-usage-
|
|
31
|
+
- [๐ผ๏ธ Compiler Usage](#๏ธ-compiler-usage-automatic--jit)
|
|
20
32
|
- [๐ฅ Runtime Usage](#-runtime-usage-ar-tracking)
|
|
21
|
-
- [
|
|
22
|
-
- [
|
|
23
|
-
- [
|
|
24
|
-
- [
|
|
25
|
-
- [
|
|
26
|
-
- [
|
|
33
|
+
- [React Component](#1-the-easy-way-react-component-)
|
|
34
|
+
- [React Hook](#2-high-performance-react-hook-usear-)
|
|
35
|
+
- [Native API](#3-native-api-starttracking)
|
|
36
|
+
- [Custom Overlays](#4-custom-overlays-beyond-videoimages-)
|
|
37
|
+
- [Three.js / A-Frame](#5-advanced-integration-threejs--a-frame)
|
|
38
|
+
- [๐๏ธ Protocol V11](#๏ธ-protocol-v11-nanite-virtualized-format)
|
|
39
|
+
- [๐ Visual Search & Embeddings](#-visual-search--embeddings-new-)
|
|
27
40
|
- [๐ License & Credits](#-license--credits)
|
|
28
41
|
|
|
29
42
|
---
|
|
30
43
|
|
|
31
44
|
## ๐ Key Features
|
|
32
45
|
|
|
33
|
-
|
|
34
|
-
-
|
|
35
|
-
|
|
36
|
-
|
|
37
|
-
|
|
38
|
-
|
|
39
|
-
|
|
40
|
-
|
|
41
|
-
|
|
42
|
-
|
|
43
|
-
|
|
44
|
-
|
|
45
|
-
|
|
46
|
-
|
|
47
|
-
|
|
46
|
+
<div align="center">
|
|
47
|
+
<img src="./docs/images/features-grid.png" alt="TapTapp AR Key Features" width="600"/>
|
|
48
|
+
</div>
|
|
49
|
+
|
|
50
|
+
<br/>
|
|
51
|
+
|
|
52
|
+
| Feature | Description |
|
|
53
|
+
|---------|-------------|
|
|
54
|
+
| ๐ญ **Non-Rigid Tracking** | Curved & deformable surfaces with Delaunay Meshes |
|
|
55
|
+
| ๐ **Nanite-style Features** | Single-pass multi-octave detection |
|
|
56
|
+
| โก **Zero Dependencies** | No TensorFlow.js - Pure JavaScript |
|
|
57
|
+
| ๐งฌ **Neural Encoding** | Fourier positional encoding (GPT-style) |
|
|
58
|
+
| ๐งต **HD Precision** | 1280x960 default resolution |
|
|
59
|
+
| โก **JIT Compilation** | Pass an image URL, track instantly |
|
|
60
|
+
| ๐ **20% - 1000% Scale** | Extreme scale range from a single keyframe |
|
|
61
|
+
| ๐ฆ **~100KB Output** | Ultra-compact `.taar` files |
|
|
48
62
|
|
|
49
63
|
---
|
|
50
64
|
|
|
@@ -58,6 +72,12 @@ npm install @srsergio/taptapp-ar
|
|
|
58
72
|
|
|
59
73
|
## ๐ Industry-Leading Benchmarks (v7 Moonshot)
|
|
60
74
|
|
|
75
|
+
<div align="center">
|
|
76
|
+
<img src="./docs/images/performance-chart.png" alt="Performance Comparison" width="500"/>
|
|
77
|
+
</div>
|
|
78
|
+
|
|
79
|
+
<br/>
|
|
80
|
+
|
|
61
81
|
| Metric | Official MindAR | TapTapp AR V11 | Improvement |
|
|
62
82
|
| :--- | :--- | :--- | :--- |
|
|
63
83
|
| **Compilation Time** | ~23.50s | **~1.69s (HD)** | ๐ **~14x Faster** |
|
|
@@ -130,6 +150,12 @@ const tracker = await startTracking({
|
|
|
130
150
|
|
|
131
151
|
## ๐ฅ Runtime Usage (AR Tracking)
|
|
132
152
|
|
|
153
|
+
<div align="center">
|
|
154
|
+
<img src="./docs/images/ar-tracking-demo.png" alt="AR Tracking Pipeline" width="700"/>
|
|
155
|
+
</div>
|
|
156
|
+
|
|
157
|
+
<br/>
|
|
158
|
+
|
|
133
159
|
### 1. The Easy Way: React Component โ๏ธ
|
|
134
160
|
|
|
135
161
|
The simplest, zero-config way to add AR to your app:
|
|
@@ -243,7 +269,7 @@ The `onUpdate` callback provides a rich data object:
|
|
|
243
269
|
- `worldMatrix`: 4x4 matrix for WebGL/Three.js integration.
|
|
244
270
|
- `targetDimensions`: `[width, height]` of the source target.
|
|
245
271
|
|
|
246
|
-
###
|
|
272
|
+
### 5. Advanced Integration (Three.js / A-Frame)
|
|
247
273
|
|
|
248
274
|
We still provide wrappers for 3D engines if you need to render complex 3D models instead of DOM overlays.
|
|
249
275
|
|
|
@@ -256,6 +282,13 @@ import { TaarThree } from '@srsergio/taptapp-ar';
|
|
|
256
282
|
---
|
|
257
283
|
|
|
258
284
|
## ๐๏ธ Protocol V11 (Nanite Virtualized Format)
|
|
285
|
+
|
|
286
|
+
<div align="center">
|
|
287
|
+
<img src="./docs/images/architecture-flow.png" alt="Architecture Pipeline" width="700"/>
|
|
288
|
+
</div>
|
|
289
|
+
|
|
290
|
+
<br/>
|
|
291
|
+
|
|
259
292
|
TapTapp AR uses a proprietary **Nanite-style Vision Codec** that is significantly more efficient than standard AR formats.
|
|
260
293
|
|
|
261
294
|
- **Virtualized Multi-Octave Features**: Instead of storing redundant images for each scale, V11 stores a single high-res keyframe with features stratified across 6 octaves.
|
|
@@ -270,7 +303,13 @@ TapTapp AR uses a proprietary **Nanite-style Vision Codec** that is significantl
|
|
|
270
303
|
|
|
271
304
|
---
|
|
272
305
|
|
|
273
|
-
##
|
|
306
|
+
## ๐ Visual Search & Embeddings (NEW!) ๐
|
|
307
|
+
|
|
308
|
+
<div align="center">
|
|
309
|
+
<img src="./docs/images/visual-search.png" alt="Visual Search & Embeddings" width="600"/>
|
|
310
|
+
</div>
|
|
311
|
+
|
|
312
|
+
<br/>
|
|
274
313
|
|
|
275
314
|
TapTapp AR now includes a state-of-the-art **Image Embedding** system based on Hyperdimensional Computing (HDC). This allows you to convert any image into a tiny mathematical fingerprint (vector) for ultra-fast visual search, deduplication, and clustering.
|
|
276
315
|
|
|
@@ -316,7 +355,7 @@ await vectorDB.insert({
|
|
|
316
355
|
|
|
317
356
|
---
|
|
318
357
|
|
|
319
|
-
##
|
|
358
|
+
## ๐ License & Credits
|
|
320
359
|
|
|
321
360
|
This project is licensed under the **Fair Source License v0.9**.
|
|
322
361
|
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@srsergio/taptapp-ar",
|
|
3
|
-
"version": "1.1.
|
|
3
|
+
"version": "1.1.9",
|
|
4
4
|
"description": "Ultra-fast Augmented Reality (AR) SDK for Node.js and Browser. Image tracking with 100% pure JavaScript, zero-dependencies, and high-performance compilation.",
|
|
5
5
|
"keywords": [
|
|
6
6
|
"augmented reality",
|