jetson-examples 0.1.3__py3-none-any.whl → 0.1.5__py3-none-any.whl
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- {jetson_examples-0.1.3.dist-info → jetson_examples-0.1.5.dist-info}/METADATA +13 -9
- {jetson_examples-0.1.3.dist-info → jetson_examples-0.1.5.dist-info}/RECORD +27 -8
- {jetson_examples-0.1.3.dist-info → jetson_examples-0.1.5.dist-info}/WHEEL +1 -1
- reComputer/scripts/depth-anything/Dockerfile +6 -0
- reComputer/scripts/depth-anything/LICENSE +21 -0
- reComputer/scripts/depth-anything/README.md +102 -0
- reComputer/scripts/depth-anything/clean.sh +3 -0
- reComputer/scripts/depth-anything/images/Autonomous Driving.png +0 -0
- reComputer/scripts/depth-anything/images/Indoor Scenes.png +0 -0
- reComputer/scripts/depth-anything/images/Opr.png +0 -0
- reComputer/scripts/depth-anything/images/Security.png +0 -0
- reComputer/scripts/depth-anything/images/Underwater Scenes.png +0 -0
- reComputer/scripts/depth-anything/images/WebUI.png +0 -0
- reComputer/scripts/depth-anything/images/teaser.png +0 -0
- reComputer/scripts/depth-anything/run.sh +12 -0
- reComputer/scripts/llama-factory/README.md +67 -0
- reComputer/scripts/llama-factory/assets/llama-factory-Jetson.png +0 -0
- reComputer/scripts/llama-factory/assets/webui.png +0 -0
- reComputer/scripts/llama-factory/clean.sh +4 -0
- reComputer/scripts/llama-factory/init.sh +52 -0
- reComputer/scripts/llama-factory/run.sh +10 -0
- reComputer/scripts/ultralytics-yolo/LICENSE +21 -0
- reComputer/scripts/ultralytics-yolo/README.md +3 -0
- reComputer/scripts/ultralytics-yolo/images/Ultralytics-yolo.gif +0 -0
- {jetson_examples-0.1.3.dist-info → jetson_examples-0.1.5.dist-info}/LICENSE +0 -0
- {jetson_examples-0.1.3.dist-info → jetson_examples-0.1.5.dist-info}/entry_points.txt +0 -0
- {jetson_examples-0.1.3.dist-info → jetson_examples-0.1.5.dist-info}/top_level.txt +0 -0
@@ -1,6 +1,6 @@
|
|
1
1
|
Metadata-Version: 2.1
|
2
2
|
Name: jetson-examples
|
3
|
-
Version: 0.1.
|
3
|
+
Version: 0.1.5
|
4
4
|
Summary: Running Gen AI models and applications on NVIDIA Jetson devices with one-line command
|
5
5
|
Author-email: luozhixin <zhixin.luo@seeed.cc>
|
6
6
|
Project-URL: Homepage, https://github.com/Seeed-Projects/jetson-examples
|
@@ -23,11 +23,11 @@ License-File: LICENSE
|
|
23
23
|
|
24
24
|
This repository provides examples for running AI models and applications on [NVIDIA Jetson devices](https://www.seeedstudio.com/reComputer-J4012-p-5586.html) with a single command.
|
25
25
|
|
26
|
-
This repo builds upon the work of the [jetson-containers](https://github.com/dusty-nv/jetson-containers),
|
26
|
+
This repo builds upon the work of the [jetson-containers](https://github.com/dusty-nv/jetson-containers), [ultralytics](https://github.com/ultralytics/ultralytics) and other excellent projects.
|
27
27
|
|
28
28
|
## Features
|
29
29
|
- 🚀 **Easy Deployment:** Deploy state-of-the-art AI models on Jetson devices in one line.
|
30
|
-
- 🔄 **Versatile Examples:** Supports text generation, image generation,
|
30
|
+
- 🔄 **Versatile Examples:** Supports text generation, image generation, computer vision and so on.
|
31
31
|
- ⚡ **Optimized for Jetson:** Leverages Nvidia Jetson hardware for efficient performance.
|
32
32
|
|
33
33
|
|
@@ -60,9 +60,11 @@ Here are some examples that can be run:
|
|
60
60
|
|
61
61
|
| Example | Type | Model/Data Size | Docker Image Size | Command |
|
62
62
|
| ------------------------------------------------ | ------------------------ | --------------- | ---------- | --------------------------------------- |
|
63
|
-
| 🆕
|
64
|
-
| 🆕
|
65
|
-
|
|
63
|
+
| 🆕 llama-factory | Finetune LLM | | 13.5GB | `reComputer run llama-factory` |
|
64
|
+
| 🆕 [depth-anything](/reComputer/scripts/depth-anything/README.md) |Computer Vision | | 12.9GB | `reComputer run depth-anything` |
|
65
|
+
| [yolov10](/reComputer/scripts/yolov10/README.md) | Computer Vision | 7.2M | 5.74 GB | `reComputer run yolov10` |
|
66
|
+
| llama3 | Text (LLM) | 4.9GB | 10.5GB | `reComputer run llama3` |
|
67
|
+
| [ollama](https://github.com/ollama/ollama) | Inference Server | * | 10.5GB | `reComputer run ollama` |
|
66
68
|
| LLaVA | Text + Vision (VLM) | 13GB | 14.4GB | `reComputer run llava` |
|
67
69
|
| Live LLaVA | Text + Vision (VLM) | 13GB | 20.3GB | `reComputer run live-llava` |
|
68
70
|
| stable-diffusion-webui | Image Generation | 3.97G | 7.3GB | `reComputer run stable-diffusion-webui` |
|
@@ -72,6 +74,7 @@ Here are some examples that can be run:
|
|
72
74
|
| [yolov8-rail-inspection](/reComputer/scripts/yolov8-rail-inspection/readme.md) |Computer Vision | 6M | 13.8GB | `reComputer run yolov8-rail-inspection` |
|
73
75
|
| [ultralytics-yolo](/reComputer/scripts/ultralytics-yolo/README.md) |Computer Vision | | 15.4GB | `reComputer run ultralytics-yolo` |
|
74
76
|
|
77
|
+
|
75
78
|
> Note: You should have enough space to run example, like `LLaVA`, at least `27.4GB` totally
|
76
79
|
|
77
80
|
More Examples can be found [examples.md](./docs/examples.md)
|
@@ -83,13 +86,14 @@ We welcome contributions to improve jetson-examples! If you have an example you'
|
|
83
86
|
|
84
87
|
## TODO List
|
85
88
|
|
89
|
+
- [x] detect host environment and install what we need
|
90
|
+
- [x] all type jetson support checking list
|
91
|
+
- [x] try jetpack 6.0
|
86
92
|
- [ ] check disk space enough or not before run
|
87
93
|
- [ ] allow to setting some configs, such as `BASE_PATH`
|
88
|
-
- [ ] detect host environment and install what we need
|
89
94
|
- [ ] support jetson-containers update
|
90
|
-
- [ ] all type jetson support checking list
|
91
95
|
- [ ] better table to show example's difference
|
92
|
-
|
96
|
+
|
93
97
|
|
94
98
|
|
95
99
|
## License
|
@@ -10,8 +10,26 @@ reComputer/scripts/audiocraft/README.md,sha256=EGEoK1Rq-Vczri24APoe2kK8e5VmJHn_g
|
|
10
10
|
reComputer/scripts/audiocraft/clean.sh,sha256=0mk1BHYa1IlnPOXZt_Vy8TqxTLGAnXPIDuClMwzdTmM,77
|
11
11
|
reComputer/scripts/audiocraft/init.sh,sha256=ktAKm4XFtJYntnSR-oAK4G5OhCSSoKw511mR9qk6xGw,428
|
12
12
|
reComputer/scripts/audiocraft/run.sh,sha256=b0kjEeZnA5diQw6vjyrkOX-Svs5XVKGt0ABbWtZsZEs,160
|
13
|
+
reComputer/scripts/depth-anything/Dockerfile,sha256=gJ2Q1g2E06_z4hy9C-m1bA4X2IMqRWuo42izFfQ_E5Y,279
|
14
|
+
reComputer/scripts/depth-anything/LICENSE,sha256=feSgondqafLDgk7Dp9gnVBE5Y9K5X9mal_DGYKALzXQ,1073
|
15
|
+
reComputer/scripts/depth-anything/README.md,sha256=nHFcFIEZyoy3_n7bFuQ_3zT3IKRwLmRkxuXj9YE4sWw,4205
|
16
|
+
reComputer/scripts/depth-anything/clean.sh,sha256=81oScb0iXcFQ6-3X9bfIJRcE6hBuVETGDyNbQwMhQ7Q,75
|
17
|
+
reComputer/scripts/depth-anything/run.sh,sha256=m8g6LHQHPssKuOftLil0y3IbZaIwFIkHGt_laecCRBs,315
|
18
|
+
reComputer/scripts/depth-anything/images/Autonomous Driving.png,sha256=oHdvvCyA5-ifHNWz4MxnBGT4HSy5Bbud9vbxlilS2-w,331869
|
19
|
+
reComputer/scripts/depth-anything/images/Indoor Scenes.png,sha256=bnTMltdVecbP4TjRk7t-ldE3Rj7CmUh53RK8A6dK2lo,625925
|
20
|
+
reComputer/scripts/depth-anything/images/Opr.png,sha256=9ppsKQZ2SWI7NFKWuQMLyxyfpsHAyN1dhp1ufYuPt4k,45174
|
21
|
+
reComputer/scripts/depth-anything/images/Security.png,sha256=F25Ay65Mz6jWAP-P20fmG4-RftkijuNM6uFhUNW2rtY,235206
|
22
|
+
reComputer/scripts/depth-anything/images/Underwater Scenes.png,sha256=xpBV1VoCoQqgomAjHQKQYofJha0r4tUTNUGG6XWCm20,598471
|
23
|
+
reComputer/scripts/depth-anything/images/WebUI.png,sha256=HtlUbq6KSOqR6vV1n7mFaV_Kz5DLs2W4UcAVvEG4c-4,721506
|
24
|
+
reComputer/scripts/depth-anything/images/teaser.png,sha256=J1VpUd71nshdWgZ1dS0LUl9ppJn-Rm2-ZPX9YuM4C38,5657444
|
13
25
|
reComputer/scripts/live-llava/init.sh,sha256=ktAKm4XFtJYntnSR-oAK4G5OhCSSoKw511mR9qk6xGw,428
|
14
26
|
reComputer/scripts/live-llava/run.sh,sha256=4sWld5d8Fkr9GUVqLH2S1RyOKOjobhjojSzuJu8EuCg,10137
|
27
|
+
reComputer/scripts/llama-factory/README.md,sha256=N727Q8X-OGo-_d4ZIAhwbWtcOyjto0XwfzmI2Zw8wHg,2449
|
28
|
+
reComputer/scripts/llama-factory/clean.sh,sha256=cRpFDKCkKDCgaCoXdmF60dQ_RLAcIHbYZ5w-8PLKRr8,133
|
29
|
+
reComputer/scripts/llama-factory/init.sh,sha256=FAaIlBQxLdenS6aW8Vpo5OqBZgV0NmkrCpkbJMwkwtU,1633
|
30
|
+
reComputer/scripts/llama-factory/run.sh,sha256=NsxvjSkwFQ-b5DoPRN5DlCYsyvq1_wpZmubVN9y4nQs,231
|
31
|
+
reComputer/scripts/llama-factory/assets/llama-factory-Jetson.png,sha256=bUoDJWCiGfGRM_cQBEve-7nJyJFxCS5E0ekBcc1fpUg,574732
|
32
|
+
reComputer/scripts/llama-factory/assets/webui.png,sha256=RXaMyX3cIqZVoO27z5kn0rmbfEapdMuWN2JmPZlJlB0,419226
|
15
33
|
reComputer/scripts/llama3/init.sh,sha256=ktAKm4XFtJYntnSR-oAK4G5OhCSSoKw511mR9qk6xGw,428
|
16
34
|
reComputer/scripts/llama3/run.sh,sha256=IkHvMwh_U8fp7AH2qWFUMWywHZDbZKHlp8ODzfHgqBQ,328
|
17
35
|
reComputer/scripts/llava/clean.sh,sha256=7t2SIxj6_elOpHxtTjl9ofnU5d9Ir2r5eyNAj6lAI68,70
|
@@ -32,10 +50,11 @@ reComputer/scripts/stable-diffusion-webui/init.sh,sha256=ktAKm4XFtJYntnSR-oAK4G5
|
|
32
50
|
reComputer/scripts/stable-diffusion-webui/run.sh,sha256=E0_KRJK5BLFsBzAiJw-Ir81bvmIU4GV-TLJRgda2XHM,160
|
33
51
|
reComputer/scripts/text-generation-webui/init.sh,sha256=ktAKm4XFtJYntnSR-oAK4G5OhCSSoKw511mR9qk6xGw,428
|
34
52
|
reComputer/scripts/text-generation-webui/run.sh,sha256=mRlWxZTArGXoyyeHbgZvPbVKTflQSsFCKUERKoHYHHE,407
|
35
|
-
reComputer/scripts/ultralytics-yolo/
|
53
|
+
reComputer/scripts/ultralytics-yolo/LICENSE,sha256=feSgondqafLDgk7Dp9gnVBE5Y9K5X9mal_DGYKALzXQ,1073
|
54
|
+
reComputer/scripts/ultralytics-yolo/README.md,sha256=xmK-K6EIONhyOBzSTq30G39b6NiYkvGWL8WTTGmymSY,2397
|
36
55
|
reComputer/scripts/ultralytics-yolo/clean.sh,sha256=0sS0YZI0B1GdydOyDJU4IG1cVmAssWZS60Qt8LJobdE,63
|
37
56
|
reComputer/scripts/ultralytics-yolo/run.sh,sha256=yxXAFIKVa_nknnhowCMxfIo2_3dej9I9b9Wa23KQlho,287
|
38
|
-
reComputer/scripts/ultralytics-yolo/images/Ultralytics-yolo.gif,sha256=
|
57
|
+
reComputer/scripts/ultralytics-yolo/images/Ultralytics-yolo.gif,sha256=_xF_n-Gfa-Er-evCcJ1tBSgNkSc9oqitgDXmq4ggwBw,12628076
|
39
58
|
reComputer/scripts/ultralytics-yolo/images/tasks.png,sha256=ILhKVHoGiwZM1BQdbjcb8RM07ijq_2s3c5XqBM5rRx0,275724
|
40
59
|
reComputer/scripts/whisper/init.sh,sha256=ktAKm4XFtJYntnSR-oAK4G5OhCSSoKw511mR9qk6xGw,428
|
41
60
|
reComputer/scripts/whisper/run.sh,sha256=UKiY7Ie5uyGrdvAob1XwPSlpdEL27HR5vcMtnVOrph4,146
|
@@ -52,9 +71,9 @@ reComputer/scripts/yolov8:detect/README.txt,sha256=gLAXjOR1X9gXJM0XA0c1P12nz81zv
|
|
52
71
|
reComputer/scripts/yolov8:detect/app.py,sha256=63o2icb_av9owTBW6nL6wJfXdYEyZRt8feBL6YqrWTw,1307
|
53
72
|
reComputer/scripts/yolov8:detect/run.sh,sha256=iq5o5iy2iPaUfC471sOWY4HhYWIOZ1geauqNQ-fg-2Y,130
|
54
73
|
reComputer/scripts/yolov8:detect/templates/index.html,sha256=Q0mRmqax_F4cZq8Zau_JLtwvCpFH_Al6lUisu9Uaids,524
|
55
|
-
jetson_examples-0.1.
|
56
|
-
jetson_examples-0.1.
|
57
|
-
jetson_examples-0.1.
|
58
|
-
jetson_examples-0.1.
|
59
|
-
jetson_examples-0.1.
|
60
|
-
jetson_examples-0.1.
|
74
|
+
jetson_examples-0.1.5.dist-info/LICENSE,sha256=ac_LOi8ChcJhymEfBulX98Y06wTI2IMcQnqCXZ5yay4,1066
|
75
|
+
jetson_examples-0.1.5.dist-info/METADATA,sha256=389saGoBSnNuJzwFBxj07iucvIAQgHbJcKSR0FkY9lY,5323
|
76
|
+
jetson_examples-0.1.5.dist-info/WHEEL,sha256=y4mX-SOX4fYIkonsAGA5N0Oy-8_gI4FXw5HNI1xqvWg,91
|
77
|
+
jetson_examples-0.1.5.dist-info/entry_points.txt,sha256=5-OdcBifoDjVXE9KjNoN6tQa8l_XSXhdbBEgL2hxeDM,58
|
78
|
+
jetson_examples-0.1.5.dist-info/top_level.txt,sha256=SI-liiUOkoGwOJfMP7d7k63JKgdcbiEj6DEC8QIKI90,11
|
79
|
+
jetson_examples-0.1.5.dist-info/RECORD,,
|
@@ -0,0 +1,6 @@
|
|
1
|
+
FROM nvcr.io/nvidia/l4t-pytorch:r35.2.1-pth2.0-py3
|
2
|
+
RUN mkdir /usr/src/DepthAnything-on-Jetson-Orin
|
3
|
+
WORKDIR /usr/src/DepthAnything-on-Jetson-Orin
|
4
|
+
COPY . /usr/src/DepthAnything-on-Jetson-Orin
|
5
|
+
RUN pip install flask onnx flask flask_socketio huggingface_hub
|
6
|
+
CMD ["python3", "app.py"]
|
@@ -0,0 +1,21 @@
|
|
1
|
+
MIT License
|
2
|
+
|
3
|
+
Copyright (c) [2024] [Seeed Studio]
|
4
|
+
|
5
|
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
6
|
+
of this software and associated documentation files (the "Software"), to deal
|
7
|
+
in the Software without restriction, including without limitation the rights
|
8
|
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
9
|
+
copies of the Software, and to permit persons to whom the Software is
|
10
|
+
furnished to do so, subject to the following conditions:
|
11
|
+
|
12
|
+
The above copyright notice and this permission notice shall be included in all
|
13
|
+
copies or substantial portions of the Software.
|
14
|
+
|
15
|
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
16
|
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
17
|
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
18
|
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
19
|
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
20
|
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
21
|
+
SOFTWARE.
|
@@ -0,0 +1,102 @@
|
|
1
|
+
# Jetson-Example: Run Depth Anything on NVIDIA Jetson Orin 🚀
|
2
|
+
This project provides an one-click deployment of the Depth Anything monocular depth estimation model developed by Hong Kong University and ByteDance. The deployment is visualized on [reComputer J4012](https://www.seeedstudio.com/reComputer-J4012-p-5586.html) (Jetson Orin NX 16GB, 100 TOPS) and includes a WebUI for model conversion to TensorRT and real-time depth estimation.
|
3
|
+
<p align="center">
|
4
|
+
<img src="images/WebUI.png" alt="WebUI">
|
5
|
+
</p>
|
6
|
+
|
7
|
+
All models and inference engine implemented in this project are from the official [Depth Anything](https://depth-anything.github.io/).
|
8
|
+
|
9
|
+
## 🔥Features
|
10
|
+
|
11
|
+
- One-click deployment for Depth Anything models.
|
12
|
+
- WebUI for model conversion and depth estimation.
|
13
|
+
- Support for uploading videos/images or using the local camera
|
14
|
+
- Supports S, B, L models of Depth Anything with input sizes of 308, 384, 406, and 518.
|
15
|
+
|
16
|
+
### 🗝️WebUI Features
|
17
|
+
- **Choose model**: Select from depth_anything_vits14 models. (S, B, L)
|
18
|
+
- **Choose input size**: Select the desired input size.(308, 384, 406, 518)
|
19
|
+
- **Grayscale option**: Option to use grayscale.
|
20
|
+
- **Choose source**: Select the input source (Video, Image, Camera).
|
21
|
+
- **Export Model**: Automatically download and convert the model from PyTorch (.pth) to TensorRT format.
|
22
|
+
- **Start Estimation**: Begin depth estimation using the selected model and input source.
|
23
|
+
- **Stop Estimation**: Stop the ongoing depth estimation process.
|
24
|
+
<p align="center">
|
25
|
+
<img src="images/Opr.png" alt="Depthanything" width="320" height="360">
|
26
|
+
</p>
|
27
|
+
|
28
|
+
## 🥳Getting Started
|
29
|
+
### 📜Prerequisites
|
30
|
+
- reComputer J4012 [(🛒Buy Here)](https://www.seeedstudio.com/reComputer-J4012-p-5586.html)
|
31
|
+
- Docker installed on reComputer
|
32
|
+
- USB Camera (optional)
|
33
|
+
### 🚀Installation
|
34
|
+
|
35
|
+
|
36
|
+
PyPI(recommend)
|
37
|
+
```sh
|
38
|
+
pip install jetson-examples
|
39
|
+
```
|
40
|
+
Linux (github trick)
|
41
|
+
```sh
|
42
|
+
curl -fsSL https://raw.githubusercontent.com/Seeed-Projects/jetson-examples/main/install.sh | sh
|
43
|
+
```
|
44
|
+
Github (for Developer)
|
45
|
+
```sh
|
46
|
+
git clone https://github.com/Seeed-Projects/jetson-examples
|
47
|
+
cd jetson-examples
|
48
|
+
pip install .
|
49
|
+
```
|
50
|
+
|
51
|
+
### 📋Usage
|
52
|
+
1. Run code:
|
53
|
+
```sh
|
54
|
+
reComputer run depth-anything
|
55
|
+
```
|
56
|
+
2. Open a web browser and input **http://{reComputer ip}:5000**. Use the WebUI to select the model, input size, and source.
|
57
|
+
|
58
|
+
3. Click on **Export Model** to download and convert the model.
|
59
|
+
|
60
|
+
4. Click on **Start Estimation** to begin the depth estimation process.
|
61
|
+
|
62
|
+
5. View the real-time depth estimation results on the WebUI.
|
63
|
+
|
64
|
+
## ⛏️Applications
|
65
|
+
|
66
|
+
- **Security**: Enhance surveillance systems with depth perception.
|
67
|
+
<p align="center">
|
68
|
+
<img src="images/Security.png" alt="Security" width="500" height="150">
|
69
|
+
</p>
|
70
|
+
- **Autonomous Driving**: Improve environmental sensing for autonomous vehicles.
|
71
|
+
<p align="center">
|
72
|
+
<img src="images/Autonomous Driving.png" alt="Autonomous Driving" width="500" height="150">
|
73
|
+
</p>
|
74
|
+
- **Underwater Scenes**: Apply depth estimation in underwater exploration.
|
75
|
+
<p align="center">
|
76
|
+
<img src="images/Underwater Scenes.png" alt="Underwater Scenes" width="500" height="150">
|
77
|
+
</p>
|
78
|
+
- **Indoor Scenes**: Use depth estimation for indoor navigation and analysis.
|
79
|
+
<p align="center">
|
80
|
+
<img src="images/Indoor Scenes.png" alt="Indoor Scenes" width="500" height="150">
|
81
|
+
</p>
|
82
|
+
|
83
|
+
## Further Development 🔧
|
84
|
+
- [Depth Anything Official](https://depth-anything.github.io/)
|
85
|
+
- [Depth Anything TensorRT](https://github.com/spacewalk01/depth-anything-tensorrt)
|
86
|
+
- [Depth Anything ONNX](https://github.com/fabio-sim/Depth-Anything-ONNX)
|
87
|
+
- [Depth Anything ROS](https://github.com/scepter914/DepthAnything-ROS)
|
88
|
+
- [Depth Anything Android](https://github.com/FeiGeChuanShu/ncnn-android-depth_anything)
|
89
|
+
|
90
|
+
|
91
|
+
## 🙏🏻Contributing
|
92
|
+
|
93
|
+
We welcome contributions from the community. Please fork the repository and create a pull request with your changes.
|
94
|
+
|
95
|
+
## ✅License
|
96
|
+
|
97
|
+
This project is licensed under the MIT License.
|
98
|
+
|
99
|
+
## 🏷️Acknowledgements
|
100
|
+
|
101
|
+
- Depth Anything [project](https://depth-anything.github.io/) by Hong Kong University and ByteDance.
|
102
|
+
- Seeed Studio team for their [support and resources](https://github.com/Seeed-Projects/jetson-examples).
|
Binary file
|
Binary file
|
Binary file
|
Binary file
|
Binary file
|
Binary file
|
Binary file
|
@@ -0,0 +1,12 @@
|
|
1
|
+
#!/bin/bash
|
2
|
+
|
3
|
+
docker pull yaohui1998/depthanything-on-jetson-orin:latest
|
4
|
+
|
5
|
+
docker run --rm -it \
|
6
|
+
--privileged \
|
7
|
+
--network host \
|
8
|
+
-v /tmp/.X11-unix:/tmp/.X11-unix[@] \
|
9
|
+
-v /dev/*:/dev/* \
|
10
|
+
-v /etc/localtime:/etc/localtime:ro \
|
11
|
+
--runtime nvidia \
|
12
|
+
yaohui1998/depthanything-on-jetson-orin:latest
|
@@ -0,0 +1,67 @@
|
|
1
|
+
# Finetune LLM by Llama-Factory on Jetson
|
2
|
+
|
3
|
+
|
4
|
+
## Hello
|
5
|
+
|
6
|
+
💡 Here's an example of quickly deploying [Llama-Factory](https://github.com/hiyouga/LLaMA-Factory) on Jetson device.
|
7
|
+
|
8
|
+
🔥 Hightlights:
|
9
|
+
- **Llama-Factory** is an efficient tool to unify efficient Fine-Tuning of 100+ LLMs. 🚀🔍
|
10
|
+
- **Jetson-examples** is a toolkit designed to deploy containerized applications on NVIDIA Jetson devices. ✨
|
11
|
+
- **Jetson** is powerful AI hardware platform for edge computing.💻
|
12
|
+
|
13
|
+
🛠️ Follow the tutorial below to quickly experience the performance of Llama-Factory on edge computing devices.
|
14
|
+
|
15
|
+
<!-- <div align="center">
|
16
|
+
<img alt="yolov10" width="1200px" src="./assets/llama-factory-Jetson.png">
|
17
|
+
</div> -->
|
18
|
+
|
19
|
+
## Get a Jetson Orin Device 🛒
|
20
|
+
| Device Model | Description | Link |
|
21
|
+
|--------------|-------------|------|
|
22
|
+
| reComputer J4012, powered by Orin NX 16GB, 100 TOPS | Embedded computer powered by Orin NX | [Buy Here](https://www.seeedstudio.com/reComputer-J4012-p-5586.html) |
|
23
|
+
| NVIDIA® Jetson AGX Orin™ 64GB Developer Kit | smallest and most powerful AI edge computer | [Buy Here](https://www.seeedstudio.com/NVIDIArJetson-AGX-Orintm-64GB-Developer-Kit-p-5641.html) |
|
24
|
+
|
25
|
+
## Getting Started
|
26
|
+
|
27
|
+
- install **jetson-examples** by pip:
|
28
|
+
```sh
|
29
|
+
pip3 install jetson-examples
|
30
|
+
```
|
31
|
+
- restart reComputer
|
32
|
+
```sh
|
33
|
+
sudo restart
|
34
|
+
```
|
35
|
+
- run Llama-Factory webui on jetson in one line:
|
36
|
+
```sh
|
37
|
+
reComputer run llama-factory
|
38
|
+
```
|
39
|
+
- Please visit http://127.0.0.1:7860
|
40
|
+
|
41
|
+
<div align="center">
|
42
|
+
<img alt="yolov10" width="1200px" src="./assets/webui.png">
|
43
|
+
</div>
|
44
|
+
|
45
|
+
|
46
|
+
|
47
|
+
## Run Training Script
|
48
|
+
|
49
|
+
> **Note:** Some models and datasets require confirmation before using them, so we recommend logging in with your Hugging Face account by:
|
50
|
+
> `sudo docker exec -it llama-factory huggingface-cli login`
|
51
|
+
|
52
|
+
There are a lot of parameters to choose from webui, you can refer to here for more information.
|
53
|
+
|
54
|
+
For demonstration purposes, set `Model name: Phi-1.5-1.3B`, `Dataset: alpaca_zh`, leave the other parameters unchanged, and then click the `Start` button
|
55
|
+
|
56
|
+
<div align="center">
|
57
|
+
<img alt="yolov10" width="1200px" src="./assets/llama-factory-Jetson.png">
|
58
|
+
</div>
|
59
|
+
|
60
|
+
|
61
|
+
## Build Docker Image
|
62
|
+
We highly recommend that you use `jetson-containers` to compile the docker container, as you can see [here](https://github.com/dusty-nv/jetson-containers/pull/566).
|
63
|
+
|
64
|
+
## Reference
|
65
|
+
- https://github.com/hiyouga/LLaMA-Factory
|
66
|
+
- https://github.com/dusty-nv/jetson-containers
|
67
|
+
|
Binary file
|
Binary file
|
@@ -0,0 +1,52 @@
|
|
1
|
+
#!/bin/bash
|
2
|
+
|
3
|
+
|
4
|
+
# check L4T_VERSION
|
5
|
+
# reference https://github.com/dusty-nv/jetson-containers/blob/master/jetson_containers/l4t_version.sh
|
6
|
+
ALLOWED_L4T_VERSIONS=("35.3.1" "35.4.1" "35.5.0")
|
7
|
+
|
8
|
+
ARCH=$(uname -i)
|
9
|
+
if [ $ARCH = "aarch64" ]; then
|
10
|
+
L4T_VERSION_STRING=$(head -n 1 /etc/nv_tegra_release)
|
11
|
+
|
12
|
+
if [ -z "$L4T_VERSION_STRING" ]; then
|
13
|
+
L4T_VERSION_STRING=$(dpkg-query --showformat='${Version}' --show nvidia-l4t-core)
|
14
|
+
L4T_VERSION_ARRAY=(${L4T_VERSION_STRING//./ })
|
15
|
+
L4T_RELEASE=${L4T_VERSION_ARRAY[0]}
|
16
|
+
L4T_REVISION=${L4T_VERSION_ARRAY[1]}
|
17
|
+
else
|
18
|
+
L4T_RELEASE=$(echo $L4T_VERSION_STRING | cut -f 2 -d ' ' | grep -Po '(?<=R)[^;]+')
|
19
|
+
L4T_REVISION=$(echo $L4T_VERSION_STRING | cut -f 2 -d ',' | grep -Po '(?<=REVISION: )[^;]+')
|
20
|
+
fi
|
21
|
+
|
22
|
+
L4T_REVISION_MAJOR=${L4T_REVISION:0:1}
|
23
|
+
L4T_REVISION_MINOR=${L4T_REVISION:2:1}
|
24
|
+
|
25
|
+
L4T_VERSION="$L4T_RELEASE.$L4T_REVISION"
|
26
|
+
echo $L4T_VERSION
|
27
|
+
elif [ $ARCH != "x86_64" ]; then
|
28
|
+
echo "unsupported architecture: $ARCH"
|
29
|
+
exit 1
|
30
|
+
fi
|
31
|
+
|
32
|
+
echo "L4T_VERSION: $L4T_VERSION"
|
33
|
+
if [[ ! " ${ALLOWED_L4T_VERSIONS[@]} " =~ " ${L4T_VERSION} " ]]; then
|
34
|
+
echo "L4T_VERSION is not in the allowed versions list. Exiting."
|
35
|
+
exit 1
|
36
|
+
fi
|
37
|
+
|
38
|
+
|
39
|
+
BASE_PATH=/home/$USER/reComputer
|
40
|
+
mkdir -p $BASE_PATH/
|
41
|
+
JETSON_REPO_PATH="$BASE_PATH/jetson-containers"
|
42
|
+
BASE_JETSON_LAB_GIT="https://github.com/dusty-nv/jetson-containers"
|
43
|
+
if [ -d $JETSON_REPO_PATH ]; then
|
44
|
+
echo "jetson-ai-lab existed."
|
45
|
+
else
|
46
|
+
echo "jetson-ai-lab does not installed. start init..."
|
47
|
+
cd $BASE_PATH/
|
48
|
+
git clone --depth=1 $BASE_JETSON_LAB_GIT
|
49
|
+
cd $JETSON_REPO_PATH
|
50
|
+
bash install.sh
|
51
|
+
fi
|
52
|
+
|
@@ -0,0 +1,21 @@
|
|
1
|
+
MIT License
|
2
|
+
|
3
|
+
Copyright (c) [2024] [Seeed Studio]
|
4
|
+
|
5
|
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
6
|
+
of this software and associated documentation files (the "Software"), to deal
|
7
|
+
in the Software without restriction, including without limitation the rights
|
8
|
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
9
|
+
copies of the Software, and to permit persons to whom the Software is
|
10
|
+
furnished to do so, subject to the following conditions:
|
11
|
+
|
12
|
+
The above copyright notice and this permission notice shall be included in all
|
13
|
+
copies or substantial portions of the Software.
|
14
|
+
|
15
|
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
16
|
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
17
|
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
18
|
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
19
|
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
20
|
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
21
|
+
SOFTWARE.
|
@@ -45,3 +45,6 @@ All models implemented in this project are from the official [Ultralytics Yolo](
|
|
45
45
|
- [TensorRT Acceleration](https://wiki.seeedstudio.com/YOLOv8-DeepStream-TRT-Jetson/)
|
46
46
|
- [Multistreams using Deepstream](https://wiki.seeedstudio.com/YOLOv8-DeepStream-TRT-Jetson/#multistream-model-benchmarks) Tutorials.
|
47
47
|
|
48
|
+
## License
|
49
|
+
|
50
|
+
This project is licensed under the MIT License.
|
Binary file
|
File without changes
|
File without changes
|
File without changes
|