jetson-examples 0.1.3__py3-none-any.whl → 0.1.5__py3-none-any.whl

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (27) hide show
  1. {jetson_examples-0.1.3.dist-info → jetson_examples-0.1.5.dist-info}/METADATA +13 -9
  2. {jetson_examples-0.1.3.dist-info → jetson_examples-0.1.5.dist-info}/RECORD +27 -8
  3. {jetson_examples-0.1.3.dist-info → jetson_examples-0.1.5.dist-info}/WHEEL +1 -1
  4. reComputer/scripts/depth-anything/Dockerfile +6 -0
  5. reComputer/scripts/depth-anything/LICENSE +21 -0
  6. reComputer/scripts/depth-anything/README.md +102 -0
  7. reComputer/scripts/depth-anything/clean.sh +3 -0
  8. reComputer/scripts/depth-anything/images/Autonomous Driving.png +0 -0
  9. reComputer/scripts/depth-anything/images/Indoor Scenes.png +0 -0
  10. reComputer/scripts/depth-anything/images/Opr.png +0 -0
  11. reComputer/scripts/depth-anything/images/Security.png +0 -0
  12. reComputer/scripts/depth-anything/images/Underwater Scenes.png +0 -0
  13. reComputer/scripts/depth-anything/images/WebUI.png +0 -0
  14. reComputer/scripts/depth-anything/images/teaser.png +0 -0
  15. reComputer/scripts/depth-anything/run.sh +12 -0
  16. reComputer/scripts/llama-factory/README.md +67 -0
  17. reComputer/scripts/llama-factory/assets/llama-factory-Jetson.png +0 -0
  18. reComputer/scripts/llama-factory/assets/webui.png +0 -0
  19. reComputer/scripts/llama-factory/clean.sh +4 -0
  20. reComputer/scripts/llama-factory/init.sh +52 -0
  21. reComputer/scripts/llama-factory/run.sh +10 -0
  22. reComputer/scripts/ultralytics-yolo/LICENSE +21 -0
  23. reComputer/scripts/ultralytics-yolo/README.md +3 -0
  24. reComputer/scripts/ultralytics-yolo/images/Ultralytics-yolo.gif +0 -0
  25. {jetson_examples-0.1.3.dist-info → jetson_examples-0.1.5.dist-info}/LICENSE +0 -0
  26. {jetson_examples-0.1.3.dist-info → jetson_examples-0.1.5.dist-info}/entry_points.txt +0 -0
  27. {jetson_examples-0.1.3.dist-info → jetson_examples-0.1.5.dist-info}/top_level.txt +0 -0
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.1
2
2
  Name: jetson-examples
3
- Version: 0.1.3
3
+ Version: 0.1.5
4
4
  Summary: Running Gen AI models and applications on NVIDIA Jetson devices with one-line command
5
5
  Author-email: luozhixin <zhixin.luo@seeed.cc>
6
6
  Project-URL: Homepage, https://github.com/Seeed-Projects/jetson-examples
@@ -23,11 +23,11 @@ License-File: LICENSE
23
23
 
24
24
  This repository provides examples for running AI models and applications on [NVIDIA Jetson devices](https://www.seeedstudio.com/reComputer-J4012-p-5586.html) with a single command.
25
25
 
26
- This repo builds upon the work of the [jetson-containers](https://github.com/dusty-nv/jetson-containers), which provides a modular container build system for various AI/ML packages on NVIDIA Jetson devices.
26
+ This repo builds upon the work of the [jetson-containers](https://github.com/dusty-nv/jetson-containers), [ultralytics](https://github.com/ultralytics/ultralytics) and other excellent projects.
27
27
 
28
28
  ## Features
29
29
  - 🚀 **Easy Deployment:** Deploy state-of-the-art AI models on Jetson devices in one line.
30
- - 🔄 **Versatile Examples:** Supports text generation, image generation, vision transformers, computer vision and so on.
30
+ - 🔄 **Versatile Examples:** Supports text generation, image generation, computer vision and so on.
31
31
  - ⚡ **Optimized for Jetson:** Leverages Nvidia Jetson hardware for efficient performance.
32
32
 
33
33
 
@@ -60,9 +60,11 @@ Here are some examples that can be run:
60
60
 
61
61
  | Example | Type | Model/Data Size | Docker Image Size | Command |
62
62
  | ------------------------------------------------ | ------------------------ | --------------- | ---------- | --------------------------------------- |
63
- | 🆕 [yolov10](/reComputer/scripts/yolov10/README.md) | Computer Vision | 7.2M | 5.74 GB | `reComputer run yolov10` |
64
- | 🆕 llama3 | Text (LLM) | 4.9GB | 10.5GB | `reComputer run llama3` |
65
- | 🆕 [ollama](https://github.com/ollama/ollama) | Inference Server | * | 10.5GB | `reComputer run ollama` |
63
+ | 🆕 llama-factory | Finetune LLM | | 13.5GB | `reComputer run llama-factory` |
64
+ | 🆕 [depth-anything](/reComputer/scripts/depth-anything/README.md) |Computer Vision | | 12.9GB | `reComputer run depth-anything` |
65
+ | [yolov10](/reComputer/scripts/yolov10/README.md) | Computer Vision | 7.2M | 5.74 GB | `reComputer run yolov10` |
66
+ | llama3 | Text (LLM) | 4.9GB | 10.5GB | `reComputer run llama3` |
67
+ | [ollama](https://github.com/ollama/ollama) | Inference Server | * | 10.5GB | `reComputer run ollama` |
66
68
  | LLaVA | Text + Vision (VLM) | 13GB | 14.4GB | `reComputer run llava` |
67
69
  | Live LLaVA | Text + Vision (VLM) | 13GB | 20.3GB | `reComputer run live-llava` |
68
70
  | stable-diffusion-webui | Image Generation | 3.97G | 7.3GB | `reComputer run stable-diffusion-webui` |
@@ -72,6 +74,7 @@ Here are some examples that can be run:
72
74
  | [yolov8-rail-inspection](/reComputer/scripts/yolov8-rail-inspection/readme.md) |Computer Vision | 6M | 13.8GB | `reComputer run yolov8-rail-inspection` |
73
75
  | [ultralytics-yolo](/reComputer/scripts/ultralytics-yolo/README.md) |Computer Vision | | 15.4GB | `reComputer run ultralytics-yolo` |
74
76
 
77
+
75
78
  > Note: You should have enough space to run example, like `LLaVA`, at least `27.4GB` totally
76
79
 
77
80
  More Examples can be found [examples.md](./docs/examples.md)
@@ -83,13 +86,14 @@ We welcome contributions to improve jetson-examples! If you have an example you'
83
86
 
84
87
  ## TODO List
85
88
 
89
+ - [x] detect host environment and install what we need
90
+ - [x] all type jetson support checking list
91
+ - [x] try jetpack 6.0
86
92
  - [ ] check disk space enough or not before run
87
93
  - [ ] allow to setting some configs, such as `BASE_PATH`
88
- - [ ] detect host environment and install what we need
89
94
  - [ ] support jetson-containers update
90
- - [ ] all type jetson support checking list
91
95
  - [ ] better table to show example's difference
92
- - [ ] try jetpack 6.0
96
+
93
97
 
94
98
 
95
99
  ## License
@@ -10,8 +10,26 @@ reComputer/scripts/audiocraft/README.md,sha256=EGEoK1Rq-Vczri24APoe2kK8e5VmJHn_g
10
10
  reComputer/scripts/audiocraft/clean.sh,sha256=0mk1BHYa1IlnPOXZt_Vy8TqxTLGAnXPIDuClMwzdTmM,77
11
11
  reComputer/scripts/audiocraft/init.sh,sha256=ktAKm4XFtJYntnSR-oAK4G5OhCSSoKw511mR9qk6xGw,428
12
12
  reComputer/scripts/audiocraft/run.sh,sha256=b0kjEeZnA5diQw6vjyrkOX-Svs5XVKGt0ABbWtZsZEs,160
13
+ reComputer/scripts/depth-anything/Dockerfile,sha256=gJ2Q1g2E06_z4hy9C-m1bA4X2IMqRWuo42izFfQ_E5Y,279
14
+ reComputer/scripts/depth-anything/LICENSE,sha256=feSgondqafLDgk7Dp9gnVBE5Y9K5X9mal_DGYKALzXQ,1073
15
+ reComputer/scripts/depth-anything/README.md,sha256=nHFcFIEZyoy3_n7bFuQ_3zT3IKRwLmRkxuXj9YE4sWw,4205
16
+ reComputer/scripts/depth-anything/clean.sh,sha256=81oScb0iXcFQ6-3X9bfIJRcE6hBuVETGDyNbQwMhQ7Q,75
17
+ reComputer/scripts/depth-anything/run.sh,sha256=m8g6LHQHPssKuOftLil0y3IbZaIwFIkHGt_laecCRBs,315
18
+ reComputer/scripts/depth-anything/images/Autonomous Driving.png,sha256=oHdvvCyA5-ifHNWz4MxnBGT4HSy5Bbud9vbxlilS2-w,331869
19
+ reComputer/scripts/depth-anything/images/Indoor Scenes.png,sha256=bnTMltdVecbP4TjRk7t-ldE3Rj7CmUh53RK8A6dK2lo,625925
20
+ reComputer/scripts/depth-anything/images/Opr.png,sha256=9ppsKQZ2SWI7NFKWuQMLyxyfpsHAyN1dhp1ufYuPt4k,45174
21
+ reComputer/scripts/depth-anything/images/Security.png,sha256=F25Ay65Mz6jWAP-P20fmG4-RftkijuNM6uFhUNW2rtY,235206
22
+ reComputer/scripts/depth-anything/images/Underwater Scenes.png,sha256=xpBV1VoCoQqgomAjHQKQYofJha0r4tUTNUGG6XWCm20,598471
23
+ reComputer/scripts/depth-anything/images/WebUI.png,sha256=HtlUbq6KSOqR6vV1n7mFaV_Kz5DLs2W4UcAVvEG4c-4,721506
24
+ reComputer/scripts/depth-anything/images/teaser.png,sha256=J1VpUd71nshdWgZ1dS0LUl9ppJn-Rm2-ZPX9YuM4C38,5657444
13
25
  reComputer/scripts/live-llava/init.sh,sha256=ktAKm4XFtJYntnSR-oAK4G5OhCSSoKw511mR9qk6xGw,428
14
26
  reComputer/scripts/live-llava/run.sh,sha256=4sWld5d8Fkr9GUVqLH2S1RyOKOjobhjojSzuJu8EuCg,10137
27
+ reComputer/scripts/llama-factory/README.md,sha256=N727Q8X-OGo-_d4ZIAhwbWtcOyjto0XwfzmI2Zw8wHg,2449
28
+ reComputer/scripts/llama-factory/clean.sh,sha256=cRpFDKCkKDCgaCoXdmF60dQ_RLAcIHbYZ5w-8PLKRr8,133
29
+ reComputer/scripts/llama-factory/init.sh,sha256=FAaIlBQxLdenS6aW8Vpo5OqBZgV0NmkrCpkbJMwkwtU,1633
30
+ reComputer/scripts/llama-factory/run.sh,sha256=NsxvjSkwFQ-b5DoPRN5DlCYsyvq1_wpZmubVN9y4nQs,231
31
+ reComputer/scripts/llama-factory/assets/llama-factory-Jetson.png,sha256=bUoDJWCiGfGRM_cQBEve-7nJyJFxCS5E0ekBcc1fpUg,574732
32
+ reComputer/scripts/llama-factory/assets/webui.png,sha256=RXaMyX3cIqZVoO27z5kn0rmbfEapdMuWN2JmPZlJlB0,419226
15
33
  reComputer/scripts/llama3/init.sh,sha256=ktAKm4XFtJYntnSR-oAK4G5OhCSSoKw511mR9qk6xGw,428
16
34
  reComputer/scripts/llama3/run.sh,sha256=IkHvMwh_U8fp7AH2qWFUMWywHZDbZKHlp8ODzfHgqBQ,328
17
35
  reComputer/scripts/llava/clean.sh,sha256=7t2SIxj6_elOpHxtTjl9ofnU5d9Ir2r5eyNAj6lAI68,70
@@ -32,10 +50,11 @@ reComputer/scripts/stable-diffusion-webui/init.sh,sha256=ktAKm4XFtJYntnSR-oAK4G5
32
50
  reComputer/scripts/stable-diffusion-webui/run.sh,sha256=E0_KRJK5BLFsBzAiJw-Ir81bvmIU4GV-TLJRgda2XHM,160
33
51
  reComputer/scripts/text-generation-webui/init.sh,sha256=ktAKm4XFtJYntnSR-oAK4G5OhCSSoKw511mR9qk6xGw,428
34
52
  reComputer/scripts/text-generation-webui/run.sh,sha256=mRlWxZTArGXoyyeHbgZvPbVKTflQSsFCKUERKoHYHHE,407
35
- reComputer/scripts/ultralytics-yolo/README.md,sha256=naa2xbK-lcHdEW60_H2l4uHKKSgCiv_nzvPZJ6rv7Uk,2337
53
+ reComputer/scripts/ultralytics-yolo/LICENSE,sha256=feSgondqafLDgk7Dp9gnVBE5Y9K5X9mal_DGYKALzXQ,1073
54
+ reComputer/scripts/ultralytics-yolo/README.md,sha256=xmK-K6EIONhyOBzSTq30G39b6NiYkvGWL8WTTGmymSY,2397
36
55
  reComputer/scripts/ultralytics-yolo/clean.sh,sha256=0sS0YZI0B1GdydOyDJU4IG1cVmAssWZS60Qt8LJobdE,63
37
56
  reComputer/scripts/ultralytics-yolo/run.sh,sha256=yxXAFIKVa_nknnhowCMxfIo2_3dej9I9b9Wa23KQlho,287
38
- reComputer/scripts/ultralytics-yolo/images/Ultralytics-yolo.gif,sha256=cbA1vAcPbGlbU2bLAHJGu3FyDZ4ospVviBI5uMXZk9w,1315335
57
+ reComputer/scripts/ultralytics-yolo/images/Ultralytics-yolo.gif,sha256=_xF_n-Gfa-Er-evCcJ1tBSgNkSc9oqitgDXmq4ggwBw,12628076
39
58
  reComputer/scripts/ultralytics-yolo/images/tasks.png,sha256=ILhKVHoGiwZM1BQdbjcb8RM07ijq_2s3c5XqBM5rRx0,275724
40
59
  reComputer/scripts/whisper/init.sh,sha256=ktAKm4XFtJYntnSR-oAK4G5OhCSSoKw511mR9qk6xGw,428
41
60
  reComputer/scripts/whisper/run.sh,sha256=UKiY7Ie5uyGrdvAob1XwPSlpdEL27HR5vcMtnVOrph4,146
@@ -52,9 +71,9 @@ reComputer/scripts/yolov8:detect/README.txt,sha256=gLAXjOR1X9gXJM0XA0c1P12nz81zv
52
71
  reComputer/scripts/yolov8:detect/app.py,sha256=63o2icb_av9owTBW6nL6wJfXdYEyZRt8feBL6YqrWTw,1307
53
72
  reComputer/scripts/yolov8:detect/run.sh,sha256=iq5o5iy2iPaUfC471sOWY4HhYWIOZ1geauqNQ-fg-2Y,130
54
73
  reComputer/scripts/yolov8:detect/templates/index.html,sha256=Q0mRmqax_F4cZq8Zau_JLtwvCpFH_Al6lUisu9Uaids,524
55
- jetson_examples-0.1.3.dist-info/LICENSE,sha256=ac_LOi8ChcJhymEfBulX98Y06wTI2IMcQnqCXZ5yay4,1066
56
- jetson_examples-0.1.3.dist-info/METADATA,sha256=k5xb-PmnJIAa9z95m4SNrNARQ7t2yndcw3qYu79u_9s,5146
57
- jetson_examples-0.1.3.dist-info/WHEEL,sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ,92
58
- jetson_examples-0.1.3.dist-info/entry_points.txt,sha256=5-OdcBifoDjVXE9KjNoN6tQa8l_XSXhdbBEgL2hxeDM,58
59
- jetson_examples-0.1.3.dist-info/top_level.txt,sha256=SI-liiUOkoGwOJfMP7d7k63JKgdcbiEj6DEC8QIKI90,11
60
- jetson_examples-0.1.3.dist-info/RECORD,,
74
+ jetson_examples-0.1.5.dist-info/LICENSE,sha256=ac_LOi8ChcJhymEfBulX98Y06wTI2IMcQnqCXZ5yay4,1066
75
+ jetson_examples-0.1.5.dist-info/METADATA,sha256=389saGoBSnNuJzwFBxj07iucvIAQgHbJcKSR0FkY9lY,5323
76
+ jetson_examples-0.1.5.dist-info/WHEEL,sha256=y4mX-SOX4fYIkonsAGA5N0Oy-8_gI4FXw5HNI1xqvWg,91
77
+ jetson_examples-0.1.5.dist-info/entry_points.txt,sha256=5-OdcBifoDjVXE9KjNoN6tQa8l_XSXhdbBEgL2hxeDM,58
78
+ jetson_examples-0.1.5.dist-info/top_level.txt,sha256=SI-liiUOkoGwOJfMP7d7k63JKgdcbiEj6DEC8QIKI90,11
79
+ jetson_examples-0.1.5.dist-info/RECORD,,
@@ -1,5 +1,5 @@
1
1
  Wheel-Version: 1.0
2
- Generator: bdist_wheel (0.43.0)
2
+ Generator: setuptools (70.2.0)
3
3
  Root-Is-Purelib: true
4
4
  Tag: py3-none-any
5
5
 
@@ -0,0 +1,6 @@
1
+ FROM nvcr.io/nvidia/l4t-pytorch:r35.2.1-pth2.0-py3
2
+ RUN mkdir /usr/src/DepthAnything-on-Jetson-Orin
3
+ WORKDIR /usr/src/DepthAnything-on-Jetson-Orin
4
+ COPY . /usr/src/DepthAnything-on-Jetson-Orin
5
+ RUN pip install flask onnx flask flask_socketio huggingface_hub
6
+ CMD ["python3", "app.py"]
@@ -0,0 +1,21 @@
1
+ MIT License
2
+
3
+ Copyright (c) [2024] [Seeed Studio]
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE.
@@ -0,0 +1,102 @@
1
+ # Jetson-Example: Run Depth Anything on NVIDIA Jetson Orin 🚀
2
+ This project provides an one-click deployment of the Depth Anything monocular depth estimation model developed by Hong Kong University and ByteDance. The deployment is visualized on [reComputer J4012](https://www.seeedstudio.com/reComputer-J4012-p-5586.html) (Jetson Orin NX 16GB, 100 TOPS) and includes a WebUI for model conversion to TensorRT and real-time depth estimation.
3
+ <p align="center">
4
+ <img src="images/WebUI.png" alt="WebUI">
5
+ </p>
6
+
7
+ All models and inference engine implemented in this project are from the official [Depth Anything](https://depth-anything.github.io/).
8
+
9
+ ## 🔥Features
10
+
11
+ - One-click deployment for Depth Anything models.
12
+ - WebUI for model conversion and depth estimation.
13
+ - Support for uploading videos/images or using the local camera
14
+ - Supports S, B, L models of Depth Anything with input sizes of 308, 384, 406, and 518.
15
+
16
+ ### 🗝️WebUI Features
17
+ - **Choose model**: Select from depth_anything_vits14 models. (S, B, L)
18
+ - **Choose input size**: Select the desired input size.(308, 384, 406, 518)
19
+ - **Grayscale option**: Option to use grayscale.
20
+ - **Choose source**: Select the input source (Video, Image, Camera).
21
+ - **Export Model**: Automatically download and convert the model from PyTorch (.pth) to TensorRT format.
22
+ - **Start Estimation**: Begin depth estimation using the selected model and input source.
23
+ - **Stop Estimation**: Stop the ongoing depth estimation process.
24
+ <p align="center">
25
+ <img src="images/Opr.png" alt="Depthanything" width="320" height="360">
26
+ </p>
27
+
28
+ ## 🥳Getting Started
29
+ ### 📜Prerequisites
30
+ - reComputer J4012 [(🛒Buy Here)](https://www.seeedstudio.com/reComputer-J4012-p-5586.html)
31
+ - Docker installed on reComputer
32
+ - USB Camera (optional)
33
+ ### 🚀Installation
34
+
35
+
36
+ PyPI(recommend)
37
+ ```sh
38
+ pip install jetson-examples
39
+ ```
40
+ Linux (github trick)
41
+ ```sh
42
+ curl -fsSL https://raw.githubusercontent.com/Seeed-Projects/jetson-examples/main/install.sh | sh
43
+ ```
44
+ Github (for Developer)
45
+ ```sh
46
+ git clone https://github.com/Seeed-Projects/jetson-examples
47
+ cd jetson-examples
48
+ pip install .
49
+ ```
50
+
51
+ ### 📋Usage
52
+ 1. Run code:
53
+ ```sh
54
+ reComputer run depth-anything
55
+ ```
56
+ 2. Open a web browser and input **http://{reComputer ip}:5000**. Use the WebUI to select the model, input size, and source.
57
+
58
+ 3. Click on **Export Model** to download and convert the model.
59
+
60
+ 4. Click on **Start Estimation** to begin the depth estimation process.
61
+
62
+ 5. View the real-time depth estimation results on the WebUI.
63
+
64
+ ## ⛏️Applications
65
+
66
+ - **Security**: Enhance surveillance systems with depth perception.
67
+ <p align="center">
68
+ <img src="images/Security.png" alt="Security" width="500" height="150">
69
+ </p>
70
+ - **Autonomous Driving**: Improve environmental sensing for autonomous vehicles.
71
+ <p align="center">
72
+ <img src="images/Autonomous Driving.png" alt="Autonomous Driving" width="500" height="150">
73
+ </p>
74
+ - **Underwater Scenes**: Apply depth estimation in underwater exploration.
75
+ <p align="center">
76
+ <img src="images/Underwater Scenes.png" alt="Underwater Scenes" width="500" height="150">
77
+ </p>
78
+ - **Indoor Scenes**: Use depth estimation for indoor navigation and analysis.
79
+ <p align="center">
80
+ <img src="images/Indoor Scenes.png" alt="Indoor Scenes" width="500" height="150">
81
+ </p>
82
+
83
+ ## Further Development 🔧
84
+ - [Depth Anything Official](https://depth-anything.github.io/)
85
+ - [Depth Anything TensorRT](https://github.com/spacewalk01/depth-anything-tensorrt)
86
+ - [Depth Anything ONNX](https://github.com/fabio-sim/Depth-Anything-ONNX)
87
+ - [Depth Anything ROS](https://github.com/scepter914/DepthAnything-ROS)
88
+ - [Depth Anything Android](https://github.com/FeiGeChuanShu/ncnn-android-depth_anything)
89
+
90
+
91
+ ## 🙏🏻Contributing
92
+
93
+ We welcome contributions from the community. Please fork the repository and create a pull request with your changes.
94
+
95
+ ## ✅License
96
+
97
+ This project is licensed under the MIT License.
98
+
99
+ ## 🏷️Acknowledgements
100
+
101
+ - Depth Anything [project](https://depth-anything.github.io/) by Hong Kong University and ByteDance.
102
+ - Seeed Studio team for their [support and resources](https://github.com/Seeed-Projects/jetson-examples).
@@ -0,0 +1,3 @@
1
+ #!/bin/bash
2
+
3
+ sudo docker rmi yaohui1998/depthanything-on-jetson-orin:latest
@@ -0,0 +1,12 @@
1
+ #!/bin/bash
2
+
3
+ docker pull yaohui1998/depthanything-on-jetson-orin:latest
4
+
5
+ docker run --rm -it \
6
+ --privileged \
7
+ --network host \
8
+ -v /tmp/.X11-unix:/tmp/.X11-unix[@] \
9
+ -v /dev/*:/dev/* \
10
+ -v /etc/localtime:/etc/localtime:ro \
11
+ --runtime nvidia \
12
+ yaohui1998/depthanything-on-jetson-orin:latest
@@ -0,0 +1,67 @@
1
+ # Finetune LLM by Llama-Factory on Jetson
2
+
3
+
4
+ ## Hello
5
+
6
+ 💡 Here's an example of quickly deploying [Llama-Factory](https://github.com/hiyouga/LLaMA-Factory) on Jetson device.
7
+
8
+ 🔥 Hightlights:
9
+ - **Llama-Factory** is an efficient tool to unify efficient Fine-Tuning of 100+ LLMs. 🚀🔍
10
+ - **Jetson-examples** is a toolkit designed to deploy containerized applications on NVIDIA Jetson devices. ✨
11
+ - **Jetson** is powerful AI hardware platform for edge computing.💻
12
+
13
+ 🛠️ Follow the tutorial below to quickly experience the performance of Llama-Factory on edge computing devices.
14
+
15
+ <!-- <div align="center">
16
+ <img alt="yolov10" width="1200px" src="./assets/llama-factory-Jetson.png">
17
+ </div> -->
18
+
19
+ ## Get a Jetson Orin Device 🛒
20
+ | Device Model | Description | Link |
21
+ |--------------|-------------|------|
22
+ | reComputer J4012, powered by Orin NX 16GB, 100 TOPS | Embedded computer powered by Orin NX | [Buy Here](https://www.seeedstudio.com/reComputer-J4012-p-5586.html) |
23
+ | NVIDIA® Jetson AGX Orin™ 64GB Developer Kit | smallest and most powerful AI edge computer | [Buy Here](https://www.seeedstudio.com/NVIDIArJetson-AGX-Orintm-64GB-Developer-Kit-p-5641.html) |
24
+
25
+ ## Getting Started
26
+
27
+ - install **jetson-examples** by pip:
28
+ ```sh
29
+ pip3 install jetson-examples
30
+ ```
31
+ - restart reComputer
32
+ ```sh
33
+ sudo restart
34
+ ```
35
+ - run Llama-Factory webui on jetson in one line:
36
+ ```sh
37
+ reComputer run llama-factory
38
+ ```
39
+ - Please visit http://127.0.0.1:7860
40
+
41
+ <div align="center">
42
+ <img alt="yolov10" width="1200px" src="./assets/webui.png">
43
+ </div>
44
+
45
+
46
+
47
+ ## Run Training Script
48
+
49
+ > **Note:** Some models and datasets require confirmation before using them, so we recommend logging in with your Hugging Face account by:
50
+ > `sudo docker exec -it llama-factory huggingface-cli login`
51
+
52
+ There are a lot of parameters to choose from webui, you can refer to here for more information.
53
+
54
+ For demonstration purposes, set `Model name: Phi-1.5-1.3B`, `Dataset: alpaca_zh`, leave the other parameters unchanged, and then click the `Start` button
55
+
56
+ <div align="center">
57
+ <img alt="yolov10" width="1200px" src="./assets/llama-factory-Jetson.png">
58
+ </div>
59
+
60
+
61
+ ## Build Docker Image
62
+ We highly recommend that you use `jetson-containers` to compile the docker container, as you can see [here](https://github.com/dusty-nv/jetson-containers/pull/566).
63
+
64
+ ## Reference
65
+ - https://github.com/hiyouga/LLaMA-Factory
66
+ - https://github.com/dusty-nv/jetson-containers
67
+
@@ -0,0 +1,4 @@
1
+ #!/bin/bash
2
+
3
+ sudo docker rmi youjiang9977/llama-factory:r35.4.1
4
+ sudo rm -rf /home/$USER/reComputer/jetson-containers/LLaMA-Factory/*
@@ -0,0 +1,52 @@
1
+ #!/bin/bash
2
+
3
+
4
+ # check L4T_VERSION
5
+ # reference https://github.com/dusty-nv/jetson-containers/blob/master/jetson_containers/l4t_version.sh
6
+ ALLOWED_L4T_VERSIONS=("35.3.1" "35.4.1" "35.5.0")
7
+
8
+ ARCH=$(uname -i)
9
+ if [ $ARCH = "aarch64" ]; then
10
+ L4T_VERSION_STRING=$(head -n 1 /etc/nv_tegra_release)
11
+
12
+ if [ -z "$L4T_VERSION_STRING" ]; then
13
+ L4T_VERSION_STRING=$(dpkg-query --showformat='${Version}' --show nvidia-l4t-core)
14
+ L4T_VERSION_ARRAY=(${L4T_VERSION_STRING//./ })
15
+ L4T_RELEASE=${L4T_VERSION_ARRAY[0]}
16
+ L4T_REVISION=${L4T_VERSION_ARRAY[1]}
17
+ else
18
+ L4T_RELEASE=$(echo $L4T_VERSION_STRING | cut -f 2 -d ' ' | grep -Po '(?<=R)[^;]+')
19
+ L4T_REVISION=$(echo $L4T_VERSION_STRING | cut -f 2 -d ',' | grep -Po '(?<=REVISION: )[^;]+')
20
+ fi
21
+
22
+ L4T_REVISION_MAJOR=${L4T_REVISION:0:1}
23
+ L4T_REVISION_MINOR=${L4T_REVISION:2:1}
24
+
25
+ L4T_VERSION="$L4T_RELEASE.$L4T_REVISION"
26
+ echo $L4T_VERSION
27
+ elif [ $ARCH != "x86_64" ]; then
28
+ echo "unsupported architecture: $ARCH"
29
+ exit 1
30
+ fi
31
+
32
+ echo "L4T_VERSION: $L4T_VERSION"
33
+ if [[ ! " ${ALLOWED_L4T_VERSIONS[@]} " =~ " ${L4T_VERSION} " ]]; then
34
+ echo "L4T_VERSION is not in the allowed versions list. Exiting."
35
+ exit 1
36
+ fi
37
+
38
+
39
+ BASE_PATH=/home/$USER/reComputer
40
+ mkdir -p $BASE_PATH/
41
+ JETSON_REPO_PATH="$BASE_PATH/jetson-containers"
42
+ BASE_JETSON_LAB_GIT="https://github.com/dusty-nv/jetson-containers"
43
+ if [ -d $JETSON_REPO_PATH ]; then
44
+ echo "jetson-ai-lab existed."
45
+ else
46
+ echo "jetson-ai-lab does not installed. start init..."
47
+ cd $BASE_PATH/
48
+ git clone --depth=1 $BASE_JETSON_LAB_GIT
49
+ cd $JETSON_REPO_PATH
50
+ bash install.sh
51
+ fi
52
+
@@ -0,0 +1,10 @@
1
+ #!/bin/bash
2
+
3
+
4
+ DATA_PATH="/home/$USER/reComputer/jetson-containers/data"
5
+
6
+ sudo docker run -it --rm --network host --runtime nvidia \
7
+ --volume $DATA_PATH:/data \
8
+ --name llama-factory \
9
+ youjiang9977/llama-factory:r35.4.1
10
+
@@ -0,0 +1,21 @@
1
+ MIT License
2
+
3
+ Copyright (c) [2024] [Seeed Studio]
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE.
@@ -45,3 +45,6 @@ All models implemented in this project are from the official [Ultralytics Yolo](
45
45
  - [TensorRT Acceleration](https://wiki.seeedstudio.com/YOLOv8-DeepStream-TRT-Jetson/)
46
46
  - [Multistreams using Deepstream](https://wiki.seeedstudio.com/YOLOv8-DeepStream-TRT-Jetson/#multistream-model-benchmarks) Tutorials.
47
47
 
48
+ ## License
49
+
50
+ This project is licensed under the MIT License.