![\"\"](\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2023\/12\/2.png\")
<\/figure><\/div>\n\n\nWhy Both Train and Deploy Models on the Edge?<\/h2>\n\n\n\n
1. On-Device Training:<\/strong><\/p>\n\n\n\n Jetson devices, equipped with sufficient computational power, allow developers to perform on-device training. This means that the AI model can be updated and re-trained directly on the edge device based on the continuous new data input from the real scene, without the need to send data back to a central server or cloud for training, which enables a decentralized and efficient workflow.<\/p>\n\n\n\n 2. Enhance Privacy<\/strong><\/p>\n\n\n\n Jetson enhances privacy by processing data locally and uploading only analyzed insights to the cloud. Even when a subset of data is transmitted for training, robust anonymization safeguards user identities. This not only preserves privacy but also streamlines compliance with data regulations.<\/p>\n\n\n\n 3. More Stable Operation<\/strong><\/p>\n\n\n\n Rather than dealing with fluctuating workloads and potential bottlenecks on traditional computing servers, the Jetson’s efficiency can be shown through its ability to execute operations with precision and stability, running 7×24 without frequent human maintenance and complex overhaul.<\/p>\n\n\n\n 4. Minimize Latency<\/strong><\/p>\n\n\n\n The Jetson Edge device stands out as a latency-reducing powerhouse due to its streamlined data processing approach. It eliminates the need for data to traverse back and forth between the deployment end and a central server, a critical factor for achieving real-time response in applications. By focusing on transmitting concise, updated data rather than the complete large datasets, the Jetson optimizes bandwidth efficiency. It delivers only the essential information needed for quick decision-making, building the Jetson a formidable solution for applications demanding swift and responsive computing.<\/p>\n\n\n\n Now, I’m glad to lead you to train and deploy an object detection model referring to the YOLOv8 object detection algorithm for the busy traffic road, where we use reComputer J4012 Jetson Orin NX 16GB<\/a> with pre-installed Jetpack 5.1.1 version. Appreciate the contribution of our application engineer Youjiang<\/a> to build this demo and figure out the clear path, feel free to also check out the full details in this wiki<\/a>.<\/p>\n\n\n\n We have two methods to prepare a high-quality dataset for good model performance: <\/p>\n\n\n\n 1. Download the pre-annotated open-source public dataset<\/strong><\/p>\n\n\n\n You can find a proper public dataset fitting for your application scenario through open platforms such as Roboflow<\/a>, Kaggle<\/a>, and so on. After downloading the traffic Detection project dataset from Kaggle, you need to modify the paths that direct to locations of training, testing, and validating sets in the data.json file.<\/p>\n\n\n\n 2. Collect and label images as your dataset for training<\/strong><\/p>\n\n\n\n Easily get started annotating images with Label Studio<\/a>. before doing that, install and run the annotation tool as follows:<\/p>\n\n\n\n Follow the step guides<\/a> to create your annotation project, and export the dataset in YOLO format. To organize them with the downloaded data together, you can save all images to the train\/images folder, and then copy the generated annotation text files to the train\/labels folder, both two folders are for the public dataset.<\/p>\n\n\n Here we are going to download the YOLOv8 source code on reComputer, modify the requirements.txt first, and install the PyTorch Jetson version. Follow the wiki commands<\/a>.<\/p>\n\n\n\n Remember to check if you have already installed YOLO successfully:<\/p>\n\n\n\n Revise your Python script by editing as follows, it’s optional to use the CLI approach to train the model by setting up different configurations based on your specific scenario requirements. The full steps for the training part can be found in the wiki<\/a>.<\/p>\n\n\n\n After the training progress finishes, you’ll see the model weight files saved in the specific folder:<\/p>\n\n\n By verifying the prediction results, you’ll first figure out if the model can perform the expected capability in the real scenario. However, it’s just the verification of the model feasibility, without considering the inferencing speed based on the practical requirements in the real-world application. So, finding the balance between efficiency and prediction accuracy plays a crucial role during the deployment process. TensorRT Inference engine can help improve the inferencing speed of the model. Follow the wiki to generate the inference.py file and replace the model and cap part with your paths. <\/p>\n\n\n\n To make a more versatile model with faster inference, the quantized model is also important to take into the deployment part. based on our test in this demo, the inferencing performance could be leveraged from 21.9 FPS to 29.76 FPS after using the quantized model.<\/p>\n\n\n Looking ahead, it’s still crucial to focus on advancing inferencing speed. Leveraging the exceptional Orin NX AI performance, reaching up to 100 TOPS, the next step involves fine-tuning the AI model to unlock even greater speeds in edge AI inferencing.<\/p>\n\n\n\n It’s also achievable to accelerate the AI development process by synergizing generative AI with the entire loop, which can not only enhance model generative capability by fast dataset extension but also re-train AI models with the transfer learning ability based on a smaller amount of task-specific data. All these advancements could be handled with our reComputer Jetson Orin edge device, and then further seamlessly integrated into end-to-end edge AI application development and deployment pipelines, continuing to show innovation in diverse industry fields and ecosystems.<\/p>\n\n\n\n Join the forefront of AI innovation with us! Harness the power of cutting-edge hardware and technology to revolutionize the deployment of machine learning in the real world across industries. Be a part of our mission to provide developers and enterprises with the best ML solutions available. Check out our success case study catalog<\/a> to discover more edge AI possibilities! <\/p>\n\n\n\n Discover infinite computer vision application possibilities through our vision AI resource hub<\/a>!<\/p>\n\n\n\n Take the first step and send us an email at edgeai@seeed.cc<\/a> to become a part of this exciting journey! <\/p>\n\n\n\n Download our latest Jetson product Catalog<\/a> to find one option that suits you well. If you can\u2019t find the off-the-shelf Jetson hardware solution for your needs, please check out our customization services<\/a>, and submit a new product inquiry to us at odm@seeed.cc for evaluation.<\/p>\n","protected":false},"excerpt":{"rendered":" In the rapidly developing field of Machine Learning, training AI models is a familiar yet<\/p>\n","protected":false},"author":3606,"featured_media":89371,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_lmt_disableupdate":"","_lmt_disable":"","_price":"","_stock":"","_tribe_ticket_header":"","_tribe_default_ticket_provider":"","_tribe_ticket_capacity":"0","_ticket_start_date":"","_ticket_end_date":"","_tribe_ticket_show_description":"","_tribe_ticket_show_not_going":false,"_tribe_ticket_use_global_stock":"","_tribe_ticket_global_stock_level":"","_global_stock_mode":"","_global_stock_cap":"","_tribe_rsvp_for_event":"","_tribe_ticket_going_count":"","_tribe_ticket_not_going_count":"","_tribe_tickets_list":"[]","_tribe_ticket_has_attendee_info_fields":false,"iawp_total_views":0,"footnotes":""},"categories":[4394,4393],"tags":[4637,3254,2799,1608,4809,4808,1824],"class_list":["post-89003","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-deploy","category-tech","tag-ai-models","tag-computer-vision","tag-edge-ai","tag-machine-learning","tag-model-deployment","tag-model-training","tag-nvidia-jetson"],"yoast_head":"\nComplete the Entire Procedure on Jetson Orin NX<\/h2>\n\n\n\n
Dataset Collection<\/h3>\n\n\n\n
train: .\/train\/images\nval: .\/valid\/images\ntest: .\/test\/images\n\nnc: 5\nnames: ['bicycle', 'bus', 'car', 'motorbike', 'person']<\/code><\/pre>\n\n\n\nsudo groupadd docker\nsudo gpasswd -a ${USER} docker\nsudo systemctl restart docker\nsudo chmod a+rw \/var\/run\/docker.sock\n\nmkdir label_studio_data\nsudo chmod -R 776 label_studio_data\ndocker run -it -p 8080:8080 -v $(pwd)\/label_studio_data:\/label-studio\/data heartexlabs\/label-studio:latest<\/code><\/pre>\n\n\n\n![\"\"](\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2023\/12\/labeling-1030x551.png\")
<\/figure><\/div>\n\n\nSet up Runtime Environment<\/h3>\n\n\n\n
yolo detect predict model=yolov8s.pt source='https:\/\/ultralytics.com\/images\/bus.jpg'<\/code><\/pre>\n\n\n\nTrain Your Model<\/h3>\n\n\n\n
from ultralytics import YOLO\n\n# Load a model\nmodel = YOLO('yolov8s.pt')\n\n# Train the model\nresults = model.train(\n data='\/home\/nvidia\/Everything_Happens_Locally\/Dataset\/data.yaml', \n batch=8, epochs=100, imgsz=640, save_period=5\n)<\/code><\/pre>\n\n\n\n![\"\"](\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2023\/12\/models-1030x188.png\")
<\/figure><\/div>\n\n\nModel Validation & Deployment<\/h3>\n\n\n\n
![\"\"](\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2023\/12\/502b2361cd8a94a503bbeb3fe2a53978-772x1030.jpg\")
<\/figure><\/div>\n\n\n
\n\n\n![\"\"](\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2023\/09\/WeChatWorkScreenshot_0fa3f479-5b1c-4e23-9896-b989d6bde69c-3-1030x599.png\")
<\/figure><\/div>\n\n\n