{"id":84923,"date":"2023-09-21T11:40:08","date_gmt":"2023-09-21T03:40:08","guid":{"rendered":"https:\/\/www.seeedstudio.com\/blog\/?p=84923"},"modified":"2024-02-18T07:00:42","modified_gmt":"2024-02-18T07:00:42","slug":"revolutionizing-wildlife-monitoring-tinyml-iot-and-lora-technologies-with-xiao-esp32s3-sense-and-wio-e5-module","status":"publish","type":"post","link":"https:\/\/www.seeedstudio.com\/blog\/2023\/09\/21\/revolutionizing-wildlife-monitoring-tinyml-iot-and-lora-technologies-with-xiao-esp32s3-sense-and-wio-e5-module\/","title":{"rendered":"Revolutionizing Wildlife Monitoring: TinyML, IoT, and LoRa Technologies with XIAO ESP32S3 Sense and Wio E5 Module"},"content":{"rendered":"\n

Updated on Feb 28th, 2024<\/strong><\/p>\n\n\n\n

Leverage TinyML, IoT, and LoRa technologies to develop innovative solutions for real-time monitoring of wildlife encroachment into human habitats. This solution aims to promptly issue alerts to prevent potential conflicts between wildlife and humans.<\/p>\n\n\n\n

Seeed Hardware:<\/strong> Seeed Studio XIAO ESP32S3 Sense<\/a><\/p>\n\n\n\n

Software:<\/strong> Arduino IDE, Edge Impulse, Blues Notehub.io<\/p>\n\n\n\n

Industry:<\/strong> Agriculture, Urban Wildlife Monitoring, Zoos and Aquariums, Conservation Biology, Tourism and Nature Conservation, Research and Education<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

The Background<\/h1>\n\n\n\n

The frequency and intensity of human-wildlife conflicts have surged in recent decades, primarily due to factors such as population growth, urban expansion, habitat fragmentation, climate fluctuations, wildlife poaching, and illicit trade. It has become increasingly vital to discover effective and sustainable solutions to mitigate these conflicts. For example, in January 2023, an elephant called PT 7 caused fatalities in Tamil Nadu and Kerala, emphasizing the need for effective solutions.<\/p>\n\n\n\n

The Solution<\/h1>\n\n\n\n

In response to this challenge, Pradeep Thiruna<\/a> decided to leverage TinyML, LoRa and IoT technologies to detect wildlife and alert people effectively. <\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

Pradeep employed the XIAO ESP32S3 Sense equipped with a camera to detect wildlife. Additionally, he has harnessed the power of Edge Impulse for precise wildlife classification with TinyML. Subsequently, he transmits this classification data to a Blues base station through LoRa technology. To facilitate this data transfer, Pradeep has ingeniously designed a custom PCB that incorporates both the XIAO ESP32S3 Sense and LoRa Wio E5 modules with the help of Seeed Fusion PCBA Services<\/strong><\/a>.<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

Edge Impulse Model Creation<\/h2>\n\n\n\n

Pradeep developed an image classification system using Edge Impulse. To achieve this, he utilized 10 GB of data from Kaggle<\/a>, he then uploaded all required image models to Edge Impulse and labeled the images. The labeling process can be done manually or by generating predefined labels with YOLO V5. Afterward, he prepared the impulse design, incorporating classification, and generated the model features. Once the model output was generated, he deployed it for Arduino IDE.<\/p>\n\n\n\n

\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n<\/figure>\n\n\n\n

EL Model Deployment<\/h2>\n\n\n\n

Next, Pradeep added the El Library to his Arduino IDE. To do this, he went to the Sketch tab, chose Add Zip Library, and picked the downloaded zip file from the Edge Impulse portal. This allowed him to deploy the EI model to the Xiao ESP32S3 Sense. The Arduino sketch works like this: it classifies wild animals and sends alerts via LoRa. When a specific animal is detected, it activates the node_send() function.<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

Reciever Setup<\/h2>\n\n\n\n

He then focused on configuring the base station. He set it up to receive LoRa signals and alert users when data was sent to Blues Notehub<\/a> via Notcard. It also notified remote users through Qubitro<\/a>. He connected both XIAO + LoRa E5 and Blues Notecard to the XIAO ESP32S3 board. He used an Arduino sketch to collect data from the slave node and transfer it to Blues Notehub, with the need to adjust the product UID. Afterward, he created a new project in Notehub | Create Project<\/a>, retrieved the project UID, and replaced it in the Arduino Sketch. This allowed Blues Notehub to start receiving data as expected.<\/p>\n\n\n\n

\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n<\/figure>\n\n\n\n

Visualizing Data<\/h2>\n\n\n\n

Once the data reached the Notehub, Pradeep used Qubitro to visualize and create an alert function based on the received data. He navigated to the Qubitro Portal<\/a>, created a new project, and selected MQTT as the data source. Next, he input all the required details, accessed the created MQTT source, and selected the connection details. The credentials were displayed, necessary for transferring data to Qubitro.<\/p>\n\n\n\n

Moving on to the Blues Notehub\u2019s route page, Pradeep created a new MQTT route and adjusted the username and password to match his Qubitro credentials. He specified which data should be sent to Qubitro, choosing to send only the payload. After successfully transferring the payload to Qubitro, he accessed the Qubitro portal to monitor incoming data.<\/p>\n\n\n\n

The data could be visualized through the Qubitro dashboard. First, he navigated to the Dashboard section and created a new dashboard. Then, he edited it and added the necessary widgets. These included an image widget for displaying data points, a standard gauge for alert level visualization, and a state widget for slave number visualization. He also used map widgets for GPS mapping. This resulted in the final dashboard, showcasing the base station’s location and the status of the slave nodes.<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

Rule Engine Setup<\/h2>\n\n\n\n

In this section, he added a rule function to alert users when an anomaly is detected. To accomplish this, he accessed the Qubitro portal’s function and selected the rule section. Subsequently, he created a new rule and opted for Webhooks<\/a>. Basic details were provided, and he advanced to the next page. There, he accessed the webhook site, copied the webhook URL, and then pasted it into the Qubitro rule page. He proceeded to define the conditions, specifying that the rule would trigger when the Alert level exceeded 0. Below, you can find the webhook response. At this stage, he had the option to use Twilio or Mailgun to send customized SMS or email alerts.<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

The Conclusion<\/h2>\n\n\n\n

In conclusion, human-wildlife conflict poses a serious threat to biodiversity, human development, and social harmony, with the potential for retaliatory actions against wildlife. Yet, by leveraging IoT and Machine Learning, we can create innovative solutions to mitigate conflict, protect both human and wildlife interests, and promote harmonious coexistence.<\/p>\n\n\n\n

More Information<\/h2>\n\n\n\n

Learn More Project Details on<\/strong> Hackster:<\/strong> Digitalizing the Wild with Blues<\/a><\/p>\n\n\n\n

Explore more TinyML stories:<\/strong><\/p>\n\n\n\n