{"id":95661,"date":"2024-05-22T03:47:17","date_gmt":"2024-05-22T03:47:17","guid":{"rendered":"https:\/\/www.seeedstudio.com\/blog\/?p=95661"},"modified":"2024-05-30T02:55:40","modified_gmt":"2024-05-30T02:55:40","slug":"deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities","status":"publish","type":"post","link":"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/","title":{"rendered":"Deploying LLMs on Raspberry Pi Powered HMI: Talk with Intelligent Facilities"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"95661\" class=\"elementor elementor-95661\" data-elementor-post-type=\"post\">\n\t\t\t\t<div class=\"elementor-element elementor-element-a935bb0 e-flex e-con-boxed e-con e-parent\" data-id=\"a935bb0\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-3f4e5cf elementor-widget elementor-widget-heading\" data-id=\"3f4e5cf\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbcd185\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span><h2 class=\"elementor-heading-title elementor-size-default\">Introduction<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-5fd0621 e-flex e-con-boxed e-con e-parent\" data-id=\"5fd0621\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-3088386 elementor-widget elementor-widget-text-editor\" data-id=\"3088386\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbce485\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t<p>In the modern era of technological advancement, both<strong> smart factories and smart buildings<\/strong> represent the forefront of innovation in their respective domains. A\u00a0 smart facility, encompassing both manufacturing and structural management, leverages a blend of advanced technologies to optimize operations, enhance efficiency, and ensure seamless communication between systems and humans. By integrating the <strong>Internet of Things (IoT), artificial intelligence (AI), machine learning (ML), and big data analytics<\/strong>, these facilities create an interconnected environment that not only improves production processes and building operations but also ensures flexibility and sustainability. In this comprehensive ecosystem, automated processes and real-time data exchange drive the intelligent management of everything from manufacturing workflows to <b>heating, ventilation, air conditioning (HVAC), lighting, and security, resulting in superior performance, enhanced comfort, and significant energy savings.<\/b><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-ce8e93f e-flex e-con-boxed e-con e-parent\" data-id=\"ce8e93f\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-bdc3de6 elementor-widget elementor-widget-image\" data-id=\"bdc3de6\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbd07ce\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"720\" height=\"380\" src=\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/9d736aeb-22b1-4bc3-a88c-3117ac833a78-720x380.jpg\" class=\"attachment-magazine-7-medium size-magazine-7-medium wp-image-95669\" alt=\"\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-7f96403 e-flex e-con-boxed e-con e-parent\" data-id=\"7f96403\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-1a00d3f elementor-widget elementor-widget-heading\" data-id=\"1a00d3f\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbd15e1\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span><h2 class=\"elementor-heading-title elementor-size-default\">Local Deployment of Large Language Models\n<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-e54e7b9 e-flex e-con-boxed e-con e-parent\" data-id=\"e54e7b9\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-b66879d elementor-widget elementor-widget-text-editor\" data-id=\"b66879d\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbd2320\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t<p>The advent of <strong>Large Language Models (LLMs)<\/strong> has opened new frontiers in artificial intelligence, with models now comprising billions of parameters and continuously evolving to meet diverse applications. While cloud-based AI services have become prevalent, <strong>deploying LLMs locally on personal or enterprise hardware<\/strong> offers significant advantages, particularly regarding <strong>privacy and data control<\/strong>. This approach enables users and organizations to process sensitive information and perform AI-driven analyses without relying on external servers, thereby <strong>keeping proprietary or confidential data securely within their own computing environments.<\/strong> Local deployment addresses many of the privacy concerns associated with cloud-based services, where data may transit through or be stored on third-party servers. However, selecting the appropriate hardware for running LLMs locally is crucial to achieving optimal performance and efficiency.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-7a0f4d3 e-flex e-con-boxed e-con e-parent\" data-id=\"7a0f4d3\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-ed6d7a2 elementor-widget elementor-widget-image\" data-id=\"ed6d7a2\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbd3a20\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"300\" height=\"300\" src=\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/b1eb83ac-cc96-46bf-9319-d030670206f7-300x300.jpg\" class=\"attachment-medium size-medium wp-image-95668\" alt=\"\" srcset=\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/b1eb83ac-cc96-46bf-9319-d030670206f7-300x300.jpg 300w, https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/b1eb83ac-cc96-46bf-9319-d030670206f7-80x80.jpg 80w, https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/b1eb83ac-cc96-46bf-9319-d030670206f7-768x768.jpg 768w, https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/b1eb83ac-cc96-46bf-9319-d030670206f7-32x32.jpg 32w, https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/b1eb83ac-cc96-46bf-9319-d030670206f7.jpg 1024w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-c637fe5 e-flex e-con-boxed e-con e-parent\" data-id=\"c637fe5\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-2a25701 elementor-widget elementor-widget-heading\" data-id=\"2a25701\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbd473c\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span><h2 class=\"elementor-heading-title elementor-size-default\">Raspberry Pi Powered HMI on Small Language Models<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-6df7c85 e-flex e-con-boxed e-con e-parent\" data-id=\"6df7c85\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-ffdc816 elementor-widget elementor-widget-text-editor\" data-id=\"ffdc816\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbd5445\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t<p>With the<strong> 8GB RAM available in the reTerminal DM<\/strong>, deploying small quantized language models becomes feasible within this HMI environment. After extensive research, we have determined suitable models that balance quality, size, and performance for deployment on the Raspberry Pi-powered reTerminal HMI.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-8a15b89 e-flex e-con-boxed e-con e-parent\" data-id=\"8a15b89\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-24e8a90 elementor-widget elementor-widget-text-editor\" data-id=\"24e8a90\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbd61b3\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t<p><a href=\"https:\/\/huggingface.co\/TheBloke\/Llama-2-7B-Chat-GGUF\"><b>LLaMA 2 7B Chat &#8211; GGUF<\/b><\/a><\/p><ul><li>Parameters: 7 billion<\/li><li>Quantization: 4-bit in super-blocks containing 8 blocks, each block having 32 weights. Scales and mins are quantized with 6 bits.<\/li><li>Model Size: 4.08GB<\/li><li>Memory Requirement: 6.58GB<\/li><li>Performance: This model offers balanced quality and medium size<\/li><\/ul><div><div>\u00a0<\/div><div><a href=\"https:\/\/huggingface.co\/TheBloke\/phi-2-GGUF\"><b>Phi-2-GGUF<\/b><\/a><\/div><div><ul><li>Quantization: 4-bit in super-blocks containing 8 blocks, each block having 32 weights. Scales and mins are quantized with 6 bits.<\/li><li>Model Size: 1.79GB<\/li><li>Memory Requirement: 4.29GB<\/li><li>Performance: With medium, balanced quality, Phi-2 is faster and more responsive for given prompts compared to LLaMA 2 7B Chat<\/li><\/ul><div><a href=\"https:\/\/huggingface.co\/TheBloke\/TinyLlama-1.1B-Chat-v1.0-GGUF\"><b>TinyLLaMA-GGUF<\/b><\/a><\/div><div>\u00a0<\/div><div><div><ul><li>Deployment: Specifically designed for edge devices with restricted memory and computational capacities.<\/li><li>Quantization: 4-bit, with a model size of 637 MB.<\/li><li>Performance: TinyLLaMA-1.1B provides fast responses suitable for less time constraint-time machine translation without internet connectivity. However, its output flexibility is less compared to the LLaMA 2 7B Chat and Phi-2 models.<\/li><\/ul><\/div><\/div><\/div><\/div>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-c7f8fe4 e-flex e-con-boxed e-con e-parent\" data-id=\"c7f8fe4\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-841bb64 elementor-widget elementor-widget-text-editor\" data-id=\"841bb64\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbd6eb7\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t<p>Deploying these <strong>small quantized language models<\/strong> on the reTerminal DM enhances the capabilities of the <strong>Raspberry Pi-powered HMI by enabling robust, localized AI-driven functionalities<\/strong>. While each model has its strengths and trade-offs in terms of size, memory requirements, and response quality, the selection should be based on the specific application needs and performance criteria. For tasks requiring high quality and flexibility, LLaMA 2 7B Chat is suitable, while Phi-2 is preferable for faster response times. For ultra-compact and efficient edge deployments, This demo we use Phi-2 stands out as an optimal choice.<\/p><p>If your system has internet access, you can interact with various <strong>LLM services using API keys<\/strong>. Some APIs are available for free, such as <strong>Google Gemini and Meta AI&#8217;s LLaMA 3<\/strong>. By creating a Gemini AI API key, you can gain access to the Gemini API and other related services, as well as Meta AI&#8217;s LLaMA 3. Since these interactions occur over the internet, you can experience significantly faster response times compared to local LLMs. Integrating these cloud-based LLM services can enhance the capabilities of your system, providing rapid and sophisticated data analysis and decision support.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-f8c4576 e-flex e-con-boxed e-con e-parent\" data-id=\"f8c4576\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-d40a8d7 elementor-widget elementor-widget-heading\" data-id=\"d40a8d7\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbd7bae\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span><h2 class=\"elementor-heading-title elementor-size-default\">Technical Stack<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-499bee8 e-flex e-con-boxed e-con e-parent\" data-id=\"499bee8\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-b2557ae elementor-widget elementor-widget-text-editor\" data-id=\"b2557ae\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbd88b6\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t<p><a href=\"https:\/\/nodered.org\/\"><span style=\"font-size: 20px;\"><strong>NodeRed<\/strong><\/span><\/a>: Node-RED is an open-source, flow-based development tool designed for visual programming, particularly suited for integrating devices, APIs, and online services.Node-RED offers a user-friendly, browser-based interface that allows users to wire together various components and create complex workflows through a simple drag-and-drop mechanism. This visual approach significantly reduces the barrier to entry, enabling both developers and non-developers to automate processes and build IoT applications efficiently. Key benefits of Node-RED include its extensibility through a vast library of pre-built nodes, its ability to handle real-time data processing and its support for a wide range of protocols and devices. This makes Node-RED a powerful and versatile tool for developing smart solutions in diverse environments such as smart buildings and factories, enhancing productivity and enabling rapid prototyping and deployment.<\/p><p><a href=\"https:\/\/mariadb.org\/\"><span style=\"font-size: 18px;\"><strong>MariaDB<\/strong><\/span><\/a>: MariaDB is a robust, open-source relational database management system . Known for its high performance, reliability, and security, MariaDB is an excellent choice for handling large volumes of data and complex queries efficiently. It supports a wide array of storage engines, advanced clustering, and is fully compatible with MySQL, making it a versatile solution for various database needs. A significant advantage of MariaDB is its ability to be seamlessly deployed on Linux environments, including the Raspbian OS used by the reTerminal DM.<\/p><p><a href=\"https:\/\/flowfuse.com\/\"><span style=\"font-size: 18px;\"><strong>FlowFuse<\/strong><\/span><\/a>: FlowFuse is an innovative tool that enhances the capabilities of Node-RED by providing an intuitive set of nodes specifically designed for creating data-driven dashboards and visualizations. Their latest offering, Dashboard 2.0, simplifies the process of building interactive and visually appealing user interfaces.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-e007cde e-flex e-con-boxed e-con e-parent\" data-id=\"e007cde\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-1135573 elementor-widget elementor-widget-image\" data-id=\"1135573\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbda36e\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"640\" height=\"476\" src=\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/\u4f01\u4e1a\u5fae\u4fe1\u622a\u56fe_17156783084676-1030x766.png\" class=\"attachment-large size-large wp-image-95369\" alt=\"\" srcset=\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/\u4f01\u4e1a\u5fae\u4fe1\u622a\u56fe_17156783084676-1030x766.png 1030w, https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/\u4f01\u4e1a\u5fae\u4fe1\u622a\u56fe_17156783084676-300x223.png 300w, https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/\u4f01\u4e1a\u5fae\u4fe1\u622a\u56fe_17156783084676-768x571.png 768w, https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/\u4f01\u4e1a\u5fae\u4fe1\u622a\u56fe_17156783084676-32x24.png 32w, https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/\u4f01\u4e1a\u5fae\u4fe1\u622a\u56fe_17156783084676-1024x761.png 1024w, https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/\u4f01\u4e1a\u5fae\u4fe1\u622a\u56fe_17156783084676.png 1123w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-0bd9325 e-flex e-con-boxed e-con e-parent\" data-id=\"0bd9325\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t<div class=\"elementor-element elementor-element-a3e11be e-con-full e-flex e-con e-parent\" data-id=\"a3e11be\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-9d75b4c elementor-align-center elementor-widget elementor-widget-button\" data-id=\"9d75b4c\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbdc14d\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/www.seeedstudio.com\/reTerminal-DM-p-5616.html\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t\t\t\t<span class=\"elementor-button-text\">More on reTerminal DM<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-5b2653e e-con-full e-flex e-con e-parent\" data-id=\"5b2653e\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-48ccee3 elementor-align-center elementor-widget elementor-widget-button\" data-id=\"48ccee3\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbdcf28\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/wiki.seeedstudio.com\/raspberry-pi-devices\/\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t\t\t\t<span class=\"elementor-button-text\">More about Raspberry pi Devices<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-3ea58d5 e-flex e-con-boxed e-con e-parent\" data-id=\"3ea58d5\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-f8d9403 elementor-widget elementor-widget-heading\" data-id=\"f8d9403\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbddcfe\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span><h2 class=\"elementor-heading-title elementor-size-default\">Methodology<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-22cfb24 e-flex e-con-boxed e-con e-parent\" data-id=\"22cfb24\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-85e5c41 elementor-widget elementor-widget-video\" data-id=\"85e5c41\" data-element_type=\"widget\" data-settings=\"{&quot;video_type&quot;:&quot;hosted&quot;,&quot;autoplay&quot;:&quot;yes&quot;,&quot;play_on_mobile&quot;:&quot;yes&quot;,&quot;mute&quot;:&quot;yes&quot;,&quot;loop&quot;:&quot;yes&quot;,&quot;controls&quot;:&quot;yes&quot;}\" data-widget_type=\"video.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbdf0da\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t<div class=\"e-hosted-video elementor-wrapper elementor-open-inline\">\n\t\t\t\t\t<video class=\"elementor-video\" src=\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered-building-demo-final.mp4\" autoplay=\"\" loop=\"\" controls=\"\" muted=\"muted\" playsinline=\"\" controlsList=\"nodownload\"><\/video>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-5589dc2 e-flex e-con-boxed e-con e-parent\" data-id=\"5589dc2\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-ba5d6d6 elementor-widget elementor-widget-text-editor\" data-id=\"ba5d6d6\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbdfec9\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t<p>In this project, we&#8217;re setting up sensors using different protocols like <b>Modbus TCP, Modbus RTU, and MQTT.<\/b> These sensors collect data through <b>Node-RED<\/b> nodes, which streamline the process. Next, we&#8217;re deploying <b>MariaDB<\/b> on the reTerminal DM, where we <b>create databases and tables to store the collected<\/b> data securely. Then, we&#8217;re utilizing <b>locally deployed Small Language Models<\/b> (SLMs) on the reTerminal DM or with cloud support like <b>Google Gemini or Meta Llama<\/b> to generate SQL queries from natural language. These queries are then executed on the relevant database tables to retrieve answers. Finally, we&#8217;re designing a user-friendly <b>dashboard using FlowFuse and Node-Red<\/b>, which acts as the interface between the user and the system, allowing for easy data visualization and control.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-3dbd0e4 e-flex e-con-boxed e-con e-parent\" data-id=\"3dbd0e4\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-9b73603 elementor-widget elementor-widget-video\" data-id=\"9b73603\" data-element_type=\"widget\" data-settings=\"{&quot;video_type&quot;:&quot;hosted&quot;,&quot;autoplay&quot;:&quot;yes&quot;,&quot;play_on_mobile&quot;:&quot;yes&quot;,&quot;mute&quot;:&quot;yes&quot;,&quot;loop&quot;:&quot;yes&quot;,&quot;controls&quot;:&quot;yes&quot;}\" data-widget_type=\"video.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbe0c99\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t<div class=\"e-hosted-video elementor-wrapper elementor-open-inline\">\n\t\t\t\t\t<video class=\"elementor-video\" src=\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/Untitled-video-Made-with-Clipchamp-15.mp4\" autoplay=\"\" loop=\"\" controls=\"\" muted=\"muted\" playsinline=\"\" controlsList=\"nodownload\"><\/video>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-27c4b23 e-flex e-con-boxed e-con e-parent\" data-id=\"27c4b23\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-1e36791 elementor-widget elementor-widget-heading\" data-id=\"1e36791\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbe19ed\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span><h2 class=\"elementor-heading-title elementor-size-default\">Conclusion<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-3555610 e-flex e-con-boxed e-con e-parent\" data-id=\"3555610\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-0b12cca elementor-widget elementor-widget-text-editor\" data-id=\"0b12cca\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbe2736\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t<p>Integrating Operational Technology (OT) and Information Technology (IT) services in factory operations or smart buildings offers significant advantages, particularly when leveraging cloud-based LLM APIs or Local SLMs within existing systems. Traditional OT systems, such as factory automation, often operate in closed networks without internet connectivity. By incorporating local&nbsp; LLMs, these systems can enhance their capabilities without breaching<b>&nbsp;security and privacy<\/b>. Additionally, deploying quantized models on the reTerminal DM offers a <b>cost-effective solution<\/b> that extends beyond data acquisition and edge control. <b>This setup not only manages real-time operations efficiently but also empowers decision-makers and non-technical personnel by providing easy access to advanced data insights through natural language queries.<\/b> The reTerminal DM, with its ability to facilitate local deployment of LLMs, ensures that sensitive information remains within the organization\u2019s control while enabling <b>sophisticated data analysis and decision support, ultimately driving operational excellence and innovation.<\/b><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-87b3085 e-flex e-con-boxed e-con e-parent\" data-id=\"87b3085\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-4adf6da elementor-widget elementor-widget-heading\" data-id=\"4adf6da\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbe33f3\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span><h2 class=\"elementor-heading-title elementor-size-default\">Resources<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-3196e5c e-flex e-con-boxed e-con e-parent\" data-id=\"3196e5c\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-370ae56 elementor-widget elementor-widget-text-editor\" data-id=\"370ae56\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbe4786\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t<ul><li><a href=\"https:\/\/huggingface.co\/TheBloke\/Llama-2-7B-Chat-GGUF\">Llama-2-7B-Chat-GGUF<\/a><\/li><li><a href=\"https:\/\/huggingface.co\/TheBloke\/phi-2-GGUF\">phi-2-GGUF<\/a><\/li><li><a href=\"https:\/\/huggingface.co\/TheBloke\/TinyLlama-1.1B-Chat-v1.0-GGUF\">TinyLlama-1.1B-Chat-v1.0-GGUF<\/a><\/li><li><a href=\"https:\/\/kazuhitoyokoi.medium.com\/local-llm-on-industrial-raspberry-pi-d6e88e545028\">Kazuhito Yokoi Article on LLM<\/a><\/li><\/ul><p>\u00a0<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-521da51 e-flex e-con-boxed e-con e-parent\" data-id=\"521da51\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-9f68a4c elementor-widget elementor-widget-heading\" data-id=\"9f68a4c\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbe56d3\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span><h2 class=\"elementor-heading-title elementor-size-default\">New in the Town <\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-8cb64c5 e-flex e-con-boxed e-con e-parent\" data-id=\"8cb64c5\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-8908dad elementor-widget elementor-widget-image\" data-id=\"8908dad\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbe6dd0\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"720\" height=\"380\" src=\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/32-720x380.jpg\" class=\"attachment-magazine-7-medium size-magazine-7-medium wp-image-95377\" alt=\"\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-63a1535 e-flex e-con-boxed e-con e-parent\" data-id=\"63a1535\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-fdb42b8 elementor-align-center elementor-widget elementor-widget-button\" data-id=\"fdb42b8\" data-element_type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span id=\"scroll6a206fbbe7bc0\"  class=\"scrollMagicControl\" type=\"hidden\" effect = {} wpmp_enable_desktop=\"yes\" wpmp_enable_tablet=\"yes\" wpmp_enable_mobile=\"yes\" wpmp_trigger_hook=\"0.5\" wpmp_reverse=\"yes\" wpmp_class_CSS =\"custom\" split-text = {} value=\"scrollmagic\"><\/span>\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/www.seeedstudio.com\/reComputer-R1025-10-p-5895.html\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t\t\t\t<span class=\"elementor-button-text\">Want to know more about this?<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Introduction In the modern era of technological advancement, both smart factories and smart buildings represent<\/p>\n","protected":false},"author":3625,"featured_media":95673,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_lmt_disableupdate":"","_lmt_disable":"","_price":"","_stock":"","_tribe_ticket_header":"","_tribe_default_ticket_provider":"","_tribe_ticket_capacity":"0","_ticket_start_date":"","_ticket_end_date":"","_tribe_ticket_show_description":"","_tribe_ticket_show_not_going":false,"_tribe_ticket_use_global_stock":"","_tribe_ticket_global_stock_level":"","_global_stock_mode":"","_global_stock_cap":"","_tribe_rsvp_for_event":"","_tribe_ticket_going_count":"","_tribe_ticket_not_going_count":"","_tribe_tickets_list":"[]","_tribe_ticket_has_attendee_info_fields":false,"iawp_total_views":0,"footnotes":""},"categories":[4391,1,4393],"tags":[1301,4895,2112,304,4726,4894,4897,4764],"class_list":["post-95661","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-build","category-news","category-tech","tag-ai","tag-edgecomputing","tag-hmi","tag-iot","tag-llm","tag-ml","tag-smart-buildings","tag-smart-cities"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v24.0 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Deploying LLMs on Raspberry Pi Powered HMI: Talk with Intelligent Facilities - Latest News from Seeed Studio<\/title>\n<meta name=\"description\" content=\"Explore how Large Language Models (LLMs) enhance smart facilities with local and cloud-based AI solutions. Discover the role of Raspberry pi powered reTerminal DM in integrating advanced AI for efficient and secure smart factory and building management. Learn about Google Gemini, Meta AI&#039;s LLaMA 3, and the benefits of OT and IT convergence in industrial settings. Optimize your operations with innovative HMI and AI technologies.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Deploying LLMs on Raspberry Pi Powered HMI: Talk with Intelligent Facilities - Latest News from Seeed Studio\" \/>\n<meta property=\"og:description\" content=\"Explore how Large Language Models (LLMs) enhance smart facilities with local and cloud-based AI solutions. Discover the role of Raspberry pi powered reTerminal DM in integrating advanced AI for efficient and secure smart factory and building management. Learn about Google Gemini, Meta AI&#039;s LLaMA 3, and the benefits of OT and IT convergence in industrial settings. Optimize your operations with innovative HMI and AI technologies.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/\" \/>\n<meta property=\"og:site_name\" content=\"Latest News from Seeed Studio\" \/>\n<meta property=\"article:published_time\" content=\"2024-05-22T03:47:17+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-05-30T02:55:40+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1280\" \/>\n\t<meta property=\"og:image:height\" content=\"720\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Kasun Thushara\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Kasun Thushara\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/\",\"url\":\"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/\",\"name\":\"Deploying LLMs on Raspberry Pi Powered HMI: Talk with Intelligent Facilities - Latest News from Seeed Studio\",\"isPartOf\":{\"@id\":\"https:\/\/www.seeedstudio.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered.png\",\"datePublished\":\"2024-05-22T03:47:17+00:00\",\"dateModified\":\"2024-05-30T02:55:40+00:00\",\"author\":{\"@id\":\"https:\/\/www.seeedstudio.com\/blog\/#\/schema\/person\/bcc6823a4a5c37767b36c37aaedb0ce0\"},\"description\":\"Explore how Large Language Models (LLMs) enhance smart facilities with local and cloud-based AI solutions. Discover the role of Raspberry pi powered reTerminal DM in integrating advanced AI for efficient and secure smart factory and building management. Learn about Google Gemini, Meta AI's LLaMA 3, and the benefits of OT and IT convergence in industrial settings. Optimize your operations with innovative HMI and AI technologies.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/#primaryimage\",\"url\":\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered.png\",\"contentUrl\":\"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered.png\",\"width\":1280,\"height\":720},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.seeedstudio.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Deploying LLMs on Raspberry Pi Powered HMI: Talk with Intelligent Facilities\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.seeedstudio.com\/blog\/#website\",\"url\":\"https:\/\/www.seeedstudio.com\/blog\/\",\"name\":\"Latest News from Seeed Studio\",\"description\":\"Emerging IoT, AI and Autonomous Applications on the Edge\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.seeedstudio.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.seeedstudio.com\/blog\/#\/schema\/person\/bcc6823a4a5c37767b36c37aaedb0ce0\",\"name\":\"Kasun Thushara\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.seeedstudio.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e18409f3dc8298c54d4708e6cfec78dc?s=96&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e18409f3dc8298c54d4708e6cfec78dc?s=96&r=g\",\"caption\":\"Kasun Thushara\"},\"url\":\"https:\/\/www.seeedstudio.com\/blog\/author\/kasun\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Deploying LLMs on Raspberry Pi Powered HMI: Talk with Intelligent Facilities - Latest News from Seeed Studio","description":"Explore how Large Language Models (LLMs) enhance smart facilities with local and cloud-based AI solutions. Discover the role of Raspberry pi powered reTerminal DM in integrating advanced AI for efficient and secure smart factory and building management. Learn about Google Gemini, Meta AI's LLaMA 3, and the benefits of OT and IT convergence in industrial settings. Optimize your operations with innovative HMI and AI technologies.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/","og_locale":"en_US","og_type":"article","og_title":"Deploying LLMs on Raspberry Pi Powered HMI: Talk with Intelligent Facilities - Latest News from Seeed Studio","og_description":"Explore how Large Language Models (LLMs) enhance smart facilities with local and cloud-based AI solutions. Discover the role of Raspberry pi powered reTerminal DM in integrating advanced AI for efficient and secure smart factory and building management. Learn about Google Gemini, Meta AI's LLaMA 3, and the benefits of OT and IT convergence in industrial settings. Optimize your operations with innovative HMI and AI technologies.","og_url":"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/","og_site_name":"Latest News from Seeed Studio","article_published_time":"2024-05-22T03:47:17+00:00","article_modified_time":"2024-05-30T02:55:40+00:00","og_image":[{"width":1280,"height":720,"url":"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered.png","type":"image\/png"}],"author":"Kasun Thushara","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Kasun Thushara","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/","url":"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/","name":"Deploying LLMs on Raspberry Pi Powered HMI: Talk with Intelligent Facilities - Latest News from Seeed Studio","isPartOf":{"@id":"https:\/\/www.seeedstudio.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/#primaryimage"},"image":{"@id":"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/#primaryimage"},"thumbnailUrl":"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered.png","datePublished":"2024-05-22T03:47:17+00:00","dateModified":"2024-05-30T02:55:40+00:00","author":{"@id":"https:\/\/www.seeedstudio.com\/blog\/#\/schema\/person\/bcc6823a4a5c37767b36c37aaedb0ce0"},"description":"Explore how Large Language Models (LLMs) enhance smart facilities with local and cloud-based AI solutions. Discover the role of Raspberry pi powered reTerminal DM in integrating advanced AI for efficient and secure smart factory and building management. Learn about Google Gemini, Meta AI's LLaMA 3, and the benefits of OT and IT convergence in industrial settings. Optimize your operations with innovative HMI and AI technologies.","breadcrumb":{"@id":"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/#primaryimage","url":"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered.png","contentUrl":"https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered.png","width":1280,"height":720},{"@type":"BreadcrumbList","@id":"https:\/\/www.seeedstudio.com\/blog\/2024\/05\/22\/deploying-llms-on-reterminal-dm-talk-with-intelligent-facilities\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.seeedstudio.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Deploying LLMs on Raspberry Pi Powered HMI: Talk with Intelligent Facilities"}]},{"@type":"WebSite","@id":"https:\/\/www.seeedstudio.com\/blog\/#website","url":"https:\/\/www.seeedstudio.com\/blog\/","name":"Latest News from Seeed Studio","description":"Emerging IoT, AI and Autonomous Applications on the Edge","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.seeedstudio.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.seeedstudio.com\/blog\/#\/schema\/person\/bcc6823a4a5c37767b36c37aaedb0ce0","name":"Kasun Thushara","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.seeedstudio.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e18409f3dc8298c54d4708e6cfec78dc?s=96&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e18409f3dc8298c54d4708e6cfec78dc?s=96&r=g","caption":"Kasun Thushara"},"url":"https:\/\/www.seeedstudio.com\/blog\/author\/kasun\/"}]}},"modified_by":"Kasun Thushara","views":4869,"featured_image_urls":{"full":["https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered.png",1280,720,false],"thumbnail":["https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered-80x80.png",80,80,true],"medium":["https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered-300x169.png",300,169,true],"medium_large":["https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered-768x432.png",640,360,true],"large":["https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered-1030x579.png",640,360,true],"1536x1536":["https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered.png",1280,720,false],"2048x2048":["https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered.png",1280,720,false],"visody_icon":["https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered-32x18.png",32,18,true],"magazine-7-slider-full":["https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered.png",1280,720,false],"magazine-7-slider-center":["https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered-936x720.png",936,720,true],"magazine-7-featured":["https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered-1024x576.png",1024,576,true],"magazine-7-medium":["https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered-720x380.png",720,380,true],"magazine-7-medium-square":["https:\/\/www.seeedstudio.com\/blog\/wp-content\/uploads\/2024\/05\/LLM-nodered-675x450.png",675,450,true]},"author_info":{"display_name":"Kasun Thushara","author_link":"https:\/\/www.seeedstudio.com\/blog\/author\/kasun\/"},"category_info":"<a href=\"https:\/\/www.seeedstudio.com\/blog\/category\/build\/\" rel=\"category tag\">Build<\/a> <a href=\"https:\/\/www.seeedstudio.com\/blog\/category\/news\/\" rel=\"category tag\">News<\/a> <a href=\"https:\/\/www.seeedstudio.com\/blog\/category\/tech\/\" rel=\"category tag\">Tech<\/a>","tag_info":"Tech","comment_count":"1","_links":{"self":[{"href":"https:\/\/www.seeedstudio.com\/blog\/wp-json\/wp\/v2\/posts\/95661","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.seeedstudio.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.seeedstudio.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.seeedstudio.com\/blog\/wp-json\/wp\/v2\/users\/3625"}],"replies":[{"embeddable":true,"href":"https:\/\/www.seeedstudio.com\/blog\/wp-json\/wp\/v2\/comments?post=95661"}],"version-history":[{"count":9,"href":"https:\/\/www.seeedstudio.com\/blog\/wp-json\/wp\/v2\/posts\/95661\/revisions"}],"predecessor-version":[{"id":96555,"href":"https:\/\/www.seeedstudio.com\/blog\/wp-json\/wp\/v2\/posts\/95661\/revisions\/96555"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.seeedstudio.com\/blog\/wp-json\/wp\/v2\/media\/95673"}],"wp:attachment":[{"href":"https:\/\/www.seeedstudio.com\/blog\/wp-json\/wp\/v2\/media?parent=95661"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.seeedstudio.com\/blog\/wp-json\/wp\/v2\/categories?post=95661"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.seeedstudio.com\/blog\/wp-json\/wp\/v2\/tags?post=95661"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}