{"id":93891,"date":"2024-03-27T10:37:02","date_gmt":"2024-03-27T10:37:02","guid":{"rendered":"https:\/\/www.seeedstudio.com\/blog\/?p=93891"},"modified":"2024-03-28T08:38:20","modified_gmt":"2024-03-28T08:38:20","slug":"seeed-studio-at-gtc-2024-pioneering-the-future-of-ai-at-the-edge","status":"publish","type":"post","link":"https:\/\/www.seeedstudio.com\/blog\/2024\/03\/27\/seeed-studio-at-gtc-2024-pioneering-the-future-of-ai-at-the-edge\/","title":{"rendered":"Seeed Studio at GTC 2024, Pioneering the Future of AI at the Edge"},"content":{"rendered":"
\n
\"\"<\/figure><\/div>\n\n\n

GTC 2024 emerged as a significant highlight for Seeed!  As NVIDIA Robotics Elite Partner, we took pride in hosting a booth at the “AI at the Edge” Pavilion, where we displayed our cutting-edge reThings series, driven by NVIDIA’s Robotics Jetson Orin. During GTC’s opening day, we hosted a Partner Reception, extending a warm welcome to NVIDIA teams, our edge AI partners, customers, and community. We’re sincerely thankful for everyone’s support and enthusiasm. It’s a privilege to support you as the AI hardware partner! <\/p>\n\n\n\n

At the show, we demonstrated that by uniting our ultra-low-power microcontrollers with Jetson Orin, we have masterfully blended TinyML and Local Large Language Models.  This endeavor showcases our dedication to pushing the envelope in AI technology at the edge, emphasizing a seamless fusion of innovation and efficiency<\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n

Top trends we\u2019ve observed throughout #GTC2024<\/h2>\n\n\n\n

1. The buzz around Generative AI<\/strong> was undeniable. From groundbreaking software to cutting-edge hardware, the push into Large Language Models and their application across various fields was a focal point for many.<\/p>\n\n\n\n

2.  Multimodal AI <\/strong>is on the rise, marking a significant advancement from basic image recognition to generating valuable content. NVIDIA’s display of multimodal vision language agents running on Orin was particularly notable. In line with this trend, our integration of TinyML with LLMs aims to seamlessly connect complex physical world data to the digital realm.<\/p>\n\n\n\n

3.  Robotics<\/strong> is big:  NVIDIA Jetson powering a wide range of robots. The “special guests,” Orange and Green BD-X robots, powered by Jetson Orin, received a warm welcome during Jensen Huang’s keynote speech at GTC.<\/p>\n\n\n\n

4.  Another concern among enterprises is deployment<\/strong>. NVIDIA’s NIM\u2019s release underscores the industry’s need for easier deployment of advanced foundation models.<\/p>\n\n\n\n

5.  Omniverse, industrial metaverse, and digital twins were shown to offer valuable insights across various sectors for industrial<\/strong> use cases.<\/p>\n\n\n\n

Bring Generative AI to the Edge<\/h2>\n\n\n\n

We are excited to share the GTC experience featuring Dustin Franklin<\/a> sharing his insights on integrating generative AI models<\/a> on Jetson Orin devices, including LLMs, VLMs, and EfficientViT(vision models for efficient high-resolution vision, created by MIT HAN Lab). There are new Small Language Models (SLMs) updated on Gen AI lab! SLMs represent a growing class of language models that have <7B parameters – for example, StableLM, Phi-2, and Gemma-2B. Their smaller memory footprint and faster performance make them good candidates for deploying on reComputer J3011, powered by Orin Nano.<\/a><\/p>\n\n\n\n

\"\"\/
Elaine (Edge AI partnership manager at Seeed) discussed with Dustin Franklin(Principal Engineer at NVIDIA) on how to bring LLMs to Jetson Orin by following the Gen AI Lab<\/figcaption><\/figure>\n\n\n\n

We united the new capabilities of TinyML with Gen AI Lab\u2019s Large Language Models deployment, we are presenting an advanced AI system that extends from the edge to the cloud.  <\/p>\n\n\n\n