{"id":85892,"date":"2023-09-28T16:11:12","date_gmt":"2023-09-28T08:11:12","guid":{"rendered":"https:\/\/www.seeedstudio.com\/blog\/?p=85892"},"modified":"2025-03-25T02:18:37","modified_gmt":"2025-03-25T02:18:37","slug":"raspberry-pi-5-vs-pi-4-ai-performance-cpu-benchmark-how-much-leap-forward","status":"publish","type":"post","link":"https:\/\/www.seeedstudio.com\/blog\/2023\/09\/28\/raspberry-pi-5-vs-pi-4-ai-performance-cpu-benchmark-how-much-leap-forward\/","title":{"rendered":"Raspberry Pi 5 vs. Pi 4 AI performance CPU Benchmark: How much leap forward?"},"content":{"rendered":"\n

We are thrilled about Raspberry Pi 5 finally being released! Hands on this new device with one question, how’s AI performance?<\/p>\n\n\n\n

\ud83d\udca1Answer: only $5 increases, 3x increases CPU, 4 x inference performance leap forward<\/strong><\/p>\n\n\n\n

Be the first one to get Raspberry Pi 5! >> Buy now<\/a><\/strong><\/mark><\/em> <\/p>\n\n\n\n

Welcome to the latest generation of Raspberry Pi: the everything computer. Featuring a 64-bit quad-core Arm Cortex-A76 processor<\/strong> running at 2.4GHz, Raspberry Pi 5 delivers a 2\u20133\u00d7 increase in CPU<\/strong> performance relative to Raspberry Pi 4. Alongside a substantial uplift in graphics performance from an 800MHz VideoCore VII GPU<\/strong>; dual 4Kp60 display output over HDMI<\/strong>; and state-of-the-art camera support from a rearchitected Raspberry Pi Image Signal Processor,<\/strong> it provides a smooth desktop experience for consumers, and opens the door to new applications for industrial customers.<\/p>\n\n\n\n

YOLOv8n model<\/strong>\u2018s performance on Raspberry Pi 5 8GB<\/a><\/strong><\/h3>\n\n\n\n

We tested YOLOv8n model on Raspberry Pi 5 8GB with a video input of 640×640. Using Tencent’s ncnn inference framework, the inference rate is around 12 fps. <\/p>\n\n\n\n

Benchmark on Raspberry Pi 4 8GB and Raspberry Pi 5 8GB<\/strong><\/h2>\n\n\n\n

We conducted benchmark tests using the ncnn framework<\/a> on both the Raspberry Pi 4 8GB and Raspberry Pi 5 8GB to evaluate inference performance. ncnn is an efficient and user-friendly deep learning inference framework that supports various neural network models (such as PyTorch, TensorFlow, ONNX, etc.) and a range of hardware (including x86, ARM, RISC-V, MIPS, Vulkan, and more). Ncnn was designed with mobile deployment in mind, and it offers GPU acceleration via the low-overhead Vulkan API. When leveraging the GPU capabilities of the Raspberry Pi 5, the results surpass those obtained with CPU-only inference. Here’s a comparison of model performance between the two Raspberry Pi model. <\/p>\n\n\n

\n
\"\"<\/figure><\/div>\n\n\n
Model<\/strong><\/td>Raspberry Pi 4 @1thread<\/strong>
avg inference rate, ms<\/td>		Raspberry Pi 4 @4thread<\/strong>
avg inference rate, ms<\/td>		Raspberry Pi 5 @1thread<\/strong>
avg inference rate, ms<\/td>		Raspberry Pi 5 @4thread<\/strong>
avg inference rate, ms<\/td><\/tr>
mobilenet_v2<\/td>93.48<\/td>61.88<\/td>19.24<\/td>13.63<\/td><\/tr>
mobilenet_v3<\/td>72.81<\/td>47.53<\/td>13.25<\/td>9.48<\/td><\/tr>
efficientnet_b0<\/td>129.73<\/td>74.19<\/td>26.24<\/td>14.87<\/td><\/tr>
efficientnetv2_b0<\/td>155.76<\/td>79.34<\/td>39.97<\/td>19.99<\/td><\/tr>
resnet18<\/td>191.1<\/td>123.12<\/td>32<\/td>24.12<\/td><\/tr>
resnet18_int8<\/td>158.5<\/td>83.92<\/td>57.01<\/td>32.68<\/td><\/tr>
resnet50<\/td>534.11<\/td>262.83<\/td>96.28<\/td>56.29<\/td><\/tr>
resnet50_int8<\/td>423.96<\/td>196.65<\/td>117.57<\/td>73.59<\/td><\/tr>
mobilenet_ssd<\/td>251<\/td>121.46<\/td>53.07<\/td>31.48<\/td><\/tr>
mobilenet_ssd_int8<\/td>170.56<\/td>71.14<\/td>46.35<\/td>31.27<\/td><\/tr>
yolov4-tiny<\/td>372.99<\/td>207.22<\/td>74.1<\/td>56.19<\/td><\/tr>
vision_transformer<\/td>6605.73<\/td>1909.21<\/td>1268.82<\/td>629.51<\/td><\/tr>
FastestDet<\/td>52.61<\/td>38.69<\/td>9.03<\/td>6.59<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

Tencent ncnn<\/strong><\/h2>\n\n\n\n

ncnn is a versatile, cross-platform tool that performs exceptionally well on mobile phone CPUs and has no third-party dependencies. It empowers developers to deploy deep learning models seamlessly on mobile platforms, enabling the creation of intelligent apps and putting artificial intelligence at your fingertips. Notably, ncnn is currently employed in several Tencent applications, including QQ, Qzone, WeChat, Pitu, and more.<\/p>\n\n\n\n

Experience the future of computing with the Raspberry Pi 5 and unlock new horizons for AI applications!<\/p>\n\n\n\n

Resources<\/strong><\/h2>\n\n\n\n