In this video, we put the Raspberry Pi 5 and Orange Pi 5B to the test by running Microsoft’s Phi-3-mini, a small yet powerful local Large Language Model (LLM) optimized for constrained devices. We dive into the performance differences between these two boards and explore the challenges of running LLMs on the less-supported Orange Pi 5B. For the Raspberry Pi 5, it's smooth sailing—using Ollama, we easily run the model with minimal setup. However, things get more complicated with the Orange Pi 5B. We had to install special libraries like ezrknn-llm and use specifically converted models to get the LLM running properly. Watch to see how each board stacks up in this head-to-head comparison and decide which one is the right choice for your LLM projects!