00:00:00 - Intro. 00:01:12 - Difference between RK3588 and RK3576 (CPU and GPU). 00:02:15 - NPU performance 6TOPS 3NPU or 6TOPS 2 NPU, who will win? 00:03:37 - Price and power performance 00:04:26 - Mekotronics R57 Debian installation 00:05:44 - RKLLM (rkllm-runtime)? How to set up LLM for RockChip? (RK3588, RK3576) 00:07:30 - Setting up environment: host machine 00:07:55 - Run the export script 00:08:25 - Running RKLLM 00:08:41 - Flusk API wrapper 00:10:00 - Supported LLM models for RK3576 and RK3588 00:11:10 - Useful transformers, Whisper support 00:12:10 - My impressions My LinkedIn - My Telegram channel - e-mail: anton@ Twitter - The board I used as RK3576 - - Comparision test about CPU and GPU - main library from RockChip - A nice fork from the official one