Testing AI and LLM on Rockchip RK3588 Using Mixtile Blade 3 SBC with 32GB RAM

Posted by rcarmo on Sunday March 03, 2024 @03:50AM
from the taoofmac.com dept.

https://taoofmac.com/space/links/2024/03/01/0116

( 8 comments | 6 points | on HN )

Re:Testing AI and LLM on Rockchip RK3588 Using Mixtile Blade... by keikobadthebad on Sunday March 03, 2024 @04:17AM (#39579596)

This is just 5 paras of excuses for not testing squat.

[ Parent | on HN ]

Re:Testing AI and LLM on Rockchip RK3588 Using Mixtile Blade... by teraflop on Sunday March 03, 2024 @05:05AM (#39579820)

The blog post is discussing another article that actually does contain test results: https://www.cnx-software.com/2024/02/27/testing-ai-and-llm-o...

[ Parent | on HN ]

Re:Testing AI and LLM on Rockchip RK3588 Using Mixtile Blade... by lagrange77 on Sunday March 03, 2024 @05:12AM (#39579862)

Thanks. Oh wow, the title is the link to the discussed article.

[ Parent | on HN ]

Re:Testing AI and LLM on Rockchip RK3588 Using Mixtile Blade... by rcarmo on Sunday March 03, 2024 @07:17AM (#39580382)

That's being fixed now. And the screenshot will automatically link there as well. Apologies for the inconvenience.

[ Parent | on HN ]

Re:Testing AI and LLM on Rockchip RK3588 Using Mixtile Blade... by lagrange77 on Tuesday March 05, 2024 @04:41PM (#39609485)

Cool, thanks for the feedback.

[ Parent | on HN ]

Re:Testing AI and LLM on Rockchip RK3588 Using Mixtile Blade... by lionkor on Sunday March 03, 2024 @04:29AM (#39579647)

Title should be "Not Testing..."

[ Parent | on HN ]

Re:Testing AI and LLM on Rockchip RK3588 Using Mixtile Blade... by ditados on Sunday March 03, 2024 @04:49AM (#39579746)

I wonder how stable those libraries mentioned are, and how much RAM is needed, because I cannot run LLMs at all on my Pis.

[ Parent | on HN ]

Re:Testing AI and LLM on Rockchip RK3588 Using Mixtile Blade... by imtringued on Sunday March 03, 2024 @03:57PM (#39584476)

This unfortunately is a red herring. Jetson Orin with 32GB is a more reasonable option. Yes it is expensive (950€ on arrow.de), but it is a niche product in the first place.

[ Parent | on HN ]