How Fast Does the Jetson Nano Run Large Language Models? Posted by amrrs on Sunday December 29, 2024 @01:56PM from the jeremymorgan.com dept. https://www.jeremymorgan.com/blog/tech/nvidia-jetson-orin-nano-speed-test ( 1 comment | 2 points | on HN )
According to spec, this model has 4GB 64-bit LPDDR4 (25.6GB/s) memory