Just in case it's useful for anyone, Gemma 2B using ollama runs quite smoothly on raspberry pi 5 too. I have just used ollama's interactive shell so far.