Give Alpine Linux (RPi version) a try. I mostly moved away from RPis but wanted to try it anyway and was suprised of how small and efficient it is, just like on other platforms; musl makes a ton of difference. Too bad they have ready images for the RPi but none for other ARM boards; that would be a godsend.