Sadly homebrew Debian variants aren't very safe either. Usually they lack timely OS updates, ship pregenerated ssh host keys in the images, stuff like that. Even Raspbian is pretty bad at this though better than many smaller ones.