The proverb is associated with a figure called Daruma, with a round physique that always gets up no matter how it's knocked down. It's cute and symbolic, popular in Japanese culture.

https://en.wikipedia.org/wiki/Daruma_doll