Yep, the celibacy is not about sex but about marriage; throughout history it was not that rare for priests to have unofficial spouses and kids, and at some times it wasn't even particularly shunned, but the concept of celibacy ensured that there couldn't be any legitimate kids i.e. heirs.