A small user base is absolutely a problem, if there are only so many zcash nodes then traffic analysis becomes very easy.

Though, if there are only a few transactions each day that's not as large of an issue as it sounds; the blockchain still has no linkability between transactions. Active attacks might work but few attackers can pull those off, and no attacker is able to go back in time to deanonymize older transactions (assuming the cryptography holds).