And no, when you make the complexity super hard. I really dislike every website has a different complexity rule. Also, be aware that passphrase is a form of password. Instead of choosing "j2%25a^a2" as your password, you can choose a phrase you construct "hacker news is really awesome right buddy" (assuming the website cap at a reasonable length - allowing a long long password is a DOS vulnerability by itself). The pitfall of password/passphrase is reusing common password/passphrase which goes back to the first point - YES.
The real bummer is reusing your password and passphrase for every website. I have several sets of passwords. One set for financial/sensitive website for example.
https://hashcat.net/wiki/doku.php?id=mask_attack
So it's critically important to enforce length because short passwords will be cracked quickly even with slower hashing algorithms.