Then you just start building a customized keyspace from that information. Include some common substitutions: letters for numbers, numbers for letters. If you have other passwords, look for general patterns. Some people use long passphrases, but they have a pattern or algorithm on how they build all their passphrases! There you just might need a human expert to take a look.
In the end, yes, it is very difficult but it is still a lot better than plain brute-force.
But yeah, I doubt Customs have the equipment or knowledge to do this. That is something that NSA would do. They would have access to the best tools. I can imagine there might be some kind of very constrained cooperation between them. "You send us a disk clone + personal info of the owner, and we'll try to send you back the cracked passphrase. You don't ask as questions how we got it, and you don't even mention that we got involved at all."
The forensics guys will clone your drive, then feed huge fuzzed dictionary attacks using the same algorithm until they find something that works, and they'll do it with machines a lot faster than your laptop.
They don't have to brute-force the keyspace. They only have to brute-force your password-space.