You might trust someone with one thing but not with the other thing. A question "do you trust them?" out of context is not specific enough.