It might work, given how often "please" works for us and is therefore also in training data, but it certainly isn't guaranteed.