I've heard people say that the right way to say 'no' in Japanese is more along the lines of "it is very difficult." I have no idea how much linguistic truth there is to that, but it definitely rings true culturally.