It's a beautiful way to approach problems. But one problem I find with it is that I get a bit paranoid with my solutions. Sure, it's not being rejected by any of my experimentation, but is it ready for millions of dollars of commitment? How do I know when I'm confident enough? After all, I went into this trying to prove myself wrong, so my mind is in a place where I'm expecting for it to fall apart.

There's another story about Feynman, somewhat related to this issue. He had worked out the V-A structure of the weak force which had been an outstanding puzzle for some time. At some later point he was visiting CERN and they during the tour the guide said something along the lines of "Oh! Professor Feynman! This [huge experiment and expensive detector] is to test your theory of [such and such blah blah blah]."

Feynman smiled and said, "What, you don't trust me?"

As long as you do some experimentation that's fine. You might be legitimately be criticised for not doing the right experiment or not enough. Take it on the chin, learn, move on.