I think it depends on what you're trying to learn from your MVP. If you can get the data and feedback you need without building tests then I don't see anything terribly wrong with that.