At the end of the day UX is the product, that’s what the customer sees. Maybe you could get away with it with early adopters. A good UX team will help focusing on core features instead of useless ones and optimum experience. For a startups, a good UX designer could validate a MVP in few days without a line of code.