I can empathize, OP. I started a company with a good friend almost a year ago. I run tech, he does business. A few months in, and I moved 1000 miles away and have been building a client base on my end, while he has done nothing to help us grow in his location. However he has done his part outside of that. We had a frank discussion and decided while we're happy to work together, this isn't something he's interested in pursuing. I paid him back everything he's invested in the business. We agreed that instead of splitting it 50/50 I would pay him a flat fee to continue what he's doing while I take the rest. Keep in mind we're doing less than $20k/yr in sales. I considered removing him from the legal structure but it's not worth my time.

Like with any relationship, you need to talk about it with your friend. Not what you've done by "alluding to it", but by being straightforward. "You don't seem interested in our company. I don't want to continue like this. Is it time for you to leave the company?" Yes it may be a difficult discussion but can it really be worse than what you're putting yourself through right now?