The coffee shop closest to my house has the same problem. The only times they are open are while I'm at work. They opened right about the time we moved (a little over a year ago), and we were excited to have a play we could go close by. But they are never open when it would be convenient for us.
The dumbest thing in my mind is that they are open for like 4 hours on Saturday (7am - 11am).
I think the problem with that particular coffee shop though is that they lady who owns it also runs a catering / event hosting business, so the needs of the coffee shop come last.
And it's not just them, I see a lot of local businesses in this area struggling, but the problem is they aren't open to take my money at reasonable times. There's another café even closer to me that is trying to make it, but they are closed 2 days a week and it's not the weekend, I'm not sure which days they are, so it's hard to check it out. It's just baffling to me - you pay rent 24/7, you have bills every month, and staff … but if you want to take money (generate income) you have to be open. If you want to make the most money, shouldn't you try to have your doors open the most amount of time you can?