There's no reason we can't take the positive step forward of making it a holiday now which would improve it for a huge amount of people and then improve it further.
It seems people want 100% solutions. If it's not perfect we might as well stay stuck where we are. This is essentially what you are saying. This is why no progress is ever made, because improvements are ignored because they are "not perfect." The world isn't perfect, but we can do better and making it a holiday will help significantly.
Keep searching for Utopia, while the pragmatists get things done.
Some states might even allow absentee ballots for those who will be present in the state, but are essential personnel who have been scheduled to work on election day. That's not something that can be established federally, though.
And it has to be on-par with things like memorial day, labor day, thanksgiving and christmas... plus include primaries as well.
If it is similar to President's day or Veterens day, not only will folks still work, but they will usually get paid normal wages that day as well.
Do you need to get to the polling place? I guess all gas station workers are exempt. As is everybody working for the various transit systems.
Can you ensure nobody has a medical issue on a national holiday? Doctors, nurses, and hospital support staff are all working. This also brings on either the entire power grid, or someone in maintenance to watch the generators.
Do you eat? All restaurants are exempt. So are grocery stores. So are all the utilities related to energy needed for cooking. (though here Israel with their nobody working on the sabbath has an interesting take - in part that works there because non-jews are willing to work but it need not)
Are you going arrest foreigners the night before (which is to say no passports are valid, go home before voting day and come back afterwards - bad weather is not an excuse to plan ahead)? I guess hotels get to remain open.
You can go on. It turns out to run civilization we need a lot of people working even on holidays. Interestingly, it turns out a lot of these workers are the poorer people who you were trying to help.