I've had physical labor jobs (refinishing airliners, sanding gym floors, bussing tables), and playing music is about as physical of an occupation as I'd like.
IMO, 40 hours a week for a single thing is a bad job. I get plenty of work done in 30, I have a lower pay and live in the sticks, but I like it a lot.
Look for a company that offers VTO (volunteer time off). I worked for one that would organize a group volunteer event once per quarter and gave us a maximum of 8 individual days to volunteer per year. There's a ton of fun, physical volunteering opportunities. I've done habitat builds a few times and there are a bunch of parks in the Bay Area that are always willing to put volunteers to work on trail restoration, habitat restoration and other strenuous outdoor activities. One year I even combined all my VTO with a few days of PTO and volunteered in a national park for a couple weeks.