A capacitor bank wouldn't really help here, since that power has to come from somewhere. The issue isn't that the batteries aren't capable of outputting that peak power -- Even small battery systems are more than capable of outputting the 50kw+ it might take to get on plane. The real issue is that doing that repeatedly requires you to scale up your battery capacity and weight, which is a positive feedback loop.
Boats are not just getting on/off plane once on a tank of gas, they're doing it 10-20 times depending on driving conditions, surroundings, no wake zones. This might happen 100s of times for watersports like wakeboarding. So a big part of the equation is finding a way to save weight elsewhere that can then be used to insert more batteries.
Could a capacitor bank be used to deliver a burst of power to plane out? Or does the weight and volume of capacitors still exceed what's practical? Also seems like it wouldn't work for wakeboarding, where the goal is to generate a big, inefficient wake all the time.