Yes, a single capacitor will only hold the voltage applied to it. But after charging each one and cleverly arranging them in series you can hold very high voltages with a bank of them. This is what occurs in a voltage multiplier circuit.