They are providing like 6% of the German electricity. So yes, replacing them will require more fossil fuel short time. On the other side, the idea is to replace them with renewal sources. Germany is already at 50 renewables in the electricity mix.

Nuclear is not really a replacement for gas, rather than coal, due to its slow nature. Gas power plants are used in Germany mostly for quick peak power.