Yes, if nobody removes the excess, grid frequency will increase. Running too high or too low frequency can damange equipment, on both the supply and demand sides.