That's exactly what L2 is. Otherwise the orbits of JWST and Earth would have different periods. It's handy to be able to have constant high speed communications and not need large antennas with blackouts.

It also is handy to keep the closest IR sources (Earth and moon) in the same direction as the sun at all times so there is never a point where you have a significant IR source above the sun shield.