Many sockets have little bent-wire brackets that pop into those holes when the plug is fully inserted in order to help hold it in place.

A tangential use (but not the original design intent) is to put a padlock on the plug to prevent it being plugged for safety reasons. (Think power tools, high temperature devices etc).