That only makes sense if we label foods with every step of their production and the labels would become large documents. There is nothing special about GM which warrants a special label.

GM is probably much safer than mutation via massive radiation - but nobody is asking to label that.