Humans primarily follow lane markings. When these are missing and/or unclear it becomes very difficult to guess where you are supposed to be.

Anyone who has driven through road construction and had to follow temporary lines while ignoring blacked out lines knows this struggle.