I'm not going to argue that it would be a reasonable engineering challenge, but it certainly does not need random access to the memory. Screen frames are updated in a predictable pattern, meaning we could take full advantage of the bursting capabilities of modern memory.