Except the Genesis account pretty clearly establishes that it is.

The garden of Eden story isn't even consistent with the other creation story in Genesis, though; if a literalist can accept it as true on faith despite that, they can do so despite any inconsistency with mere sense data, which unlike the conflicting text in the Bible they don't hold to be infallibly accurate as a matter of religious doctrine.