[1, 0] and [1, 1] are linearly independent but not mutually orthogonal. Unless I am understanding what you mean by "in their space".