I completely agree. In college, my first set of Linear Algebra courses were taught by the Math department and were completely algebra based. Later on, taking the engineering LA courses where they stressed the geometry of all the operations really cemented the concepts and simplicity of LA into my mind.