News for hackers. Stuff that matters.
Re:Linear Algebra: What matrices are by ambicapter on Saturday August 29, 2015 @10:51AM (#10140153)
Why were you taught that you can't multiply vectors together? Aren't there two ways to "multiply" vectors–dot and cross?
Re:Linear Algebra: What matrices are by philh on Saturday August 29, 2015 @11:07AM (#10140216)
Traditionally, multiplication takes two elements of a set and turns them into another element of that set. The dot product doesn't do that, it takes two vectors and turns them into a scalar.

The cross product only exists in three dimensions. And it's not associative (A×B×C gives a different answer depending which order you do it in), which is another thing multiplication usually satisfies.

There are two other not-quite-multiplication operators that I recall seeing. There's an analog of the cross product in two dimensions: (a,b,0)×(c,d,0) = (0,0,ad-bc), so it can be useful to have an operator (a,b)×(c,d) = ad-bc, again turning two vectors into a scalar.

And if the dot product is defined in terms of matrix multiplication by A·B = AᵀB, then you can also define an operator ABᵀ, turning two vectors into a matrix. These vectors don't even need to have the same length.

Re:Linear Algebra: What matrices are by tanderson92 on Saturday August 29, 2015 @12:51PM (#10140597)
> The cross product only exists in three dimensions

While true, the Wedge product is a useful concept that generalizes a cross product to arbitrary dimensions and is used in multivariable calculus for proving various integral theorems in high dimension. Here, generalized Stokes theorems apply despite the cross product not being defined. Admittedly, it isn't really a map on the vector space, but the fact that Stokes theorems still hold makes it pretty darn useful to me.

Re:Linear Algebra: What matrices are by jules on Saturday August 29, 2015 @07:44PM (#10141758)
FYI, in geometric algebra you can truly multiply two vectors and get another element of the geometric algebra out, no matter the dimensionality.
Re:Linear Algebra: What matrices are by tomadi on Saturday August 29, 2015 @09:43PM (#10141980)
But the product isn't a vector of the same shape as the inputs, so it isn't a vector multiplication. It is tensor multiplication.
Re:Linear Algebra: What matrices are by pash on Saturday August 29, 2015 @01:14PM (#10140671)
To add to the other responses at this level, I want to point out that one form of vector-vector "multiplication"—inner products—corresponds to applying linear functionals, i.e., to linearly mapping a vector space into its underlying scalar field.

So just as every matrix is a representation of a linear transformation of vectors into other vectors, with matrix-vector multiplication corresponding to function application, it is also true that each vector in a vector space represents a linear transformation that turns vectors in the space into a scalar, with vector-vector multiplication in the form of inner products corresponding to function application. The converse is also true: every linear functional on a vector space can be represented by a vector in the space.

This last insight is known (in various forms) as the Riesz representation theorem and holds not only on finite inner-product spaces (i.e., vector spaces on which an inner product is defined) but also on Hilbert spaces (complete inner product spaces, whether finite or infinite). It turns out to be quite powerful.

Re:Linear Algebra: What matrices are by RBerenguel on Saturday August 29, 2015 @11:06AM (#10140212)
Well, it actually depends what you've been told about what "multiplication" is. Multiplication should be closed, hence dot product is not a multiplication because the result is not a vector (unless you are using 1-dimensional vectors, sure, but the result is still not a vector.) Wedge (or outer, or cross) product is a delicate issue, because, well, it works as a product but to get it to be actually defined you get the generalisation (exterior algebras) and then they are also not closed (because the exterior algebra is different from the source algebra and is only the same dimension in a few cases)
Re:Linear Algebra: What matrices are by pbhjpbhj on Saturday August 29, 2015 @11:21AM (#10140277)
Surely "multiplication" is a scalar operation and that's why you need to define dot/cross vector products. You can multiply vectors, by scalars.