Heh, this made me chuckle and this is reason why I read HN comments. I can't help but to picture someone ringing your doorbell early on an sunday and saying: "Hi! Have you considered inverting vectors?" slams door "Who was it?" "It was just another of those damned geometric algebraists"
It is an absolute necessity for general relativity.
I mean specifically Geometric Algebra.
It sort of seems like a notation, but it has almost a cult like following and perhaps it's more than a notation, is it a theory, a branch of mathematics?
Additionally the GA formalism enables closed form solutions for the exponential map for all bivector algebras. (see 'Graded symmetry Groups' https://www.researchgate.net/publication/353116859_Graded_Sy...).
A vector is pretty much by definition also a matrix, and there is a standard way to multiply matrices. You can define several inverses of a vector that way, though you can't define a unique inverse.
The standard inner product is of course also an exceptionally typical way to multiply vectors, but the concept of an inverse there doesn't make much sense.
There are vector spaces of functions, with infinite dimension, but there are also vector spaces with a finite number of elements.
So only some vectors can even be written as 1xN matrices, if that is what you're referring to. But even if you write a vector that way, it doesn't mean it IS a matrix or that it automatically "has" multiplication.
In mathematics, an object only has an operation if it's part of the definition, and as such, vectors don't "have" multiplication.
The set of elements defined by certain properties of their addition and of their multiplication with the elements belonging to a set of scalars is named "vector space" by some and "linear space" by others.
According to the etymology of the word vector, "linear space" would be more appropriate. You have used "vector" with the meaning "element of a linear space", and what you have said is correct, except that for any "vector" as an element of a linear space, considered as a column vector, there exists a corresponding row vector, even in the infinite-dimensional case.
"Vector" means translation of the space, and this is what "vector" meant when the word was introduced by Hamilton. While the set of translations is a linear space a.k.a. a vector space in the generalized sense, the set of translations, i.e. vectors in the strict sense, has additional properties due to the multiplication operations that must be defined for "vectors" in their strict sense (which are needed e.g. to determine the angles between translations and the distances).
"Vectors" as elements of linear spaces are a very general notion, which appears in many domains, and for all linear spaces, including for those infinite-dimensional, you can define matrices, i.e. linear functions, and matrix multiplication, i.e. composition of linear functions, and also the correspondence between a 1xN vector and a Nx1 vector, more correctly between a vector and an associated linear form. The latter also exists for the infinite-dimensional case, even if it is less likely to use names like row vectors and column vectors (though the names bra vectors and ket vectors are still in use for the infinite-dimensional case).
For the infinite-dimensional case the vectors and the matrices become functions of 1 or of 2 parameters and the sums from the formulas of matrix multiplication become integrals.
While for most computer applications, "vectors" refer just to elements of linear spaces, most "vectors" used in models of physical systems are vectors in the original sense of the word, where not only the vector addition and the product with scalars matter, but the products of vectors also have an essential role and their meaning can be best understood in the context of the complete geometric algebra theory.
A standard way to multiply a MxN with a NxK matrix, but none for a 1xN with a 1xN or a Nx1 with a Nx1 matrix - the two possible ways to describe a vector. You have to transpose exactly one of the two vectors. And then you have two possible results, 1xN multiplied with Nx1 yields a scalar (that's actually the 'usual' dot-product/scalar product/whatever you call it) and Nx1 multiplied with 1xN, where the result is a NxN matrix.
Though thinking about it more, it seems like the outer-product-inverse of a vector (a) must be unique if it exists; and (b) is highly unlikely to exist.
> 1xN multiplied with Nx1 yields a scalar (that's actually the 'usual' dot-product/scalar product/whatever you call it)
I'm aware of this, but there are two ways we might conceive of an "inverse":
- Since a vector is a matrix, the inverse of a vector might be defined by matrix multiplication, where A is the inverse of B if AB is "the" identity matrix. This is only strictly defined for square matrices, but the pseudoinverse concept extends it to nonsquare matrices.
- Or, we could go for a more basic sense of "multiplicative inverse", where the concept is that if AB = C, then B = A⁻¹C. This is what I was thinking of when saying that the concept of an inverse doesn't make sense when multiplication is the inner product - if I give you a vector v, and its inner product with some other vector u, there is no way of recovering what u was.
Not all vector spaces are equipped with an inner product. The point is that you can start with some simple axioms and build these more complicated things (inner product spaces, algebras over a field, geometric algebras, etc.).
Any vector space over a field (usually part of the definition of a vector space) is equipped with the standard inner product, because multiplication and addition are part of the definition of a field.
What you probably mean is that “you can always define an inner product” but that’s a very different statement.
That’s not true either though, the different dimensions in a vector space do bot have to belong to the same field, so you can’t assume you can add them together.
Well, no, not at all.
The inner product is still there. It's still an inner product. The space in which your vectors exist is still an inner product space. You may not care about the inner product, but it doesn't cease to exist when you stop looking at it.
Setting aside the subtler point of what it means to "have" something in mathematics:
clearly only some vector spaces even have the potential to introduce an inner product. Consider F for some random finite field. You can make a vector space from it, but what would the inner product be? Or R x F for that matter, you could never give that an inner product.
That's why the concepts of "vector space" and "inner product space" are separate concepts. Some vector spaces aren't, and could never be, inner product spaces.
Basically the extra stuff that is usually skipped in first year linear algebra courses are the symmetric and asymmetric (often called exterior) products. These form algebras, of course. The exterior product, or wedge product, has a natural interpretation in terms of signed areas (or volumes) and from this you get the determinant as a volume form.
These are the natural generalizations of dot products (inner products) and wedge products (exterior products).
You can take a vector and associate it with a 1 form (asymmetric algebra or exterior algebra), and then multiply two vectors to get a 2 form using the standard wedge product, etc. In dimension 3, the space of 2 forms is dual to the space of 1 forms and so you can "multiply" two vectors to get a third vector. That is all that's going on here.
Actually a good multi-variable calculus class will cover most of this stuff as you need some motivation for Jacobian volume forms used to calculate areas and volumes under change of basis, and dot/wedge products are useful for generalizations of the Gauss divergence theorem and the generalized fundamental theorem that says the integral over a function, f, on the n-1 dimensional boundary of a shape is the differential of the integral of the shape.
Moreover any class on Riemannian geometry will give you all the linear algebra you need as well.
One thing I would caution students with is that by using somewhat non-standard jargon they may not understand how to generalize this stuff to n-dimensions, nor will the connections between, say, determinants and wedge-forms be clear, or dot products and angles be fully understood if only the n=3 cases is emphasized. Only in n=3 can you multiply two vectors to get a vector. But fun fact: in dimension 3k you can multiply two k-forms to get a third k-form (as the space of 2k forms is dual to the space of k forms in n=3k). If you think there is this new thing called "geometric algebra" other than usual tensor products, it may not be obvious how things generalize to n != 3.
Yes, that's my sense too. Of course cross products, wedge products etc make sense and that's just standard mathematics, but the part that I haven't really seen the point of is to form the algebra where all these forms live side by side.
It doesn't seem like a useful "fusing", in the way that say the complex plane is.
Of course it's very cool that sub-algebras in 2 or 3-space in GA are isomorphic to the complex plane or even quaternions, but it still feels a bit made up.
For a concrete example, one youtuber showed how Maxwells equations simplified to a single equation if you introduce an operator that is a combination of div and curl, and also a new kind of physical entity that combines the electrical and magnetic fields.
This is of course cool, but what I want to know is if this new operator makes some physical sense, and if the new multi dimensional field has any physical meaning. If they don't, it just seems like a parlour trick.
Not saying they actually don't, but I haven't seen any deeper explanations of it.
It has the dual quaternions as even subalgebra (in 3D), and unifies all linear and angular aspects. It leads to remarkable new insights, as removing the need for force-couples (pure angular acceleration is caused by pushing along a line at infinity), while pure linear acceleration is caused by forces along lines through the center of mass.
These geometric ideas are independent of dimension - forces, both angular and linear are always lines. The treatment of inertia becomes a duality map, and things like Steiners theorem are not needed at all.
On top of this, the separation of the metric that sets GA apart means that this formulation of rigid body dynamics works not only in flat Euclidean space, but unmodified in the Spherical and Hyperbolic geometries. (by a simple change of metric of the projective dimension).
For a (graphics/game programmer oriented) tutorial on this see https://www.youtube.com/watch?v=pq9YfdPHhIo&ab_channel=Bivec...
I remember for a long time, people coming from the math end of things would look down a bit on physicists laboriously working everything out in complex tensor notation when there are these elegant canonical descriptions arising from differential geometry that look very simple and beautiful and are completely coordinate-invariant.
But then when you want to actually calculate something, you end up doing all the painful tensor contractions anyway, so the physicists would likewise often lookdown on the mathematicians for writing these simple one liners that described all of mechanics but not really understanding how to calculate stuff.
So if repackaging some of the basic facts of differential geometry as "Geometric Algebra" gets physicists to be excited about it, then that's a good thing. Just like repackaging some of the laborious tensor calculus computations into differential geometry has gotten a lot of mathematicians excited about physics. It really is much more pleasant to work in a coordinate-free manner using differential structures associated to the natural manifold suggested by the problem, rather than being stuck in euclidean space and needing to deal with lots of fictional forces and complex change of basis formulas.
For example, look at this text: https://depositonce.tu-berlin.de/bitstream/11303/2482/1/Doku...
Back when I was in university, we covered this in our differential geometry class. And yes, you'd use more abstract concepts like curvature, hodge dual, and exterior product.
Maxwells equations in any dimension can be reduced to: dF = 0 and d*F = 0
That's two equations, not one, but you can introduce a new D = (d, d*) and then get DF=0 if you want.
The advantage here is the d, and F have all the old physical meanings. F is curvature, which is the electro-magnetic field E+B, and d is the derivative (exterior derivative, but that is the derivative needed in calculus).
Here is a derivation: http://home.lu.lv/~sd20008/papers/essays/Maxwell's%20equatio...
https://en.wikipedia.org/wiki/Electromagnetic_tensor
(This assumes you believe a "Field" has a physical meaning.)
Sure, the same information is contained in the F tensor, but it doesn't have a similar straightforward geometric intuition.
Looking at the link reminds me that this entity is used outside of GA, but it still feels a bit weird. More weird than say complex currents, but maybe it actually isn’t.
As to vectors, obviously they have inverses, additive inverses. Since vectors don't have multiplication, there is no multiplicative inverse, but if you define new operations on them, well then that operation can have an inverse but that is not really "the inverse of a vector" anymore.