News for hackers. Stuff that matters.
Re:A tutorial on Principal Components Analysis [pdf] by wiz21c on Monday May 22, 2023 @04:45AM (#36028860)
PCA is really something that one must use whenever it has a multivariables model. It's a very quick check, easy to implement, which avoids basic issues such as: "I thought this variable was important in my model and well, it is not", much like : "don't optimize without measuring first".
Re:A tutorial on Principal Components Analysis [pdf] by qqqwwweeerrr on Monday May 22, 2023 @09:02AM (#36030908)
Unless you are strictly talking about predictive modeling, I would disagree with this. PCA just tries to represent N-dimensional observations in a k < N dimensional subspace (for a given k) such that it captures the most variation. This does not mean that any obtained component loadings refer to anything real or meaningful.
Re:A tutorial on Principal Components Analysis [pdf] by wrp on Monday May 22, 2023 @09:25AM (#36031142)
To clarify your point, we need to distinguish between pruning dimensions and projecting onto a k < N set of new orthogonal dimensions. The name of PCA does make it sound like you are selecting dimensions.
Re:A tutorial on Principal Components Analysis [pdf] by jackthetab on Monday May 22, 2023 @03:17PM (#36035485)
> The name of PCA does make it sound like you are selecting dimensions.

I certainly thought that!

Using somes terms from the previous comment, does this mean that the k < N subspace is not (necessarily) a subset of the N-space? Or is the subspace a subset of the data with a different coordinate system?

(Yes, I'm still trying to intuitively grasp these ideas.)