[deleted]
Re:An Introduction to Gradient Descent and Linear Regression
by grayclhn on Thursday June 26, 2014 @03:22PM
(#7951173)
Just to add to the other comments: you almost never want to invert the X'X matrix. (Which is k by k, where k is the number of regressors.) The QR decomposition is much more reliable. (for those that want a citation: Seber and Lee's Linear regression analysis is great.)
Re:An Introduction to Gradient Descent and Linear Regression
by teraflop on Thursday June 26, 2014 @03:17PM
(#7951149)
Nope, ordinary linear regression can be done in O(n) time and O(1) space.
Re:An Introduction to Gradient Descent and Linear Regression
by Sherlock on Thursday June 26, 2014 @02:49PM
(#7951025)
That's a common (notation-induced) mistake. You just need to solve a linear system.
Re:An Introduction to Gradient Descent and Linear Regression
by GFK_of_xmaspast on Thursday June 26, 2014 @03:12PM
(#7951120)
I think n is the number of predictor variables, not the data size.