News for hackers. Stuff that matters.
[deleted]
Re:An Introduction to Gradient Descent and Linear Regression by grayclhn on Thursday June 26, 2014 @03:22PM (#7951173)
Just to add to the other comments: you almost never want to invert the X'X matrix. (Which is k by k, where k is the number of regressors.) The QR decomposition is much more reliable. (for those that want a citation: Seber and Lee's Linear regression analysis is great.)
Re:An Introduction to Gradient Descent and Linear Regression by teraflop on Thursday June 26, 2014 @03:17PM (#7951149)
Nope, ordinary linear regression can be done in O(n) time and O(1) space.

http://en.wikipedia.org/wiki/Simple_linear_regression

Re:An Introduction to Gradient Descent and Linear Regression by Sherlock on Thursday June 26, 2014 @02:49PM (#7951025)
That's a common (notation-induced) mistake. You just need to solve a linear system.
Re:An Introduction to Gradient Descent and Linear Regression by GFK_of_xmaspast on Thursday June 26, 2014 @03:12PM (#7951120)
I think n is the number of predictor variables, not the data size.