News for hackers. Stuff that matters.
Re:Time Series Prediction – A short introduction for pragmat... by hprotagonist on Saturday November 09, 2019 @12:38PM (#21492853)
My very first move with timeseries data is to get to frequency space as fast as I can.
Re:Time Series Prediction – A short introduction for pragmat... by wenc on Saturday November 09, 2019 @06:03PM (#21495101)
Genuinely curious -- how do you create predictive time-series models in the frequency domain?

(background: control systems)

Re:Time Series Prediction – A short introduction for pragmat... by hprotagonist on Sunday November 10, 2019 @09:14AM (#21498012)
speech recognition immediately jumps to mind
Re:Time Series Prediction – A short introduction for pragmat... by wenc on Sunday November 10, 2019 @02:52PM (#21499795)
Speech recognition is generally not considered a time series problem though.
Re:Time Series Prediction – A short introduction for pragmat... by hprotagonist on Monday November 11, 2019 @10:55AM (#21505800)
what about speech is nontemporal?
Re:Time Series Prediction – A short introduction for pragmat... by wenc on Wednesday November 13, 2019 @12:14AM (#21521328)
Time series problems are indeed temporal, but not all temporal problems are time series problems. Time series deals with time-specific features of a discrete sequence like autocorrelation, trends, seasonality, etc. whereas frequency domain methods deal with, well, frequency.

Support you’re are looking at sales patterns over a long period of time, which has certain patterns. FFTs are unlikely to tell you much that is useful or predict much whereas time series methods can reveal patterns where the t is the independent variable.

Re:Time Series Prediction – A short introduction for pragmat... by windsignaling on Saturday November 09, 2019 @05:23PM (#21494842)
In the spirit of the article, how can frequency domain representation be used for prediction / forecasting? Any examples you could share?
Re:Time Series Prediction – A short introduction for pragmat... by 1996 on Saturday November 09, 2019 @12:54PM (#21492968)
+1. FFT is under appreciated.
Re:Time Series Prediction – A short introduction for pragmat... by new2628 on Saturday November 09, 2019 @01:32PM (#21493287)
What do you mean? It's one of the most used algorithm in the history of mankind.
Re:Time Series Prediction – A short introduction for pragmat... by sgillen on Saturday November 09, 2019 @01:42PM (#21493363)
Under appreciated by people just now getting into time series regression, who may be really excited about throwing deep learning at the problem.

Edit: literally saw this happen two weeks ago by a PhD in electrical engineering.

Re:Time Series Prediction – A short introduction for pragmat... by 1996 on Saturday November 09, 2019 @03:12PM (#21494009)
So much that! Also under appreciated: plots and OLS.

Start plotting before firing up the GPUs, then compare to standard OLS - like in this article!

Suggested reading if you don't know OLS: ML from scratch.

Re:Time Series Prediction – A short introduction for pragmat... by dnautics on Saturday November 09, 2019 @06:00PM (#21495085)
Well to be fair if you use a convolutional recurrent architecture, you're doing it without realizing it.
Re:Time Series Prediction – A short introduction for pragmat... by sgillen on Saturday November 09, 2019 @08:49PM (#21495883)
Is that true? I would think that would be more like a wavelet transform where the wavelets are learned?
Re:Time Series Prediction – A short introduction for pragmat... by dnautics on Saturday November 09, 2019 @11:03PM (#21496323)
Yeah, that's true.
Re:Time Series Prediction – A short introduction for pragmat... by hprotagonist on Saturday November 09, 2019 @01:39PM (#21493339)
and not a single DS/ML person seems to have ever heard of it.
Re:Time Series Prediction – A short introduction for pragmat... by teej on Saturday November 09, 2019 @01:42PM (#21493357)
Because most folks in DS/ML are working on predicting likelihood to press a button. You don’t need Fourier transforms for that.
Re:Time Series Prediction – A short introduction for pragmat... by XuMiao on Saturday November 09, 2019 @02:56PM (#21493889)
CNN is essentially a FT with learnable kernels.
Re:Time Series Prediction – A short introduction for pragmat... by hprotagonist on Saturday November 09, 2019 @03:36PM (#21494181)
well, it’s certainly usually convolution. Hardly anyone knows why or how that connects to the FT though.
Re:Time Series Prediction – A short introduction for pragmat... by hprotagonist on Saturday November 09, 2019 @01:53PM (#21493443)
you do, depending on your feature preprocessing.
Re:Time Series Prediction – A short introduction for pragmat... by scottlocklin on Saturday November 09, 2019 @03:50PM (#21494267)
Most DS/ML people are useless chimps.

FWIIW I've used it all the time, along with wavelets, cepstrums, lifters and Hilbert transforms. For timeseries with nonlinearities and lots of data points, it's the way to go. 9/10 times I'd rather hire a EE with signal processing background than a statistician or data scientist for time series work.

Re:Time Series Prediction – A short introduction for pragmat... by objektif on Saturday November 09, 2019 @01:10PM (#21493105)
Can you give an example pls?
Re:Time Series Prediction – A short introduction for pragmat... by hprotagonist on Saturday November 09, 2019 @01:27PM (#21493248)
“bandpass with a butterworth then plot the FFT and phase”
Re:Time Series Prediction – A short introduction for pragmat... by wenc on Saturday November 09, 2019 @06:06PM (#21495128)
If you would indulge me, what sorts of insights would this get you? (genuinely curious)

All I can think of is identification of frequency modes.