News for hackers. Stuff that matters.

microprediction

Re: on Saturday April 29, 2023 @12:45PM (#35754582)
For unmanned missions into GPT returning structured data.
Re: on Thursday January 19, 2023 @02:33PM (#34444543)
As of today I have permission to make public my somewhat mischievous entry in the year-long world-wide stock and ETF forecasting contest … the sixth major M-competition in a storied history stretching back to 1982.

The intent of my entry was to turn the contest from a “model versus model” into a “market versus model” battle. Or if you like, a battle between the contest community and the community of a different kind that makes options markets efficient. You can call this contest highjacking if you want, or just “exogenous data”.

Re:Quant Book of the Year on Monday December 19, 2022 @04:17PM (#34057852)
Microprediction named Quant Book of the Year by Rebellion Research.
Re: on Wednesday October 05, 2022 @02:54PM (#33099775)
I'm the author. AMA.
Re:Zillow, Prophet, time series, and prices on Monday November 08, 2021 @02:10PM (#29152978)
Hi I'm the author of the Prophet article https://www.microprediction.com/blog/prophet which for better or worse is why many people have recently questioned Prophet as a time-series method. (There are better, and certainly more formal critiques before and after - I referenced several).

I just hope those who push back on your article read all the way to the last paragraph. I'll repeat it below. Very well put.

I'm happy to answer technical questions about Prophet from anyone here but again, this is somewhat beside the point, which is...

The requirement that people come to your company knowing how to use piss easy baby tools is an extremely dumb and lazy hiring practice. It is also, unfortunately, a common practice in data science job postings. The aggregate effect of this practice being widespread is that talented people with unusual backgrounds get gatekept out of good paying jobs that they’d be exceptional at. Making fun of the job posting and using Prophet has been compared to gatekeeping. To be clear, the Prophet prerequisite is an actual form of gatekeeping being undertaken by a major company that has actual material impacts on people’s careers. The job post excludes people not based on aptitude, but based on whether they have previous experience and familiarity with a tool they could be introduced to and then master in under 15 minutes. A tweet making fun of the job posting is not gatekeeping. Get over it, LinkedIn clout chasers

I would add that since posting my own less-well worded version of this astonishment I have received numerous DM's from people at large companies who are aghast at the way Prophet is a favorite of management. So whether or not this was a problem at Zillow beyond, say, 2015, it might well be the case elsewhere.

Re:What is the probability a horse finishes last? on Thursday November 04, 2021 @09:20AM (#29106814)
What is the probability a horse finishes last, or 7th, or 5th?

If you think you have a good approach, there's probably a paper in this.

Re:A test of human intuition for mean-reverting processes on Monday October 18, 2021 @11:53PM (#28914684)
You are asked one mathematically subtle question about mean-reverting processes.

Results will be part of a submitted academic paper. Thanks to all who participate.

Re:Petition for publication of Facebook critical article on Tuesday October 12, 2021 @01:51PM (#28842770)
It's stand up to Facebook week, people!
The details of the M6 Forecasting competition have been announced. This time it is the hardest possible test and it’s good to see that we’re going real-time.
Re:Tbats tops Elo ratings for forecasting on Sunday September 19, 2021 @08:10PM (#28589148)
The Elo Ratings in this table are produced transparently in the repo timeseries-elo-ratings and based on k-step ahead prediction duels using live time series data. See METHODOLOGY.md for interpretation of Elo ratings. The table named univariate-k_002 refers to 2-step ahead prediction, and so forth.
Re:The future of forecasting contests, according to the experts on Tuesday September 14, 2021 @12:42PM (#28527356)
A recent paper by Spyros Makridakis, Chris Fry, Fotios Petropoulos, and Evangelos Spiliotis considers the past evidence from forecasting competitions and lays out some design principles for future ones.
Re:Cryptocurrency Prediction Contest on Tuesday September 14, 2021 @11:50AM (#28526599)
Jackpot is going up $100 every day
Re:Time-Series Package Recommender on Friday July 30, 2021 @03:28PM (#28011410)
Recommends open-source time-series packages
Re:Sums up the state of data science on Thursday July 29, 2021 @04:28PM (#28001079)
Takedown of Towards Data Science sums up the data science landscape.
Re:Towards Data Science cops a meme hit on Thursday July 29, 2021 @08:09AM (#27995488)
Towards Data Science cops a meme hit
Re:Notebook that chooses an optimizer for you on Thursday July 22, 2021 @03:46PM (#27923365)
Here's a colab notebook that will recommend a black-box optimizer for your objective function.

The recommendations are based on the Elo ratings for derivative-free optimization packages (see https://lnkd.in/ghgmKfN) which are now quite mature.

The notebook will also compare directly the performance of many different optimization strategies, drawn from disparate libraries, on your objective function(s).

This is a lot faster than trying out nlopt, bobyqa, dlib, nevergrad, pysot, hebo, bayesopt, skopt, ax-platform, shgo, pymoo, hyperopt, optuna, platypus, ultraopt and other Python packages, not to mention variations within, yourself.

A lot faster.

Re:Stop Shy of the First Down on Tuesday July 06, 2021 @12:09PM (#27750403)
On the first down, NFL teams should tell their players to stop shy of the first down marker, unless they can get three more yards.
Stronger than "Prophet"?

I began writing this post because I was working on integrating Prophet into a Python package I call time machines, which is my attempt to remove some ceremony from the use of forecasting packages and compare them. These power some bots that the prediction network (explained at www.microprediction.com if you are interested). How could I not include the most popular time series package?

I hope you interpret this post as nothing more than an attempt to understand the quizzical performance results, without denying the possible utility of Prophet or its strengths (if nothing else it might be classified as a change-point detection package). I mean seriously, can Prophet really be all that bad? At minimum, all those who downloaded Prophet are casting a vote for interpretability, scalability and good documentation - but perhaps accuracy as well in a manner that is hard to grasp quantitatively.

(from the article)

Older »