Re:Hopular: Modern Hopfield Networks for Tabular Data
by cgreerrun on Monday June 06, 2022 @06:07PM
(#31647000)
Notable criticism here: https://medium.com/@tunguz/trouble-with-hopular-6649f22fa2d3
[ Parent
| on HN ]
Re:Hopular: Modern Hopfield Networks for Tabular Data
by grej on Monday June 06, 2022 @07:27PM
(#31647829)
One day these researchers will learn to give Bojan Tunguz a quick first pass before claiming their new model is the latest tabular data wonder tool.
Re:Hopular: Modern Hopfield Networks for Tabular Data
by latenightcoding on Monday June 06, 2022 @10:21PM
(#31649158)
That "notable criticism" is terrible.
His whole argument is that because this algorithm does not outperform sklearn's HistGradientBoostingClassifier the paper is useless and a waste of his "very precious time"
Re:Hopular: Modern Hopfield Networks for Tabular Data
by lcrmorin on Monday June 20, 2022 @08:49AM
(#31809718)
The tweets / medium article are a bit incomplete. But they mean at least:
- Authors didn't make decent efforts to build a robust baseline. Worse it seems that they have purposefully built a bad baseline to make their solution look better.
- Authors didn't really disclose full performance. Statistical performance is one thing but time complexity is another. Hopular needs 10 mins on a 500 rows datasets. That's a NO NO for any serious application.
- Authors didn't provide an easy to use interface. You can't really claim SoTA on small tabular data with something that isn't testable by everyone.
Re:Hopular: Modern Hopfield Networks for Tabular Data
by cgreerrun on Monday June 06, 2022 @11:56PM
(#31649732)
I think it is notable because he's an expert in that area and would know how to assess it. I'm not a fan of the tone either though...
But the authors claim "Hopular surpasses Gradient Boosting (e.g. XGBoost), Random Forests, and SVMs on tabular data." So if a simple sklearn model works better, it's worth knowing it might not be all it's cracked up to be before deciding to spend hours understanding another paper.
Re:Hopular: Modern Hopfield Networks for Tabular Data
by bbstats on Tuesday June 07, 2022 @08:39AM
(#31653314)
https://twitter.com/tunguz/status/1532480966836510753
The fact that SVM was the #2 algo in these results, and that linear methods beat out all the other methods means there's something going awry.
Re:Hopular: Modern Hopfield Networks for Tabular Data
by cgreerrun on Monday June 06, 2022 @11:43PM
(#31649651)
Also more context about criticism from the paper's authors here: https://twitter.com/bschaefl/status/1532281938593173504