News for hackers. Stuff that matters.
Re:Gzip and KNN Outperforms Transformers on Text Classification by iJesus on Thursday July 13, 2023 @09:46AM (#36709041)
What does it take to learn math at such a deep level?
Re:Gzip and KNN Outperforms Transformers on Text Classification by lmeyerov on Thursday July 13, 2023 @10:34AM (#36709776)
Even just undergraduate linear algebra & calc + real analysis & prob/stats... With good teachers to draw the connections

Stuff like info theory are amazing bc of this... But easy to miss if you are just working through a drier text

The crazier version for me is we have a physics professor on our team whose grounding intuitions are use ideas like black holes for mental intuition... Which does not work as well for the rest of the team

(And a lot of modern ML/AI feels very engineered and interchangeable after that, like 'metric function of the month')

Re:Gzip and KNN Outperforms Transformers on Text Classification by TheDong on Thursday July 13, 2023 @11:14AM (#36710535)
Either a year in college, or your entire lifetime. Not that it really matters since mathematically, they're both fundamentally the same, they're both just numbers.
Re:Gzip and KNN Outperforms Transformers on Text Classification by nico on Thursday July 13, 2023 @11:52AM (#36711222)
You don’t really need to go that deep, just broad

You can get a lot just by reading Wikipedia and following links in each article

It’s hard to grasp the formulas and proofs sometimes, but if you only care about understanding the concepts, there are a lot of dots to connect

Re:Gzip and KNN Outperforms Transformers on Text Classification by inimino on Friday July 14, 2023 @01:25AM (#36719816)
Reading textbooks is wildly more effective than trying to pick up new math from Wikipedia.
Re:Gzip and KNN Outperforms Transformers on Text Classification by dekhn on Sunday July 16, 2023 @01:00PM (#36749153)
decades of trying, in my case. and I still only understand a little. I focused a lot on linear algebra, graphs, and probability- most of abstract math is completely outside my understanding.

other folks pick it up quickly in college.