News for hackers. Stuff that matters.
Re:Matrix Multiplication Using Only Addition by daniel-cussen on Friday July 07, 2023 @08:50PM (#36640191)
Hi HN, this paper is my first proper academic publication, it's on arxiv only for now--this is a pre-print--but is being considered for publication by peer-reviewed journals concurrently. Open-access journals, of course.

I'm totally disinterested in tenure or academic recognition. For my goals being a Stanford dropout is better than any other amount of academic recognition. So i don't care about journals uh prestige numbers the impact factors i know that term but anything paywalled is bad for what i do care about, which is my business, fgemm. Means Fast/Faster/Fastest GEneral Matrix-Matrix multiplication. gemm is an acronym already used in BLAS libraries, Basic Linear Algebra Subprograms, which is what most of the time n money spent on ML goes to.

I'm going to be available to answer questions insofar as i can.

Re:Matrix Multiplication Using Only Addition by unlikelymordant on Friday July 07, 2023 @10:15PM (#36640714)
Could you adapt this to finding fast inverses?
Re:Matrix Multiplication Using Only Addition by daniel-cussen on Friday July 07, 2023 @10:29PM (#36640800)
I looked at that, i concluded yes because the bottleneck of inverting a matrix is matrix multiplication. Spesh since fgemm targets 32-bit floating-point format, n has high accuracy (not saying how high but much better than Strassen, at least as good as naive matrix multiplication).
Re:Matrix Multiplication Using Only Addition by quickthrower2 on Friday July 07, 2023 @11:57PM (#36641234)
Hi Daniel. Thanks for the inspiration. Something I have thought about too is sticking some papers out there without needing to go through expensive gates (PhD etc.).
Re:Matrix Multiplication Using Only Addition by daniel-cussen on Saturday July 08, 2023 @12:17AM (#36641305)
It's brutally hard. I had an easier time buying skylinesort.com n posting the skylinesort algorithm there, than publishing through professors n academia. Typically not feasible for undergraduates, least of all anybody not paying tuition. Same way professors are expected to have an undergraduate degree at the very least (4 profs at Stanford have just an undergraduate degree), a Master's degree (a handful have that and no more), but typically a PhD is required (literally all the other professors have PhD's). Is required. Who requires it? Who says, "I require a PhD."? Is expected? Who expects it? Who says, "I expect a PhD."? Passive voice is typical in academia. Very rare to get around the gatekeeping, frankly. I couldn't publish on arxiv for years because of lack of academic affiliation alone.

Took years to get to this point in terms of the effort I dedicate to getting recognition for my work.

Re:Matrix Multiplication Using Only Addition by Vasniktel on Saturday July 08, 2023 @12:50AM (#36641438)
Thanks Daniel. Could you expand on this comment? What did you have to do to be able to publish a paper on arxiv?
Re:Matrix Multiplication Using Only Addition by daniel-cussen on Saturday July 08, 2023 @01:20AM (#36641563)
At the time, i needed academic affiliation, meaning be in college or more likely have a professor vouch for me. What i ended up doing was return to Stanford undergrad n take classes related to algorithms, show my algorithm portfolio in office hours, then get referred to other profs, one of them being Jeffrey Ullman, in 2019. N then after emails back n forth we met in person in the Gates building, it went from there.

Very happy to have met Professor Jeffrey Ullman.

Re:Matrix Multiplication Using Only Addition by jmhimara on Saturday July 08, 2023 @03:10AM (#36642094)
Not sure if this is what you're talking about, but you don't typically pay to get a PhD (in fact you get paid in the US).
Re:Matrix Multiplication Using Only Addition by daniel-cussen on Saturday July 08, 2023 @09:54PM (#36650739)
Yeah n how much do you get paid, n for what? You get paid to take on professorial duties, TA'ing, lab assistant, that sort of thing usually. Pretty rough in many ways.
Re:Matrix Multiplication Using Only Addition by blast on Saturday July 08, 2023 @01:16AM (#36641545)
This is cool! How did you end up working with Ullman? I guess "being a Stanford dropout" explains how you met him, but there must be an interesting story here. Can you share how that happened and what the process was?
Re:Matrix Multiplication Using Only Addition by henistein on Sunday July 09, 2023 @06:40PM (#36659753)
Is there any python implementation of it? I would really like to try it out
Re:Matrix Multiplication Using Only Addition by bishop77 on Tuesday July 11, 2023 @04:43PM (#36686963)
How does this compare to Strassen's algorithm? Could you please provide a reference implementation?