News for hackers. Stuff that matters.
Re:New algorithm breaks speed limit for solving linear equat... by blt on Monday March 08, 2021 @10:28PM (#26395101)
I felt the article undersold an important technical detail about this work. Many randomized algorithms have a "with high probability" guarantee, which for linear systems might look like:

    for any ε > 0 and 0 < δ < 1, using poly(dimension, #nonzeros, condition, 1/ε, 1/δ) floating-point operations, our algorithm finds a solution having less than ε error with probability 1 - δ.
However, that is not the kind of guarantee stated in Theorem 1.1 in the paper. Even though the algorithm uses randomness, the analysis yields a classic big-O complexity guarantee that does not involve probabilities.

This is a big difference, and it makes the result stronger.

Re:New algorithm breaks speed limit for solving linear equat... by okintheory on Tuesday March 09, 2021 @04:02AM (#26396801)
Not really. This algorithm is only fast with high probability, and getting a linear equation solver to be always-correct is just a matter of checking the output at the end and trying again if you're (too) wrong. So always-correct and fast-with-high-probability is a feature of any randomized linear equation solver. It still amazing stuff, I'm just pointing out that this particular aspect of the behaviour is not surprising.
Re:New algorithm breaks speed limit for solving linear equat... by blt on Tuesday March 09, 2021 @08:06PM (#26406574)
Thanks for your insight!

> This algorithm is only fast with high probability

Why is this not mentioned in Theorem 1.1?

Re:New algorithm breaks speed limit for solving linear equat... by okintheory on Wednesday March 10, 2021 @08:01AM (#26410774)
This is a pretty common omission to make, even though it's strictly speaking wrong. But suppose for a moment that the algorithm was always fast. In that case, it would not need randomness anymore, as you could just pick a fixed string as the "random" outcome, and you would be guaranteed success. So, if an algorithm uses randomness, it will either fail with some probability or be slow with some probability. If neither is true, that algorithm doesn't need the randomness.
Re:New algorithm breaks speed limit for solving linear equat... by blt on Wednesday March 10, 2021 @02:21PM (#26415007)
Makes sense. Thank you for the thoughtful response. I hope my original comment is not too misleading.
Re:New algorithm breaks speed limit for solving linear equat... by YetAnotherNick on Tuesday March 09, 2021 @02:23AM (#26396307)
I think that is definition of approximate algorithm, not randomized algorithm. Quicksort is a classic randomized algorithm, but it is not approximate.
Re:New algorithm breaks speed limit for solving linear equat... by bonzini on Tuesday March 09, 2021 @08:29AM (#26398545)
Randomized quick sort could pick the wrong pivot at every step (or at every other step, that's still quadratic complexity), so it's only O(n log n) with high probability.
Re:New algorithm breaks speed limit for solving linear equat... by zeroonetwothree on Tuesday March 09, 2021 @09:58AM (#26399384)
The probability is so low that this has probably never happened in all history (for reasonably sized arrays).

It’s not typical to analyse randomised algorithms this way for that reason.

Re:New algorithm breaks speed limit for solving linear equat... by HelloNurse on Tuesday March 09, 2021 @10:30AM (#26399703)
Quicksort is popular, and Quicksort bad inputs can happen in highly plausible specific cases (e.g. almost sorted input vs. pivot on first array element) and can be easily engineered whenever an attacker controls a large input to be sorted and can guess what sorting algorithm is being used. Probability of bad performance is only low on implausibly random input instances.
Re:New algorithm breaks speed limit for solving linear equat... by ychen306 on Tuesday March 09, 2021 @11:09AM (#26400179)
Re:New algorithm breaks speed limit for solving linear equat... by eru on Monday March 08, 2021 @11:44PM (#26395482)
Re:New algorithm breaks speed limit for solving linear equat... by leapis on Tuesday March 09, 2021 @12:30AM (#26395727)
Is this a theoretical difference, or a difference in terms of an actual implementation? I have no knowledge of linear systems algorithms, but as far as I was aware, many w.h.p algorithms resolve to correctness with probability of 1 - (1/n)^c (with c effectively being a hyperparameter), which would seem like quite a strong result in itself.