News for hackers. Stuff that matters.
Re:Extreme Video Compression by david-gpu on Tuesday February 20, 2024 @09:42AM (#39441872)
It's a bit more nuanced than that. Floating point arithmetic is not associative: "(A+B)+C" is not always equal to "A+(B+C)". Because of that, certain mathematical operations used in neural networks, such as parallel reductions, will yield slightly different results if you run them multiple times with the same arguments.

There are some people working hard to provide the means to perform deterministic AI computations like these, but that will come with some performance losses, so I would guess that most AIs will continue to be (slightly) non-deterministic.

Re:Extreme Video Compression by nuancebydefault on Tuesday February 20, 2024 @03:53PM (#39446757)
Is AI in general relying on floating point calculations?
Re:Extreme Video Compression by david-gpu on Wednesday February 21, 2024 @03:30AM (#39451394)
One hundred percent. It's mostly fancy floating point matrix multiplications.