News for hackers. Stuff that matters.
Re:0.30000000000000004 by chrisseaton on Monday December 02, 2019 @09:49PM (#21689477)
> Currency, taxes, rebates, etc. handling is NEVER done with floating point.

Nonsense. I’ve seen real banking code at reputable banks that uses floats.

> Whatever you do with money you need predictable, reproducible results.

Floats aren’t random. They’re perfectly deterministic, predictable and reproducible. If you do the same operation in two places you get the same result.

Re:0.30000000000000004 by mynegation on Monday December 02, 2019 @10:14PM (#21689591)
I write real banking code. There is definitely a banking code that uses floats, e.g. valuation of financial instruments. The parent comment talks about software that does transactions and “simpler” calculations, like taxes and fees etc.

When people talk about non-determinism of floating point, what they usually mean is non-associativity, that is (x+y)+z may not be exactly equal to x+(y+z).

Re:0.30000000000000004 by throwawaymath on Monday December 02, 2019 @10:28PM (#21689664)
> When people talk about non-determinism of floating point, what they usually mean is non-associativity, that is (x+y)+z may not be exactly equal to x+(y+z).

Good example of this, in Python 3:

    >>> (0.1 + 0.2) + 0.3
    0.6000000000000001
    >>> 0.1 + (0.2 + 0.3)
    0.6
Re:0.30000000000000004 by chrisseaton on Tuesday December 03, 2019 @03:35AM (#21690822)
Every single time you run those two statements, you’ll get the same result. Yes they're non-associative. But that's specified and documented. That's not the same thing as non-deterministic in any way.
Re:0.30000000000000004 by lmilcin on Tuesday December 03, 2019 @03:57AM (#21690917)
Yet, in accounting, you are expected to be able to sum a set of numbers in different ways and still get the same result
Re:0.30000000000000004 by throwawaymath on Tuesday December 03, 2019 @11:47AM (#21693975)
Yes, sorry, I was just intending to highlight non-associativity :) I agree it's not "non-deterministic".
Re:0.30000000000000004 by FabHK on Tuesday December 03, 2019 @03:31PM (#21696383)
The same code might be optimised in different ways by different compilers, though (or the same compiler with different flags). This might lead to different results for the same code. In that sense, it's non-deterministic.
Re:0.30000000000000004 by chrisseaton on Tuesday December 03, 2019 @06:43PM (#21698164)
> The same code might be optimised in different ways by different compilers, though

It's not an optimisation if it changes the result! And if you use non-standard flags that's your problem.

Re:0.30000000000000004 by lmilcin on Wednesday December 04, 2019 @04:48AM (#21700884)
What is and what is not optimization and what changes are allowed or not depends on the application.

MP3 is an optimization of WAV, yet it changes the result.

Some applications are ok with reducing precision of calculations because they are not sensitive enough to small inaccuracies or they take effort to control inaccuarcies.

For example, graphics applications are typically heavy in FP calculations and yet they tend to not care much about precision and much more about performance. For those applications reducing accuracy for slight performance increase is likely win.

Re:0.30000000000000004 by tsimionescu on Tuesday December 03, 2019 @02:42AM (#21690616)
> Floats aren’t random. They’re perfectly deterministic, predictable and reproducible. If you do the same operation in two places you get the same result.

That's not exactly true in real hardware, or at least it wasn't until ~10 years ago. With the x87 FPU, internal precision was 80 bits, while the x86 registers were at most 64 bits. So, depending on the way the program would transfer data between the CPU and FPU your could get different results. It is very likely that different compilers and different optimization decisions could change the way these operations were implemented, so you would get slight differences between different versions of the software.

There are/were also several global FP flags that could get changed by other programs running on the same CPU/FPU that could impact the result of calculations. So, if you want 100% reproducible FP, you would have to either audit all software running on the same machine to ensure it doesn't touch those flags, or set the flags yourself for every FP calculation in your your program.

Re:0.30000000000000004 by chrisseaton on Tuesday December 03, 2019 @03:13AM (#21690726)
In a language like Java, all these factors are specified and fully deterministic.
Re:0.30000000000000004 by lmm on Tuesday December 03, 2019 @09:05AM (#21692303)
False. Floating-point arithmetic in Java is generally nondeterministic. You will notice that the strictfp keyword exists and is off by default.
Re:0.30000000000000004 by chrisseaton on Tuesday December 03, 2019 @09:32AM (#21692504)
It's not false - strictfp mandates deterministic FP. If you use that your program will always run all floating point calculations in exactly the same way, full stop.

Secondly, on mainstream implementations, strictfp is already documented the same as default! They're planning to remove it anyway as it's a no-op in almost all cases.

See JEP 306.

Re:0.30000000000000004 by lmm on Tuesday December 03, 2019 @05:00PM (#21697253)
> It's not false - strictfp mandates deterministic FP. If you use that your program will always run all floating point calculations in exactly the same way, full stop.

If you use it. Which is not the default. Your original claim remains false.

Re:0.30000000000000004 by lmilcin on Tuesday December 03, 2019 @04:01AM (#21690933)
It does not matter. When you are doing accounting you are supposed to be able to sum large collections of numbers and get the same result regardless of the order.

That's something FP does not provide and it makes it completely unusable for accounting.

Re:0.30000000000000004 by josefx on Wednesday December 04, 2019 @08:34AM (#21701995)
> regardless of the order.

That seems like a completely arbitrary requirement. Do accounting laws prohibit sort? Does 1 + 1 have to equal green on Tuesdays?

Re:0.30000000000000004 by lmilcin on Wednesday December 04, 2019 @08:47AM (#21702080)
It seems you have no idea what double-side accounting is.

Each operation is accounted on two opposite sides of various account in a way that always keeps sides balanced (ie. they must sum up to the same value).

When you go to your bank account, for example, you have various sums on both sides of your account. Yet when you sum them up they MUST agree or you will be crying blood and suing your bank.

Re:0.30000000000000004 by tsimionescu on Tuesday December 03, 2019 @03:56AM (#21690914)
True, that's a good point. I was thinking of C & C++, but you're right, newer languages do a much better job of specifying and controlling this behavior.

Wonder if JS does something similar or not.

Re:0.30000000000000004 by gdxhyrd on Tuesday December 03, 2019 @05:00AM (#21691185)
All major C/C++ compilers implement IEEE754. If you are telling the compiler to disregard it, that is on you.
Re:0.30000000000000004 by tsimionescu on Tuesday December 03, 2019 @05:50AM (#21691373)
It's not about IEEE754, it's about the precision that the FP co-processor offers. The results you get are correct per IEEE754, it's just that they may have even less error than required by IEEE754 in some cases. But, this is enough to make the results non-deterministic between different compilation options.

Also, changes applied to the FP co-processor by other processes on the machine could impact your process, regardless of your own compilation settings.

Re:0.30000000000000004 by chrisseaton on Tuesday December 03, 2019 @06:28AM (#21691523)
Are you talking about x87?

That's ancient history. Compilers don't use that instruction set any more in normal operation.

GCC, Java, LLVM, etc, will normally emit SSE2 in order to be standards compliant. They will only relax this if you tell them to, then it's your problem.

Re:0.30000000000000004 by tsimionescu on Tuesday December 03, 2019 @07:45AM (#21691823)
Yes, I was explicitly talking about the x87, and did mention that it has stopped being relevant for at least 10 years.

I believe there is still quite a bit of cautionary discussion of floating point numbers that was written in the age of the x87, so it's important to understand that people were not just misunderstanding IEEE754, even though their concerns are no longer applicable to modern hardware.

Re:0.30000000000000004 by lmilcin on Tuesday December 03, 2019 @04:05AM (#21690954)
I did not say floats are random. But when you do accounting you need to be able to sum large sets of numbers and compare results with another sum of different numbers and the sum must match. This just does not work with FP.

Poor souls that use FP for accounting are scourge of the industry and source of jokes.

Re:0.30000000000000004 by chrisseaton on Tuesday December 03, 2019 @04:12AM (#21690983)
That's what I used to think, then I met these banking types, and they told me 'no we understand their semantics and we use them correctly and we know it is safe for our programs.' These teams have compiler experts on them - they aren't ignorant.
Re:0.30000000000000004 by lmilcin on Tuesday December 03, 2019 @04:18AM (#21691009)
I started working on accounting software in 2002 and right now work for Citi. Compiler experts in accounting? If you are doing HFT you are not doing accounting. Accounting is what happens later when all those transactions need to actually be accounted for and balance calculated
Re:0.30000000000000004 by loopz on Tuesday December 03, 2019 @06:07AM (#21691438)
If you rely on compiler implementations for accounting, you're already lost.

For anything imprecise and scientific, doubles will normally work well.

Accounting rules regarding truncation and rounding as specified, seems unaccounted for by most until they meet such stringent reqs.