News for hackers. Stuff that matters.
Re:LibBF – a small library to handle arbitrary precision flo... by danbruc on Tuesday March 06, 2018 @04:44PM (#16532363)
Mostly off topic but maybe this post attracts people who know the answer to a question that I ran into when I implemented a big integer based rational number library some time ago.

The decimal representation of a rational number p / q has the general form ±<integer part>.<non-repeating fractional part>(<repeating fractional part>), for example 41,111,111 / 333,000 equals 123.456(789). Is there an efficient algorithm to determine the lengths of the fractional parts or one that does at least provides reasonably tight bounds on them?

I did quite a bit of research at the time but only with limited success. I am reasonably sure that finding the exact lengths is comparable in hardness to factoring p and q in some cases and possibly harder in the general case. But I did not come across much with regard to bounds on the lengths.

Maybe there was somewhere an implicit answer to my question which I did not recognize or fully appreciate due to my limited knowledge of number theory but I never came across an explicit statement that said that printing the decimal representation of a rational number or estimating its length is a hard or unsolved problem.

I ended up just performing the expansion digit by digit until I detected a cycle or reached a specified maximum length, but it would by nice to know in advance how long it will be or at least to learn that this is actually an hard or unsolved problem.

Re:LibBF – a small library to handle arbitrary precision flo... by mrmr1993 on Tuesday March 06, 2018 @05:36PM (#16532719)
As you said, this is equivalent to factorisation in terms of complexity. The Wikipedia article[0] on the subject does a good job of summarising the details of this in the section "Other properties of repeatend lengths".

For a simple answer, the lengths are bounded above by Euler's totient function [1] (the sum of factors) of the denominator. Any tighter bounds depend on the specific primes in the factorisation.

Note that Euler's totient function is "always 'nearly n'" in magnitude (Hardy and Littlewood), so that representation will be very expensive for most fractions of large denominator.

[0]: https://en.wikipedia.org/wiki/Repeating_decimal [1]: https://en.wikipedia.org/wiki/Euler%27s_totient_function

Re:LibBF – a small library to handle arbitrary precision flo... by thaumasiotes on Wednesday March 07, 2018 @03:45AM (#16535117)
> As you said, this is equivalent to factorisation in terms of complexity.

This can't be right. Factorisation is, legendarily, a hard problem, unsolved (in realistic time frames) for large input. But more than that, it's harder than division is.

Finding the length of the nonrepeating and repeating parts of a rational number's decimal expansion can be done just by doing the division. That would appear to be evidence that it is not harder than division?

Edit: from the wikipedia section you link:

> If k = 2^a·5^b·n where n > 1 and n is not divisible by 2 or 5, then the length of the transient of 1/k is max(a,b) and the period [of the repetend, presumably] is r, where r is the smallest integer such that 10^r ≡ 1 (mod n)

All integers (except those whose only prime factors are 2 and 5) satisfy this condition, so this would appear to be exactly the method desired? Repeatedly dividing by 5 is much, much easier than factoring is. Taking the discrete log of 1... could be equivalent to factoring.

Re:LibBF – a small library to handle arbitrary precision flo... by danbruc on Wednesday March 07, 2018 @01:02PM (#16538335)
That would appear to be evidence that it is not harder than division?

From your edit I guess that you already realized this, but the hard part here is that for 1 / q you would have to perform up to q divisions of integers of size n = log₂(q) which of course takes time O(2ⁿ) even assuming the divisions are O(1).

Re:LibBF – a small library to handle arbitrary precision flo... by danbruc on Tuesday March 06, 2018 @07:08PM (#16533303)
That Wikipedia article on repeating decimals is probably where I started looking into it, but the article is somewhat weird. For many problems Wikipedia articles say we know this and that but those other things are still unknown, this article has a lot of information but does not talk about unknown things at all. The length of the repeating fractional part of 1 / n divides φ(n)...and then nothing. Is this all we know or is there more but just not in this article?

I still remember that quite well because that was probably the first and only time that I was unable to find someone stating that we do not know any better, and not only the Wikipedia article but everywhere I looked there was no such statement to be found. I eventually gave up after a couple of evenings but it obviously kept stuck somewhere in my mind and that is why I wrote the initial comment.

Re:LibBF – a small library to handle arbitrary precision flo... by yorwba on Tuesday March 06, 2018 @07:44PM (#16533485)
The repeating digits in the fractional part are essentially the output of a linear congruence random number generator. Finding the period is almost the same as determining the order of an element of the state space, but by chance you might get a shorter repetition that fits into the longer one.

Finding the order of an element in a group is a hard problem on par with factoring http://mathworld.wolfram.com/GroupOrder.html

I'm not sure about cases where the state space doesn't form a multiplicative group, but I doubt that it gets much easier.

Re:LibBF – a small library to handle arbitrary precision flo... by jcranmer on Tuesday March 06, 2018 @07:42PM (#16533478)
MathWorld is often a decent resource for finding this kind of information: <http://mathworld.wolfram.com/DecimalPeriod.html>, but it's often difficult to arrive at those pages if you don't have any idea where to start.
Re:LibBF – a small library to handle arbitrary precision flo... by danbruc on Tuesday March 06, 2018 @08:02PM (#16533556)
I certainly also looked through MathWorld but I failed to make some - in hindsight - rather obvious connections or did not pay enough attention. I certainly knew what the discrete logarithm problem is and that it is hard but I did not realize until a few minutes ago that finding the multiplicative order is just that only with a different name. And now being aware of that the MathWorld article spells exactly this out in a way that it seems impossible to miss.
Re:LibBF – a small library to handle arbitrary precision flo... by yorwba on Tuesday March 06, 2018 @07:46PM (#16533498)
There's an extra > at the end of your link.
Re:LibBF – a small library to handle arbitrary precision flo... by tadkar on Tuesday March 06, 2018 @05:00PM (#16532473)
While I’m sure you know this, when computing the fractional part you will have at most q-1 digits in your repeating cycle. When you divide by q, you have at most q unique remainders (0 to q-1). Also when computing the fractional part, if you end up with the same remainder as you’ve previously seen then you’ve hit the cycle.
Re:LibBF – a small library to handle arbitrary precision flo... by danbruc on Tuesday March 06, 2018 @06:12PM (#16532948)
That is exactly what I did, I implemented some cycle finding algorithm, a tortoise and hare variant maybe but I can not tell from the top of my head, on the reminder sequence giving up after a user-specified number of steps. But it irks me that this may abort just a hand full of steps before finally finding the cycle.

And unfortunately q is just way to loose as a bound if it even deserves the name bound in this case. I initially started looking into this because I wanted to print something like »0.577 215 664 <901,532 more digits>« but in that case q is essentially useless because you either have to really search the cycle which quickly becomes impractical once q reaches millions or billions or you have to live with »0.577 215 664 <up to 999,999,991 more digits but maybe also just one>«.

Re:LibBF – a small library to handle arbitrary precision flo... by thaumasiotes on Wednesday March 07, 2018 @04:38AM (#16535286)
> I implemented some cycle finding algorithm, a tortoise and hare variant maybe but I can not tell from the top of my head, on the reminder sequence giving up after a user-specified number of steps.

What's the cycle finding for? Isn't it enough to record the remainder sequence with indices? As soon as any remainder reoccurs, that's the cycle.

Re:LibBF – a small library to handle arbitrary precision flo... by danbruc on Wednesday March 07, 2018 @12:52PM (#16538232)
You could of course just maintain the set of remainders seen so far and then you would detect the cycle by reaching a remainder that is already in your set of remainders seen so far but that requires space proportional to the number of digits expanded and if you are expanding a lot of digits and have a large denominator, this will add substantially to the amount of memory consumed. The digits themselves require of course a linear amount of space, too, but only about one byte per digit compared to the potentially big remainder.
Re:LibBF – a small library to handle arbitrary precision flo... by siegelzero on Tuesday March 06, 2018 @05:32PM (#16532703)
There are some closely related difficult problems. Consider the fraction a/b, and let r be the length of the repeating fractional part. Then r <= b - 1. Moreover, if r == b - 1, then b is prime. In general, r divides phi(b), where phi is the Euler phi function.
Re:LibBF – a small library to handle arbitrary precision flo... by abetusk on Tuesday March 06, 2018 @06:25PM (#16533060)
The length of the repeated part is the multiplicative order of 10 mod q [1].

Look at the Wikipedia page on repeated decimals and you can see many of the repeated sequences have length (q-1) ((q-1) is phi(q) when q is prime) [2].

There's a SO answer that talks about this [3]. I think I can derive it here, though take it with a grain of salt as I might have screwed something up.

Say you have a rational number p / q, and w.l.o.g., p < q. Consider an integer, R, that corresponds to the repeated portion of the rational number (in base 10), with length s (in decimal). This implies:

    p/q = R sum_{k=1}^{\infty} 10^{-s k} = R / ( 10^s - 1 )
rearranging terms:

    p (10^s - 1) - q R = 0
Let's just assume for now 10 and q are relatively prime. I think I have to do a little hand waiving at this point and just assume the above has a solution. If the above is true, this means 10^s = 1 (%q) for s equal to the order of 10 mod q, which is a fancy way of saying 10^s = C q + 1 for some integer C. One choice that will always work is taking s = phi(q) though this might be smaller (specifically a divisor or phi(q)) depending on what the order of 10 is to q.

So to make the above equation true, let's be coarse and choose s = phi(q) in the below:

    .. p (10^{ phi(q) } - 1 ) - q R = 0
    -> p ( C q ) - q R = 0
    -> q ( p C - R ) = 0
And there you go. Assuming that I haven't bungled anything, this also gives an 'algorithm' to find the actual repeated sequence: R = p C = p 10^{phi(q)} . Choosing s, the length of R in base 10, to be phi(q) will always "work", but, again, s might be able to be chosen smaller, depending on what divisors of phi(q) there are and what order 10 is to q, so the real answer of the length of the repeated sequence is 10's order in the multiplicative group mod q.

There's also the case of when 10 and q aren't relatively prime that needs to be worked out.

You can also see how this argument could be modified to work with other bases.

[1] https://softwareengineering.stackexchange.com/a/192077

[2] https://en.wikipedia.org/wiki/Repeating_decimal#Decimal_expa...

[3] https://softwareengineering.stackexchange.com/a/192081

Re:LibBF – a small library to handle arbitrary precision flo... by danbruc on Tuesday March 06, 2018 @07:32PM (#16533430)
This made me look at multiplicative order again and I finally found [1] what I could not find at the time, someone explicitly stating that this is a hard problem. Now it seems so obvious that I should have looked at what cryptography has to say about it that I can not imagine why I did not. Anyway, case finally closed, I got my peace of mind now.

[1] https://math.stackexchange.com/questions/837489/algorithms-f...