News for hackers. Stuff that matters.
Re:A bootable CD image with a retro game in a single tweet by jobu on Tuesday July 31, 2018 @09:55PM (#17659029)
This reminds me a bit of the science of nanoinformatics as described in one of the Expanse novellas (The Vital Abyss):

"A thought experiment from my first course in the program: Take a bar of metal and put a single notch in it. The two lengths thus defined have a relationship that can be expressed as the ratio between them. In theory, therefore, any rational number can be expressed with a single mark on a bar of metal. Using a simple alphabetic code, a mark that calculated to a ratio of.12152205 could be read as 12-15-22-05, or “l-o-v-e.” The complete plays of Shakespeare could be written in a single mark, if it were possible to measure accurately enough. Or the machine language expression of the most advanced expert systems, though by then the notch might be small enough that Planck’s constant got in the way. How massive amounts of information could be expressed in and retrieved from infinitesimal objects was the driving concern of my college years."

Pure fiction at this point, but it would be an interesting experiment to encode data into objects that could be expressed using the mathematical ratio of their shapes or sizes.

Re:A bootable CD image with a retro game in a single tweet by magnat on Wednesday August 01, 2018 @12:52AM (#17659789)
> Or the machine language expression of the most advanced expert systems, though by then the notch might be small enough that Planck’s constant got in the way.

With Planck's length being roughly 10^-35m, I'd say you'd hit the limit trying to store more than 15 bytes.

Re:A bootable CD image with a retro game in a single tweet by Tepix on Wednesday August 01, 2018 @03:36AM (#17660362)
Also depends on the length of the metal rod, doesn't it?
Re:A bootable CD image with a retro game in a single tweet by OscarCunningham on Wednesday August 01, 2018 @03:53AM (#17660422)
The observable universe is 2^205.5 Planck lengths across, so you can store at most 205 bits, or 25 bytes.
Re:A bootable CD image with a retro game in a single tweet by soVeryTired on Wednesday August 01, 2018 @09:50AM (#17662446)
And at that length your latency gets reeeeeeal bad.
Re:A bootable CD image with a retro game in a single tweet by hamilyon2 on Wednesday August 01, 2018 @03:23AM (#17660313)
This is insightful. 15 bytes is not a lot. I wonder what are other narural limits on information density? For example, magnetic field. Is there a least measurable difference?
Re:A bootable CD image with a retro game in a single tweet by AmericanChopper on Wednesday August 01, 2018 @04:22AM (#17660525)
The limit on information density is called the Bekenstein Bound, the point after which adding more information to the volume would create a black hole.

https://en.m.wikipedia.org/wiki/Bekenstein_bound

Re:A bootable CD image with a retro game in a single tweet by jtrip on Wednesday August 01, 2018 @05:14AM (#17660830)
How are you calculating a value of simply 15 bytes? The proposal is that the mathematical value of the ratio of the lengths of rod and the notch will deliver a value on the number line, which in effect can be of any desired length. You actually could find a number that can represent the complete contemporary knowledge of Humanity.

The limitations mentioned in the above comment relate to the fact that to know you'd arrived at the number designed into the Notch and the Rod, you'd have to have agreed to beforehand the tolerance limits on measurement of this 'device' so that the uncertainty in measurement can be ignored and the ratio derived.

To maybe get the right number you would have to expand your possible number of ratios (at a certain measurement sensitivity you would have a certain number of lengths you could use, and thus certain number of ratios would be available to you) and to get just the right number to describe your whole "machine language expression of the most advanced expert systems" you would have to delve into tolerances of the Plank length.

Or adjust the size of your rod length and notch, make them bigger, to get that sweet number with a 'poorer' level of sensitivity.

.. Or find a number with enough usable number sequences to serve the purpose and program in the numbers surrounding gibberish as markers/jump points to the next sequence of usable numbers. I suppose you could find enough usable sequences in the full expression of pi (as it's rational expression is without end) to write a program that can decode the full linux kernel out of it.

Re:A bootable CD image with a retro game in a single tweet by rcxdude on Wednesday August 01, 2018 @06:28AM (#17661218)
Assuming the length of the rod is 1m, and you have a resolution of one plank length, there are 10e35 possible ratios you can express (because that's the number of possible locations of the notch). that's about 2^113, which is a number which fits in 15 bytes of information. As discussed below, if you also allow for the bar to be the size of the observable universe, this doesn't increase by much. A notch or ratio is linear, information and combinatorics grows a lot lot faster than that.
Re:A bootable CD image with a retro game in a single tweet by jtrip on Wednesday August 01, 2018 @02:25PM (#17665403)
How would you say a rod to notch ratio of 22/7 compares? How much information would you say that has?
Re:A bootable CD image with a retro game in a single tweet by rcxdude on Thursday August 02, 2018 @05:55AM (#17670317)
Meaningless on its own. What matters is how many distinct ratios are possible.
Re:A bootable CD image with a retro game in a single tweet by stevenhuang on Saturday August 04, 2018 @04:20AM (#17685927)
> Meaningless on its own.

That's the crux. What we're saying is that, of these set of ratios, there exists one whose infinite decimal representation contains our intended data. Yes we'd be limited to Planck length resolution, but the idea is that we would determine such a ratio and construct the notch and bar in such a way that it yields the decimal sequence desired; the # of particular ratios is not relevant.

I wouldn't be surprised if it can be proven this can't be done, but then that would be proper question to ask.

Re:A bootable CD image with a retro game in a single tweet by utopcell on Wednesday August 01, 2018 @12:03PM (#17663758)
you can loosely think of it as writing down a number in unary where each "digit" takes 1.6 x 10^-35 m space to draw.
Re:A bootable CD image with a retro game in a single tweet by jtrip on Wednesday August 01, 2018 @02:29PM (#17665447)
But what does that have to do with the emergent ratio between the notch and the rod? There may be 10^35 possible steps, but that does not mean that the answer, the ratio of the notch and the rod, will be limited by that. The answer will come from the number line, where any irrational number can have however many trailing numbers. If the ratio of the rod and the notch is 22/7, how much information would you say that is?
Re:A bootable CD image with a retro game in a single tweet by utopcell on Wednesday August 01, 2018 @06:12PM (#17667550)
If 'x' marks the notch of a rod of length "1", [0---------x------------1], then the implied ratio is not x/(1-x), but x/1 (so the ratio is always < 1.) Even so, your question could be "what is the information content of 1/7" (the presumed implication being that 1/7, while periodic, has an infinite decimal representation.)

But that is not the direction we are interested in. We would like, given a message, such as "l-o-v-e", or 12-15-22-05, or 0.12152205, to figure out what is the ratio that uniquely specifies it. As we can only mark one notch, we can create "only" h ~= 10^35 ratios, or represent h unique messages. We know how to distinguish between h unique elements with log(h) bits (we just enumerate them from 1 to h and write that number down in binary.)

Re:A bootable CD image with a retro game in a single tweet by jtrip on Thursday August 02, 2018 @01:59AM (#17669501)
Let's assume that the rod is 1 m in length, and say I wrote a book that is perfectly represented by the number 0.abcdefg...yz. If that number is perfectly represented by one of the ratios in set 'h', then have I not stored more infromation than 15 bytes?

As for x/(1-x), why not? And why limit ourselves to a 1 m rod? Why not a 22 m rod with a 7 m notch? I could then define the method of decoding the information via (Rod length)/(notch length). The I'd have 'infinite' information in the form of expression of pi.

My main issue with the parent comment is that they imply only 15 bytes of data could be stored via this method. I think that's prespoterous as the number of ratios my be only 15 bytes, the ratios themselves can have any possible size.

It becomes more a game of probability rather than that of exact numbers. Will you find the right number, from set 'h', that matches exactly what you wanted to say?

    0.abcd...xyz = [(notch length=alpha*plank length)/(rod length=beta*plank length)]
where alpha and beta are just any variables that you play with until you solve the equation.
Re:A bootable CD image with a retro game in a single tweet by utopcell on Thursday August 02, 2018 @10:07AM (#17671458)
A 22m rod with a 7m notch is perfectly ok. You'd then be encoding 7/22. As others have pointed out, the rod could span the known universe and it would still not matter.

Say you found a great message in the representation of 1/7. Weird, since it is a rational so if its representation is infinite, its periodic (you can't write down 1/π or 1/e for example, as these are irrationals.)

Excited you found that message, you want to put your notch exactly at 1/7 on the rod to celebrate it.

But you can't. Your desired notch position will fall between two possible notches, spaced one planck distance apart, and you'll have to pick one of the two.

And when you do, you truncate your message to 15 bytes worth of information.

Re:A bootable CD image with a retro game in a single tweet by rcxdude on Thursday August 02, 2018 @06:10AM (#17670367)
Not really. You have stored something which has a representation of more than 15 bytes, but you will struggle to find a way to store most things longer than 15 bytes in this way. (everything can be transformed into a representation which is infinite in size anyway, for example by using an irrational base). Information really comes down to the number of possible values you can distinguish.

If you do the ratio thing you have described you will find that alpha and beta are many, many times the size of the observable universe for something like a book. If you allow the length of the rod itself to also contribute to the information, you have added another symbol so you can store more than 15 bytes, but this doesn't even double the amount of bytes you can store.

Re:A bootable CD image with a retro game in a single tweet by jtrip on Thursday August 02, 2018 @07:23AM (#17670636)
Total Human knowledge ~ 250 EB

Assuming all of it can be described as ascii characters, (ratio of.12152205 could be read as 12-15-22-05, or “l-o-v-e.”) then let's assume 4 numbers will be required to encode one letter. That gives us, in our limited system, 4 decimal bits to a byte (we really can't limit ourselves to just ratios that are sufficiently large and only made of 1s & 0s).

So, all human knowledge is, in our system,

    250*(1024^6)=288230376151711740000 bytes. 
As we assumed that all of it can be described as ascii characters, and in the standard system 1 byte holds one character, there are now 288230376151711740000 characters. Expressing these many characters in our 4-byte decimal numbers will require a ratio with

    (288230376151711740000*4)=1152921504606846976000 
numbers in it. All the ratios with 1.15 * 10^21 numbers will be the candidates which can be used to store all of humanity's contemporary knowledge.

Now, as I said earlier, the ratios may have an impressive number of numbers in them, expressed in a decimal system, and there are an infinite number of them on the number line itself, that does not mean all of those are available for use. We are limited to ratios derived from lengths which are multiples of the plank length. Assuming, for a particular rod and it's notch, there is a set 'h' that contains all the possible ratios. We will be limited to such ratios only to find our matching ratio, the ratio through chance of cosmic infinity, or not. If not, then we have to increase/decrease the design length of the rod and the notch to change the set 'h', and hope there is a number we are looking for.

How many such ratios, of the required length of 1.15 * 10^21 numbers, would exist if derived solely through the ratios, is unknown and wholly dependent on the information that has to be encoded. The longer the data, the higher the probability of not finding the right number. As you put it, there will be 15 bytes of choice, or in a one meter rod there will be 10^32 number of choices of ratios to play with. If you doubled the length of the rod, you would have twice the amount of choice, as so on. Again,

    0.abcd...xyz = [(notch length=alpha*plank length)/(rod length=beta*plank length)]
where alpha and beta are just any variables that you play with until you solve the equation.

And again, you could find the ratio you are looking for, it will be a probability game.

Please read what I wrote carefully and respond point by point.

Re:A bootable CD image with a retro game in a single tweet by perl4ever on Thursday August 02, 2018 @04:08PM (#17675013)
Are you just saying the length of the rod can be variable along with the position of the notch? If so, it seems like that means you approximately square the number of possibilities, so if there was a maximum of 25 bytes, then there is an maximum of 50 bytes available in something the width of the universe. Still not large.
Re:A bootable CD image with a retro game in a single tweet by stevenhuang on Saturday August 04, 2018 @03:55AM (#17685871)
Your comment is a non-sequitor; reread what he said.

He's saying that there exists a certain ratio in the set of ratios whose decimal representation represents a corpus of knowledge, in this case the entirety of human knowledge.

It's the same idea as this example: http://www.angio.net/pi/

Re:A bootable CD image with a retro game in a single tweet by jtrip on Friday August 03, 2018 @01:10AM (#17677422)
How did you not get that the term '25 bytes' is merely the size necessary to store the number of possible ratios instead of any actual information?

Did no one read the discussion below about encoding information into pi? This is the same concept. Yes, there are only 25 bytes worth of ratios to chose from, but those ratios themselves can, possibly, POSSIBLY, store all the information.

Re:A bootable CD image with a retro game in a single tweet by perl4ever on Friday August 03, 2018 @11:16PM (#17685181)
There is no ratio equal to pi, so I don't understand how pi can be relevant to a method of storing information using ratios.

Show me an irrational number in real life.

Re:A bootable CD image with a retro game in a single tweet by stevenhuang on Saturday August 04, 2018 @04:01AM (#17685890)
Hmm, try reading some other comments in this thread, should make things more clear.
Re:A bootable CD image with a retro game in a single tweet by haser_au on Tuesday July 31, 2018 @11:07PM (#17659345)
The same has been said about Pi (3.14). If you can compute, store and search enough the digits of Pi, you can reference anything by just providing the 'start' and 'finish' locations. Unfortunately, with enough digits of Pi, the 'start' and 'finish' numbers can get quite long themselves.
Re:A bootable CD image with a retro game in a single tweet by troupe on Tuesday July 31, 2018 @11:40PM (#17659463)
Years ago I tried this and basically ended up proving that if Pi is random and you are "compressing" random data, on average the start and finish numbers together are at least as long as the numbers you are trying to "compress."
Re:A bootable CD image with a retro game in a single tweet by ibotty on Wednesday August 01, 2018 @01:54AM (#17660040)
Did you proove it formally or only by experiment. If it were a real proof, did you publish it somewhere?
Re:A bootable CD image with a retro game in a single tweet by OscarCunningham on Wednesday August 01, 2018 @03:27AM (#17660326)
In fact, any lossless compression algorithm has the property that the output is (on average) at least as long as the input. The best you can hope for is an algorithm that compresses the kind of data that humans want to store, at the expense of making other data a bit longer. If you're trying to compress random data then you just can't do it.

Here's a proof: consider the strings of length n or less, suppose there are M of them in total. Their average length is just the sum of all their lengths divided by M, and the average length of their compressed versions is just the total length of the compressed versions divided by M. Since the compression is lossless the compressed strings must all be different.

Since there are M strings, if any of them mapped to a string of length more than n then there must be some string of length at most n not being mapped to, so the average length can be improved by instead mapping that string to the shorter string. So any optimal compression method must map only to the strings of length at most n.

So the M outputs are just the M inputs, possibly permuted. So their total length is the same, and hence their average length is the same.

Re:A bootable CD image with a retro game in a single tweet by Const-me on Wednesday August 01, 2018 @03:44AM (#17660385)
> any lossless compression algorithm has the property that the output is (on average) at least as long as the input.

The article you’ve linked says nothing about average. It says that for every algorithm there’s at least some input files that increase the size. It even explains more about that:

Any lossless compression algorithm that makes some files shorter must necessarily make some files longer, but it is not necessary that those files become very much longer. Most practical compression algorithms provide an "escape" facility that can turn off the normal coding for files that would become longer by being encoded. In theory, only a single additional bit is required to tell the decoder that the normal coding has been turned off for the entire input

Re:A bootable CD image with a retro game in a single tweet by OscarCunningham on Wednesday August 01, 2018 @03:49AM (#17660409)
Thanks. I realized this just after I posted it, so I wrote the proof into my comment instead.
Re:A bootable CD image with a retro game in a single tweet by aengvs on Wednesday August 01, 2018 @04:32AM (#17660574)
>In fact, any lossless compression algorithm has the property that the output is (on average) at least as long as the input

I don't think this is true. If it was, lossless compression would be useless in a lot of applications. It's pretty easy to come up with a counter example.

E.g.

(simple huffman code off the top of my head, not optimal)

symbol -> code

"00" -> "0"

"01" -> "10"

"10" -> "110"

"11" -> "111"

If "00" will appear 99.999% of the time, and the other 3 symbols only appear 0.001% of the time, the output will "on average" be slightly more than half the length of the input.

Re:A bootable CD image with a retro game in a single tweet by OscarCunningham on Wednesday August 01, 2018 @04:41AM (#17660631)
Sure, I'm assuming that (a) you are trying to encode all strings of length at most n and (b) you have the uniform distribution over those strings. This makes sense in the original context of encoding random data.
Re:A bootable CD image with a retro game in a single tweet by aengvs on Wednesday August 01, 2018 @04:55AM (#17660718)
>you have the uniform distribution over those strings. This makes sense in the original context of encoding random data.

Lossless compression is nothing more than taking advantage of prior knowledge of the distribution of the data you are compressing.

Random data isn't always (or even often) uniformly distributed. Everything we compress is "random" (in the context of information theory), so I disagree that it makes sense to assume uniformly distributed data.

Re:A bootable CD image with a retro game in a single tweet by OscarCunningham on Wednesday August 01, 2018 @04:58AM (#17660742)
Then the original statement about not being able to use pi as a data compression method is false. It could be the case that 99% of the time you want to encode the string "141592653".
Re:A bootable CD image with a retro game in a single tweet by aengvs on Wednesday August 01, 2018 @05:09AM (#17660807)
The efficacy of a compression algorithm is dependent on the data it is compressing, so that statement is true for some data.
Re:A bootable CD image with a retro game in a single tweet by tylerhou on Wednesday August 01, 2018 @05:07AM (#17660795)
Re:A bootable CD image with a retro game in a single tweet by aengvs on Wednesday August 01, 2018 @05:10AM (#17660813)
Re:A bootable CD image with a retro game in a single tweet by mercora on Wednesday August 01, 2018 @02:28AM (#17660159)
i did somewhat the same thing. it introduced me to programming... i thought how about multiple start indices and fixed width? you can then compress the list of start indices in the same manner until you reach sufficient compression :D
Re:A bootable CD image with a retro game in a single tweet by sjcsjc on Wednesday August 01, 2018 @03:50AM (#17660417)
http://www.angio.net/pi/

My 11 digit phone number occurs around the 115 millionth digit, a grand saving of two digits.

Re:A bootable CD image with a retro game in a single tweet by potench on Wednesday August 01, 2018 @05:54AM (#17661055)
Wow, isn’t there a really low probability of finding your phone number in the first 200m digits of pi? (0.09995% in first 100m) I’m tempted to start throwing a dictionary of phone numbers through this pi lookup to find your number, call you, and verify, I think you could quickly narrow in on your phone number given the information above.
Re:A bootable CD image with a retro game in a single tweet by OscarCunningham on Wednesday August 01, 2018 @06:17AM (#17661176)
I think you'll have trouble. Assuming the first digit of the phone number is somewhere between 114.5 million and 115.5 million, you have 1 million potential 11 digit numbers to check.

There are 10^11 sequences with 11 digits. The number of people in the USA is 3×10^8, and we can assume there is roughly 1 number per person (some people don't have a phone number and some people have more than one, but it turns out that the exact approximation won't matter unless we're a few of orders of magnitude off). So about 0.3% of 11 digit sequences are valid phone numbers.

So there are approximately 0.3% × 1000000 = 3000 people with phone numbers around the 115 millionth digit of pi. You have no way of knowing which one of those people is sjcsjc.

Re:A bootable CD image with a retro game in a single tweet by maxerickson on Wednesday August 01, 2018 @07:52AM (#17661624)
It'd be a great 1 person-audience magic trick to call up all 3000 of those people and say, "Hi sjcsjc, I found your phone number in Pi".
Re:A bootable CD image with a retro game in a single tweet by feintruled on Wednesday August 01, 2018 @12:00PM (#17663724)
Derren Brown did a great series of tricks based on probability.. your comment reminded me on the one that showed a video of him flipping 10 heads in a row on an unbiased coin. He revealed them that he had done it by flipping a coin for hours until he got that sequence.
Re:A bootable CD image with a retro game in a single tweet by maxerickson on Thursday August 02, 2018 @10:03PM (#17676841)
Teller has made a similar statement, about practicing something more than anyone would find reasonable, so the trick is just in being able to do it.
Re:A bootable CD image with a retro game in a single tweet by amake on Wednesday August 01, 2018 @02:41AM (#17660191)
Here's an implementation of precisely that, as a filesystem:

https://github.com/philipl/pifs

Discussed here previously (2014):

https://news.ycombinator.com/item?id=8018818

Re:A bootable CD image with a retro game in a single tweet by praptak on Wednesday August 01, 2018 @03:46AM (#17660397)
The indexes will, on average, have more digits than the sequence you compress. This is true for any infinite sequence of digits, not only Pi.
Re:A bootable CD image with a retro game in a single tweet by com2kid on Wednesday August 01, 2018 @12:26PM (#17664012)
World's most painful compression algorithm: Finds a mathematical series of infinite digits, and the offset into it, that most efficiently compresses data passed in. Probably have to chunk the data up to make this efficient.

Of course one can argue that all current real life compression algorithms are aiming to simulate this, and that a brute force algorithm is one of those "after turning the sun into a CPU, still won't have enough compute power to finish the problem" types of solutions.

Re:A bootable CD image with a retro game in a single tweet by dfcarney on Tuesday July 31, 2018 @10:00PM (#17659059)
Re:A bootable CD image with a retro game in a single tweet by utopcell on Tuesday July 31, 2018 @10:46PM (#17659250)
Yep, not fiction at all, pretty much what is used for state-of-the-art compression.
Re:A bootable CD image with a retro game in a single tweet by im3w1l on Wednesday August 01, 2018 @12:09AM (#17659580)
The fiction part is being able to notch the bar sufficiently precise to store any significant amount of data.
Re:A bootable CD image with a retro game in a single tweet by ddalex on Thursday August 02, 2018 @03:23AM (#17669762)
You can if you start from the middle out.
Re:A bootable CD image with a retro game in a single tweet by utopcell on Wednesday August 01, 2018 @09:52PM (#17668688)
:-)
Re:A bootable CD image with a retro game in a single tweet by jhbadger on Wednesday August 01, 2018 @06:10AM (#17661133)
The late mathematics popularizer Martin Gardner wrote about this concept in the 1970s (I think his example involved reducing the Encyclopedia Britannica to a notch), although I don't know if the idea was unique to him or if he was popularizing an earlier idea.
Re:A bootable CD image with a retro game in a single tweet by gballan on Wednesday August 01, 2018 @03:16AM (#17660296)
Reminds me of 'pulse position modulation' [1].

[1] https://en.wikipedia.org/wiki/Pulse-position_modulation

Re:A bootable CD image with a retro game in a single tweet by billpg on Wednesday August 01, 2018 @05:01AM (#17660762)
You could split the package of data into chunks and place multiple notches on the bar. You'd need to include enough information to allow the chunks to be sorted into their original order for that to work.

As if this were a practical means of storing data.