News for hackers. Stuff that matters.
Re:AIs are now re-writing history by ivanche on Tuesday October 07, 2014 @12:43PM (#8422208)
Some time ago I conducted a simple (albeit impossible in practice, for now at least) thought experiment. Let's say that average size of a JPEG image is 5 MB. Now, some machine could generate all possible valid JPEG files sized 5 MB. In some of those images there would be events which never happen, and never could (for example Usain Bolt running in 1896 Athens Olympic Games etc.) Of course, sheer number of such images is ginormous, but for me it's interesting (and scary) that something like this will maybe be possible...
Re:AIs are now re-writing history by masklinn on Tuesday October 07, 2014 @01:09PM (#8422385)
I'm not sure you realise the scales involved. 5MB (40Mb) is enough to create 1e12626113 different files, that's a number with 12.5 million digits

For reference, the number of atoms in the visible universe is ~1e80 (1e78 to 1e82), you'd generate 1e12626033 images per atom (doesn't look any different does it? Well it's got 80 zeroes chopped off). For a second reference, assuming you're a standard-size hooman you have 1e14 cells tops (estimate vary, "An estimation of the number of cells in the human body"[0] gave 3.7e13).

So no, it's not possible. Even if you remove a few order of magnitudes to account for invalid jpegs, let's say we cut it by a thousand orders of magnitude it's still 1e12000 images to generate[1].

They're also all contained in PI. And the thought experiment is but a variant of the infinite monkeys theorem[2]

[0] http://informahealthcare.com/doi/abs/10.3109/03014460.2013.8...

[1] if you can compute full tilt until the heath death of the universe you have ~1e47 seconds, you'd need to compute 1e11953 images per second… or 1e11873 images per second per atom in the universe

[2] http://en.wikipedia.org/wiki/Infinite_monkey_theorem

Re:AIs are now re-writing history by ccvannorman on Tuesday October 07, 2014 @02:22PM (#8422939)
:-]

I thought of a similar thing for an mp3; a computer would produce every possible "song"..but even at an incredibly low resolution of 100 kilobytes for a 3 minute song, you're looking at 2^800,000 possibilities. (1e240000).

Another cool one is possible games of Go, ~1e768. This is one reason top computers still can't touch top humans at winning the game.

Big numbers are fun. :-]

Re:AIs are now re-writing history by dTal on Wednesday October 08, 2014 @08:45AM (#8426578)
I don't think the number of possible games has anything to do with the difficulty of programming computers to play Go. There are 10^120 possible games of chess, for instance - still 40 orders of magnitude larger than the number of protons in the observable universe - and yet computers roundly defeat humans at chess these days.
Re:AIs are now re-writing history by xnull on Tuesday October 07, 2014 @02:45PM (#8423098)
100% correct.

But what if we imagine/allow/invent the series of algorithms that 'pluck' a good picture of Usain Bolt from the set of 5MB files without inspecting too many (let's say O(log) or O(log log))?

That's only ~c25/~c5 bits of entropy to sort through, even less if the algorithm were to work in some sort of sparsity domain.

Re:AIs are now re-writing history by teddyh on Tuesday October 07, 2014 @03:00PM (#8423214)
You remind me of the space pirate Pugg, as encountered in the sixth sally of Trurl and Klapaucius as described in The Cyberiad by Stanisław Lem.

That is to say, however much you pre-sort your data, there will still be a virtual infinity of them still left, all abiding your pre-set conditions, but all still uninteresting.

Re:AIs are now re-writing history by xnull on Tuesday October 07, 2014 @03:08PM (#8423286)
Can't a human draw a picture of Usain Bolt in the Greek Olympics? Wouldn't such a criticism also apply to human art?
Re:AIs are now re-writing history by teddyh on Tuesday October 07, 2014 @03:16PM (#8423325)
I don’t understand you. The amount of human art, or indeed the possible maximum number possible of human artistic expressions (from the beginning of time until the end of the universe), is, I believe, far smaller than the pictures you would have left after your sorting filter.
Re:AIs are now re-writing history by xnull on Tuesday October 07, 2014 @03:58PM (#8423616)
I don't understand you either.

I don't know what you mean by a 'sorting filter', but what I'm talking about is an algorithm that takes >40Mb of data as input (pictures of Bolt and Athens for example) and uses this data to output ~40Mb of Bolt in Athens.

I mean human artists to be an analogy: humans can 'select' a picture of Athens Bolt without enumerating all others. I don't see why computers couldn't.

Re:AIs are now re-writing history by mikeash on Tuesday October 07, 2014 @03:52PM (#8423580)
xkcd has a good take on this: http://what-if.xkcd.com/34/

It's discussing tweet variations, which is a much smaller set than the set of valid 5MB JPEG files, but even then it's rather a lot.

Re:AIs are now re-writing history by IvyMike on Tuesday October 07, 2014 @01:33PM (#8422557)
You may be interested in Borges's short story The Library of Babel.

http://hyperdiscordia.crywalt.com/library_of_babel.html

""The Library of Babel" (Spanish: La biblioteca de Babel) is a short story by Argentine author and librarian Jorge Luis Borges (1899–1986), conceiving of a universe in the form of a vast library containing all possible 410-page books of a certain format." (from wikipedia)

Re:AIs are now re-writing history by HCIdivision17 on Tuesday October 07, 2014 @02:48PM (#8423119)
I immediately thought of the same thing. Personally, I like the idea of the Library of Babel more than, say, "all data is found in Pi". There's an important aspect to the story that really drives home the point, a hopelessness in the search as well as dealing with the nigh-incomprehensible scale. Well worth the read, as it brings the idea to a visceral level.

I'm at a loss for the story about indexing meaningfully the library, but I think I may have found a neat article on the Library: james.grimmelmann.net/files/Library.markdown

Re:AIs are now re-writing history by munificent on Tuesday October 07, 2014 @12:59PM (#8422305)
> Of course, sheer number of such images is ginormous, but for me it's interesting (and scary) that something like this will maybe be possible...

It will never be possible. A 5 MB JPEG has 5,368,709,120 bits, which means there are 2^5,368,709,120 different possible images. In scientific notation, it's 1.302... × 10^1,616,142,483.

For comparison, there are about 10^80 atoms in the entire universe.

Re:AIs are now re-writing history by mfringel on Tuesday October 07, 2014 @01:04PM (#8422337)
I suspect you can significantly cut down the space by limiting it to valid JPEG files.
Re:AIs are now re-writing history by tbirdz on Tuesday October 07, 2014 @01:19PM (#8422461)
You can cut it down but it still won't be feasible. Consider generating even just all possible 100x100 1-bit monochrome images. There will be 100 * 100 = 10000 bits per image, giving a total of 2^10000 possible images: about 1.995 * 10^3010 which is still way, way bigger than 10^80.

A 5MB JPEG image would have a much larger resolution and color pallete then this.

Re:AIs are now re-writing history by masklinn on Tuesday October 07, 2014 @01:23PM (#8422487)
A 5MB JPEG corresponds to 12~16MP@24bpp, although many of the images would compress to the same result.
Re:AIs are now re-writing history by Dylan16807 on Tuesday October 07, 2014 @01:34PM (#8422567)
The identifier for any particular 'generated' photo is equivalent to the photo itself.

In reality there is no generation at all. It's just a blank slate with every bit unknown.

It's a perceptual problem, human don't understand randomness well.

I don't blame you, it's a common mistake, but you're fundamentally wrong in calling it generation. Generation of everything is 100% equivalent to generation of nothing. Creation requires decision, is equivalent to decision.

Re:AIs are now re-writing history by Houshalter on Tuesday October 07, 2014 @05:06PM (#8424013)
Here is an interesting article on a business plan is to copyright every conceivable image and make money on the royalties:

http://torrentfreak.com/copyright-apocalypse-trolls-attack-t...

>“Qentis aims to produce all possible combinations of text (and later on images and sound) and to copyright them,” Qentis’ Michael Marcovici told TorrentFreak.

>“Concerning text we try this in chunks of 400 word articles in English, German and Spanish. That would mean that we will hold the copyright to any text produced from now on and that it becomes impossible for anyone to circumvent Qentis when writing a text.”

>In terms of graphics, Qentis promotional material states that a subsidiary has already generated 3.23% of “all possible images” in the 1000×800 pixel format.

>“We are now generating images at a much faster pace and expect to complete 10 percent of all possible images by the end of 2015. At current projections, we will by 2020 generate every possible image in the 1000×800 pixel resolution,” the company claims.

Re:AIs are now re-writing history by cesarbs on Tuesday October 07, 2014 @12:53PM (#8422265)
A group of classmates and I spend about a week obsessed with this idea once. It's also cool to think that among all those images you would have e.g. the whole history of the world from all possible perspectives.

I doubt it will ever be possible, though. Even for tiny, grayscale images the amount of images you'd have to generate is absolutely impractical, not to mention the effort to distinguish noise from actual pictures.

Re:AIs are now re-writing history by lifeformed on Wednesday October 08, 2014 @05:42AM (#8426072)
Not to mention that the whole thing would be illegal. It'd have child porn, state secrets, libel, copyrighted software, etc.
Re:AIs are now re-writing history by gatehouse on Tuesday October 07, 2014 @12:53PM (#8422266)
Or a computer generate all bytestrings and run them as executables. One of them would post this comment -- or maybe it is!
Re:AIs are now re-writing history by abemassry on Tuesday October 07, 2014 @01:28PM (#8422522)
Also had a similar thought experiment, went and built it. Thanks for the other commentors as well I should link to this HN page in the README.

https://github.com/abemassry/crazip

Re:AIs are now re-writing history by nobodysfool on Tuesday October 07, 2014 @03:33PM (#8423436)
Thanks for this. Have you considered using a GPU to speed up computations?
Re:AIs are now re-writing history by abemassry on Tuesday October 07, 2014 @04:14PM (#8423738)
I thought about it, but according to the other commentors here a project like this wouldn't make sense. I was learning python at the time and I wanted to learn about multithreaded programming in python.

I could turn it into a learning project with no practical applications. It would be a good platform to learn about OpenCL, and see if the benchmarking times improve.

Re:AIs are now re-writing history by nobodysfool on Wednesday October 08, 2014 @03:12PM (#8428850)
You're right, it is absolutely senseles. However, that doesn't mean you shouldn't take pride in your work.

Take a look at my Pythagorean cipher. It's idiotic and not practical, but it's just neat.

https://github.com/sp1d3rx/nonsense/blob/master/cipher.py