The naming of the txt files is of mixed to good usefulness for you. First ten listed as example.

    - 0/0.4 - Mike Lancaster.epub.txt
    - 0/0.721 - Gary Webster.epub.txt
    - 0/01 - Alec Dunn.epub.txt
    - 0/01 Kai_ Ninja Of Fire (Scholastic) - Greg Farshtey (retail).epub.txt
    - 0/02 Crescendo -  Becca Fitzpatrick.epub.txt
    - 0/03 Cole_ Ninja Of Earth (Scholastic) - Greg Farshtey (retail).epub.txt
    - 0/03 - Jean-Christophe Valtat.epub.txt
    - 0/04. R. W. Peake - Antony and Cleopatra Part I Antony (Marching With Caesar, Book 4) [Retail].epub.txt
    - 0/05. R. W. Peake - Antony and Cleopatra Part II Cleopatra (Marching With Caesar, Book 5) [Retail].epub.txt
    - 0/05 LEGO Ninjago - Snake Attack! (Scholastic) - Tracey West (retail).epub.txt

Apologies, I had included the wrong corpus originally, the correct list is this one.

Second edit - Books3 is much cleaner than Books1, I am editing my negative opinion to a more positive one to reflect that.

The dmca.mp4 file is a video of performance art in which about eight women in fancy dresses chant while vigorously mimicking male masturbation. I didn't watch to the end, but the activity appears to go on for a full ten minutes, and I bet there's a suitable finale.

Presumably this is a "fuck you" to the DMCA law.

EDIT: there is unfortunately no "suitable finale."

Hello! I made the books3 dataset. I am delighted to hear that this might be useful for your personal use.

I spent four or five days intensely working on the script to convert an .epub to .txt. It's a surprisingly hard problem, so I tried to be correct in every detail. It was important to me that an AI learn the way humans learn.

Therefore, yes, I have found that these books are quite readable. However there are some unique challenges due to the nature of it being .txt, which I would love to help you navigate.

Firstly, the top and the bottom of each file is usually "repetitive". By that I mean, there tends to be a lot of metadata that might be hard to skip.

However, the neat thing is, these aren't actually .txt files -- it's Markdown. And we can take advantage of the markdown format to help you out.

Here is a direct link to "A Mathematician's Apology": https://gist.githubusercontent.com/shawwn/1b399325e866731165...

I like this file as an example, because it illustrates both problems that will be challenging for you. Firstly, the book itself doesn't begin until halfway down the file. There is a ridiculously long "forward" section, written by someone else. Normally this would be easy to skip.

The cheat code I use to read this book is to search for "# 1". Double quote, followed by pound sign (or "hashtag" as the kids say nowadays, ha), followed by a space, then the number one.

That brings you straight to chapter one.

However, not all books use that format for chapter one. So I would recommend searching for a regex, if you can: "beginning of line" followed by pound sign.

That'll usually do the trick. And yes, I find all of these to be quite readable, which I was proud of.

The code is courtesy of Aaron Swartz, by the way. I merely refined it. I am so proud of him for what he was able to achieve during his lifetime. This is "html-to-text" with some modifications.

If you want to convert .epub files to .txt for your own use, the script is here: https://github.com/shawwn/scrap/blob/master/epub2txt-all

It has a rather cryptic name of "epub2txt-all". Sorry about that. But the script itself should be just a matter of running it.

Here are some notes on what I did with this script, in case you find it helpful: https://github.com/soskek/bookcorpus/issues/27

Happy reading! Please let me know any other questions you might have.

By the way, dmca.mp4 is a joke video. Sort of. It's a good question of what is actually going on there. As far as I can tell, it's a dozen professionals who have gathered together to simulate jacking themselves off while singing "ahhhhhhHHhhH" for ten minutes. I don't really know anything beyond that, but the-eye.eu community seems rather proud of it.

I'm gonna take you at your word on blindness and help out here. There are a small assembly women in a semi-circle on stage, singing with stearn and serious faces what is an aria like song piece, all while vigorously gesturing what can universally be described male masterbation. The camera pans into their faces, and back out to reveal the small group of women to be a chorus of fapping.

No need to take me on my word, Googling my username / full name will lead you to a pretty long, detailed and hart to forge online history.

> what's in that dmca.mp4 file? All I hear is music.

I wish you could see it, here's a basic description.

It begins with a close up of a person singing while performing a gesture of masturbation then zooms out to three people signing and then a full group of around 10 people. It's basically telling whoever is trying to DMCA to jerk themselves off.

The filenames are readable and informative. The dmca.mp4 is a 10 minute video of a group of women standing in a half-circle, singing and doing "spank the monkey" gestures.

I’m downloading it right now, I’ll try to come back and let you know what it looks like.

Also the dmca.mp4 is a video of like 5 or 10 people singing into microphones while pretending to jack off