News for hackers. Stuff that matters.
Re:Classifying all of the pdfs on the internet by moralestapia on Monday August 19, 2024 @09:49AM (#41291039)
Libgen size is ~33TB so, no, it's not "the largest corpus of PDFs online".

(Although you could argue libgen is not really "public" in the legal sense of the word, lol).

Disregarding that, the article is great!

(edit: why would someone downvote this, HN is becoming quite hostile lately)

Re:Classifying all of the pdfs on the internet by tecleandor on Monday August 19, 2024 @10:39AM (#41291454)
I think Libgen is ~100TB, and the full Anna's Archive is near a PB.

They all probably contain lots of duplicates but...

https://annas-archive.se/datasets

Re:Classifying all of the pdfs on the internet by matthewaveryusa on Monday August 19, 2024 @10:21AM (#41291289)
It's being down voted because your number is really off. Libgen's corpus is 100+ TB
Re:Classifying all of the pdfs on the internet by simonw on Monday August 19, 2024 @10:14AM (#41291222)
8TB - ~8,000GB - is more than 33GB.
Re:Classifying all of the pdfs on the internet by moralestapia on Monday August 19, 2024 @10:37AM (#41291440)
Whoops, typo!

But that's what the comments are for, not the downvotes.

Re:Classifying all of the pdfs on the internet by dotancohen on Monday August 19, 2024 @10:58AM (#41291614)
I upvoted this comment because, though the number is wrong, it proves the point. The fact that the correct number proves the point even more, is a reason _not_ to downvote the comment.
Re:Classifying all of the pdfs on the internet by mellosouls on Monday August 19, 2024 @10:22AM (#41291302)
I haven't downvoted you but it is presumably because of your hasty typing or lack of proofreading/research.

33TB (first google result from 5 years ago) not 33GB. Larger figures from more recently.

Re:Classifying all of the pdfs on the internet by moralestapia on Monday August 19, 2024 @10:40AM (#41291469)
>hasty typing or lack of proofreading/research

This is exactly what I meant with "HN is becoming quite hostile"

* I brought up something I looked up to support GP's argument.

* The argument is correct.

* I do it in good faith.

* G is literally next to T.

* I even praise the article, while at it.

"Oh, but you made a typo!".

Good luck, guys. I'm out.

PS. I will give my whole 7 figure net worth, no questions asked, transferred immediately to any account of their choice, to anyone here who has not ever made a typo in their life.

Re:Classifying all of the pdfs on the internet by dotancohen on Monday August 19, 2024 @11:00AM (#41291631)

  > I will give all my 7 figure net worth, no questions asked, transferred immediately to any account of their choice, to anyone here who has not ever made a typo in their life.
My greatest typo was saying "I Do" when it should have been "I Go".
Re:Classifying all of the pdfs on the internet by llm_trw on Monday August 19, 2024 @11:11AM (#41291719)
> I will give my whole 7 figure net worth

You sound deeply unpleasant to talk to.

Imaginary internet points are just that.

Re:Classifying all of the pdfs on the internet by ozr on Monday August 19, 2024 @10:59AM (#41291618)
Don't take it too personally. Downvoting/flagging it makes it clear to people who come across it in the future that it's wrong.
Re:Classifying all of the pdfs on the internet by mellosouls on Monday August 19, 2024 @12:38PM (#41292516)
Like I said, I didn't downvote and took the time to answer your question. I didn't take the time to sugarcoat it.

You are interpreting bluntness as hostility; that's ultimately an issue for you to resolve.

Re:Classifying all of the pdfs on the internet by moralestapia on Monday August 19, 2024 @03:01PM (#41293709)
You don't have to sugarcoat it.

You just have to read this site's guidelines and follow them.

Ez pz.

Re:Classifying all of the pdfs on the internet by mellosouls on Monday August 19, 2024 @04:06PM (#41294179)
Have been throughout. Anyway, I hope you are able to reconsider and move on within HN.
Re:Classifying all of the pdfs on the internet by samatman on Monday August 19, 2024 @05:31PM (#41294742)
> Please don't comment about the voting on comments. It never does any good, and it makes boring reading.

https://news.ycombinator.com/newsguidelines.html

Re:Classifying all of the pdfs on the internet by Kerb_ on Monday August 19, 2024 @02:10PM (#41293293)
I haven't ever made a typo, all of my mispelings are intended and therefore not mistakes
Re:Classifying all of the pdfs on the internet by zo1 on Tuesday August 20, 2024 @01:10AM (#41297015)
Some days it's worth it to burn some imaginary internet points for the good of the discussion and article. People downvote for various reasons, which we will never be able to figure out why definitely. Each person is different, and they all have days where they swing one way or another.
Re:Classifying all of the pdfs on the internet by reaperducer on Monday August 19, 2024 @11:12AM (#41291733)
(edit: why would someone downvote this, HN is becoming quite hostile lately)

Also, there are browser extensions that will automatically downvote and/or hide HN comments that use words like "lol," or start with "So..." or include any of a number of words that the user considers indicative of low-grade content.