News for hackers. Stuff that matters.

A comment on We tasked Opus 4.6 using agent teams to build a C Compiler. Parent comment

Re:We tasked Opus 4.6 using agent teams to build a C Compiler by kgeist on Thursday February 05, 2026 @04:46PM (#46905828)
A lot of the internet is duplicate data, low quality content, SEO spam etc. I wouldn't be surprised if 1 TB is a significant portion of the high-quality, information-dense part of the internet.
[ Parent | on HN ]
Re:We tasked Opus 4.6 using agent teams to build a C Compiler by FeepingCreature on Thursday February 05, 2026 @04:53PM (#46905915)
I would be extremely surprised if it was that small.
[ Parent | on HN ]
Re:We tasked Opus 4.6 using agent teams to build a C Compiler by kaibee on Thursday February 05, 2026 @11:31PM (#46909143)
Well, a terabyte of text is... quite a lot of text.
[ Parent | on HN ]
Re:We tasked Opus 4.6 using agent teams to build a C Compiler by artisin on Friday February 06, 2026 @09:52AM (#46913536)
I was curious about the scale of 1TiB of text. According to WolframAlpha, it's roughly 1.1 trillion characters, which breaks down to 180.2 billion words, 360.5 million pages, or 16.2 billion lines. In terms of professional typing speed, that's about 3800 years of continuous work.

So post-deduplication, I think it's a fair assessment that a significant portion of high-quality text could fit within 1TiB. Tho 'high-quality' is a pretty squishy and subjective term.

[ Parent | on HN ]
Re:We tasked Opus 4.6 using agent teams to build a C Compiler by FeepingCreature on Monday February 09, 2026 @04:14AM (#46943278)
Yes, a million books is a reasonably big library.

But I would be surprised if the internet only filled a reasonably big library.

[ Parent | on HN ]