Re:Ask HN: What is new in Algorithms / Data Structures these...
by marginalia_nu on Thursday May 11, 2023 @02:46AM
(#35898611)
Well what do you know, they contradict the claim made above.
Re:Ask HN: What is new in Algorithms / Data Structures these...
by karpierz on Thursday May 11, 2023 @11:12AM
(#35903338)
Sorry, they've crawled trillions of pages, and narrowed it down to an index of 100s of billions. Conveniently, the link answers your question of "can you have PB sized indices?" to which we can clearly say, yes.
As far as I am aware Google doesn't publish any statistics about the size of its index, which no doubt varies.