News for hackers. Stuff that matters.
Re:Applebot by londons_explore on Tuesday September 01, 2020 @12:12AM (#24338491)
An index of enough of the web to keep 90% of users happy can be built for ~$10k of storage.

The last 10% quickly gets very expensive tho.

Re:Applebot by sneak on Tuesday September 01, 2020 @02:00AM (#24338975)
Hard drives are cheap enough that storing the index itself is the least expensive part of building it. Engineer time to make that index usable for a search engine is that much money every week.