News for hackers. Stuff that matters.
Re:How a team of young people helped rebuild healthcare.gov by ChuckMcM on Monday July 13, 2015 @12:16AM (#9876354)
When Blekko was serving web traffic if it came from the primary index and was cached (a repeat request) it was served up in under a millisecond. I learned at Google to never under estimate what sort of performance you could get reading the result out of the memory of a nearby computer. 10,000 computers with 96GB each on them can easily keep 640TB of data ready to return very very quickly. Its even faster if you have your own zero copy TCP/IP layer (right from client memory into the network interface card).

For an example of scale, 10,000 nodes with 96GB each costs less than $30M dollars. The government spent billions on the healthcare.gov project.

There are no comments on this comment yet.