News for hackers. Stuff that matters.
Re:Ask HN: What's next big thing in bandwidth? by geuis on Tuesday November 11, 2008 @01:36PM (#360769)
To go with this, we need to see a large drop in latency. I think the biggest obstacle will be overcoming the total write/read throughput and speed when placing data over the broader internet versus a local hard drive or SAN/NAS.
Re:Ask HN: What's next big thing in bandwidth? by drewp on Thursday November 13, 2008 @04:54AM (#362908)
I don't see how latency would be a big problem for file storage. Home user file reads and writes are very spatially coherent, right? Keep the first N bytes of each file in a local cache, and when the user starts to read a file, you're pre-buffered. Note that this is just a cache; the whole file is still reliably stored at the remote site.

Users probably use the same small subset of files over and over again, too, so you don't even need to keep the head of all the files to eliminate most latency effects.

Re:Ask HN: What's next big thing in bandwidth? by bprater on Tuesday November 11, 2008 @01:47PM (#360780)
There is one constant we can't beat -- the speed of light. Unless servers are physically closer to the people using them, latency will always be an issue.
Re:Ask HN: What's next big thing in bandwidth? by ObieJazz on Tuesday November 11, 2008 @01:52PM (#360791)
I don't think that is the bottleneck:

"If you were a beam of light, then your trip [around the world] would take only 1/10 of a second."

http://www.bigsiteofamazingfacts.com/how-long-does-it-take-t...

Re:Ask HN: What's next big thing in bandwidth? by orib on Tuesday November 11, 2008 @02:20PM (#360832)
100 ms is still a pretty big latency.

Add to that the slowdown of propagating in a fiber optic cable, and you've just increased the time to 150 ms.

So, for a server 1/4 of the way around the world, you're stuck with a minimum round trip time of 75 ms. This will be increased by switching times in repeaters, for example. And that's only for one data packet.

Re:Ask HN: What's next big thing in bandwidth? by pasbesoin on Tuesday November 11, 2008 @02:51PM (#360871)
> And that's only for one data packet.

A crucial point. A few years back, I had to deal with some rather "chatty" applications that were attempting to span filesets/databases located in both the U.S. and India. Latency on a single data exchange might be annoying; multiply that by hundreds or thousands of exchanges per each human-level interaction with the application, and said application ground to something that would make a "crawl" look high speed.

Partly the vendor's fault, for not accurately representing this situation. Partly the Company's fault for neither anticipating nor investigating it (nor listening to me when I advocated doing so); further, for attempting a non-standard deployment in an attempt to save a few bucks.

I guess I'll blame the vendor again for such an unnecessarily verbose and crap-laden application design. Anyway, the whole thing turned into one giant, festering pool of fail, that the users actively avoided when they could and loathed and sweated over when they couldn't. Eventually, turnover at the pointy haired boss level made it politically feasible to kill more and more of the pieces, and now some years later the Company has supposedly ponied up the money for a solution that actually works (well, the demos look/work better, and the basic design seems capable of allowing it to work).

When I think of the countless hours and frustration wasted on that doomed deployment.

So, anyway, watch your network latency, know your application design, and pay attention to the implications. When testing, test network performance, and inject latency, noise and the like to get a picture of what things will look like in the real world.

Sounds simple; nonetheless, this technologically relatively sophisticated company still managed to completely screw it up.