News for hackers. Stuff that matters.
Re:Zed Shaw: "poll, epoll, science, and superpoll" with R by bdr on Tuesday August 03, 2010 @03:58PM (#1572539)
Read "on dial-up" as "slow". The argument depends only on there being a certain distribution of client speeds. It's not about dial-up in particular.
Re:Zed Shaw: "poll, epoll, science, and superpoll" with R by zedshaw on Tuesday August 03, 2010 @04:05PM (#1572564)
And, if there's a distribution of speeds then you can measure the distribution and see what works best. Again, my challenge still stands:

Measure it or STFU.

Re:Zed Shaw: "poll, epoll, science, and superpoll" with R by frio on Tuesday August 03, 2010 @07:57PM (#1573189)
You've already got a benchmarking system configured; why not benchmark using a congested (or at least, emulated) pipe?

It doesn't necessarily depend on dial-up, either. Imagine the number of people who leave bittorrent open in the background, stream porn, or whatever else that leaves their individual HTTP connections slow. Hell, latency alone (it takes at least a second for my connection to reach the east coast of the USA) would have an effect, and you can't underestimate the increasing number of mobile devices on slow(-ish, depending on congestion) 3G networks.

I'd provide statistics from my server (I serve an NZ gaming community), but I suspect my numbers would be disproportionate compared to the average workload. Here in NZ, we have far more people on crappy pipes (our DSL network is, famously, a gigantic pile of shit - although that has improved over the past couple of years and continues to), and far less people on smartphones (iPhones cost ~$800USD here).

Still, I believe the commenter has a point which you shouldn't ignore, or at least shouldn't pass off so easily :). I'd love to do some testing myself, but unfortunately between working a day-job, and spending my evenings trying to get a startup off the ground, I've got no time spare.

Re:Zed Shaw: "poll, epoll, science, and superpoll" with R by blasdel on Tuesday August 03, 2010 @06:05PM (#1572923)
How about you get measurements of ATR from real-world deployments instead of the wild conjectures you've laid in this thread? Your challenge applies even moreso to yourself:

Measure it or GTFO.

Re:Zed Shaw: "poll, epoll, science, and superpoll" with R by zedshaw on Tuesday August 03, 2010 @07:45PM (#1573160)
Oh, you mean do what I'm already doing? Measuring and developing ideas then testing them?

It helps if you're going to comment that you actually read the words I use, not the ones you have in your head that make you sound like you're super smart.

Re:Zed Shaw: "poll, epoll, science, and superpoll" with R by blasdel on Tuesday August 03, 2010 @08:18PM (#1573240)
Yes, you measured the ideal ATR inflection point for poll vs. epoll in your synthetic microbenchmark.

But you guessed wildly about what ATRs people see in the real world: http://news.ycombinator.com/item?id=1572292 http://news.ycombinator.com/item?id=1572418

Re:Zed Shaw: "poll, epoll, science, and superpoll" with R by zedshaw on Wednesday August 04, 2010 @11:14AM (#1574665)
Yeah, 'cause there's no way I'll be able to test a real web server that I actually wrote based on this small test. This is a small test to test one specific thing, doing more would confound the test. Confounding. Look it up.

Incidentally, this is the same test everyone else uses, so if you thought it was bullshit why did you support it when people testing epoll with it were using it? Oh, because they used it to confirm your bias rather than disagree with it.

Re:Zed Shaw: "poll, epoll, science, and superpoll" with R by tel on Wednesday August 04, 2010 @01:22PM (#1575075)
I think there's less disagreement about the well-controlled result derived and more about whether

   a) Your controls were right, and
   b) What the most optimal decision is in light of this new information.
(a) is well known to be one of the most difficult parts of scientific reasoning and is almost always open to endless debate and improvement. In short, it's the question of whether ATR is a human-sensible metric. (b) however has an interesting direct answer: figure out the distribution of "live" ATRs on an interesting population of real servers and then, to borrow Eliezer's phrase, shut up and multiply.

If a lot of servers that you're targeting with M2 fall across that 60% divide (under circumstances similar to your controlled microbenchmark) then of course Superpoll is a good compromise.

Jacques is arguing a combination of (a) and (b). Perhaps ATR is not a sufficient metric to understand all interesting server loads. Moreover, perhaps many interesting servers live at really low or high ATRs all the time and so Superpoll must gracefully degrade to either poll or epoll.

In any case, driving for empirical data is noble, but possessing data is never sufficient to whitewall all detractors. It's really nice to have strong empirical support for the breakeven point between the two (ie. the ratio of their constant time components) via your benchmark, but science isn't just statistics.

(edit: I'll also add that pushing the pipetest microbenchmark past where people are usually making hyperbolic claims is a pretty big deal and a good catch.)

Re:Zed Shaw: "poll, epoll, science, and superpoll" with R by adamtj on Wednesday August 04, 2010 @12:56PM (#1574990)
I think he was suggesting that you find the ATR on real-world production webservers, which has nothing to do with your test and would not confound it. Maybe in practice nobody sees an ATR > 30%, in which case your test, if correct, is irrelevant. What sort of loads produce an ATR > 60%? How common are they?

One problem with getting such numbers is that real world, the load is given, not the ATR, and the ATR for a given load may depend on implementation choices. Total connections is a function of server latency, and on a loaded system, latency can be a function of polling method. So switching methods may change your ATR.

On the other hand maybe ATR for a given load doesn't change significantly depending on implementation. Your test found what is best for a given ATR, but not necessarily for a given load, or how ATR depends on load for a given implementation. Depending on the results, you may want to add some hysteresis to superpoll.

Re:Zed Shaw: "poll, epoll, science, and superpoll" with R by rortian on Tuesday August 03, 2010 @05:53PM (#1572894)
If only you practiced what you preached. Imagine the amount of self-righteous bile that your servers wouldn't serve.
Re:Zed Shaw: "poll, epoll, science, and superpoll" with R by zedshaw on Tuesday August 03, 2010 @07:49PM (#1573175)
I am practicing what I preach, you stupid 20%-er troll. That's why the whole blog post is full of measurements, testing hypotheses, and the assumption that I might be wrong.

Because unlike you, I actually go do shit rather than spout off in a comment thread.

Re:Zed Shaw: "poll, epoll, science, and superpoll" with R by rortian on Tuesday August 03, 2010 @08:05PM (#1573211)
You may think you are. Far out. Why you think you can violate basic social norms, while others apparently support it, is beyond me.
Re:Zed Shaw: "poll, epoll, science, and superpoll" with R by zedshaw on Wednesday August 04, 2010 @11:18AM (#1574675)
Basic social norms also involve not saying ruthless comments you wouldn't say to my face.