News for hackers. Stuff that matters.
Re:BBC iPlayer serves nearly 1000 requests per second with C... by SwellJoe on Friday April 17, 2009 @03:39AM (#566514)
Since someone suggested in the YouPorn job thread that YouPorn might be the largest Catalyst, Django, or RoR site in the world, I figured this one might also be interesting.
Re:BBC iPlayer serves nearly 1000 requests per second with C... by reggplant on Friday April 17, 2009 @08:31AM (#566775)
These stats are taken before the busiest period for the iPlayer (over Christmas) so I imagine they doubled the statistics for christmas day.

The BBC also created their own framework which they named Perl on Rails to adapt between Ruby on Rails which is used for their internal web apps and the perl code base of the main site. http://www.bbc.co.uk/blogs/radiolabs/2007/11/perl_on_rails.s...

Re:BBC iPlayer serves nearly 1000 requests per second with C... by amix on Friday April 17, 2009 @05:18AM (#566574)
Serving global content is easy to scale, since it's very easy to cache and easy to distribute across a cluster of computers. The real challenge comes when you have to serve and generate different content for different users and you can't use a global cache.

It sounds to me that they are serving global content - - and doing this, 1000 req. pr. sec is not that impressive and almost any framework tied to memcached could do this - - or even better, setup nginx to use the memcached module.

Re:BBC iPlayer serves nearly 1000 requests per second with C... by SwellJoe on Friday April 17, 2009 @05:25AM (#566580)
I don't think anybody is suggesting it's a miracle, or only possible with Catalyst. Just an interesting story of scaling a dynamic site using off-the-shelf Open Source components.
Re:BBC iPlayer serves nearly 1000 requests per second with C... by amix on Friday April 17, 2009 @05:41AM (#566599)
You could do this kind of serving in Ruby on Rails, Django or any other framework. Nothing really interesting, other than it's Catalyst - which for me does not make this any more interesting - - especially also since they use memcached caching to take down the load.
Re:BBC iPlayer serves nearly 1000 requests per second with C... by wenbert on Friday April 17, 2009 @06:03AM (#566614)
> "Our database is flattened, denormalised and heavily indexed to make sql queries as quick as possible"

very interesting quote. at least for me.

Re:BBC iPlayer serves nearly 1000 requests per second with C... by wallflower on Friday April 17, 2009 @09:33AM (#566864)
I wonder if its a true STAR schema (not that they are doing data warehouse-type queries, just curious)
Re:BBC iPlayer serves nearly 1000 requests per second with C... by DavidMcLaughlin on Friday April 17, 2009 @05:21AM (#566578)
> Apache2.2/OOperl/Catalyst/memcached

What is OOperl?

Re:BBC iPlayer serves nearly 1000 requests per second with C... by SwellJoe on Friday April 17, 2009 @05:30AM (#566586)
I'm not certain, but I think it's their way of saying, "We don't have any of that crufty Perl you used to see on those awful 'hotscripts' type sites. We only use the good stuff around here."

Because Perl is a multi-paradigm language (supporting OO, functional, and procedural, and most Perlmongers use a little of all three in any given program), some folks consider it worth mentioning it when the paradigm they use most is OO. I'm a little suspicious when I see explicit mention of OO Perl, as I have to wonder if that means I couldn't use functional Perl idioms (which are often quite nice) if I worked in their shop.

Re:BBC iPlayer serves nearly 1000 requests per second with C... by DavidMcLaughlin on Friday April 17, 2009 @05:50AM (#566606)
Ah, right. I picked up the OO part from them using Catalyst, so I thought mentioning it as part of their stack meant they used something other than mod_perl.
Re:BBC iPlayer serves nearly 1000 requests per second with C... by rjurney on Friday April 17, 2009 @10:53AM (#567026)
Most Catalyst deployments are on FastCGI nowadays. Its nice that Catalyst doesn't much care how you deploy it: built-in test server/CGI/mod_perl/FastCGI all 'just work.'
Re:BBC iPlayer serves nearly 1000 requests per second with C... by aoeu on Friday April 17, 2009 @06:56AM (#566654)
Re:BBC iPlayer serves nearly 1000 requests per second with C... by ivankirigin on Friday April 17, 2009 @08:29AM (#566774)
Here is a talk by Cory Doctorow mentioning why the DRM in the BBC iPlayer is retarded: http://www.boingboing.net/2009/04/15/my-drm-and-ebooks-ta.ht...