News for hackers. Stuff that matters.

Ask YC: What do you use to stress test your app/db?

I am particularly interested in making database read/write requests through the web app.

My app is in Python(Pylons), the datastore is an ODBMS based on ZopeDB, server and client(me) are running Linux.

( 21 comments | 20 points | on HN )
Re:Ask YC: What do you use to stress test your app/db? by dmharrison on Sunday March 16, 2008 @05:57PM (#138454)
The grinder http://grinder.sourceforge.net/ (write your scripts in jython) for unit and nightly runs and for large scale testing on partners hardware HP (formerly mercury) Load Runner https://h10078.www1.hp.com/cda/hpms/display/main/hpms_conten...
Re:Ask YC: What do you use to stress test your app/db? by nickb on Sunday March 16, 2008 @10:19PM (#138608)
How much does Load Runner cost? Thousands of $$?
Re:Ask YC: What do you use to stress test your app/db? by dmharrison on Monday March 17, 2008 @03:28AM (#138767)
Yep, ridiculously expensive, grinder is good enough. In the enterprisey space where my day job is, load runner has a certain reputation (despite whether it deserves it or not). We found with the open source or cheaper tools (IBM rational tools included) under really high loads logging, measurements and the tools themselves got flaky. When you've got extremely limited time and hard deadlines in a hardware lab, time is the most precious commodity, so the cost can be worth it.
Re:Ask YC: What do you use to stress test your app/db? by epi0Bauqu on Sunday March 16, 2008 @10:44AM (#138178)
ab is a quick and dirty way: http://httpd.apache.org/docs/2.0/programs/ab.html

You can send it particular URLs that do your desired DB read/write requests.

For more in depth testing, I've heard HttpUnit is good (http://httpunit.sourceforge.net/), though I don't have much experience with it.

Re:Ask YC: What do you use to stress test your app/db? by kashif on Sunday March 16, 2008 @12:41PM (#138238)
I am using Pythonpaste's webserver - does this only work on apache? httpunit looks interesting...
Re:Ask YC: What do you use to stress test your app/db? by inklesspen on Sunday March 16, 2008 @12:51PM (#138242)
No, it's just HTTP. It just happens to come with apache, that's all.
Re:Ask YC: What do you use to stress test your app/db? by epi0Bauqu on Sunday March 16, 2008 @12:57PM (#138245)
Right. Here's a simple example:

ab -n 10000 -c 25 http://your.com/your.py

10000 hits, with 25 concurrent requests. You can keep cranking up -c n and see what happens. This is also useful for testing your network capability, e.g. simultaneous connections, from a fast remote network.

Re:Ask YC: What do you use to stress test your app/db? by kashif on Sunday March 16, 2008 @01:47PM (#138268)
Thanks, I am using Siege which does this and a bit.. If i am going to learn anything new then httpunit it is.
Re:Ask YC: What do you use to stress test your app/db? by ericb on Sunday March 16, 2008 @04:10PM (#138370)
I'm working on a hosted load testing solution for this type of problem. Specifically, it will let you run full transactions against a web front-end. You record a script with your web browser and then upload it, and run a mass of virtual users executing those steps.

If you want an update when it's ready, shoot me an email. On gmail, I'm ebeland.

Re:Ask YC: What do you use to stress test your app/db? by dedalus on Sunday March 16, 2008 @12:01PM (#138221)
Re:Ask YC: What do you use to stress test your app/db? by kashif on Sunday March 16, 2008 @01:57PM (#138281)
Autobengh is a wrapper around httpperf.
Re:Ask YC: What do you use to stress test your app/db? by god on Sunday March 16, 2008 @01:59PM (#138285)
I let the masses use it an see, which scripts and queries use the most resources.
Re:Ask YC: What do you use to stress test your app/db? by staunch on Sunday March 16, 2008 @03:45PM (#138349)
I use ab for simple things and siege for more involved benchmarking. I write my own functionality tests in Perl with WWW::Mechanize for monitoring.
Re:Ask YC: What do you use to stress test your app/db? by henning on Sunday March 16, 2008 @04:30PM (#138386)
JMeter. I have an ant task that does it automatically.
Re:Ask YC: What do you use to stress test your app/db? by sfalbo on Sunday March 16, 2008 @10:30PM (#138616)
I like JMeter too. I've just started using it and I've been very happy with it.
Re:Ask YC: What do you use to stress test your app/db? by axod on Monday March 17, 2008 @11:18AM (#138949)
Throw it up and wait for the email complaints from customers :)
Re:Ask YC: What do you use to stress test your app/db? by wlievens on Monday March 17, 2008 @12:05PM (#138983)
This actually works in many cases.
Re:Ask YC: What do you use to stress test your app/db? by nonrecursive on Sunday March 16, 2008 @11:01AM (#138188)
httperf, ftp://ftp.hpl.hp.com/pub/httperf/httperf-0.9.0.tar.gz
Re:Ask YC: What do you use to stress test your app/db? by gordonguthrie on Sunday March 16, 2008 @06:00PM (#138458)
Tsung (http://tsung.erlang-projects.org/) - an Erlang-based performance testing tool.
Re:Ask YC: What do you use to stress test your app/db? by omarish on Sunday March 16, 2008 @02:31PM (#138303)
siege
Re:Ask YC: What do you use to stress test your app/db? by christefano on Monday March 17, 2008 @12:06AM (#138660)
Apache JMeter and ApacheBench.