News for hackers. Stuff that matters.
Re:Load Test Rails4 app ruby 2.1 MRI Vs Rubinius 2.0 by jacques_chester on Wednesday October 09, 2013 @09:43AM (#6521161)
Reliable benchmarking is hard. There are actual journals about measuring computer system performance.

Some questions:

* How is startup time controlled for?

* Why only one run?

* Why so few requests?

* Why no warmup period?

* Why this particular configuration?

* What is the OS, hardware configuration?

* Why is it running in a development environment instead of a test or prod environment?

Re:Load Test Rails4 app ruby 2.1 MRI Vs Rubinius 2.0 by ebonfortress on Wednesday October 09, 2013 @10:36AM (#6521469)
I would really like to see some articles about proper benchmarking procedures at 1000+ requests per second. Are there any?
Re:Load Test Rails4 app ruby 2.1 MRI Vs Rubinius 2.0 by jacques_chester on Wednesday October 09, 2013 @10:42AM (#6521503)
The ACM's SIGMETRICS[1] are the main group publishing this kind of research. Some of it gets very specialised -- just picking a title from the most recent Performance Evaluation Review[2], I get "YOUQMON: a system for on-line monitoring of YouTube QoE in operational 3G networks".

However, being the ACM, it's basically inaccessible unless you sell a kidney.

An organisation with a slightly more industrial focus is the Computer Measurement Group[3]. Like the ACM ... bring money.

[1] http://www.sigmetrics.org/

[2] http://dl.acm.org/citation.cfm?id=2518025&CFID=252561427&CFT...

[3] http://www.cmg.org/

Re:Load Test Rails4 app ruby 2.1 MRI Vs Rubinius 2.0 by look_lookatme on Wednesday October 09, 2013 @11:14AM (#6521720)
Sorry to go off-topic, but does anyone know if it's possible to get your hands on these pubs/journals for free at the Science, Industry and Business Library [1] in NYC?

[1] http://www.nypl.org/locations/sibl

Re:Load Test Rails4 app ruby 2.1 MRI Vs Rubinius 2.0 by resca79 on Wednesday October 09, 2013 @09:47AM (#6521179)
Prod. The app is a very simple rails4 standard app

iMac Intel Core 2 Duo 3,06 GHz cpu 1

Re:Load Test Rails4 app ruby 2.1 MRI Vs Rubinius 2.0 by jacques_chester on Wednesday October 09, 2013 @09:59AM (#6521237)

    => Rails 4.0.0 application starting in development on http://0.0.0.0:3000
Re:Load Test Rails4 app ruby 2.1 MRI Vs Rubinius 2.0 by resca79 on Wednesday October 09, 2013 @10:01AM (#6521246)
.... update the gits .. thanks!