News for hackers. Stuff that matters.
Re:Web Framework Benchmarks Round 4 by nopal on Thursday May 02, 2013 @11:36AM (#5645179)
Any reason you didn't test ASP.NET MVC or ASP Web Forms?
Re:Web Framework Benchmarks Round 4 by apalmer on Thursday May 02, 2013 @04:04PM (#5646870)
ASP.Net kind of put themselves out of the benchmark game here:

Mono Issue #1, since the vast vast majority of ASP.Net websites run on windows a Mono performance test even if accurate is going to be of dubious value.

Mono Issue #2, since Mono is nowhere near as polished as the Microsoft .Net implementation the numbers wont really be meaningful.

Windows Issue #1, if you do the test on a different OS than every other test implementation, the results really wont be comparable in any fair way.

Microsoft Issue #1, dont know if it still holds now a days but in past official EULA for .Net prohibited publishing benchmark results. PERIOD.

I am a .net developer and as much as I like ASP.Net I dont think the effort of adding a .Net implementation really would pay off.

Re:Web Framework Benchmarks Round 4 by bsaul on Thursday May 02, 2013 @04:15PM (#5646930)
I completely understand your point, but I think it's fair to say that most .Net code will run on Windows server, and that pretty much everything else will run on some kind of linux flavor. Just like you have a "keep the default framework setting" approach to help compare very different frameworks because that's how the majority of people will use them, you may very well assume that comparing frameworks on their preferred OS is fair enough.

I know that i wouldn't mind switching to a windows+.Net environment if it proved to be much much faster than what i'm using right now.

Re:Web Framework Benchmarks Round 4 by DennisP on Thursday May 02, 2013 @10:10PM (#5648442)
Exactly, and if there is such a performance boost, having the numbers would help you figure out whether hardware savings would be worth the licensing cost.
Re:Web Framework Benchmarks Round 4 by voidlogic on Thursday May 02, 2013 @05:53PM (#5647421)
Care to backup your Mono claims with evidence?

I have a friend who went to a Mono talk at MS MIX where a Mono developer was speaking. The Mono developer said that while Mono is a little slower than .NET (and he was talking a couple percent) Mono often ends up being faster on the same hardware because the Linux system calls the runtime uses are faster. There were a few ROFLs in the audience.

I also agree with you that investing in a .NET (Windows) test isn't good bang for the buck here.

Re:Web Framework Benchmarks Round 4 by apalmer on Thursday May 02, 2013 @06:16PM (#5647532)
I don't know that mono is guaranteed to be slower or not, but definitely a lot fewer man hours have gone into polishing mono as compared to the amount of effort spent to polish the .net framework on windows.

Further, even if Mono itself is as fast as the .net framework, IIS the web server is going to be totally different performance characteristics from whatever webserver you are using on linux.

I am glad you showed me the error of my ways because I would have guess .net was somewhat faster than mono, but it goes to show even more comparing across operating systems is meaningless...

now i would love to get my hands on the numbers dont get me wrong, just saying if i was running the project I wouldnt go through the amount of effort required to get the .net results.

Re:Web Framework Benchmarks Round 4 by pfalls on Thursday May 02, 2013 @11:46AM (#5645243)
We would like to have a .NET test running on mono. We were hoping to get a pull request for round 4, but unfortunately we have yet to receive one.
Re:Web Framework Benchmarks Round 4 by JulienSchmidt on Thursday May 02, 2013 @11:39AM (#5645193)
Maybe because the server is not running Windows?

Edit: yeah right Mono and w/e

Re:Web Framework Benchmarks Round 4 by cmircea on Thursday May 02, 2013 @11:42AM (#5645218)
Would it be too much to ask to also run a Windows VM? Or use Mono?
Re:Web Framework Benchmarks Round 4 by platz on Thursday May 02, 2013 @11:52AM (#5645283)
http://www.techempower.com/benchmarks/#section=motivation

"As with the previous question, we'd love to. We have heard tentative word from a reader/contributor that a pull request may be incoming soon that will include several .NET frameworks on Mono, which we assume will be as easy to include as any other pull request. One challenge we face is that the test infrastructure we've built assumes a Linux deployment that we can automate using ssh and Python. To do a proper .NET test on Windows Servers, we will need to work on adapting that platform to automate Windows Servers as well. Community assistance on this would be greatly appreciated."

Re:Web Framework Benchmarks Round 4 by iknight on Thursday May 02, 2013 @02:30PM (#5646313)
Can you share who the Mono contributor is?
Re:Web Framework Benchmarks Round 4 by bhauer on Thursday May 02, 2013 @10:15PM (#5648461)
Sure. We now have two pending issues, one of which is a pull request. If you can weigh in and perhaps contribute some review time to the PR in particular, that would be very appreciated!

https://github.com/TechEmpower/FrameworkBenchmarks/pull/239

https://github.com/TechEmpower/FrameworkBenchmarks/issues/15...

Re:Web Framework Benchmarks Round 4 by voidlogic on Thursday May 02, 2013 @11:57AM (#5645328)
Linux amd64 is the dominate internet serving platform; supporting a non-free OS for the benefit of a single test entry seems dumb. I'm all for a Mono entry however.
Re:Web Framework Benchmarks Round 4 by diroussel on Thursday May 02, 2013 @12:30PM (#5645550)
I don't think it seems dumb. It would be a very useful comparison between platforms. Stackoverlfow runs on .Net and Windows servers and they say it's very performant. So why not compare with other frameworks on the same hardware.
Re:Web Framework Benchmarks Round 4 by bhauer on Thursday May 02, 2013 @01:13PM (#5645843)
Voidlogic is right that we are waiting to get a pull request that will include some .Net frameworks [1]. If you can help, it would be greatly appreciated. We do want to include .Net. We will test on Mono to start.

We also want to test on .Net's native Windows platform. But we need to work on the testing platform we've built in order to automate a Windows server in the same way we presently automate a Linux server.

[1] https://github.com/TechEmpower/FrameworkBenchmarks/issues/15...

Re:Web Framework Benchmarks Round 4 by egeozcan on Thursday May 02, 2013 @04:48PM (#5647138)
Nancy[1] comes to mind.

[1]: http://nancyfx.org/

Re:Web Framework Benchmarks Round 4 by bhauer on Thursday May 02, 2013 @10:17PM (#5648470)
I like the looks of that! Could I convince you to put together a test as a pull request? :)
Re:Web Framework Benchmarks Round 4 by egeozcan on Friday May 03, 2013 @05:23AM (#5649473)
I can't promise to deliver but I'll sure look into it this weekend =)
Re:Web Framework Benchmarks Round 4 by cmircea on Thursday May 02, 2013 @03:53PM (#5646772)
Linux may be the dominant platform, but that doesn't mean Windows doesn't have a very significant share either: http://w3techs.com/technologies/overview/operating_system/al...
Re:Web Framework Benchmarks Round 4 by AndrewGaspar on Thursday May 02, 2013 @11:40AM (#5645201)
I had the same thought. ASP.NET MVC and Web Forms are both very popular frameworks, and they're free to develop for. Might be harder to set up on a non-Windows machine, which could be why they were not tested.
Re:Web Framework Benchmarks Round 4 by voidlogic on Thursday May 02, 2013 @11:59AM (#5645338)
They were not tested because no one has submitted a pull request for them.