Re:Go vs. Python for a simple web server
by DocSavage on Wednesday June 22, 2011 @09:32AM
(#2682996)
While this article discusses some pros/cons of Go for implementing a web server, I'm surprised there's absolutely no mention of how fast his working (?) server runs or the memory footprint relative to python.
Re:Go vs. Python for a simple web server
by briancurtin on Wednesday June 22, 2011 @09:38AM
(#2683020)
When I read "In addition, threading in Python performs poorly due to GIL." and then just leaving it at that, I wasn't expecting any sort of performance or resource usage investigation.
Re:Go vs. Python for a simple web server
by alec on Wednesday June 22, 2011 @09:46AM
(#2683053)
When I read "I would seriously consider using Go for writing server side of web applications as it provides a right balance between speed and memory efficiency of the running code", I was expecting at least some number to back it up.
Re:Go vs. Python for a simple web server
by sc68cal on Wednesday June 22, 2011 @11:37AM
(#2683586)
Agreed. If we want to nitpick further regarding the GIL - Python boosters could state that the GIL is just a implementation detail of cPython that is not a problem in other implementations, like Jython or IronPython.
Re:Go vs. Python for a simple web server
by kjksf on Wednesday June 22, 2011 @02:19PM
(#2684391)
It's a fair point. However, when I did that port, almost a year ago, I did it to understand how Go compares to Python in terms of writing the code. The result was fast enough, I didn't bother benchmarking.
Plus, whatever the results were then, Go's compiler and runtime has improved in the past year, so the data would no longer be indicative of current performance. And the compiler is still being improved.
Re:Go vs. Python for a simple web server
by St-Clock on Wednesday June 22, 2011 @09:54AM
(#2683084)
"Overall, the experience was positive and I would seriously consider using Go for writing server side of web applications as it provides a right balance between speed and memory efficiency of the running code (much closer to C than to e.g. Python) and speed of development (much closer to Python than to C)."
It seems these days that there is a confusion between the web server (often a reverse-proxy), the web application and the thing in the middle (gateway/pipe/container/app server). While I would certainly consider Go for the implementation of a reverse-proxy or an app server, it isn't clear that Go is a good choice for the web application itself, especially when you consider that most of the time is spent in the DB and in the cache...
Anway, the article mostly talked about Go and not about Python...
Re:Go vs. Python for a simple web server
by justincormack on Wednesday June 22, 2011 @10:21AM
(#2683213)
That confusion is because there are a lot more options now, what with there being embedded (performant) HTTP libraries so you can run your stack without a separate server, or you can embed user code into a traditional server, or many other combinations. Async stacks do not a bit in the middle. And some NoSQL databases like Couch can embed the web server and middle parts of the code.
Go has an interesting combination of lightweight threading and a high quality performant HTTP server, so potentially it is good for implementing the http serving and application layers.
Re:Go vs. Python for a simple web server
by uriel on Wednesday June 22, 2011 @12:01PM
(#2683717)
If you are using the 32bit compilers, there were issues with the garbage collector for a while, in any case you should always use the 6g 64bit compilers for any serious work, they are much better tested and generate more efficient output.
Other than the issue with the 32bit compilers, I don't remember hearing of any leaks in Go.
Re:Go vs. Python for a simple web server
by otterley on Wednesday June 22, 2011 @01:08PM
(#2684048)
"efficient Python web servers (like Tornado) use event driven way of handling HTTP requests. The downside of that is that there can only be one HTTP handler function executed at a time. If that function takes a lot of time, it blocks all other requests."
This statement needs clarity. If the handler is CPU-intensive, the design of the server (threaded vs. AIO) is irrelevant. Both will perform equally, the only difference being that on an SMP system, the OS could schedule the thread on a different processor. This is why the typical deployment model for AIO servers is to start one server per processor and route incoming requests to a proxy to balance the requests among the available servers.
On the other hand, if the handler is dependent on slow network services (e.g. database or downstream API service), the AIO-based server will easily be able to handle additional incoming requests while waiting for the other tasks to complete, subject to memory. This is the power of non-blocking I/O function calls.
Re:Go vs. Python for a simple web server
by nitrogen on Wednesday June 22, 2011 @03:04PM
(#2684587)
the only difference being that on an SMP system, the OS could schedule the thread on a different processor.
There's a bit more to it than that. The OS will frequently block and preempt the long-running thread even on a single CPU system, allowing other, shorter requests to be processed in the mean time.
Re:Go vs. Python for a simple web server
by otterley on Wednesday June 22, 2011 @07:36PM
(#2685897)
I'm assuming for this example that every request has equal CPU impact. Preempting the running thread in this case won't improve overall request throughput on a single-CPU system. Adding concurrency here will simply increase response latency.
Re:Go vs. Python for a simple web server
by blub on Wednesday June 22, 2011 @10:10AM
(#2683160)
If you're looking for something useful, I am afraid that you are looking in the wrong place. Similarly to the last post by the same author, this is just an anecdote.
Re:Go vs. Python for a simple web server
by deadwisdom on Thursday June 23, 2011 @12:55AM
(#2686721)
Should say that it compared Go vs. Tornado. His only real problem with Python was concurrency which could be handled much better with Eventlet or Gevent. This will also drastically cut down the line count of the source.
Plus, whatever the results were then, Go's compiler and runtime has improved in the past year, so the data would no longer be indicative of current performance. And the compiler is still being improved.
Yet another example of where I'd love to see some numbers.
It seems these days that there is a confusion between the web server (often a reverse-proxy), the web application and the thing in the middle (gateway/pipe/container/app server). While I would certainly consider Go for the implementation of a reverse-proxy or an app server, it isn't clear that Go is a good choice for the web application itself, especially when you consider that most of the time is spent in the DB and in the cache...
Anway, the article mostly talked about Go and not about Python...
Go has an interesting combination of lightweight threading and a high quality performant HTTP server, so potentially it is good for implementing the http serving and application layers.
Last time I created a simple web service with Go it leaked like a hell.
Other than the issue with the 32bit compilers, I don't remember hearing of any leaks in Go.
This statement needs clarity. If the handler is CPU-intensive, the design of the server (threaded vs. AIO) is irrelevant. Both will perform equally, the only difference being that on an SMP system, the OS could schedule the thread on a different processor. This is why the typical deployment model for AIO servers is to start one server per processor and route incoming requests to a proxy to balance the requests among the available servers.
On the other hand, if the handler is dependent on slow network services (e.g. database or downstream API service), the AIO-based server will easily be able to handle additional incoming requests while waiting for the other tasks to complete, subject to memory. This is the power of non-blocking I/O function calls.
There's a bit more to it than that. The OS will frequently block and preempt the long-running thread even on a single CPU system, allowing other, shorter requests to be processed in the mean time.