Re:Protocol Buffers, Avro, Thrift & MessagePack
by sigil on Monday August 01, 2011 @08:20PM
(#2835136)
> Protobuf's python performance was abysmal — over 10x worse than Thrift.
This is still true of the official implementation from Google, which is pure Python. That's why I wrote the Python half of lwpb [1], and why the Greplin guys wrote fast-python-pb [2]. Both are about 10x faster than the Google Python implementation, so I'd guess on par with Thrift now.
[1] https://github.com/acg/lwpb
[2] https://github.com/Greplin/fast-python-pb/tree/master/benchm...
Re:Protocol Buffers, Avro, Thrift & MessagePack
by thadeus_venture on Monday August 01, 2011 @10:19PM
(#2835421)
Does anyone by any chance know if there is a version of the riak python driver that does not use google's protobuf implementation? I'm looking into using riak and hearing this does not exactly instill confidence, as riak uses google's protobuf implementation and http as its two communication protocols.
Re:Protocol Buffers, Avro, Thrift & MessagePack
by grncdr on Tuesday August 02, 2011 @03:20AM
(#2836194)
Take this for what it is (anectdotal evidence) but I found that write performance with python+riak was abysmal, while read performance wasn't as bad.
Unfortunately I didn't have time to hack the riak driver to use a non-google protocol buffer implementation before my deadlines, but it should be do-able.
Conversely, we chose Thrift over protobuf for this reason. Protobuf's python performance was abysmal — over 10x worse than Thrift.