News for hackers. Stuff that matters.
Re:Proxygen, Facebook's C++ HTTP Framework by dcsommer on Wednesday November 05, 2014 @06:46PM (#8564965)
The blog post goes into more detail, but Proxygen started with an effort to write a L7 reverse proxy that could deeply integrate into FB internal services. We pulled out a lot of the non-FB specific stuff into this open source release. Before that, we used hardware load balancers for this role, which was expensive.
Re:Proxygen, Facebook's C++ HTTP Framework by nbm on Wednesday November 05, 2014 @07:09PM (#8565065)
By expensive, not just capital costs, but costs around operating them - they weren't as reliably configurable, health-checkable, and instrumentable as we'd want, and Proxygen (and a later L4 load balancer) were.

Also the previous load balancers had constraints we weren't willing to accept - they required special connectivity to our networks, we could not use particular combinations of options, and we had to rely on vendors to solve problems that most of their customers were not encountering and/or able to detect.

Re:Proxygen, Facebook's C++ HTTP Framework by johnbellone on Thursday November 06, 2014 @08:02AM (#8566785)
Yeah, we are hitting the same wall right now and we've been going down the same route using HAProxy/Chef. Our plan is to put an API in front of it and treat it similar to an ELB. Are you still using hardware load balancers for SSL termination?
Re:Proxygen, Facebook's C++ HTTP Framework by nbm on Thursday November 06, 2014 @12:14PM (#8568098)
The machines running Proxygen do the TLS termination.
Re:Proxygen, Facebook's C++ HTTP Framework by cmbaus on Wednesday November 05, 2014 @07:25PM (#8565133)
That's interesting. I had been working something similar years ago. I eventually open sourced it, but discontinued work on it. Http://github.com/baus/swithflow

I'm surprised more systems don't take this approach of doing more work in L7 proxies.

Re:Proxygen, Facebook's C++ HTTP Framework by themonk on Thursday November 06, 2014 @06:25AM (#8566571)
Can you tell us motivation to build this instead of contorting to and using existing solutions such as Apache Traffic Server, squid, nginx or haproxy?
Re:Proxygen, Facebook's C++ HTTP Framework by johnbellone on Thursday November 06, 2014 @08:05AM (#8566795)
I am not a huge fan of NIH but more often than not it is simply easier in the long run to roll something in house that does the job. Although the debt that piles up tends to dwarf the original choice it is often still a better idea due to having employee churn. Its much easier to keep it within the standards of normal coding conventions.

I don't work at FB but near the bottom in the comments you can see that they build on existing C++ libraries that have been tried/tested. We do the [same thing][1] with smaller services simply because its easier in the SDLC process to move libraries that are already in-house.

[1]: https://github.com/bloomberg/bde/tree/master/groups/bsl

Re:Proxygen, Facebook's C++ HTTP Framework by e12e on Thursday November 06, 2014 @03:12AM (#8566198)
I'll have a look at the blog for more -- but this was something that couldn't be solved with haproxy and/or trafficserver?
Re:Proxygen, Facebook's C++ HTTP Framework by nbm on Thursday November 06, 2014 @02:07PM (#8569003)
haproxy only got TLS support in 2012, whereas work on proxygen began quite before that. In addition, haproxy does not support SPDY natively (although it can forward it to something that does).

Apache Traffic Server only got SPDY support in a release about 45 days ago according to their release notes.

There are many other relatively basic features besides those, and similar considerations exist for the other projects that existed back then (and even now).

Re:Proxygen, Facebook's C++ HTTP Framework by taha_jahangir on Friday November 07, 2014 @10:47AM (#8573000)
He ask the reason for `not contributing` to that projects, not `using` them.