Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Uber's technology is reportedly 'hanging by a thread'. Parent comment
But sharding comes at the cost of complexity.
I work on an uber-like service and we use crude sharding between countries.
The problem is:
* sometimes your sharding is too coarse - eg. two cities which have no cross traffic
* sometimes your sharding is too fine - eg. cross border traffic
But the real complexity is;
* managing configuration and logic differences between countries and cities
* hosting so many different sharded clusters, routing between them, and keeping them all updated.
And that's where all the work goes.
There are no comments on this comment yet.
But sharding comes at the cost of complexity.
I work on an uber-like service and we use crude sharding between countries.
The problem is:
* sometimes your sharding is too coarse - eg. two cities which have no cross traffic
* sometimes your sharding is too fine - eg. cross border traffic
But the real complexity is;
* managing configuration and logic differences between countries and cities
* hosting so many different sharded clusters, routing between them, and keeping them all updated.
And that's where all the work goes.