Billions of Messages a Day – Yelp's Real-Time Data Pipeline

Re:Billions of Messages a Day – Yelp's Real-Time Data Pipeline by eellpp on Saturday July 16, 2016 @12:09AM (#12105199)

Applying the 80/20 principle: 80% of traffic occurs in the 20% of years time. Which is around 12 reviews per second. Still modest.

[ Parent | on HN ]

Re:Billions of Messages a Day – Yelp's Real-Time Data Pipeline by NhanH on Saturday July 16, 2016 @01:37AM (#12105370)

Not entirely on topic, but is the 80/20 principle recursive?

[ Parent | on HN ]

Re:Billions of Messages a Day – Yelp's Real-Time Data Pipeline by thesimpsons1022 on Saturday July 16, 2016 @09:26PM (#12108610)

20 percent of it is 80 percent recursive

[ Parent | on HN ]

Re:Billions of Messages a Day – Yelp's Real-Time Data Pipeline by nsp on Saturday July 16, 2016 @03:05AM (#12105548)

Yes.

[ Parent | on HN ]

Re:Billions of Messages a Day – Yelp's Real-Time Data Pipeline by ju-st on Saturday July 16, 2016 @05:59AM (#12105821)

Even a Sqlite DB could handle this

[ Parent | on HN ]

Re:Billions of Messages a Day – Yelp's Real-Time Data Pipeline by discordance on Saturday July 16, 2016 @07:46PM (#12108327)

Also, 80% (often 90%) are reads and 10-20% are writes.

[ Parent | on HN ]