Re:The Implications of Facebook Indexing a Trillion Posts
by yincrash on Monday December 29, 2014 @09:05AM
(#8809781)
You could build an index per person, but rather than search 500 indexes, the index of each person would be of all their and their friends' posts, so you would only search one index.
[ Parent
| on HN ]
Re:The Implications of Facebook Indexing a Trillion Posts
by daigoba66 on Monday December 29, 2014 @10:54AM
(#8810242)
That's how Twitter does it. A new tweet is not immediately visible in all "subscribed" timelines. But eventually it is.
Re:The Implications of Facebook Indexing a Trillion Posts
by arethuza on Monday December 29, 2014 @09:23AM
(#8809845)
Doesn't that make updating rather expensive - for each new post it needs to go into a lot of different search indexes?
Off-topic: Wasn't there a start-up a while back that was allowing people to build their own personal search index for their social media content?
Re:The Implications of Facebook Indexing a Trillion Posts
by ihsw on Monday December 29, 2014 @10:30AM
(#8810139)
Sounds about right, but the benefit is that reading through every single person's personal index would be very fast. This can be useful in many ways, and it alone was probably the goal.
In fact it was probably already developed long before this feature was deployed to the general populace, and this new feature is just a token gesture of "giving back to users."
I doubt it'll see much use from end-users themselves.
Yes the search terms from users will be useful, but I don't see this as being a replacement for Google.
Re:The Implications of Facebook Indexing a Trillion Posts
by yincrash on Monday December 29, 2014 @09:30AM
(#8809880)
Yes. Writes can be delayed and queued though. Reads need to be fast.
Re:The Implications of Facebook Indexing a Trillion Posts
by eastbayjake on Monday December 29, 2014 @04:27PM
(#8811888)
Doesn't having a time-series index -- where new entries are only being added to the end of the index, never updating the middle of the index -- make it a little less expensive?