News for hackers. Stuff that matters.
Re:Ask HN: How do you harmonize user data? by hackerews on Saturday April 23, 2016 @07:10PM (#11557819)
Does this actually work though? For instance, we may have user data in an API that, thanks to arbitrary rate limits, isn't useful at all when querying in real time.
Re:Ask HN: How do you harmonize user data? by abengoam on Thursday April 28, 2016 @06:03AM (#11587605)
You mean not being able to access specific user data due to hitting the rate limits of the API? In that case, you can always cache the data (using the cache facilities of the data virtualization layer) and create a hybrid real time/cached workflow that pulls data in real time when possible and from cache for the APIs that have restrictions in place.