News for hackers. Stuff that matters.
Re:AWS Case Study: Parse (YC S11) by trustfundbaby on Wednesday March 06, 2013 @09:02PM (#5335489)
Why both redis and memcached?
Re:AWS Case Study: Parse (YC S11) by manuelflara on Wednesday March 06, 2013 @09:47PM (#5335705)
I can't speak for Parse, but I use both of these technologies in one site. Memcached is, well, for any kind data that you want to cache: results of SQL queries, blocks of the site (HTML), etc. Redis, on the other hand, it's a final data storage on its own (like MySQL, because it's also persistent), but it's faster than MySQL for certain things. For example, for things like "List of profiles I've visited / have visited me recently on Facebook". This seems like a very simple MySQL table and query, but once it becomes big it starts to get slow. On the other hand, you can have one key per user on Redis, like "<id_user>_visit_history" which is a sorted set of <time, id_user>. You could do the same with Memcached (although it doesn't support the same data types), but then it wouldn't be persistent.
Re:AWS Case Study: Parse (YC S11) by trustfundbaby on Wednesday March 06, 2013 @10:34PM (#5335906)
Right ... thats my point. redis is as fast if not faster than memcached for caching exactly the same things you talked about (results of sql queries, blocks of the site etc) so why not just use redis for everything and eliminate memcached.
Re:AWS Case Study: Parse (YC S11) by shykes on Thursday March 07, 2013 @01:43AM (#5336465)
Here's one possible answer, for one specific use case: http://engineering.pinterest.com/posts/2012/memcache-games/
Re:AWS Case Study: Parse (YC S11) by spimmy on Wednesday March 06, 2013 @09:47PM (#5335707)
We use redis because we use resque extensively for the push notifications architecture. Memcache is superior to redis for simple caching in front of data sources.
Re:AWS Case Study: Parse (YC S11) by AznHisoka on Wednesday March 06, 2013 @10:20PM (#5335842)
Any reason why you haven't tried using Sidekiq, which is much more efficient in terms of using memory resources? Or is Resque just good enough for now?
Re:AWS Case Study: Parse (YC S11) by spimmy on Wednesday March 06, 2013 @10:31PM (#5335892)
Hm, well Sidekiq wasn't out when we started developing. :) Memory has never been a constraint for us with resque though. The only problems we've had with it have been things like improper signal handling, pretty easy to deal with.