News for hackers. Stuff that matters.
Re:This is what 864GB of RAM looks like now by hyuen on Friday January 27, 2012 @11:07AM (#3518743)
I wonder what kind of stuff can be done with 1Tb of SSDs, much cheaper than RAM, but also somewhat slower...
Re:This is what 864GB of RAM looks like now by sciurus on Friday January 27, 2012 @11:21AM (#3518797)
Dramatically slower. RAM latency is measured in nanoseconds. SSD latency is measured in microseconds. Your CPU already thinks RAM is slow.

http://duartes.org/gustavo/blog/post/what-your-computer-does... http://h18000.www1.hp.com/products/quickspecs/13379_na/13379...

Re:This is what 864GB of RAM looks like now by lallysingh on Friday January 27, 2012 @11:18AM (#3518785)
Well, it's 256 GB of ram each for 13 servers. I do wonder if the second half of that RAM, with the money used for SSDs, would result in better performance -- as your cache could be larger for the same budget. I think it'd really come down to your cache hit rate / cache size.
Re:This is what 864GB of RAM looks like now by TylerE on Friday January 27, 2012 @11:25AM (#3518811)
Not for a memached server. If it ain't RAM, memcached can't use it.
Re:This is what 864GB of RAM looks like now by lallysingh on Friday January 27, 2012 @03:29PM (#3520002)
Can you tie two copies of memcached together? One that's small and all-in-RAM, and a second-level cache that's using the VM.
Re:This is what 864GB of RAM looks like now by wlll on Friday January 27, 2012 @04:14PM (#3520188)
memcached is standalone, no one server knows about any other server, so at a simple level, no. It also can't go out and fetch data from else where, it's either got the data or it hasn't.

You could write a more complex cacheing layer on top of memcached that looked first in memcached, then fetched from solid state storage if it wasn't there. That's kind of what we will be using it for by wrapping Rails around it.

Re:This is what 864GB of RAM looks like now by meatmanek on Saturday January 28, 2012 @03:39AM (#3521635)
> You could write a more complex cacheing layer on top of memcached that looked first in memcached, then fetched from solid state storage if it wasn't there.

I wonder how that would compare to just setting up an SSD as swap space.

Re:This is what 864GB of RAM looks like now by robotresearcher on Friday January 27, 2012 @12:32PM (#3519145)
Does memcached not use virtual memory?
Re:This is what 864GB of RAM looks like now by danudey on Friday January 27, 2012 @01:54PM (#3519553)
Memcached is designed to be fast. Anything that makes it slower that doesn't need to be there isn't there. For example: authentication (anyone who can access the port can fetch data), indexing (you need to know the key), deallocating memory (you configure memcached with an upper bound; it keeps allocating memory as needed until it gets there), etc.

Virtual memory (I assume you actually mean 'does memcached not page data out to disk') would make it much slower. Since memcached is just that - a memory cache - if you're out of memory it just expires the least-recently-used data. In your application, you fetch the key, and if that fails you fetch it from the primary data store (or wherever else you can find it).

Re:This is what 864GB of RAM looks like now by TylerE on Friday January 27, 2012 @01:42PM (#3519483)
In theory it probably could, but you're losing all benefit at that point. The big selling point of memcahce is that it's VERY fast. Our memcache server (Ours is only 8GB, not nearly as impressive as some) averages under 1ms object fetch times, even accounting for network overhead.
Re:This is what 864GB of RAM looks like now by wmf on Friday January 27, 2012 @01:34PM (#3519453)
IIRC memcached is event-driven and swapping is death for event-driven programs because it blocks the whole event loop.