Re:Open Guide to Amazon Web Services
by chirau on Tuesday October 11, 2016 @03:33PM
(#12687768)
Does anyone here use x1.32xlarge instances? If so what kind of stuff are you doing with it? That thing looks beastly
[ Parent
| on HN ]
My guess is that there are companies with "legacy" applications, that can't really be re-written into a distributed system, have a large footprint, but still need to be run.
The special sub-category of those are huge RDBMS instances - a pretty common choke point in growing companies with weaker engineering teams. Some of those companies would pay basically any price to keep those DBs running.
Re:Open Guide to Amazon Web Services
by michaelbarton on Wednesday October 12, 2016 @01:55AM
(#12690686)
We're testing them for metagenome assembly with data from complex environments. The memory requirements get extremely large.
I've temporarily scaled up to c4.8xlarge for a few hours every now and then to get some parallelized computations done quickly. Plays nicely with Clojure's (pmap) function.
Re:Open Guide to Amazon Web Services
by itschekkers on Wednesday October 12, 2016 @09:45AM
(#12692720)
applied ML research here also -- a lot of interactive (but highly parallelizable) modeling, graphing. Using medium-size data sets around 3-4GB in ram, by the time you forked it a few times, you easily end up beyond the m4.10xlarge or c4.8xlarge limits.
IMO theres an awkward space between small data and big data where it isn't really worth spending a long time to treat it like a real "big data" problem, and the x1 instance gives you an easy-out.
Re:Open Guide to Amazon Web Services
by swatthatfly on Tuesday October 11, 2016 @04:41PM
(#12688352)
we use several of them for real time applications in adtech, and ML.