News for hackers. Stuff that matters.
Re:Google Genomics: store, process, explore and share genomi... by timeu on Saturday January 09, 2016 @12:02PM (#10871926)
I am wondering if you did a cost analysis. Last time I checked a dedicated on-premise HPC was still cheaper than using the cloud. Actually the CPU hours are cheaper in the cloud but data-transfer (bandwith) and storage make it more expensive (might not apply to storage anymore but AFAIK data transfer costs are still an issue). What is your experience ?
Re:Google Genomics: store, process, explore and share genomi... by i000 on Saturday January 09, 2016 @12:13PM (#10871969)
Of course we did this, but cost is not the only consideration.

Frankly, CPU-hours and TB-years are still within 5-10% of the total cost providing sequencing results to the patients. What is really important is that the cloud allows us to determine exactly our cost-per-analysis without paying for excess capacity or maintenance.

What matters also is reliability, redundancy, and peak capacity, where the cloud (both Google and the other provider) win hands down.

Re:Google Genomics: store, process, explore and share genomi... by boulos on Saturday January 09, 2016 @12:16PM (#10871979)
Just a note, you don't pay for sending data to any provider (ingress) only for pulling data out / serving it (egress). You can put your GCS buckets behind Cloudflare to take advantage of "interconnect" pricing of $.04/GB.

Disclaimer: I work on Compute Engine.

Re:Google Genomics: store, process, explore and share genomi... by timeu on Saturday January 09, 2016 @01:03PM (#10872166)
good to know. Thanks for the info !
Re:Google Genomics: store, process, explore and share genomi... by jsolson on Saturday January 09, 2016 @06:48PM (#10873389)
As boulos points out ingress is free -- the other question is how much you actually need to egress. Transfer within a GCP region is generally free as well, so unless you really need your giant result set in its raw form, you can potentially just leave it in GCP and do any analysis/summarizing work you might otherwise have done externally within GCP.

Taking this to the extreme, you might even fire up a Windows VM so you could run some analysis or reporting tool there (say, Tableau), within GCP and then only need to egress the Dashboard or Report that it generated. You'd still have the raw data, but you would only be paying to store it. Especially if you're only keeping it around for archival purposes you could put it in a Nearline bucket and really minimize your costs.

(note: I work on GCE)

Re:Google Genomics: store, process, explore and share genomi... by laurencerowe on Saturday January 09, 2016 @02:51PM (#10872586)
You can use https://aws.amazon.com/directconnect/ to reduce egress costs from AWS down to $0.02/GB.