Ask HN: How can I quickly trim my AWS bill?

Re:Ask HN: How can I quickly trim my AWS bill? by whb07 on Friday July 10, 2020 @09:19PM (#23798538)

You train the model locally and push it for inference to the cloud?

What exactly are we talking about here?

Couldn’t you build a dual NVIDIA 20XX / 32 core / 64 GB for a sub $5k and then save money while training/developing faster?

[ Parent | on HN ]

Re:Ask HN: How can I quickly trim my AWS bill? by pocw on Friday July 10, 2020 @11:42PM (#23799276)

Except they (the gender non-specific singular) is probably running kubernetes and has multiple clusters of 10 or so gpu hosts. Not that I disagree, but spinning that up locally and orchestrating it will take time and money. And explaining why training is paused because you keep blowing breakers in the office will cost political capital.

[ Parent | on HN ]

Re:Ask HN: How can I quickly trim my AWS bill? by sophiebits on Friday July 10, 2020 @11:50PM (#23799302)

You can just say “Except they are probably”.

[ Parent | on HN ]